Call audio playback speed adjustment
Patent Information
- Application Number
- JP2023539801
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-01-05
- Filing Date
- 2021-12-07
- Publication Date
- 2024-11-20
- Estimated Expiration
- 2041-12-07
AI Technical Summary
During calls, frame loss in audio transmission leads to missed audio frames, causing users to guess or ask for repetitions, disrupting the conversation and wasting time.
A system and method for adjusting call audio playback speed by detecting frame loss and retransmitting audio frames at a faster playback rate to catch up with the conversation.
Enables seamless recovery of missed audio frames by playing them at a higher speed, ensuring uninterrupted communication and improving user experience.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Claiming priority
[0001]
[0001] This application claims the benefit of priority from commonly owned U.S. non-provisional patent application Ser. No. 17 / 142,022, filed Jan. 5, 2021, the contents of which are expressly incorporated by reference in their entirety into this specification. [Technical field]
[0002] TECHNICAL FIELD
[0002] This disclosure relates generally to adjusting speech audio playback speed. [Background technology]
[0003]
[0003] Advances in technology have resulted in computing devices becoming smaller and more powerful. For example, there are now a variety of portable personal computing devices, including wireless telephones, such as mobile phones and smartphones, tablets, and laptop computers, that are small, lightweight, and easily carried by users. These devices can transmit voice and data packets over wireless networks. In addition, many of these devices incorporate additional features, such as digital still cameras, digital video cameras, digital recorders, and audio file players. Such devices can also process executable instructions, including software applications that can be used to access the Internet, such as web browser applications. As such, these devices can include significant computing functionality.
[0004]
[0004] Such computing devices often incorporate functionality for receiving audio signals from one or more microphones. For example, the audio signals may represent the user's speech captured by the microphone, external sounds captured by the microphone, or a combination of both. Such devices may include communication devices for making calls, such as voice or video calls. Network problems during a call between a first user and a second user may cause frame loss such that some audio frames transmitted from the first device of the first user are not received at the second device of the second user. In some instances, audio frames are received at the second device, but the second user temporarily misses part of the call (e.g., because he has to leave the location). The second user must guess what was missed or ask the first user to repeat the missed portion, which negatively impacts the user experience. Summary of the Invention
[0005]
[0005] According to one embodiment of the disclosure, a communication device includes one or more processors configured to receive a sequence of audio frames from a first device during a call. The one or more processors are also configured to initiate transmission of a frame loss indication to the first device in response to determining that no audio frames of the sequence have been received for a threshold duration since a last received audio frame of the sequence. The one or more processors are further configured to receive from the first device a set of audio frames of the sequence and an indication of a second playback speed in response to the frame loss indication. The one or more processors are also configured to initiate playback of the set of audio frames through a speaker based on the second playback speed. The second playback speed is greater than the first playback speed of the first set of audio frames of the sequence.
[0006]
[0006] According to another embodiment of the present disclosure, a method of communication includes receiving, at a device, a sequence of audio frames from a first device during a call. The method also includes initiating transmission of a frame loss indication from the device to the first device in response to determining that an audio frame of the sequence has not been received at the device for a threshold duration since a last received audio frame of the sequence. The method further includes receiving, at the device, from the first device, a set of audio frames of the sequence and an indication of a second playback speed in response to the frame loss indication. The method also includes initiating playback of the set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0007] According to another embodiment of the present disclosure, a device for communications includes one or more processors configured to receive a sequence of audio frames from a first device during a call, the one or more processors also configured to, in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last-played audio frame in the sequence is available, initiate playback of the set of audio frames based on a second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0008] According to another embodiment of the present disclosure, a method of communication includes receiving, at a device, a sequence of audio frames from a first device. The method also includes initiating playback of the set of audio frames at the device at at least a second playback speed in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last played audio frame in the sequence is available. The second playback speed is greater than the first playback speed of the first set of audio frames of the sequence.
[0009]
[0009] Other aspects, advantages, and features of the present disclosure will become apparent after review of the entire application, including the following sections: "Brief Description of the Drawings," "Form for Implementing the Invention," and "Claims." [Brief description of the drawings]
[0010] [Figure 1]
[0010] FIG. 1 is a block diagram of a particular illustrative aspect of a system operable to adjust call audio playback speed, in accordance with certain examples of the present disclosure. [Diagram 2]
[0011] 1 is a diagram of an example aspect of a system operable to adjust call audio playback speed, in accordance with some examples of the present disclosure. [Diagram 3]
[0012] 1 is a diagram of an example aspect of a system operable to adjust call audio playback speed, in accordance with some examples of the present disclosure. [Figure 4]
[0013] 4 is a ladder diagram of an exemplary embodiment of the operation of components of any of the systems of FIGS. 1-3, according to some examples of the present disclosure. [Diagram 5]
[0014] 4 is a diagram of an exemplary aspect of the operation of components of any of the systems of FIGS. 1-3, in accordance with some examples of the present disclosure. [Figure 6]
[0015] 1 is a diagram of an example aspect of a system operable to adjust call audio playback speed, in accordance with some examples of the present disclosure. [Figure 7]
[0016] 7A-7C are diagrams of example aspects of operation of components of the system of FIG. 6, in accordance with some examples of the present disclosure. [Figure 8]
[0017] 4A-4C are diagrams of particular embodiments of methods of call audio playback speed adjustment that may be implemented by the devices of FIGS. 1-3, in accordance with some examples of the present disclosure. [Figure 9]
[0018] 4A-4C are diagrams of particular embodiments of methods of call audio playback speed adjustment that may be implemented by the devices of FIGS. 1-3, in accordance with some examples of the present disclosure. [Figure 10]
[0019] 4A-4C are diagrams of particular embodiments of methods of call audio playback speed adjustment that may be implemented by the devices of FIGS. 1-3, in accordance with some examples of the present disclosure. [Figure 11]
[0020] 7A-7C are diagrams of particular embodiments of a method of call audio playback speed adjustment that may be implemented by the device of FIG. 6, in accordance with some examples of the present disclosure. [Figure 12]
[0021] FIG. 12 illustrates an example of an integrated circuit operable to adjust a call audio playback speed, according to some examples of the disclosure. [Figure 13]
[0022] 1 is a diagram of a mobile device operable to adjust call audio playback speed, in accordance with some examples of the present disclosure. [Figure 14]
[0023] 1 is a diagram of a headset operable to adjust call audio playback speed, in accordance with some examples of the present disclosure. [Figure 15]
[0024] FIG. 1 illustrates a diagram of a wearable electronic device operable to adjust call audio playback speed, according to some examples of the present disclosure. [Figure 16]
[0025] 1 is a diagram of a voice-controlled speaker system operable to adjust call audio playback speed, according to some examples of the present disclosure. [Figure 17]
[0026] 1 is a diagram of a camera operable to adjust call audio playback speed, according to some examples of the present disclosure. [Figure 18]
[0027] 1 is a diagram of a headset, such as a virtual reality or augmented reality headset, operable to adjust call audio playback speed, in accordance with some examples of the present disclosure. [Figure 19]
[0028] 1 illustrates a first example of a vehicle operable to adjust call audio playback speed, according to some examples of the present disclosure. [Figure 20]
[0029] 1 illustrates a diagram of a second example of a vehicle operable to adjust call audio playback speed, according to some examples of the present disclosure. [Figure 21]
[0030] 1 is a block diagram of a particular illustrative example of a device operable to adjust call audio playback speed, in accordance with certain examples of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011]
[0031] Missing a portion of a call can negatively impact user experience. For example, during a call between a first user and a second user, if some audio frames transmitted from the first device of the first user are not received at the second device of the second user, the second user may miss a portion of the first user's speech. As another example, the second user may miss a portion of the call for other reasons, such as by walking away or becoming distracted. The second user must guess what was said by the first user or ask the first user to repeat what was missed. This can cause miscommunication, disrupt the flow of the conversation, and waste time.
[0012]
[0032] A system and method for call audio playback speed adjustment is disclosed. For example, a first call manager of a first device establishes a call with a second call manager of a second device. During the call, the first call manager transmits a sequence of audio frames to the second device and buffers at least the most recently transmitted audio frame. The second call manager receives at least a portion of the sequence of audio frames and buffers the received audio frames for playback.
[0013]
[0033] In a particular example, a second frame loss manager of the second device transmits a frame loss indication to the first device in response to detecting the frame loss. For example, the second frame loss manager detects the frame loss in response to determining that an audio frame was not received within a particular period of receiving a last received (e.g., immediately prior) audio frame. The frame loss indication indicates the last received audio frame.
[0014]
[0034] In response to receiving the frame loss indication, the first frame loss manager of the first device resends the set of audio frames to the second device. For example, the set of audio frames follows the last received audio frame in the sequence. The second call manager plays the set of audio frames at a second playback speed that is faster than the first playback speed of the previous audio frames. In a particular example, the first frame loss manager transmits a second set of audio frames that is based on the set of audio frames such that playing the second set of audio frames at the first playback speed corresponds to an effective second playback speed of the set of audio frames. To illustrate, if the second set of audio frames includes every other frame of the set of audio frames, playing the second set of audio frames at the first playback speed corresponds to an effective playback speed of the set of audio frames that is twice the first playback speed. By playing the audio frames at a faster speed (or a faster effective speed), the first device can catch up with the call.
[0015]
[0035] In a particular example, a second user pauses audio playback during a call and then resumes audio playback. For example, playback is paused after a last played (e.g., most recently played) audio frame. In response to determining that playback is resumed, a second call manager of the second device plays a set of audio frames at a second playback speed that is faster than the first playback speed of the previous audio frames. This set of audio frames follows the last played audio frame in the sequence.
[0016]
[0036] The second call manager plays subsequent audio frames at the first playback speed. In certain examples, the second call manager transitions between the second playback speed and the first playback speed such that the change in playback speed is less noticeable (e.g., not noticeable).
[0017]
[0037] Certain aspects of the present disclosure are described below with reference to the drawings. In this specification, common functional units are designated by common reference numerals. Various terminology is used herein for the purpose of describing only certain embodiments and not for the purpose of limiting the embodiments. For example, the singular forms "a", "an" and "the" also include the plural unless otherwise indicated. Furthermore, some functional units described herein are in the singular form in some embodiments and in the plural form in other embodiments. To illustrate, FIG. 1 shows a device 102 including one or more processors ("processor" 120 in FIG. 1), which shows that in some embodiments the device 102 includes a single processor 120 and in other embodiments the device 102 includes multiple processors 120. For ease of reference herein, such functional units are generally introduced as "one or more" functional units and will be referred to hereafter in the singular form unless aspects relating to more than one of the functional units are described.
[0018]
[0038] As used herein, the terms "comprise", "comprises", and "comprising" may be used interchangeably with "include", "includes", or "including". Additionally, the term "wherein" may be used interchangeably with "where". As used herein, "exemplary" refers to examples, embodiments, and / or aspects and should not be construed as limiting or as indicating preferred or preferred embodiments. As used herein, ordinal terms (e.g., "first", "second", "third", etc.) used to modify an element, such as a structure, component, operation, etc., do not in themselves indicate any priority or order of that element relative to another element, but merely distinguish that element from another element with the same name (with respect to the use of ordinal terms). As used herein, the term "set" refers to one or more of a particular element, and the term "plurality" refers to a plurality (e.g., two or more) of a particular element.
[0019]
[0039] As used herein, "coupled" may include "communicatively coupled," "electrically coupled," or "physically coupled," and (alternatively) may also include any combination thereof. Two devices (or components) may be directly or indirectly coupled (e.g., communicatively coupled, electrically coupled, or physically coupled) via one or more other devices, components, wires, buses, networks (e.g., wired networks, wireless networks, or combinations thereof), and the like. Two devices (or components) that are electrically coupled may be included in the same device or in separate devices, and may be connected via electronics, one or more connectors, or inductive coupling, as illustrative, non-limiting examples. In some embodiments, two devices (or components) that are communicatively coupled, such as in electrical communication, may directly or indirectly transmit and receive signals (e.g., digital or analog signals) via one or more wires, buses, networks, and the like. As used herein, "directly coupled" may include two devices that are coupled (e.g., communicatively coupled, electrically coupled, or physically coupled) without any intervening components.
[0020]
[0040] In this disclosure, terms such as "determine," "calculate," "estimate," "shift," "adjust," and the like may be used to describe how one or more operations are performed. It should be noted that such terms should not be construed as limiting, and other techniques may be utilized to perform similar operations. Furthermore, as referred to herein, "generate," "calculate," "estimate," "use," "select," "access," and "determine" may be used interchangeably. For example, "generating," "calculating," "estimating," or "determining" a parameter (or signal) may refer to actively generating, estimating, calculating, or determining a parameter (or signal), or may refer to using, selecting, or accessing a parameter (or signal) that has already been generated by another component or device, etc.
[0021]
[0041] 1, a particular example embodiment of a system configured to adjust a call audio playback rate is disclosed and generally indicated at 100. System 100 includes a device 102 coupled to a device 104 via a network 106.
[0022]
[0042] The device 102 is coupled to a speaker 129. The device 102 includes a memory 132 coupled to the one or more processors 120. In a particular example, the memory 132 includes a receive buffer 134 (e.g., a circular buffer) configured to store a most recently received audio frame for playback. The memory 132 is configured to store data indicative of a first playback speed 105. In a particular aspect, the first playback speed 105 is based on a configuration setting, default data, user input, or a combination thereof. In a particular embodiment, the first playback speed 105 corresponds to a normal (e.g., expected) playback speed of the call. The one or more processors 120 include a call manager 122 and a frame loss manager 124.
[0023]
[0043] The device 104 is coupled to a microphone 146. The device 104 includes a memory 154 coupled to one or more processors 150. In a particular example, the memory 154 includes a transmit buffer 110 (e.g., a circular buffer) configured to store recently transmitted audio frames. The one or more processors 150 include a call manager 152 and a frame loss manager 156.
[0024]
[0044] Call manager 122 and call manager 152 are configured to manage calls (e.g., audio calls, video calls, or both) for device 102 and device 104, respectively. In a particular aspect, call manager 122 and call manager 152 correspond to clients of a communication application (e.g., an online conferencing application). In a particular aspect, frame loss manager 124 and frame loss manager 156 are configured to manage frame loss recovery during calls for device 102 and device 104, respectively.
[0025]
[0045] In some embodiments, call manager 122 and call manager 152 are blind (e.g., unaware) to any frame losses managed by frame loss manager 124 and frame loss manager 156. In some embodiments, call manager 122 and call manager 152 correspond to an upper layer (e.g., application layer) of a network protocol stack (e.g., Open Systems Interconnection (OSI) model) of device 102 and device 104, respectively. In some embodiments, frame loss manager 124 and frame loss manager 156 correspond to a lower level (e.g., transport layer) of the network protocol stack of device 102 and device 104, respectively.
[0026]
[0046] In some embodiments, device 102, device 104, or both correspond to or are included in one or various types of devices. In an illustrative example, one or more processors 120, one or more processors 150, or a combination thereof are incorporated into a headset device, including a microphone, a speaker, or both, as further described with reference to FIG. 14. In other examples, one or more processors 120, one or more processors 150, or a combination thereof are incorporated into at least one of a mobile phone or tablet computing device, as described with reference to FIG. 13, a wearable electronic device, as described with reference to FIG. 15, a voice-controlled speaker system, as described with reference to FIG. 16, a camera device, as described with reference to FIG. 17, or a virtual reality or augmented reality headset, as described with reference to FIG. 18. In another illustrative example, one or more processors 120, one or more processors 150, or a combination thereof are incorporated into a vehicle, also including a microphone, a speaker, or both, as further described with reference to FIG. 19 and FIG. 20.
[0027]
[0047] During operation, the call manager 122 and the call manager 152 establish a call (e.g., an audio call, a video call, an online meeting, or a combination thereof) between the device 102 and the device 104. For example, the call is between a user 144 of the device 104 and a user 142 of the device 102. The microphone 146 captures the speech of the user 144 while the user 144 is speaking and provides an audio input 141 representative of the speech to the device 104. The call manager 152 generates a sequence of audio frames 119 based on the audio input 141 and transmits the sequence of audio frames 119 to the device 102. For example, the sequence 119 includes the set of audio frames 109, the audio frame 111, the set of audio frames 113, the next audio frame 117, one or more additional audio frames, or a combination thereof. To illustrate, the call manager 152 generates audio frames of sequence 119 as audio input 141 is received and transmits the sequence 119 of audio frames (e.g., starts transmitting sequence 119) as the audio frames are generated.
[0028]
[0048] In a particular aspect, the frame loss manager 156 buffers the audio frames of the sequence 119 in the transmit buffer 110 as the audio frames are transmitted by the call manager 152. For example, the call manager 152 transmits each of the set of audio frames 109 to the device 102 over the network 106. The call manager 152 transmits the audio frame 111 to the device 102 over the network 106 at a first transmit time. Similarly, the call manager 152 transmits each of the set of audio frames 113 to the device 102 over the network 106. The frame loss manager 156 stores each of the set of audio frames 109, the audio frame 111, and the set of audio frames 113 in the transmit buffer 110.
[0029]
[0049] The device 102 receives a sequence 119 of audio frames from the device 104 over the network 106. In a particular embodiment, the device 102 receives a set (e.g., a burst) of the audio frames of the sequence 119. In an alternative embodiment, the device 102 receives one audio frame at a time in the sequence 119.
[0030]
[0050] In a particular example, the frame loss manager 124 receives each of the sets of audio frames 109 of the sequence 119 and stores each of the sets of audio frames 109 in a receive buffer 134. The call manager 122 retrieves one or more of the sets of audio frames 109 from the receive buffer 134 and plays the retrieved audio frames out through the speaker 129 at the first playback speed 105. The set of audio frames 109 precedes the audio frame 111 in the sequence 119.
[0031]
[0051] The frame loss manager 124 receives the audio frame 111 at a first reception time. In a particular aspect, the frame loss manager 124 stores the audio frame 111 in the receiving buffer 134 for playback (e.g., while one or more of the set of audio frames 109 are being played at a corresponding play time). For example, the frame loss manager 124 adds a delay between the receipt of the audio frame 111 and the play by the call manager 122 of the audio frame 111 at the first play time to increase the likelihood that a subsequent frame will be available at the corresponding play time (e.g., a second play time) in the receiving buffer 134.
[0032]
[0052] In a particular example, frame loss manager 124 detects frame loss following receiving audio frame 111. For example, frame loss manager 124 detects frame loss in response to determining that an audio frame of sequence 119 has not been received for a threshold duration since audio frame 111 (e.g., the last received audio frame of sequence 119) was received at a first reception time.
[0033]
[0053] In response to detecting the frame loss, the frame loss manager 124 initiates transmission of a frame loss indication 121 to the device 104 over the network 106. In a particular aspect, the frame loss indication 121 indicates (e.g., includes an identifier of) the audio frame 111 (e.g., the last received audio frame). In another aspect, the frame loss indication 121 includes a request to have a previous audio frame retransmitted that corresponds to an estimated playout duration of the lost frame at the first playout speed 105. For example, the frame loss manager 124 determines an estimated playout duration at a particular point in time based on a first reception time point (e.g., of the last received audio frame) and the particular point in time (e.g., estimated playout duration = particular point in time - first reception time point).
[0034]
[0054] The frame loss manager 156 receives the frame loss indication 121 from the device 102 via the network 106. In a particular embodiment, the frame loss manager 156 determines that the frame loss indication 121 indicates (e.g., includes an identifier of) the audio frame 111 corresponds to the audio frame last received at the device 102. In an alternative embodiment, the frame loss manager 156 identifies the last received audio frame based on its estimated playout duration in response to determining that the frame loss indication 121 includes a request to retransmit a previous audio frame corresponding to the estimated playout duration of the lost frame at the first playout speed 105. For example, the frame loss manager 156 determines a last transmission time at a particular time point based on a difference between the particular time point and the estimated playout duration (e.g., last transmission time point=particular time point−estimated playout duration), and identifies the audio frame 111 as the last received audio frame in response to determining that the last transmission time point coincides with the transmission time of the audio frame 111.
[0035]
[0055] Frame loss manager 156 determines the previous audio frame to be retransmitted based on the last received audio frame. For example, in response to determining that audio frame 111 corresponds to the last received audio frame at device 102 and that set of audio frames 113 follows the last received audio frame in sequence 119 and has been previously transmitted, frame loss manager 156 identifies set of audio frames 113 as the previous audio frame to be retransmitted.
[0036]
[0056] In response to determining that the previous audio frames to be retransmitted include the set of audio frames 113 and that the set of audio frames 113 is available in the transmission buffer 110, the frame loss manager 156 generates the set of audio frames 123 based on the set of audio frames 113 and begins transmitting the set of audio frames 123, the indication of the second playback speed 115, or both, to the device 102 over the network 106. The second playback speed 115 is greater than the first playback speed 105. In a particular embodiment, the set of audio frames 123 is the same as the set of audio frames 113, and the frame loss manager 156 begins transmitting the set of audio frames 123 and the indication of the second playback speed 115.
[0037]
[0057] In an alternative embodiment, the set of audio frames 123 includes a subset of the set of audio frames 113 such that playback of the set of audio frames 123 at the first playback speed 105 corresponds to an effective playback of the set of audio frames 113 at the second playback speed 115. For example, if the set of audio frames 123 includes all other frames of the set of audio frames 113, then playback of the set of audio frames 123 at the first playback speed 105 corresponds to an effective playback speed (e.g., second playback speed 115) of the set of audio frames 113 that is twice as fast as the first playback speed 105. The frame loss manager 156 begins transmitting the set of audio frames 123 even without an indication of the second playback speed 115 because playback of the set of audio frames 123 at the first playback speed 105 (e.g., normal playback speed) corresponds to an effective playback speed adjustment of the second playback speed 115.
[0038]
[0058] In certain aspects, the frame loss manager 156 determines the second playback speed 115 based on a number of sets of audio frames 113, a default value, a configuration setting, a user input, or a combination thereof. For example, the second playback speed 115 is greater the more audio frames are retransmitted.
[0039]
[0059] In a particular embodiment, the frame loss manager 156 at least partially suppresses silence of the set of audio frames 113 in the set of audio frames 123. For example, in response to determining that the set of audio frames 113 includes a silence frame, the frame loss manager 156 sends an indication of a third playback speed for the corresponding silence frame in the set of audio frames 123. In a particular aspect, the frame loss manager 156 selects fewer silence frames than audio frames of the set of audio frames 113 to generate the set of audio frames 123. For example, the frame loss manager 156 selects every other audio frame of the set of audio frames 113 and selects every fourth silence frame of the set of audio frames 113. The third playback speed is greater than the second playback speed 115. For example, shortening the silence portion allows the device 102 to catch up with the call faster (e.g., revert to playing subsequent audio frames at the first playback speed 105).
[0040]
[0060] In certain embodiments, the frame loss manager 156 selectively initiates transmission of the set of audio frames 123 in response to determining that the number of previous audio frames to be retransmitted is greater than a first threshold, less than a second threshold, or both. For example, if too few audio frames are lost, the frame loss may not be noticeable enough to implement playback speed adjustments. As another example, if too many audio frames are lost, the playback speed may need to be significantly increased to catch up with the call, which may be more detrimental to the user's experience than missing audio frames. In certain aspects, the frame loss manager 156 initiates transmission of the set of audio frames 123 in response to determining that the network link with the device 102 has been reestablished.
[0041]
[0061] In a particular aspect, the frame loss manager 156 transmits a skip ahead notification to the device 102 in response to determining that the number of previous audio frames is less than or equal to a first threshold or greater than or equal to a second threshold. In a particular aspect, the skip ahead notification indicates a subsequent audio frame to be transmitted by the device 104. For example, the skip ahead notification indicates a first audio frame of the next audio frames 117 of the sequence 119. The frame loss manager 156 begins transmitting the next audio frame 117 following (or simultaneously with) transmitting the skip ahead notification. The next audio frame 117 follows the set of audio frames 113 of the sequence 119. In a particular aspect, the next audio frame 117 has not been previously transmitted during the call.
[0042]
[0062] In certain aspects, in response to determining that a previous audio frame should be retransmitted, frame loss manager 156 initiates transmission of the next audio frame 117 simultaneously with transmission of the set of audio frames 123. For example, transmission of the set of audio frames 123 (corresponding to a retransmission of at least a subset of the set of audio frames 113) does not delay the initial transmission of the next audio frame 117. In certain aspects, the next audio frame 117 is associated with a transition from the second playback speed 115 and the first playback speed 105 (e.g., normal playback speed) of the set of audio frames 123 (e.g., the retransmitted audio frame). For example, the frame loss manager 156 transmits a first subset of the next audio frames 117 with an indication of the second playback speed 115, a second subset of the next audio frames 117 with an indication of an intermediate playback speed between the second playback speed 115 and the first playback speed 105, a third subset of the next audio frames 117 with an indication of the first playback speed 105, or a combination thereof. In an alternative embodiment, the frame loss manager 156 selects a first audio frame of the first subset based on the second playback speed 115 (e.g., every other audio frame) and selects a second audio frame of the second subset based on the intermediate playback speed. The frame loss manager 156 transitions the next audio frame 117 from the second playback speed 115 to the first playback speed 105 by initiating transmission of the selected first audio frame of the first subset, the selected second audio frame of the second subset, and the audio frame of the third subset.
[0043]
[0063] The frame loss manager 124 receives the set of audio frames 123, an indication of the second playback speed 115, or both, in response to the frame loss indication 121. The frame loss manager 124 initiates playback of the set of audio frames 123 through the speaker 129 based on the second playback speed 115, as will be further described with reference to FIG.
[0044]
[0064] In a particular embodiment, the set of audio frames 123 is the same as the set of audio frames 113. The frame loss manager 124 adds the set of audio frames 123 and an indication of the second playback speed 115 to the receiving buffer 134. The call manager 122 retrieves one or more of the sets of audio frames 123 from the receiving buffer 134 and performs playback of the sets of audio frames 123 based on the second playback speed 115. Illustratively, the call manager 122 provides each of the sets of audio frames 123 to the speaker 129 for playback based on the second playback speed 115. In an alternative aspect, the frame loss manager 124 retrieves each audio frame of the set of audio frames 123 from the receiving buffer 134 based on the second playback speed 115 and provides the retrieved audio frames to the call manager 122. The call manager 122 provides each received audio frame to the speaker 129 for playback.
[0045]
[0065] In an alternative embodiment, the set of audio frames 123 includes a subset of the set of audio frames 113 such that playback of the set of audio frames 123 at the first playback speed 105 corresponds to the effective playback speed (e.g., the second playback speed 115) of the set of audio frames 113. The frame loss manager 124 adds the set of audio frames 123 to the receiving buffer 134. The call manager 122 retrieves one or more of the set of audio frames 123 from the receiving buffer 134 and performs playback of the set of audio frames 123 based on the first playback speed 105. Illustratively, the call manager 122 provides each of the set of audio frames 123 to the speaker 129 for playback based on the first playback speed 105. In an alternative aspect, the frame loss manager 124 retrieves each audio frame of the set of audio frames 123 from the receiving buffer 134 based on the first playback speed 105 and provides the retrieved audio frames to the call manager 122. The call manager 122 provides each received audio frame to the speaker 129 for playback.
[0046]
[0066] In certain aspects, the frame loss manager 124 at least partially suppresses the silence to initiate playback of the set of audio frames 123. For example, in response to determining that the set of audio frames 123 includes silence frames, the frame loss manager 124 initiates playback of the silence frames at a third playback speed that is greater than the second playback speed 115. As another example, in response to receiving an indication of the third playback speed for silence frames of the set of audio frames 123, the frame loss manager 124 initiates playback of the silence frames at the third playback speed.
[0047]
[0067] In a particular example, frame loss manager 124 adds the silence frames and an indication of the third playback rate to receive buffer 134, and call manager 122 performs playback of the silence frames based on the third playback rate. Illustratively, call manager 122 provides the silence frames to speaker 129 for playback based on the third playback rate. In an alternative aspect, frame loss manager 124 retrieves silence frames from receive buffer 134 based on the third playback rate and provides the retrieved silence frames to call manager 122. Call manager 122 provides the received silence frames to speaker 129 for playback.
[0048]
[0068] In a particular aspect, the frame loss manager 124 receives the next audio frame 117 simultaneously with receiving the set of audio frames 123, as will be further described with reference to Figure 4. In a particular aspect, the frame loss manager 124 transitions the playback of the next audio frame 117 from the second playback speed 115 to the first playback speed 105, as will be further described with reference to Figure 5.
[0049]
[0069] In particular embodiments, the frame loss manager 124 transitions the playback speed of the next audio frames 117 based on the playback speed indication received for the next audio frames 117. For example, the frame loss manager 124 may initiate playback of a first subset of the next audio frames 117 based on the second playback speed 115 in response to receiving an indication of the second playback speed 115 for each of the first subset, initiate playback of a second subset of the next audio frames 117 based on the intermediate playback speed in response to receiving an indication of the intermediate playback speed for each of the second subset, initiate playback of a third subset of the next audio frames 117 at the first playback speed 105 in response to receiving an indication of the first playback speed 105 for each of the third subset, or a combination thereof.
[0050]
[0070] In a particular embodiment, the frame loss manager 124 transitions the playback speed of the next audio frames 117 based on the received audio frames of the next audio frames 117. For example, the frame loss manager 124 plays the received audio frames of the next audio frames 117 at the first playback speed 105. Because a small number of the first audio frames of the first subset of the next audio frames 117 are received, the playback of the first audio frames at the first playback speed 105 corresponds to an effective playback speed of the second playback speed 115 for the first subset. Similarly, the playback of the second audio frames of the second subset at the first playback speed 105 corresponds to an effective playback speed of the intermediate playback speed for the second subset. The playback of all frames of the third subset of the next audio frames 117 at the first playback speed 105 corresponds to an effective playback speed of the first playback speed 105 for the third subset.
[0051]
[0071] In particular embodiments, the frame loss manager 124 transitions the playback speed of the next audio frames 117 based on the number of audio frames stored (e.g., remaining) in the receiving buffer 134 for playback. For example, in response to determining that more than a first threshold number of audio frames are available in the receiving buffer 134 for playback, the frame loss manager 124 initiates playback of a first subset of the next audio frames 117 based on the second playback speed 115, in response to determining that less than or equal to the first threshold number but more than a second threshold number of audio frames are available in the receiving buffer 134 for playback, in response to determining that less than or equal to the second threshold number of audio frames are available in the receiving buffer 134 for playback, in response to determining that less than or equal to the second threshold number of audio frames are available in the receiving buffer 134 for playback, in response to determining that a third subset of the next audio frames 117 is at the first playback speed 105, or a combination thereof. By transitioning the playback speed of the next audio frame 117, the playback speed adjustment can be made less noticeable (e.g., not noticeable) and allows the device 102 to return to normal playback speed after catching up with the call.
[0052]
[0072] In a particular embodiment, the frame loss manager 124 receives a skip ahead notification in response to the frame loss indication 121. In response to receiving the skip ahead notification and receiving the next audio frame 117, the frame loss manager 124 begins playing the next audio frame 117 at the first playback speed 105.
[0053]
[0073] In this manner, system 100 allows for receiving previously lost audio frames and catching up with the call by playing out the audio frames at a faster playback speed. In some aspects, the transmission of lost audio frames is selective based on the number of audio frames lost to balance the impact of gaps in the call caused by the lost audio frames and speeding up the call audio to catch up.
[0054]
[0074] Although the microphone 146 is illustrated as being coupled to the device 104, in other embodiments the microphone 146 may be incorporated into the device 104. Although the speaker 129 is illustrated as being coupled to the device 102, in other embodiments the speaker 129 may be incorporated into the device 102. Although one microphone is illustrated, in other embodiments one or more additional microphones configured to capture the user speech may be included.
[0055]
[0075] It should be understood that for ease of explanation, device 104 is described as a transmitting device and device 102 is described as a receiving device. During a call, when user 142 begins to speak, the roles of device 102 and device 104 can switch. For example, device 102 can become a transmitting device and device 104 can become a receiving device. In certain aspects, device 102 and device 104 can each be a transmitting device and a receiving device, for example, when both user 142 and user 144 are speaking at the same time or at overlapping times.
[0056]
[0076] In certain aspects, call manager 122 is also configured to perform one or more of the operations described with respect to call manager 152, or vice versa. In certain aspects, frame loss manager 124 is also configured to perform one or more of the operations described with respect to frame loss manager 156, or vice versa. In certain embodiments, device 102 and device 104 each include a receive buffer, a transmit buffer, a speaker, and a microphone.
[0057]
[0077] 2, a system configured to adjust a call audio playback speed is disclosed and generally indicated at 200. In certain aspects, the system 100 of FIG. 1 includes one or more components of the system 200. The system 200 includes a server 204 coupled to the device 102 and the device 104 via the network 106.
[0058]
[0078] The server 204 includes a memory 232 coupled to one or more processors 220. The memory 232 includes a buffer 210 (e.g., a circular buffer). The one or more processors 220 include a call manager 222 and a frame loss manager 224. In a particular aspect, the frame loss manager 224 corresponds to the frame loss manager 156 of FIG. 1.
[0059]
[0079] The call manager 222 is configured to receive and forward audio frames during a call. For example, the call manager 222 establishes a call between the call manager 152 and the call manager 122. During the call, the call manager 152 captures the speech of the user 144 and sends a sequence 119 of audio frames to the server 204. The server 204 stores the audio frames of the sequence 119 in a buffer 210 and forwards the audio frames to the device 102.
[0060]
[0080] 1 to the server 204 (e.g., not to the device 104). The frame loss manager 224 of the server 204 manages frame loss recovery. For example, the device 104 is blind (e.g., unaware) to frame loss detected at the device 102. To illustrate, the frame loss manager 224 of the server 204 performs one or more operations described with respect to the frame loss manager 156 of FIG. 1.
[0061]
[0081] In this manner, the system 200 enables frame loss recovery for legacy devices (e.g., device 104). In certain aspects, the server 204 may also be closer (e.g., fewer network hops) to the device 102, and retransmitting the missing audio frames from the server 204 (e.g., rather than from the device 104) may conserve overall network resources. In certain aspects, the server 204 may have access to network information that may be useful to successfully retransmit the set of audio frames 113 (e.g., the corresponding set of audio frames 123) to the device 102. As an example, the server 204 initially transmits the set of audio frames 113 over a first network link. The server 204 transmits the set of audio frames 123 using a second network link that appears to be available, based at least in part on receiving the frame loss indication 121 and determining that the first network link is unavailable (e.g., down).
[0062]
[0082] 3, a system configured to adjust a call audio playback speed is disclosed and generally indicated at 300. In certain aspects, the system 100 of FIG. 1 includes one or more components of the system 300. The system 300 includes a server 204 coupled via a network 106 to the device 102, the device 104, the device 302, one or more additional devices, or a combination thereof.
[0063]
[0083] The call manager 222 is configured to establish calls between multiple devices. For example, the call manager 222 establishes a call between a user 142 of the device 102, a user 144 of the device 104, and a user 344 of the device 302. During the call, the device 104 captures the speech of the user 144 and sends a sequence 331 of audio frames to the server 204, and the device 302 captures the speech of the user 344 and sends a sequence 333 to the server 204.
[0064]
[0084] In a particular aspect, the server 204 receives audio frames of sequence 331 interspersed with receiving audio frames of sequence 333. For example, the user 144 and the user 344 are speaking alternately, simultaneously, or at overlapping times. The sequence 331 is illustrated as including multiple blocks. It should be understood that each block of the sequence represents one or more audio frames. One block of the sequence may represent the same or a different number (e.g., number) of audio frames as another block of the sequence. The server 204 stores the sequence 331 and the sequence 333 as sequence 119 in the buffer 210 for the device 102. The server 204 initiates transmission of the sequence 119 based at least in part on determining that audio frames of the sequence 119 are available in the buffer 210 for transmission to the device 102.
[0065]
[0085] The server 204 transmits audio frames of sequence 119 to the device 102, receives a frame loss indication 121, and transmits a set of audio frames 123 to the device 102, as described with reference to Figure 2. In a particular aspect, the server 204 forwards sequence 333 to the device 104, as described with reference to Figure 2. In a particular aspect, the server 204 forwards sequence 331 to the device 302, as described with reference to Figure 2.
[0066]
[0086] In this manner, system 300 enables server 204 to perform frame loss recovery for audio frames received from multiple devices during a call. For example, the playback speed of missed audio frames in set of audio frames 113 from device 104 and device 302 is adjusted similarly in set of audio frames 123 to preserve the relative timing of the conversation between user 144 and user 344.
[0067]
[0087] Referring to Figure 4, a diagram is shown, generally designated 400. Diagram 400 illustrates an example embodiment of the operation of components of system 100 of Figure 1, system 200 of Figure 2, system 300 of Figure 3, or combinations thereof. The timing and operations illustrated in Figure 4 are for purposes of illustration and not limitation. In other embodiments, additional or fewer operations may be performed and timing may differ.
[0068]
[0088] Diagram 400 illustrates the timing of transmission of audio frames of sequence 119 from device 402 to device 102. In a particular aspect, device 402 corresponds to device 104 of FIG. 1 or server 204 of FIGS.
[0069]
[0089] The device 402 transmits an audio frame 111 to the device 102. The audio frame 111 is received by the device 102 at time t0. The device 402 transmits a set of audio frames 113 to the device 102. For example, the device 402 transmits an audio frame 411, an audio frame 413, and an audio frame 415 to the device 102. The audio frames 411, 413, and 415 are expected to be received at the device 102 near time t1, time t2, and time t3 (e.g., without network issues). The set of audio frames 113 is described as including three audio frames for ease of explanation. In other embodiments, the set of audio frames 113 may include fewer than three audio frames or more than three audio frames.
[0070]
[0090] The device 102 (e.g., the frame loss manager 124 of FIG. 1) detects a frame loss in response to determining that, following time t3, no audio frame has been received within a threshold duration from time t0 of receipt of the audio frame 111 (e.g., the threshold duration is less than or equal to the difference between time t3 and time t0).
[0071]
[0091] In response to detecting a frame loss, the device 102 (e.g., the frame loss manager 124) sends a frame loss indication 121 to the device 402. In a particular aspect, the frame loss indication 121 indicates the audio frame 111 (e.g., an identifier of the audio frame 111 or a play duration of the missed audio frame) as the last received audio frame of the sequence 119, as described with reference to FIG.
[0072]
[0092] The device 402 generates the set of audio frames 123 based on the set of audio frames 113 in response to receiving the frame loss indication 121 and determining that the set of audio frames 113 corresponds to a previous audio frame not received by the device 102, as described with reference to FIG. 1. For example, the set of audio frames 123 includes audio frame 451, audio frame 453, audio frame 457, one or more additional frames, or a combination thereof, which are based on audio frame 411, audio frame 413, audio frame 415, one or more additional frames, or a combination thereof, of the set of audio frames 113. In a particular embodiment, the set of audio frames 123 includes the same audio frames as the set of audio frames 113. In an alternative embodiment, the set of audio frames 123 includes a subset of the set of audio frames 113.
[0073]
[0093] The device 402 transmits the set of audio frames 123 to the device 102. In a particular aspect, the set of audio frames 123 is transmitted as a single transmission to the device 102. In an alternative aspect, one or more audio frames of the set of audio frames 123 are transmitted to the device 102 at a shorter transmission interval compared to the first transmission of an audio frame of the sequence 119 to the device 102. For example, in normal operation, audio frames are expected to be transmitted or received at expected intervals (e.g., an average of the difference between time t1 and time t0, the difference between time t2 and time t1, the difference between time t3 and time t2, etc.). The device 102 transmits the set of audio frames 123 at an interval shorter than the expected interval.
[0074]
[0094] In certain aspects, the next audio frame 117 transitions from the second playback speed 115 to the first playback speed 105. For example, the device 402 generates the next audio frame 495 based on a first subset of the next audio frames 117 (e.g., next audio frame 491). The next audio frame 495 has the second playback speed 115. The second subset (e.g., next audio frame 493) has the first playback speed 105.
[0075]
[0095] In certain embodiments, the next audio frame 495 includes the same audio frame as the next audio frame 491. For example, audio frame 457, audio frame 459, and audio frame 461 of the next audio frame 495 are the same as audio frame 417, audio frame 419, and audio frame 421 of the next audio frame 491, respectively. The device 402 transmits the next audio frames 495 along with an indication of the second playback speed 115 for each of the next audio frames 495. The device 102 receives audio frame 457 at time t4 (e.g., the expected time of receipt of audio frame 417). The device 102 receives audio frame 459 at time t5 (e.g., the expected time of receipt of audio frame 419). The device 102 receives audio frame 461 at time t6 (e.g., the expected time of receipt of audio frame 421).
[0076]
[0096] In certain embodiments, the next audio frame 495 includes a subset (e.g., every other audio frame) of the next audio frame 491. As an illustrative example, the device 402 transmits audio frame 457 (e.g., based on audio frame 417) and audio frame 461 (e.g., based on audio frame 421) without transmitting any audio frames (e.g., audio frame 459) that are based on audio frame 419. In this example, the device 102 receives audio frame 457 at time t4, does not receive audio frame 459, and receives audio frame 461 at time t5. Because the next audio frame 495 includes a subset of the next audio frame 491, playing the next audio frame 495 at the first playback speed 105 corresponds to an effective playback speed (e.g., second playback speed 115) of the next audio frame 491 that is greater than the first playback speed 105.
[0077]
[0097] In a particular example, the device 402 transmits the set of audio frames 123 simultaneously with the transmission of the next audio frame 117. For example, the device 402 transmits audio frame 457 at an expected transmission time of audio frame 417, which is based on the transmission time of audio frame 415 and the expected transmission interval (e.g., a default transmission interval).
[0078]
[0098] The device 402 transmits the next audio frame 493 (e.g., audio frame 423, audio frame 425, one or more additional audio frames, or a combination thereof) at the first playback speed 105. For example, the device 102 receives audio frame 423 at time t7, audio frame 425 at time t8, or both.
[0079]
[0099] Thus, diagram 400 illustrates that transmitting the set of audio frames 123 does not delay the transmission of the next audio frame 117. In certain embodiments, the next audio frame 117 transitions from the second playback speed 115 to the first playback speed 105. For example, the next audio frame 491 has the second playback speed 115 and the next audio frame 493 has the first playback speed 105.
[0080]
[0100] Referring to Figure 5, a diagram is shown, generally designated 500. Diagram 500 illustrates an example embodiment of the operation of components of system 100 of Figure 1, system 200 of Figure 2, system 300 of Figure 3, or combinations thereof. The timing and operations illustrated in Figure 5 are for purposes of illustration and not limitation. In other embodiments, additional or fewer operations may be performed and timing may differ.
[0081]
[0101] The device 402 generates audio frame 111, audio frame 411, audio frame 413, audio frame 415, audio frame 417, audio frame 419, audio frame 421, audio frame 423, audio frame 425, one or more additional audio frames, or a combination thereof, of sequence 119.
[0082]
[0102] The device 402 transmits audio frame 411 to the device 102. The device 102 plays out the audio frame 411 based on the first playback speed 105. The device 402 transmits each of audio frame 413, audio frame 415, and audio frame 417. The device 102 does not receive any of audio frame 413, audio frame 415, or audio frame 417.
[0083]
[0103] The device 402 transmits the set of audio frames 123 (e.g., audio frame 451, audio frame 453, and audio frame 455) simultaneously with the transmission of the next audio frame 117. For example, the device 402 generates the next audio frame 495 (e.g., audio frame 457, audio frame 459, and audio frame 461) corresponding to the next audio frame 491 based on the second playback speed 115 as described with reference to FIG. 4. The device 402 starts transmitting the next audio frame 495 and the next audio frame 493 at the expected time when it starts transmitting the next audio frame 117. For example, the device 402 transmits the audio frame 457, the audio frame 459, the audio frame 461, the audio frame 423, and the audio frame 425 at the expected transmission time of the corresponding audio frame 417, the corresponding audio frame 419, the corresponding audio frame 421, the audio frame 423, and the audio frame 425.
[0084]
[0104] The device 102 plays out the set of audio frames 123 and the next audio frame 491 based on the second playback speed 115 (e.g., twice as fast as the first playback speed 105). For example, the device 102 plays out audio frames 451 and 453 at the second playback speed 115 in the same amount of time it takes to play out a single audio frame at the first playback speed 105. Similarly, the device 102 plays out audio frames 455 and 457 at the second playback speed 115 in the same amount of time it takes to play out a single audio frame at the first playback speed 105.
[0085]
[0105] In certain aspects, there is a gap in the playback of audio frame 111 and the playback of audio frame 451 on device 102. The next audio frame 493 may be played out at the first playback speed 105 so that the speech can be caught up by playing out set of audio frames 123 and next audio frame 491. For example, device 102 plays out audio frame 423 and audio frame 425 at the first playback speed 105.
[0086]
[0106] The next audio frame 491 is played back based on the second playback speed 115 to compensate for the delay caused by playing the set of audio frames 123 when starting to play back the next audio frame 117. For example, audio frames 451 and 453 are played back at the time when audio frame 417 would have been played back under normal circumstances. In order to catch up with the call, if the second playback speed 115 is twice as fast as the first playback speed 105, then the same number of additional audio frames (e.g., three additional audio frames) of the sequence 119 must be played back based on the second playback speed 115 as the number of audio frames lost (e.g., three audio frames). For example, if audio frames corresponding to a playback duration (e.g., 30 seconds) at the first playback speed 105 are lost, then audio frames corresponding to a playback duration (e.g., 30 seconds) at the second playback speed 115 are played back to catch up with the call if the second playback speed 115 is twice as fast as the first playback speed 105. To illustrate, the first half of the playback duration (e.g., 15 seconds) is used to play out missed audio frames based on the second playback speed 115, and the second half of the playback duration (e.g., 15 seconds) is used to play out audio frames that would have been played out at the first playback speed 105 under normal conditions during the playback duration (e.g., 30 seconds). In certain aspects, partial silence suppression may allow for faster catching up or reducing the speed at which audio frames must be played in order to achieve the second playback speed 115 overall for the set of audio frames 123, or to achieve the second playback speed 115 as an effective playback speed overall for the set of audio frames 113.
[0087]
[0107] 6, a system operable to adjust a call audio playback speed is shown, generally designated 600. In certain aspects, the system 100 of FIG.
[0088]
[0108] The one or more processors 120 include a pause manager 624. The device 102 receives a sequence 119 of audio frames during a call and stores the audio frames of the sequence 119 in the receive buffer 134. In a particular aspect, the sequence 119 corresponds to audio frames received during a call with a single additional device, as described with reference to FIGS. 1-2. For example, the call is between no more than two devices, including the device 102 and the device 104. In an alternative aspect, the sequence 119 corresponds to audio frames received during a call with multiple second devices, as described with reference to FIG. 3. The call manager 122 retrieves the audio frames from the receive buffer 134 and plays them out through the speaker 129. For example, the call manager 122 generates an audio output 143 based on the retrieved audio frames and provides the audio output 143 to the speaker 129. Illustratively, the call manager 122 plays out the set of audio frames 109 , the audio frames 111 , or a combination thereof, at a first playback speed 105 .
[0089]
[0109] The device 102 receives a pause command 620 from the user 142 (e.g., via a user input). The pause command 620 indicates a user request to pause playback of the phone call. In response to receiving the pause command 620, the pause manager 624 stops playing out audio frames of the sequence 119. For example, the pause manager 624 receives the pause command 620 following the playout of audio frame 111 at a playout point by the call manager 122. The pause manager 624 stops the call manager 122 from playing out subsequent audio frames of the sequence 119. In certain embodiments, the pause manager 624 marks audio frames following audio frame 111 (e.g., set of audio frames 113) stored in the receive buffer 134 as unavailable for playout.
[0090]
[0110] The pause manager 624 receives a resume command 622 from the user 142 (e.g., via a user input) at a resume time. The resume command 622 indicates a user request to resume playing the call. In a particular aspect, the pause manager 624 identifies the set of audio frames 113 as the previous audio frames that were missed for playback. For example, the pause manager 624 determines that the set of audio frames 113 should have been played out during a pause duration 623 between the playback duration of the last played audio frame (e.g., audio frame 111) and the resume time.
[0091]
[0111] In certain aspects, the pause manager 624 performs one or more operations described with reference to the frame loss manager 156, the frame loss manager 124, or both of FIG. 1. For example, the pause manager 624 generates the set of audio frames 123 based on the set of audio frames 113, as described with reference to FIG. 1. In certain embodiments, the set of audio frames 123 includes the same audio frames as the set of audio frames 113, and the pause manager 624 plays out the set of audio frames 123 (e.g., the set of audio frames 113) at the second playback speed 115. In another embodiment, the set of audio frames 123 includes a subset of the set of audio frames 113 such that the playback out of the set of audio frames 123 at the first playback speed 105 corresponds to the effective playback speed of the set of audio frames 113 (e.g., the second playback speed 115). The pause manager 624 transitions the next audio frame 117 from the second playback speed 115 to the first playback speed 105, as described with reference to FIG. 1.
[0092]
[0112] In a particular example, the pause manager 624 performs at least partial silence suppression on the set of audio frames 123, on a subset of the next audio frames 117, or both, as described with reference to FIG. 1. In a particular aspect, the pause manager 624 determines the second playback speed 115 based on a number of audio frames in the receiving buffer 134 available for playback. In a particular aspect, the pause manager 624 determines the second playback speed 115 based on a pause duration 623. For example, a longer pause duration 623 corresponds to a higher second playback speed 115. In a particular embodiment, the pause manager 624 selectively generates the set of audio frames 123 based on the set of audio frames 113, as described with reference to FIG. 1. For example, the pause manager 624 generates the set of audio frames 123 for playback based on the second playback speed 115 (e.g., actual or effective playback speed) or jumps to playback of the next audio frame 117 at the first playback speed 105.
[0093]
[0113] In this manner, the system 600 allows the user 142 to pause a call (e.g., a real-time call) and the user 142 can resume the call and catch up on the conversation without having to ask other participants to repeat what was missed.
[0094]
[0114] Referring to Figure 7, a diagram is shown, generally designated 700. Diagram 700 illustrates an example embodiment of the operation of the components of system 600 of Figure 6. The timing and operations illustrated in Figure 7 are for purposes of illustration and not limitation. In other embodiments, additional or fewer operations may be performed and the timing may differ.
[0095]
[0115] During the call, device 102 receives audio frame 111, audio frame 411, audio frame 413, audio frame 415, audio frame 417, audio frame 419, audio frame 421, audio frame 423, audio frame 425, one or more additional audio frames of sequence 119, or a combination thereof, from device 402.
[0096]
[0116] The device 102 (e.g., the call manager 122) plays out audio frame 111 at the first playback speed 105. The device 102 receives a pause command 620, as described with reference to FIG. 6, and pauses playback of the call for a pause duration 623. For example, the device 102 refrains from playing out audio frame 411, audio frame 413, and audio frame 415 that would have been played out during the pause duration 623 at the first playback speed 105 during normal operation.
[0097]
[0117] Device 102 receives resume command 622 and resumes playing the call, as described with reference to Figure 6. For example, device 102 (e.g., pause manager 624) generates set of audio frames 123 (e.g., audio frame 451, audio frame 453, and audio frame 455) from set of audio frames 113, and plays out set of audio frames 123 based on second playback speed 115, as described with reference to Figure 5.
[0098]
[0118] The pause manager 624 transitions from the second playback speed 115 to the first playback speed 105 for the next audio frame 117. For example, the pause manager 624 generates a next audio frame 495 corresponding to the next audio frame 491 based on the second playback speed 115, as described with reference to FIG. 4. For example, the next audio frame 495 is the same as the next audio frame 491 and is played out at the second playback speed 115, or the next audio frame 495 is a subset of the next audio frame 491, such that playing out the next audio frame 495 at the first playback speed 105 corresponds to the effective playback speed (e.g., the second playback speed 115) of the next audio frame 491, as described with reference to FIG. 5. The pause manager 624 transitions from the second playback speed 115 to the first playback speed 105 by playing out the next audio frame 493 based on the first playback speed 105. For example, the pause manager 624 plays out audio frame 423 and audio frame 425 at the first playback speed 105 .
[0099]
[0119] 8, a particular embodiment of a method 800 of call audio playback speed adjustment is shown. In a particular aspect, one or more operations of the method 800 are performed by at least one of the frame loss manager 124 of FIG. 1, the call manager 122, the one or more processors 120, the device 102, the system 100, the system 200 of FIG. 2, the system 300 of FIG. 3, or a combination thereof.
[0100]
[0120] The method 800 includes receiving a sequence of audio frames from a first device during a call, at 802. For example, the device 102 receives the sequence of audio frames 119 from the device 104 during the call, as described with reference to FIG.
[0101]
[0121] Method 800 also includes initiating transmission of a frame loss indication to the first device in response to determining that an audio frame of the sequence has not been received for a threshold duration since a last received audio frame of the sequence, at 804. For example, frame loss manager 124 of FIG. 1 initiates transmission of frame loss indication 121 to device 104 in response to determining that an audio frame of sequence 119 has not been received for a threshold duration since a last received frame of sequence 119 (e.g., audio frame 111), as described with reference to FIG.
[0102]
[0122] The method 800 further includes receiving from the first device, in response to the frame loss indication, the set of audio frames of the sequence and an indication of the second playback speed, at 806. For example, the device 102 of FIG. 1 receives from the device 104, the set 123 of audio frames of the sequence 119 and an indication of the second playback speed 115, in response to the frame loss indication 121, as described with reference to FIG.
[0103]
[0123] The method 800 also includes initiating 808 playback of the set of audio frames through the speaker based on the second playback speed. For example, the frame loss manager 124 initiates playback of the set of audio frames 123 through the speaker 129 based on the second playback speed 115, as described with reference to FIG. 1 . The second playback speed 115 is greater than the first playback speed 105 of the set of audio frames 109 of the sequence 119. In this manner, the method 800 enables receiving previously lost audio frames and catching up with the call by playing out the audio frames at the faster playback speed.
[0104]
[0124] The method 800 of Figure 8 may be performed by a field programmable gate array (FPGA) device, an application specific integrated circuit (ASIC), a processing unit such as a central processing unit (CPU), a DSP, a controller, other hardware devices, firmware devices, or any combination thereof. As an example, the method 800 of Figure 8 may be performed by one or more processors executing instructions, such as those described with reference to Figure 21.
[0105]
[0125] 9, a particular embodiment of a method 900 of call audio playback speed adjustment is shown. In a particular aspect, one or more operations of the method 900 are performed by at least one of the frame loss manager 156 of FIG. 1, the call manager 152, one or more processors 150, the device 104, the system 100, the system 200 of FIG. 2, the system 300 of FIG. 3, or a combination thereof.
[0106]
[0126] The method 900 includes initiating transmission of a sequence of audio frames to a second device during the call, at 902. For example, the device 104 of FIG. 1 initiates transmission of a sequence of audio frames 119 to the device 102 during the call, as described with reference to FIG.
[0107]
[0127] The method 900 also includes receiving a frame loss indication from the second device, at 904. For example, the frame loss manager 156 of FIG. 1 receives the frame loss indication 121 from the device 102, as described with reference to FIG.
[0108]
[0128] The method 900 further includes determining, based on the frame loss indication, a last received audio frame of the sequence received by the second device, at 906. For example, the frame loss manager 156 of FIG. 1 determines, based on the frame loss indication 121, a last received audio frame (e.g., audio frame 111) of the sequence 119 received by the device 102, as described with reference to FIG.
[0109]
[0129] The method 900 also includes, at 908, initiating transmission of the set of audio frames and an indication of a second playback speed of the set of audio frames to the second device based at least in part on determining that a set of audio frames subsequent to the last received audio frame in the sequence is available. For example, the frame loss manager 156 initiates transmission of the set of audio frames 113 (e.g., the set of audio frames 123 is the same as the set of audio frames 113) and an indication of the second playback speed 115 based at least in part on determining that a set of audio frames subsequent to the audio frame 111 is available, as described with reference to FIG. 1. The second playback speed 115 is greater than the first playback speed 105 of the set of audio frames 109 of the sequence 119. In this manner, the method 900 enables the device 102 to catch up with the call by retransmitting previously lost audio frames and playing back the audio frames at a faster playback speed.
[0110]
[0130] The method 900 of Figure 9 may be performed by a field programmable gate array (FPGA) device, an application specific integrated circuit (ASIC), a processing unit such as a central processing unit (CPU), a DSP, a controller, other hardware devices, firmware devices, or any combination thereof. As an example, the method 900 of Figure 9 may be performed by one or more processors executing instructions, such as those described with reference to Figure 21.
[0111]
[0131] 10, a particular embodiment of a method 1000 of call audio playback speed adjustment is shown. In a particular aspect, one or more operations of the method 1000 are performed by at least one of the frame loss manager 156 of FIG. 1, the call manager 152, one or more processors 150, the device 104, the system 100, the system 200 of FIG. 2, the system 300 of FIG. 3, or a combination thereof.
[0112]
[0132] The method 1000 includes initiating transmission of a sequence of audio frames to a second device during the call, at 1002. For example, the device 104 of FIG. 1 initiates transmission of a sequence of audio frames 119 to the device 102 during the call, as described with reference to FIG.
[0113]
[0133] The method 1000 also includes receiving a frame loss indication from the second device, at 1004. For example, the frame loss manager 156 of FIG. 1 receives the frame loss indication 121 from the device 102, as described with reference to FIG.
[0114]
[0134] The method 1000 further includes determining, based on the frame loss indication, a last received audio frame of the sequence received by the second device, at 1006. For example, the frame loss manager 156 of FIG. 1 determines, based on the frame loss indication 121, a last received audio frame (e.g., audio frame 111) of the sequence 119 received by the device 102, as described with reference to FIG.
[0115]
[0135] The method 1000 also includes, at 1008, generating an updated set of audio frames based on the set of audio frames such that a first playback speed of the updated set of audio frames corresponds to an effective second playback speed of the set of audio frames based at least in part on determining that a set of audio frames subsequent to the last received audio frame in the sequence is available. For example, the frame loss manager 156 generates the set of audio frames 123 based on a subset of the set of audio frames 113 such that a first playback speed 105 of the set of audio frames 123 corresponds to an effective playback speed (e.g., second playback speed 115) of the set of audio frames 113, based at least in part on determining that a set of audio frames 113 subsequent to the audio frame 111 is available, as described with reference to FIG. 1. The effective second playback speed (e.g., second playback speed 115) is greater than the first playback speed 105. In this manner, the method 1000 enables transmission of audio frames corresponding to lost audio frames with a faster effective playout speed to catch up with the conversation.
[0116]
[0136] The method 1000 of Figure 10 may be performed by a field programmable gate array (FPGA) device, an application specific integrated circuit (ASIC), a processing device such as a central processing unit (CPU), a DSP, a controller, other hardware devices, firmware devices, or any combination thereof. As an example, the method 1000 of Figure 10 may be performed by one or more processors executing instructions, such as those described with reference to Figure 21.
[0117]
[0137] 11, a particular embodiment of a method 1100 of call audio playback speed adjustment is illustrated. In a particular aspect, one or more operations of the method 1100 are performed by at least one of the frame loss manager 124 of FIG. 1, the call manager 122, the one or more processors 120, the device 102, the system 100, the pause manager 624 of FIG. 6, the system 600, or a combination thereof.
[0118]
[0138] The method 1100 includes receiving a sequence of audio frames from a first device during a call, at 1102. For example, the device 102 receives the sequence of audio frames 119 from the device 104 during the call, as described with reference to FIG.
[0119]
[0139] The method 1100 also includes, at 1104, in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to the last played audio frame in the sequence is available, commencing playback of the set of audio frames based on a second playback speed 115. For example, the pause manager 624 of FIG. 6 in response to receiving a resume command 622 indicating a user request to resume playback and determining that a set of audio frames 113 subsequent to the last played audio frame (e.g., audio frame 111) is available, as described with reference to FIG. 6. The second playback speed 115 is greater than the first playback speed 105 of the set of audio frames 109 of the sequence 119.
[0120]
[0140] In this manner, the method 1100 allows a user to pause a call (e.g., a real-time call) and the user can resume the call and catch up on the conversation without having to ask other participants to repeat what was missed.
[0121]
[0141] The method 1100 of Figure 11 may be performed by a field programmable gate array (FPGA) device, an application specific integrated circuit (ASIC), a processing device such as a central processing unit (CPU), a DSP, a controller, other hardware devices, firmware devices, or any combination thereof. As an example, the method 1100 of Figure 11 may be performed by one or more processors executing instructions, such as those described with reference to Figure 21.
[0122]
[0142] 12 depicts an embodiment 1200 of the device 102, the device 104 of FIG. 1, the server 204 of FIG. 2, or a combination thereof, as an integrated circuit 1202 that includes one or more processors 1220. The one or more processors 1220 include a call manager 1222, a frame loss manager 1224, a pause manager 624, or a combination thereof.
[0123]
[0143] In a particular aspect, call manager 1222 corresponds to call manager 122 of Figure 1, call manager 152, call manager 222 of Figure 2, or a combination thereof. In a particular aspect, frame loss manager 1224 corresponds to frame loss manager 124 of Figure 1, frame loss manager 156, frame loss manager 224 of Figure 2, or a combination thereof.
[0124]
[0144] The integrated circuit 1202 also includes an audio input 1204, such as one or more bus interfaces, to enable audio data 1228 (e.g., audio input 141) to be received for processing. The integrated circuit 1202 also includes an audio output 1206, such as a bus interface, to enable transmission of an audio output 1243, such as audio output 143. The integrated circuit 1202 can enable implementation of telephone call audio playback speed adjustment as a component within a system, such as the mobile phone or tablet depicted in FIG. 13, the headset depicted in FIG. 14, the wearable electronic device depicted in FIG. 15, the voice controlled speaker system depicted in FIG. 16, the camera depicted in FIG. 17, the virtual reality or augmented reality headset depicted in FIG. 18, or the vehicle depicted in FIG. 19 or FIG. 20.
[0125]
[0145] 13 depicts an embodiment 1300 in which the device 102, device 104, server 204, or a combination thereof includes a mobile device 1302, such as a phone or tablet, as an illustrative, non-limiting example. The mobile device 1302 includes a speaker 129, a microphone 146, and a display screen 1304. Components of the processor 1220, including the call manager 1222, the frame loss manager 1224, the pause manager 624, or a combination thereof, are incorporated into the mobile device 1302 and are illustrated using dashed lines to indicate internal components that are not typically visible to a user of the mobile device 1302. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or a combination thereof, operates to adjust the call audio playback speed of the user speech, which is then processed (e.g., by an embedded “smart assistant” application) to perform one or more actions on the mobile device 1302, such as displaying information related to the user speech on the display screen 1304.
[0126]
[0146] 14 depicts an embodiment 1400 in which the device 102, device 104, server 204, or combination thereof includes a headset device 1402. The headset device 1402 includes a speaker 129, a microphone 146, or both. One or more components of the processor 1220, including a frame loss manager 1224, a pause manager 624, a call manager 1222, or combinations thereof, are incorporated into the headset device 1402. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or combinations thereof, may operate to adjust a call audio playback rate of a user's voice, which may cause the headset device 1402 to perform one or more operations such as transmitting audio data corresponding to the user voice activity to a second device (not shown) for further processing, or combinations thereof.
[0127]
[0147] 15 depicts an embodiment 1500 in which the device 102, device 104, server 204, or combination thereof includes a wearable electronic device 1502 illustrated as a "smart watch." A frame loss manager 1224, a pause manager 624, a call manager 1222, a microphone 146, a speaker 129, or combinations thereof are incorporated into the wearable electronic device 1502. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or combinations thereof operate to adjust a call audio playback rate of user speech, which is then processed to perform one or more operations on the wearable electronic device 1502, such as launching a graphical user interface or otherwise displaying other information related to the user speech on a display screen 1504 of the wearable electronic device 1502. By way of example, the wearable electronic device 1502 may include a display screen configured to display notifications based on user speech detected by the wearable electronic device 1502. In a particular example, the wearable electronic device 1502 includes a haptic device that provides a haptic notification (e.g., vibrates) in response to detection of user voice activity. For example, the haptic notification may enable a user to look to the wearable electronic device 1502 to notice a display notification indicating detection of a keyword spoken by the user (e.g., to pause or resume playback of a phone call) or to notice a warning indicating that the phone call audio is being played in catch-up mode (e.g., at an increased speed). In this manner, the wearable electronic device 1502 may alert a user who is hearing impaired or wearing a headset that the user's voice activity is being detected.
[0128]
[0148] 16 is an embodiment 1600 in which the device 102, the device 104, the server 204, or a combination thereof includes a wireless speaker and voice-activated device 1602. The wireless speaker and voice-activated device 1602 may have wireless network connectivity and is configured to perform an assistant operation. One or more processors 1220 including a frame loss manager 1224, a pause manager 624, a call manager 1222, a microphone 146, a speaker 129, or a combination thereof are included in the wireless speaker and voice-activated device 1602. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or a combination thereof operates to adjust a call audio playback speed of the user speech. During an activity, in response to receiving a verbal command identified as the user speech, the wireless speaker and voice-activated device 1602 may perform an assistant operation, such as by executing a voice-activated system (e.g., an integrated assistant application). Assistant actions can include pausing a call, resuming a paused call at an increased playback speed to catch up, adjusting the temperature, playing music, turning on lights, etc. For example, an Assistant action is performed in response to receiving a command following a keyword or key phrase (e.g., "Hello Assistant").
[0129]
[0149] 17 depicts an embodiment 1700 in which the device 102, device 104, server 204, or a combination thereof includes a portable electronic device corresponding to a camera device 1702. A frame loss manager 1224, a pause manager 624, a call manager 1222, a microphone 146, a speaker 129, or a combination thereof is included in the camera device 1702. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or a combination thereof operates to adjust a call voice playback rate of user speech. In operation, in response to receiving a verbal command identified as user speech, the camera device 1702 can perform an action responsive to the spoken user command, such as, as illustrative examples, adjusting image or video capture settings, image or video playback settings, or image or video capture instructions.
[0130]
[0150] 18 depicts an embodiment 1800 in which the device 102, device 104, server 204, or a combination thereof includes a portable electronic device corresponding to a virtual reality, augmented reality, or mixed reality headset 1802. The frame loss manager 1224, the pause manager 624, the call manager 1222, the microphone 146, the speaker 129, or a combination thereof are incorporated into the headset 1802. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or a combination thereof operates to adjust the call audio playback rate of the user's speech. The visual interface device 1820 is placed in front of the user to enable the user to display an augmented reality or virtual reality image or scene while the headset 1802 is worn. In a particular example, the visual interface device is configured to display a notification indicating the detected user's speech.
[0131]
[0151] 19 depicts an embodiment 1900 in which the device 102, device 104, server 204, or combinations thereof correspond to or are incorporated within a vehicle 1902, illustrated as a manned or unmanned aerial device (e.g., a parcel delivery drone). A frame loss manager 1224, a pause manager 624, a call manager 1222, a microphone 146, a speaker 129, or combinations thereof are incorporated into the vehicle 1902. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or combinations thereof operate to adjust a call audio playback rate of a user speaking in response to delivery instructions, or the like, from an authenticated user of the vehicle 1902.
[0132]
[0152] 20 depicts another embodiment 2000 in which the device 102, device 104, server 204, or combination thereof corresponds to or is incorporated within a vehicle 2002, illustrated as an automobile. The vehicle 2002 includes one or more processors 1220, including a frame loss manager 1224, a pause manager 624, a call manager 1222, or combination thereof. The vehicle 2002 also includes a microphone 146, a speaker 129, or both. In a particular example, the frame loss manager 1224, the pause manager 624, the call manager 1222, or combination thereof, operates to adjust a call voice playback rate of user speech, such as in response to voice commands from an authenticated passenger. In particular embodiments, in response to receiving a verbal command identified as user speech, the voice activation system initiates one or more operations of the vehicle 2002 based on one or more keywords (e.g., "unlock," "start engine," "play music," "show weather forecast," or another voice command), such as by providing feedback or information via the display 2020 or one or more speakers (e.g., speaker 129).
[0133]
[0153] 21, a block diagram of a particular exemplary embodiment of a device is depicted, generally designated 2100. In various embodiments, device 2100 may have more or fewer components than those shown in FIG. 21. In an exemplary embodiment, device 2100 may correspond to device 102, device 104, server 204, or a combination thereof. In an exemplary embodiment, device 2100 may perform one or more of the operations described with reference to FIGS. 1-20.
[0134]
[0154] In a particular embodiment, the device 2100 includes a processor 2106 (e.g., a central processing unit (CPU)). The device 2100 may include one or more additional processors 2110 (e.g., one or more DSPs). In a particular aspect, the one or more processors 1220 of FIG. 12 correspond to the processor 2106, the processor 2110, or a combination thereof. The processor 2110 may include a speech and music coder-decoder (CODEC) 2108, including a voice coder ("vocoder") encoder 2136, a vocoder decoder 2138, a call manager 1222, a frame loss manager 1224, a pause manager 624, or a combination thereof.
[0135]
[0155] The device 2100 may include a memory 2186 and a CODEC 2134. In a particular aspect, the memory 2186 corresponds to the memory 154, the memory 132, the memory 232 of FIG. 1, or a combination thereof. The memory 2186 may include instructions 2156 executable by one or more additional processors 2110 (or the processor 2106) to perform functions described with reference to the call manager 1222, the frame loss manager 1224, the pause manager 624, or a combination thereof. The device 2100 may include a modem 2140 coupled to an antenna 2152 via a transceiver 2150.
[0136]
[0156] The device 2100 may include a display 2128 coupled to a display controller 2126. The speaker 129, the microphone 146, or both may be coupled to a CODEC 2134. The CODEC 2134 may include a digital-to-analog converter (DAC) 2102, an analog-to-digital converter (ADC) 2104, or both. In a particular embodiment, the CODEC 2134 may receive an analog signal from the microphone 146, convert the analog signal to a digital signal using the analog-to-digital converter 2104, and provide the digital signal to a speech and music codec 2108. The speech and music codec 2108 may process the digital signal, which may be further processed by the call manager 1222. In a particular embodiment, the speech and music codec 2108 may provide the digital signal to the CODEC 2134. The CODEC 2134 may convert the digital signal to an analog signal using a digital-to-analog converter 2102 and provide the analog signal to the speaker 129 .
[0137]
[0157] In certain embodiments, the device 2100 may be included in a system-in-package device or a system-on-chip device 2122. In certain embodiments, the memory 2186, the processor 2106, the processor 2110, the display controller 2126, the CODEC 2134, the modem 2140, and the transceiver 2150 are included in the system-in-package device or the system-on-chip device 2122. In certain embodiments, the input device 2130 and the power supply 2144 are coupled to the system-on-chip device 2122. Additionally, in certain embodiments, the display 2128, the input device 2130, the speaker 129, the microphone 146, the antenna 2152, and the power supply 2144 are external to the system-on-chip device 2122, as shown in FIG. In particular embodiments, the display 2128, the input device 2130, the speaker 129, the microphone 146, the antenna 2152, and the power supply 2144 may each be coupled to a component of the system-on-chip device 2122, such as an interface or controller.
[0138]
[0158] The device 2100 may include a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a game console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, a smart speaker, a speaker bar, a mobile communications device, a smartphone, a cellular telephone, a laptop computer, a tablet, a personal digital assistant, a digital video disc (DVD) player, a tuner, a vehicle, an augmented reality headset, a virtual reality headset, a mixed reality headset, an air vehicle, a home automation system, a voice-activated device, a wireless speaker and a voice-activated device, a portable electronic device, an automobile, a computing device, a virtual reality (VR) device, a base station, a mobile device, or any combination thereof.
[0139]
[0159] In connection with the described embodiment, an apparatus includes means for receiving a sequence of audio frames from a first device during a call. For example, the means for receiving may correspond to the frame loss manager 124, the call manager 122, the one or more processors 120, the device 102 of FIG. 1, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to receive a sequence of audio frames during a call, or any combination thereof.
[0140]
[0160] The apparatus also includes means for initiating transmission of a frame loss indication to the first device, the transmission being initiated in response to determining that an audio frame of the sequence has not been received for a threshold duration since a last received audio frame of the sequence. For example, the means for initiating transmission of the frame loss indication may correspond to the frame loss manager 124, the call manager 122, the one or more processors 120, the device 102 of FIG. 1, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to initiate transmission of the frame loss indication, or a combination thereof.
[0141]
[0161] The apparatus further includes means for receiving a set of audio frames of the sequence and an indication of the second playback speed from the first device, the set of audio frames and the indication being received in response to the frame loss indication. For example, the means for receiving the set of audio frames may correspond to the frame loss manager 124, the call manager 122, the one or more processors 120, the device 102 of FIG. 1, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to receive the set of audio frames, or any combination thereof.
[0142]
[0162] The apparatus also includes means for initiating playback of the set of audio frames through the speaker based on a second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence. For example, the means for initiating playback may correspond to the frame loss manager 124, the call manager 122, the one or more processors 120, the device 102 of FIG. 1, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the processor 2106, the one or more processors 2110, the device 2100, one or more other circuits or components configured to initiate transmission of a frame loss indication, or any combination thereof.
[0143]
[0163] Also in accordance with the described embodiment, the apparatus includes means for receiving a sequence of audio frames from the first device. For example, the means for receiving may correspond to the frame loss manager 124, the call manager 122, the one or more processors 120, the device 102 of FIG. 1, the pause manager 624 of FIG. 6, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to receive a sequence of audio frames during a call, or any combination thereof.
[0144]
[0164] The apparatus also includes means for initiating playback of the set of audio frames at at least a second playback rate in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to the last played audio frame in the sequence is available, the second playback rate being greater than the first playback rate of the first set of audio frames of the sequence. For example, the means for initiating playback may correspond to the frame loss manager 124, the call manager 122, the one or more processors 120, the device 102 of FIG. 1, the pause manager 624 of FIG. 6, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the device 2100, one or more other circuits or components configured to initiate playback of the set of audio frames, or any combination thereof.
[0145]
[0165] Further, in accordance with the described embodiment, the apparatus includes means for initiating transmission of a sequence of audio frames to a second device during a call. For example, the means for initiating transmission may correspond to the frame loss manager 156, the call manager 152, the one or more processors 150, the device 104 of FIG. 1, the call manager 222, the frame loss manager 224, the one or more processors 220, the server 204 of FIG. 2, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to initiate transmission of a sequence of audio frames, or any combination thereof.
[0146]
[0166] The apparatus also includes means for receiving a frame loss indication from the second device. For example, the means for receiving may correspond to the frame loss manager 156, the call manager 152, the one or more processors 150, the device 104 of FIG. 1, the call manager 222, the frame loss manager 224, the one or more processors 220, the server 204 of FIG. 2, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to receive the frame loss indication, or any combination thereof.
[0147]
[0167] The apparatus further includes means for determining, based on the frame loss indication, a last received audio frame of the sequence received by the second device. For example, the means for determining may correspond to frame loss manager 156, call manager 152, one or more processors 150, device 104 of FIG. 1, call manager 222, frame loss manager 224, one or more processors 220, server 204 of FIG. 2, one or more processors 1220, call manager 1222, frame loss manager 1224 of FIG. 12, device 2100, one or more other circuits or components configured to determine, based on the frame loss indication, a last received audio frame, or any combination thereof.
[0148]
[0168] The apparatus also includes means for initiating transmission of the set of audio frames and an indication of a second playback speed of the set of audio frames to the second device, the transmission being initiated at least in part based on determining that a set of audio frames subsequent to a last received audio frame in the sequence is available. The second playback speed is greater than the first playback speed of the first set of audio frames of the sequence. For example, the means for initiating transmission may correspond to the frame loss manager 156, the call manager 152, the one or more processors 150, the device 104 of FIG. 1, the call manager 222, the frame loss manager 224, the one or more processors 220, the server 204 of FIG. 2, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to initiate transmission of the set of audio frames, or any combination thereof.
[0149]
[0169] Also in accordance with the described embodiment, the apparatus includes means for initiating transmission of a sequence of audio frames to a second device during a call. For example, the means for initiating transmission may correspond to the frame loss manager 156, the call manager 152, the one or more processors 150, the device 104 of FIG. 1, the call manager 222, the frame loss manager 224, the one or more processors 220, the server 204 of FIG. 2, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to initiate transmission of a sequence of audio frames, or any combination thereof.
[0150]
[0170] The apparatus also includes means for receiving a frame loss indication from the second device. For example, the means for receiving may correspond to the frame loss manager 156, the call manager 152, the one or more processors 150, the device 104 of FIG. 1, the call manager 222, the frame loss manager 224, the one or more processors 220, the server 204 of FIG. 2, the one or more processors 1220, the call manager 1222, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to receive the frame loss indication, or any combination thereof.
[0151]
[0171] The apparatus further includes means for determining, based on the frame loss indication, a last received audio frame of the sequence received by the second device. For example, the means for determining may correspond to frame loss manager 156, call manager 152, one or more processors 150, device 104 of FIG. 1, call manager 222, frame loss manager 224, one or more processors 220, server 204 of FIG. 2, one or more processors 1220, call manager 1222, frame loss manager 1224 of FIG. 12, device 2100, one or more other circuits or components configured to determine, based on the frame loss indication, a last received audio frame, or any combination thereof.
[0152]
[0172] The apparatus also includes means for generating the set of updated audio frames based on the set of audio frames such that a first playback speed of the set of updated audio frames corresponds to an effective second playback speed of the set of audio frames, the set of updated audio frames being generated based at least in part on determining that a set of audio frames subsequent to a last received audio frame in a sequence is available. The effective second playback speed is greater than the first playback speed. For example, the means for generating may correspond to the frame loss manager 156, the one or more processors 150, the device 104 of FIG. 1, the frame loss manager 224, the one or more processors 220, the server 204 of FIG. 2, the one or more processors 1220, the frame loss manager 1224 of FIG. 12, the transceiver 2150, the modem 2140, the antenna 2152, the device 2100, one or more other circuits or components configured to generate the set of updated audio frames, or any combination thereof.
[0153]
[0173] In some embodiments, a non-transitory computer-readable medium (e.g., a computer-readable storage device such as memory 2186) includes instructions (e.g., instructions 2156) that, when executed by one or more processors (e.g., one or more processors 2110 or processor 2106), cause the one or more processors to receive a sequence of audio frames (e.g., sequence 119) from a first device (e.g., device 104) during a call. The instructions, when executed by one or more processors, also cause the one or more processors to initiate transmission of a frame loss indication (e.g., frame loss indication 121) to the first device in response to determining that an audio frame of the sequence has not been received for a threshold duration since a last received audio frame of the sequence (e.g., set of audio frames 111). The instructions, when executed by the one or more processors, further cause the one or more processors to receive from the first device a set of audio frames of the sequence (e.g., set of audio frames 113) and an indication of a second playback speed (e.g., second playback speed 115) in response to the frame loss indication. The instructions, when executed by the one or more processors, also cause the one or more processors to initiate playback of the set of audio frames via a speaker (e.g., speaker 129) based on the second playback speed. The second playback speed is greater than the first playback speed (e.g., first playback speed 105) of the first set of audio frames of the sequence (e.g., set of audio frames 109).
[0154]
[0174] In some embodiments, a non-transitory computer-readable medium (e.g., a computer-readable storage device such as memory 2186) includes instructions (e.g., instructions 2156) that, when executed by one or more processors (e.g., one or more processors 2110 or processor 2106), cause the one or more processors to receive a sequence of audio frames (e.g., sequence 119) from a first device (e.g., device 104) during a phone call. The instructions, when executed by one or more processors, also cause the one or more processors to initiate playback of a set of audio frames based on a second playback speed (e.g., second playback speed 115) in response to receiving a user request to resume playback (e.g., resume command 622) and determining that a set of audio frames (e.g., set of audio frames 113) following a last-played audio frame in the sequence (e.g., audio frame 111) is available. The second playback speed is greater than the first playback speed (e.g., first playback speed 105) of the first set of audio frames (e.g., set of audio frames 109) of the sequence.
[0155]
[0175] In some embodiments, a non-transitory computer-readable medium (e.g., a computer-readable storage device such as memory 2186) includes instructions (e.g., instructions 2156) that, when executed by one or more processors (e.g., one or more processors 2110 or processor 2106), cause the one or more processors to initiate transmission of a sequence of audio frames (e.g., sequence 119) to a second device (e.g., device 102) during a call. The instructions, when executed by one or more processors, also cause the one or more processors to receive a frame loss indication (e.g., frame loss indication 121) from the second device (e.g., device 102). The instructions, when executed by one or more processors further cause the one or more processors to determine a last-received audio frame (e.g., audio frame 111) of the sequence received by the second device based on the frame loss indication. The instructions, when executed by the one or more processors, will also initiate, based at least in part on the one or more processors determining that a set of audio frames (e.g., set of audio frames 113) subsequent to a last received audio frame in the sequence is available, transmission to the second device of the set of audio frames and an indication of a second playback speed (e.g., second playback speed 115) of the set of audio frames, the second playback speed being greater than the first playback speed (e.g., first playback speed 105) of the first set of audio frames (e.g., set of audio frames 109) of the sequence.
[0156]
[0176] In some embodiments, a non-transitory computer-readable medium (e.g., a computer-readable storage device such as memory 2186) includes instructions (e.g., instructions 2156) that, when executed by one or more processors (e.g., one or more processors 2110 or processor 2106), cause the one or more processors to initiate transmission of a sequence of audio frames (e.g., sequence 119) to a second device (e.g., device 102) during a call. The instructions, when executed by one or more processors, also cause the one or more processors to receive a frame loss indication (e.g., frame loss indication 121) from the second device (e.g., device 102). The instructions, when executed by one or more processors further cause the one or more processors to determine a last-received audio frame (e.g., audio frame 111) of the sequence received by the second device based on the frame loss indication. The instructions, when executed by the one or more processors, are also to generate, based at least in part on the one or more processors determining that a set of audio frames (e.g., set of audio frames 113) subsequent to a last received audio frame in a sequence is available, an updated set of audio frames (e.g., set of audio frames 123) based on the set of audio frames, such that a first playback speed (e.g., first playback speed 105) of the updated set of audio frames corresponds to an effective second playback speed (e.g., second playback speed 115) of the set of audio frames. The effective second playback speed is greater than the first playback speed.
[0157]
[0177] Particular aspects of this disclosure are described below in a first set of interrelated clauses.
[0158]
[0178] According to clause 1, a communication device comprises one or more processors configured to receive, during a call, a sequence of audio frames from a first device; in response to determining that no audio frames of the sequence have been received for a threshold duration since a last received audio frame of the sequence, initiate transmission of a frame loss indication to the first device; in response to the frame loss indication, receive from the first device a set of audio frames of the sequence and an indication of a second playback speed; and initiate playback of the set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0159]
[0179] Clause 2 includes the device of clause 1, wherein initiating playback of the set of audio frames at a second playback speed includes at least partially suppressing silence indicated by the set of audio frames.
[0160]
[0180] Clause 3 includes the device of clause 1 or clause 2, wherein the one or more processors are further configured to receive a next audio frame of the sequence from the first device, the next audio frame following the set of audio frames in the sequence, and the one or more processors are further configured to transition playback of the next audio frame from the second playback speed to the first playback speed.
[0161]
[0181] Clause 4 includes a device as described in any of clauses 1 to 3, wherein the one or more processors are further configured to store the set of audio frames in a buffer; receive a next audio frame of the sequence from the first device and store the next audio frame in the buffer, where the next audio frame follows the set of audio frames in the sequence, and the one or more processors are further configured to transition playback from the second playback speed to the first playback speed in response to determining that fewer than a threshold number of audio frames of the sequence are stored in the buffer for playback.
[0162]
[0182] Clause 5 includes a device described in any of clauses 1 to 4, wherein the one or more processors are further configured to receive a next audio frame in a sequence from the first device simultaneously with receiving the set of audio frames from the first device, the next audio frame following the set of audio frames in the sequence.
[0163]
[0183] Clause 6 includes a device as described in any of clauses 1 to 5, wherein the one or more processors are configured to determine that at a particular time point, an audio frame corresponding to a particular playback duration at a first playback speed has not been received since a last received audio frame, the particular playback duration being based on the particular time point and a reception time of the last received frame, and the frame loss indication includes a request to have a previous audio frame corresponding to the particular playback duration at the first playback speed retransmitted.
[0164]
[0184] Clause 7 includes the device of any of clauses 1 to 6, wherein the frame loss indication indicates a last received audio frame.
[0165]
[0185] Clause 8 includes the device of any of clauses 1 to 6, wherein the second playback speed is based on a number of the set of audio frames.
[0166]
[0186] Clause 9 includes the device of any of clauses 1 to 8, wherein the one or more processors are configured to, in response to determining that the set of audio frames includes a silence frame, begin playing the silence frame at a playback speed greater than the second playback speed.
[0167]
[0187] Clause 10 includes the device of any of clauses 1 to 9, wherein the one or more processors are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a gaming console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or a combination thereof.
[0168]
[0188] Particular aspects of the present disclosure are described below in a second set of interrelated clauses.
[0169]
[0189] According to clause 11, a method of communication comprises receiving, during a call, at a device a sequence of audio frames from a first device; in response to determining that no audio frames of the sequence have been received at the device for a threshold duration since a last received audio frame of the sequence, initiating transmission of a frame loss indication from the device to the first device; in response to the frame loss indication, receiving, at the device, a set of audio frames of the sequence and an indication of a second playback speed from the first device; and initiating playback of the set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0170]
[0190] Clause 12 includes a method as described in clause 11, wherein the first device includes a server, the call is with a plurality of second devices, and the sequence of audio frames is based on a plurality of sequences of audio frames received by the first device from the plurality of second devices.
[0171]
[0191] Clause 13 includes the method of clause 11, wherein the call is conducted between the device and a single additional device, the single additional device including the first device.
[0172]
[0192] Clause 14 includes a method according to any of clauses 11 to 13, the method further comprising receiving at the device a next audio frame of the sequence from the first device simultaneously with receiving at the device the set of audio frames from the first device, the next audio frame following the set of audio frames of the sequence.
[0173]
[0193] Particular aspects of the present disclosure are described below in a third set of interrelated clauses.
[0174] According to clause 15, a communications device comprises one or more processors configured to receive, during a call, a sequence of audio frames from a first device; and, in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last-played audio frame in the sequence is available, initiate playback of the set of audio frames based on a second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0175]
[0194] Clause 16 includes the device of clause 15, wherein initiating playback of the set of audio frames at a second playback speed includes at least partially suppressing silence indicated by the set of audio frames.
[0176]
[0195] Clause 17 includes the device of clause 15 or clause 16, wherein the one or more processors are further configured to receive a next audio frame of the sequence from the first device, the next audio frame following the set of audio frames in the sequence, and the one or more processors are further configured to transition playback of the next audio frame from the second playback speed to the first playback speed.
[0177]
[0196] Clause 18 includes a device according to any of clauses 15 to 17, wherein the one or more processors are further configured to store the set of audio frames in a buffer; receive a next audio frame of the sequence from the first device and store the next audio frame in the buffer, the next audio frame following the set of audio frames in the sequence, and the one or more processors are further configured to transition playback from the second playback speed to the first playback speed in response to determining that fewer than a threshold number of audio frames of the sequence are stored in the buffer for playback.
[0178]
[0197] Clause 19 includes the device of any of clauses 15 to 18, wherein the second playback speed is based on a number of the set of audio frames.
[0179]
[0198] Clause 20 includes a device as described in any of clauses 15 to 18, wherein a user request is received at the resume time and the second playback speed is based on a pause duration between the playback time of the last played audio frame and the resume time.
[0180]
[0199] Clause 21 includes a device described in any of clauses 15 to 20, wherein the one or more processors are configured to, in response to determining that the set of audio frames includes a silence frame, initiate playback of the silence frame at a playback speed greater than the second playback speed.
[0181]
[0200] Clause 22 includes the device of any of clauses 15 to 21, wherein the one or more processors are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a gaming console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or a combination thereof.
[0182]
[0201] Particular aspects of the present disclosure are described below in a fourth set of interrelated clauses.
[0183]
[0202] According to clause 23, a method of communication comprises receiving, at a device, during a call, a sequence of audio frames from a first device, and in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last played audio frame in the sequence is available, commencing playback on the device of the set of audio frames at at least a second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0184]
[0203] Clause 24 includes the method of clause 23, wherein commencing playback of the set of audio frames at a second playback speed includes at least partially suppressing silence indicated by the set of audio frames.
[0185]
[0204] Clause 25 includes a method as described in clause 23 or clause 24, the method further comprising receiving, at the device, a next audio frame of the sequence from the first device, the next audio frame following the set of audio frames in the sequence, and the method further comprising transitioning, at the device, playback of the next audio frame from the second playback speed to the first playback speed.
[0186]
[0205] Clause 26 includes a method as described in any of clauses 23 to 25, the method further comprising storing the set of audio frames in a buffer, receiving at the device a next audio frame of the sequence from the first device, and storing the next audio frame in the buffer, where the next audio frame follows the set of audio frames in the sequence, and the method further comprises transitioning playback at the device from the second playback speed to the first playback speed in response to determining that fewer than a threshold number of audio frames of the sequence are stored in the buffer for playback.
[0187]
[0206] Clause 27 includes the method of any of clauses 23 to 26, wherein the second playback speed is based on a number of the set of audio frames.
[0188]
[0207] Clause 28 includes a method according to any of clauses 23 to 26, wherein a user request is received at the resume time and the second playback speed is based on a pause duration between the playback time of the last played audio frame and the resume time.
[0189]
[0208] Clause 29 includes a method as described in any of clauses 23 to 28, the method further comprising, in response to determining that the set of audio frames includes a silence frame, commencing playback of the silence frame on the device at a playback speed greater than the second playback speed.
[0190]
[0209] Clause 30 includes a method as described in any of clauses 23 to 29, wherein the first device includes a server, the call is to a plurality of second devices, and the sequence of audio frames is based on a plurality of sequences of audio frames received by the first device from the plurality of second devices.
[0191]
[0210] Particular aspects of the present disclosure are described below in a fifth set of interrelated clauses.
[0192]
[0211] According to clause 31, a non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to receive, during a phone call, a sequence of audio frames from a first device; in response to determining that an audio frame of the sequence has not been received for a threshold duration since a last received audio frame of the sequence, initiate sending a frame loss indication to the first device; in response to the frame loss indication, receive from the first device a set of audio frames of the sequence and an indication of a second playback speed; and initiate playback of the set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0193]
[0212] Clause 32 includes the non-transitory computer-readable medium of clause 31, wherein initiating playback of the set of audio frames at a second playback speed includes at least partially suppressing silence indicated by the set of audio frames.
[0194]
[0213] Particular aspects of the present disclosure are described below in a sixth set of interrelated clauses.
[0195]
[0214] According to clause 33, a non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to receive a sequence of audio frames from a first device during a phone call; and in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last-played audio frame in the sequence is available, begin playing the set of audio frames based on a second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0196]
[0215] Clause 34 includes the non-transitory computer-readable medium of clause 33, wherein initiating playback of the set of audio frames at a second playback speed includes at least partially suppressing silence indicated by the set of audio frames.
[0197]
[0216] Particular aspects of the present disclosure are described below in a seventh set of interrelated clauses.
[0198]
[0217] According to clause 35, the apparatus comprises means for receiving a sequence of audio frames from a first device during a call and means for initiating transmission of a frame loss indication to the first device, the transmission being initiated in response to determining that no audio frames of the sequence have been received for a threshold duration since a last received audio frame of the sequence, the apparatus further comprises means for receiving a set of audio frames of the sequence and an indication of a second playback speed from the first device, the set of audio frames and the indication being received in response to the frame loss indication, and the apparatus further comprises means for initiating playback of the set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0199]
[0218] Clause 36 includes the apparatus of clause 35, wherein the means for receiving the sequence, the means for initiating transmission of the frame loss indication, the means for receiving the set of audio frames, and the means for initiating playback are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a game console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or combinations thereof.
[0200]
[0219] Particular aspects of the present disclosure are described below in an eighth set of interrelated clauses.
[0201]
[0220] According to clause 37, the apparatus comprises means for receiving a sequence of audio frames from a first device during a call, and means for initiating playback of the set of audio frames based on a second playback speed, the playback being initiated in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last-played audio frame in the sequence is available, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0202]
[0221] Clause 38 includes the apparatus of clause 37, wherein the means for receiving and the means for initiating playback are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a game console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or combinations thereof.
[0203]
[0222] Particular aspects of the present disclosure are described below in a ninth set of interrelated clauses.
[0204]
[0223] According to clause 39, a communication device comprises one or more processors configured to: initiate transmission of a sequence of audio frames to a second device during a call; receive a frame loss indication from the second device; determine a last received audio frame of the sequence received by the second device based on the frame loss indication; and initiate transmission of the set of audio frames and an indication of a second playback speed of the set of audio frames to the second device based at least in part on determining that a set of audio frames following the last received audio frame in the sequence is available, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0205]
[0224] Clause 40 includes the device of clause 39, wherein the one or more processors are incorporated into a server.
[0206]
[0225] Clause 41 includes the device of clause 39 or clause 40, wherein the frame loss indication includes a request to re-transmit a previous audio frame corresponding to a particular playback duration at a first playback speed, and the one or more processors are configured to determine a last received audio frame based on the particular playback duration, and the one or more processors are configured to initiate transmission of the set of audio frames based at least in part on determining that the previous audio frame comprises the set of audio frames.
[0207]
[0226] Clause 42 includes the device of any of clauses 39 to 41, further comprising a buffer, and wherein the one or more processors are configured to receive a sequence of audio frames from the first device, and wherein transmission of the set of audio frames is initiated based at least in part on determining that the set of audio frames is available in the buffer.
[0208]
[0227] Clause 43 includes the device of any of clauses 39 to 42, wherein the one or more processors are further configured to simultaneously start transmitting a next audio frame in the sequence while transmitting the set of audio frames.
[0209]
[0228] Clause 44 includes the device of clause 43, wherein the next audio frame is associated with a transition to the first playback speed following playback of the set of audio frames at the second playback speed.
[0210]
[0229] Clause 45 includes the device of any of clauses 39 to 44, wherein the first set of audio frames precedes a last received audio frame in a sequence.
[0211]
[0230] Clause 46 includes a device described in any of clauses 39 to 45, wherein the one or more processors are configured to selectively initiate transmission of the set of audio frames in response to determining that the number of the set of audio frames is less than a threshold.
[0212]
[0231] Clause 47 includes the device of any of clauses 39 to 46, wherein the one or more processors are configured to determine the second playback speed based on the number of the set of audio frames.
[0213]
[0232] Clause 48 includes a device as described in any of clauses 39 to 47, wherein the one or more processors are configured to initiate transmission of a set of audio frames based at least in part on determining that a network link with the second device has been re-established.
[0214]
[0233] Clause 49 includes the device of any of clauses 39 to 48, wherein the set of audio frames includes silence frames, and the one or more processors are further configured to send an indication of a third playback speed for the silence frames, the third playback speed being greater than the second playback speed.
[0215]
[0234] Particular aspects of the present disclosure are described below in a tenth set of interrelated clauses.
[0216]
[0235] According to clause 50, a communication device includes one or more processors configured to: initiate transmission of a sequence of audio frames to a second device during a call; receive a frame loss indication from the second device; determine a last received audio frame of the sequence received by the second device based on the frame loss indication; and based at least in part on determining that a set of audio frames subsequent to the last received audio frame in the sequence is available, generate an updated set of audio frames based on the set of audio frames, such that a first playback speed of the updated set of audio frames corresponds to an effective second playback speed of the set of audio frames, the effective second playback speed being greater than the first playback speed.
[0217]
[0236] Clause 51 includes the device of clause 50, wherein the one or more processors are configured to generate an updated set of audio frames by selecting a subset of the set of audio frames such that the subset has the same playback duration at a first playback speed as the set of audio frames at a second playback speed.
[0218]
[0237] Clause 52 includes a device according to clause 50 or clause 51, wherein the one or more processors are integrated into a server.
[0219]
[0238] Clause 53 includes a device as described in any of clauses 50 to 52, wherein the frame loss indication includes a request to retransmit a previous audio frame corresponding to a particular playback duration at a first playback speed, and the one or more processors are configured to determine a last received audio frame based on the particular playback duration, and the one or more processors are configured to initiate transmission of an updated set of audio frames based at least in part on determining that the previous audio frame comprises a set of audio frames.
[0220]
[0239] Clause 54 includes the device of any of clauses 50 to 53, further comprising a buffer, and wherein the one or more processors are configured to receive a sequence of audio frames from the first device, and wherein transmission of the updated set of audio frames is initiated based at least in part on determining that the set of audio frames is available in the buffer.
[0221]
[0240] Clause 55 includes the device of any of clauses 50 to 54, wherein the one or more processors are further configured to simultaneously start transmitting a next audio frame in the sequence while transmitting the updated set of audio frames.
[0222]
[0241] Clause 56 includes a device described in any of clauses 50 to 55, wherein the one or more processors are configured to selectively initiate transmission of the set of audio frames in response to determining that the number of the updated set of audio frames is less than a threshold.
[0223]
[0242] Clause 57 includes the device of any of clauses 50 to 56, wherein the one or more processors are configured to determine an effective second playback speed based on the number of the set of audio frames.
[0224]
[0243] Clause 58 includes a device as described in any of clauses 50 to 57, wherein the one or more processors are configured to initiate transmission of an updated set of audio frames based at least in part on determining that a network link with the second device has been re-established.
[0225]
[0244] Clause 59 includes the device of any of clauses 50 to 58, wherein generating the updated set of audio frames includes suppressing at least a portion of silence indicated in the set of audio frames.
[0226]
[0245] Particular aspects of the present disclosure are described below in an eleventh set of interrelated clauses.
[0227]
[0246] According to clause 61, a method of communication comprises: initiating transmission of a sequence of audio frames from a first device to a second device during a call; receiving a frame loss indication at the first device from the second device; determining a last received audio frame of the sequence received by the second device based on the frame loss indication; and initiating transmission of the set of audio frames from the first device to the second device and an indication of a second playback speed of the set of audio frames based at least in part on determining that a set of audio frames following the last received audio frame in the sequence is available, the second playback speed being greater than a first playback speed of a first set of audio frames of the sequence.
[0228]
[0247] Clause 62 includes the method of clause 61, wherein the first device is integrated into the server.
[0229]
[0248] Particular aspects of the present disclosure are described below in a twelfth set of interrelated clauses.
[0230]
[0249] According to clause 63, a method of communication comprises: commencing transmission of a sequence of audio frames to a second device during a call; receiving a frame loss indication from the second device; determining a last received audio frame of the sequence received by the second device based on the frame loss indication; and based at least in part on determining that a set of audio frames subsequent to the last received audio frame in the sequence is available, generating an updated set of audio frames based on the set of audio frames such that a first playback speed of the updated set of audio frames corresponds to an effective second playback speed of the set of audio frames, the effective second playback speed being greater than the first playback speed.
[0231]
[0250] Clause 64 includes the method of clause 63, wherein generating the updated set of audio frames includes selecting a subset of the set of audio frames such that the subset has the same playback duration at the first playback speed as the set of audio frames at the second playback speed.
[0232]
[0251] Certain aspects of the present disclosure are described below in a thirteenth set of interrelated clauses.
[0233]
[0252] According to clause 65, a non-transitory computer-readable medium stores instructions that, when executed by one or more processors, cause the one or more processors to initiate transmission of a sequence of audio frames to a second device during a call; receive a frame loss indication from the second device; determine a last received audio frame of the sequence received by the second device based on the frame loss indication; and initiate transmission of the set of audio frames and an indication of a second playback speed of the set of audio frames to the second device based at least in part on determining that a set of audio frames following the last received audio frame in the sequence is available, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0234]
[0253] Clause 66 includes the non-transitory computer-readable storage medium of clause 65, wherein the one or more processors are incorporated into a server.
[0235]
[0254] Particular aspects of the present disclosure are described below in a fourteenth set of interrelated clauses.
[0236]
[0255] According to clause 67, a non-transitory computer-readable storage medium stores instructions that, when executed by one or more processors, cause the one or more processors to initiate transmission of a sequence of audio frames to a second device during a call; receive a frame loss indication from the second device; determine a last received audio frame of the sequence received by the second device based on the frame loss indication; and based at least in part on determining that a set of audio frames following the last received audio frame in the sequence is available, generate an updated set of audio frames based on the set of audio frames such that a first playback speed of the updated set of audio frames corresponds to an effective second playback speed of the set of audio frames, the effective second playback speed being greater than the first playback speed.
[0237]
[0256] Clause 68 includes the non-transitory computer-readable storage medium of clause 67, wherein generating the updated set of audio frames includes selecting a subset of the set of audio frames such that the subset has the same playback duration at the first playback speed as the set of audio frames at the second playback speed.
[0238]
[0257] Particular aspects of the present disclosure are described below in a fifteenth set of interrelated clauses.
[0239]
[0258] According to clause 69, an apparatus comprises means for initiating transmission of a sequence of audio frames to a second device during a call; means for receiving a frame loss indication from the second device; means for determining a last received audio frame of the sequence received by the second device based on the frame loss indication; and means for initiating transmission of the set of audio frames and an indication of a second playback speed of the set of audio frames to the second device, the transmission being initiated based at least in part on determining that a set of audio frames following a last received audio frame in the sequence is available, the second playback speed being greater than the first playback speed of the first set of audio frames of the sequence.
[0240]
[0259] Clause 70 includes the apparatus of clause 69, wherein the means for initiating transmission of the sequence of audio frames, the means for determining, and the means for initiating transmission of the set of audio frames and the indication are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a game console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or combinations thereof.
[0241]
[0260] Particular aspects of the present disclosure are described below in a sixteenth set of interrelated clauses.
[0242]
[0261] According to clause 71, the apparatus includes means for initiating transmission of a sequence of audio frames to a second device during a call; means for receiving a frame loss indication from the second device; means for determining a last received audio frame of the sequence received by the second device based on the frame loss indication; and means for generating an updated set of audio frames based on the set of audio frames such that a first playback speed of the updated set of audio frames corresponds to an effective second playback speed of the set of audio frames, wherein the updated set of audio frames is generated based at least in part on determining that a set of audio frames following the last received audio frame in the sequence is available, and the effective second playback speed is greater than the first playback speed.
[0243]
[0262] Clause 72 includes the apparatus of clause 71, wherein the means for initiating transmission of the sequence of audio frames, the means for receiving a frame loss indication, the means for determining, and the means for generating an updated set of audio frames are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a game console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or combinations thereof.
[0244]
[0263] Those skilled in the art will further appreciate that the various exemplary logic blocks, configurations, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software executed by one or more processors, or a combination of both. Various exemplary components, blocks, configurations, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or as processor-executable instructions depends on the particular application and design constraints imposed on the overall system. Those skilled in the art will appreciate that the described functionality can be implemented in various ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.
[0245]
[0264] The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, as a software module executed by one or more processors, or as a combination of the two. The software module may reside in a random access memory (RAM), a flash memory, a read only memory (ROM), a programmable read only memory (PROM), an erasable programmable read only memory (EPROM), an electrically erasable programmable read only memory (EEPROM), a register, a hard disk, a removable disk, a compact disk read only memory (CD-ROM), or any other form of non-transitory storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in a computing device or a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a computing device or a user terminal.
[0246]
[0265] The previous description of the disclosed aspects is presented to enable any person skilled in the art to make or use the disclosed aspects. Various modifications to these aspects will be readily apparent to those skilled in the art, and the principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. The present disclosure is not intended to be limited to the aspects shown herein, but is to be accorded the widest possible scope consistent with the principles and novel features defined by the appended claims.
Claims
1. A communication device, comprising: one or more processors, the one or more processors comprising: During a call, receiving a first set of audio frames of a sequence of audio frames from a first device; initiating transmission of a frame loss indication to the first device in response to determining that no audio frames of the sequence have been received for a threshold duration since a last received audio frame of the sequence; receiving from the first device a second set of audio frames of the sequence and an indication of a second playback speed in response to the frame loss indication; commencing playback of the second set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than the first playback speed of the first set of audio frames; A device for communication configured to:
2. The one or more processors further comprise: configured to receive a next audio frame in the sequence from the first device simultaneously with receiving the set of audio frames from the first device; The device of claim 1 , wherein the next audio frame follows the set of audio frames of the sequence.
3. the one or more processors are configured to determine, at a particular point in time, that an audio frame corresponding to a particular playback duration at the first playback speed has not been received since a last received audio frame; the particular play duration is based on the particular time point and the reception time point of the last received frame; the frame loss indication comprises a request to retransmit a previous audio frame corresponding to the particular playback duration at the first playback speed. The device of claim 1 .
4. The device of claim 1 , wherein the frame loss indication indicates the last received audio frame.
5. 1. A method of communication comprising: During a call, receiving, at the device, a sequence of audio frames from a first device; initiating transmission of a frame loss indication from the device to the first device in response to determining that no audio frames of the sequence have been received at the device for a threshold duration since a last received audio frame of the sequence; receiving, at the device, from the first device, a set of audio frames of the sequence and an indication of a second playback speed in response to the frame loss indication; commencing playback of the set of audio frames through a speaker based on the second playback speed, the second playback speed being greater than a first playback speed of a first set of audio frames of the sequence; A method comprising:
6. the first device includes a server, and the call is with a plurality of second devices; the sequence of audio frames is based on a plurality of sequences of audio frames received by the first device from the plurality of second devices; or the call is conducted between the device and a single additional device, the single additional device including the first device; The method according to claim 5.
7. A communication device, comprising: one or more processors, the one or more processors comprising: During a call, Receiving a sequence of audio frames from a first device; in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last-played audio frame in the sequence is available, commencing playback of the set of audio frames based on a second playback speed, the second playback speed being greater than a first playback speed of a first set of audio frames of the sequence; A device for communication configured to:
8. The device of claim 1 or 7, wherein initiating playback of the set of audio frames at the second playback speed includes at least partially suppressing silence indicated by the set of audio frames.
9. The one or more processors further comprise: receiving a next audio frame of the sequence from the first device, the next audio frame following the set of audio frames in the sequence; transitioning the playback of the next audio frame from the second playback speed to the first playback speed; The device of claim 1 or 7, configured to:
10. The one or more processors further comprise: storing said set of audio frames in a buffer; receiving a next audio frame of the sequence from the first device and storing the next audio frame in the buffer, the next audio frame following the set of audio frames in the sequence; transitioning playback from the second playback speed to the first playback speed in response to determining that fewer than a threshold number of audio frames of the sequence are stored in the buffer for playback; The device of claim 1 or 7, configured to:
11. The device of claim 1 or 7, wherein the second playback speed is based on a number of the set of audio frames.
12. The user request is received at a restart point; The device of claim 7 , wherein the second playback speed is based on a pause duration between a playback time of the last played audio frame and the resume time.
13. 8. The device of claim 1 or 7, wherein the one or more processors are configured, in response to determining that the set of audio frames includes a silence frame, to begin playback of the silence frame at a playback speed greater than the second playback speed.
14. 8. The device of claim 1 or 7, wherein the one or more processors are incorporated into at least one of a virtual assistant, a home appliance, a smart device, an Internet of Things (IoT) device, a communications device, a computer, a display device, a television, a game console, a music player, a radio, a video player, an entertainment unit, a personal media player, a digital video player, a camera, a navigation device, a headset, or a combination thereof.
15. 1. A method of communication comprising: During a call, receiving, at the device, a sequence of audio frames from a first device; in response to receiving a user request to resume playback and determining that a set of audio frames subsequent to a last-played audio frame in the sequence is available, commencing playback of the set of audio frames on the device at at least a second playback speed, the second playback speed being greater than a first playback speed of a first set of audio frames of the sequence; A method comprising:
