Audio transmission methods, audio sending, receiving and transmitting devices and computer media
By having the audio receiving device automatically determine and decrypt the key to join the broadcast synchronization group, the problem of slow speed and low security in Bluetooth multi-device teaming is solved, and a fast and secure teaming process is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-09-21
- Publication Date
- 2026-03-10
AI Technical Summary
In Bluetooth 5.2 and above, when multiple audio receiving devices join a broadcast synchronization group, there is connection contention, which affects the grouping speed. Furthermore, the existing technology requires requesting a key, which makes grouping insecure.
The audio receiving device determines whether the broadcast synchronization group includes the encrypted stream by receiving the description information, obtains and decrypts the key without request, and the audio sending device broadcasts the description information and the key to join the group.
It improves team formation speed, enhances team formation security, avoids connection contention, and enables an encrypted team formation process that does not require requesting a key.
Smart Images
Figure CN115550909B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of wireless communication, in particular to an audio transmission method, an audio sending, receiving and transmitting device and a computer medium. BACKGROUND
[0002] Bluetooth is a short-range wireless communication technology that enables data exchange between fixed devices and / or mobile devices. Currently, Bluetooth technology has been widely used in the fields of audio (e.g., Bluetooth earphones, Bluetooth / smart sound boxes, Bluetooth hearing aids, etc.), data, positioning and control systems, etc.
[0003] The classic Bluetooth adopts a point-to-point communication mode, which limits people's demand for audio sharing. The latest Bluetooth 5.2 and above versions introduce broadcast synchronous group (BIG: Broadcast Isochronous Group) and broadcast synchronous stream (BIS: Broadcast Isochronous Stream) technologies to realize point-to-multipoint audio transmission, i.e., multiple and independent data stream transmission between a single audio broadcast device (or interchangeably referred to as a source device) and one or more audio receiving devices (or interchangeably referred to as a sink device).
[0004] In Bluetooth 5.2 and above versions, BIS teaming to join BIG is realized through two roles related to broadcast auxiliary scanning functions—broadcast assistant and scan delegator. For example, when the BIG or one or more BIS in the BIG is encrypted, a secret key (e.g., broadcast_code) needs to be obtained, which requires a scan delegator (e.g., implemented at the sink device) to notify a broadcast assistant (e.g., at least one broadcast assistant is implemented at the source device) of a secret key request (e.g., broadcast_code required request) to realize the sink device joining the BIG created by the source device, for example, through the BIG_Encryption field in the broadcast receive state (see Bluetooth standard document "Broadcast Audio Scan Service 1.0", September 14, 2021).
[0005] However, for the scenario of multiple sink devices, there is a problem of connection competition, which affects the speed of BIS teaming. SUMMARY
[0006] The purpose of the present disclosure is to overcome the above-mentioned defects in the prior art, and provide an audio transmission method, an audio sending, receiving and transmitting device and a computer medium.
[0007] According to a first aspect of the disclosure, an audio transmission method is provided for an audio receiving device, the method comprising: receiving, via a Bluetooth network, information broadcast by an audio sending device for describing broadcast synchronization streams in a broadcast synchronization group; based on the information, determining whether the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams; if it is determined that the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams, obtaining a first secret key for decrypting at least one encrypted broadcast synchronization stream without requesting the first secret key from the audio sending device, wherein the first secret key is encrypted; decrypting the encrypted first secret key to join the broadcast synchronization group.
[0008] In some embodiments, based on the information, determining whether the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams comprises: based on at least one of evaluating a length of the information, a parameter included in the information, or a value range of a parameter included in the information, determining whether the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams.
[0009] In some embodiments, obtaining the first secret key for decrypting at least one encrypted broadcast synchronization stream comprises at least one of: receiving, via the Bluetooth network, a message including the first secret key broadcast by the audio sending device; obtaining the first secret key in an out-of-band manner.
[0010] In some embodiments, the method further comprises: obtaining a second secret key for decrypting the first secret key; and decrypting the encrypted first secret key to join the broadcast synchronization group comprises: using the second secret key to decrypt the encrypted first secret key to join the broadcast synchronization group.
[0011] In some embodiments, obtaining the second secret key for decrypting the first secret key comprises at least one of: obtaining the second secret key from a storage device associated with the audio receiving device; obtaining the second secret key in an out-of-band manner.
[0012] In some embodiments, the method further comprises: receiving, via the Bluetooth network, the at least one encrypted broadcast synchronization stream; using the first secret key to decrypt the broadcast synchronization stream; when detecting an audio data packet in a sub-event of the decrypted broadcast synchronization stream, parsing the audio data packet to generate audio data; playing the audio data.
[0013] In some embodiments, the method further comprises: obtaining, from the decrypted broadcast synchronization stream, time information for synchronously playing the audio data; and playing the audio data comprises: based on the time information, playing the audio data synchronously with the audio sending device.
[0014] In some embodiments, the method further includes: obtaining, from the decrypted broadcast synchronization stream, control information for synchronously playing the audio data, the control information being related to a buffer of the audio sending device for buffering audio data packets; adjusting, based on the control information, a playing parameter of playing the audio data; and playing the audio data includes playing, based on the time information and the adjusted playing parameter, the audio data synchronously with the audio sending device.
[0015] According to a second aspect of the present disclosure, an audio transmission method is provided for an audio sending device, the method comprising: obtaining a first audio data packet; creating a broadcast synchronization group comprising a broadcast synchronization stream; broadcasting, via a Bluetooth network, information for describing the broadcast synchronization stream in the broadcast synchronization group, wherein the information indicates that the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams; broadcasting, via the Bluetooth network, a message comprising a first secret key for decrypting at least one encrypted broadcast synchronization stream, wherein the first secret key is included in an encrypted part of the message; and broadcasting, via the Bluetooth network, the first audio data packet through the at least one encrypted broadcast synchronization stream.
[0016] In some embodiments, the information has at least one of a variable information length, a variable parameter, or a variable parameter value.
[0017] In some embodiments, obtaining the first audio data comprises: obtaining, at the audio sending device, the first audio data packet locally.
[0018] In some embodiments, obtaining the first audio data packet comprises: obtaining, from a computing device separate from the audio sending device, a second audio data packet transmitted by the computing device based on an audio transmission protocol; parsing the second audio data packet to obtain second audio data; encoding the second audio data to obtain the first audio data packet based on a Bluetooth transmission protocol supported by the audio sending device, wherein the Bluetooth transmission protocol is different from the audio transmission protocol of the computing device.
[0019] In some embodiments, broadcasting the first audio data packet via the Bluetooth network is based on a Bluetooth Low Energy audio transmission protocol supported by the audio sending device.
[0020] In some embodiments, the method further includes: determining time information for synchronously playing first audio corresponding to the first audio data packet; and broadcasting, via the Bluetooth network, the time information through the at least one broadcast synchronization stream.
[0021] In some embodiments, the method further comprises: determining control information for synchronously playing the first audio; and broadcasting, via the Bluetooth network, the control information through the at least one broadcasted synchronization stream, the control information being related to a buffer of the audio transmitting device for buffering audio data packets.
[0022] According to a third aspect of the present disclosure, there is provided an audio receiving device, comprising: a receiving module configured to receive, via a Bluetooth network, information broadcasted by an audio transmitting device for describing broadcasted synchronization streams in a broadcasted synchronization group; a determining module configured to determine, based on the information, whether the broadcasted synchronization group comprises one or more encrypted broadcasted synchronization streams; an obtaining module configured to obtain, if it is determined that the broadcasted synchronization group comprises one or more encrypted broadcasted synchronization streams, a first secret key for decrypting at least one encrypted broadcasted synchronization stream without requesting the first secret key from the audio transmitting device, wherein the first secret key is encrypted; and a decrypting module configured to decrypt the encrypted first secret key to join the broadcasted synchronization group.
[0023] According to a fourth aspect of the present disclosure, there is provided an audio transmitting device, comprising: an obtaining module configured to obtain a first audio data packet; a creating module configured to create a broadcasted synchronization group comprising a broadcasted synchronization stream; and a broadcasting module configured to: broadcast, via a Bluetooth network, information for describing broadcasted synchronization streams in a broadcasted synchronization group, wherein the information indicates that the broadcasted synchronization group comprises one or more encrypted broadcasted synchronization streams; broadcast, via the Bluetooth network, a message comprising a first secret key for decrypting at least one encrypted broadcasted synchronization stream, wherein the first secret key is included in an encrypted part of the message; and broadcast, via the Bluetooth network, the first audio data packet through the at least one encrypted broadcasted synchronization stream.
[0024] According to a fifth aspect of the present disclosure, there is provided an audio transmitting device, comprising: at least one processor; and a memory storing computer-executable instructions that, when executed, cause the at least one processor to perform the audio transmitting method according to the first aspect or the second aspect.
[0025] According to a sixth aspect of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer-executable instructions for performing the audio transmitting method according to the first aspect or the second aspect.
[0026] The audio transmission method, the audio sending, receiving and device and the computer medium according to the present disclosure can join a broadcast synchronization group without requesting a key for a broadcast synchronization stream from an audio sending device, avoiding the problem that the queuing speed of the broadcast synchronization stream is affected by the connection competition when multiple audio receiving devices join the broadcast synchronization group via a Bluetooth network, thereby improving the queuing speed and providing queuing security. BRIEF DESCRIPTION OF DRAWINGS
[0027] Other features and advantages of the present disclosure will be better understood through the following preferred embodiments described in detail in conjunction with the accompanying drawings, wherein the same reference signs represent the same or similar components.
[0028] Figure 1 An exemplary audio transmission system according to embodiments of the present disclosure is shown.
[0029] Figure 2 Another exemplary audio transmission system according to embodiments of the present disclosure is shown.
[0030] Figure 3 A flowchart of an exemplary audio transmission method for an audio receiving device according to embodiments of the present disclosure is shown.
[0031] Figure 4 Exemplary information according to embodiments of the present disclosure is shown.
[0032] Figure 5 An exemplary broadcast synchronization group including a broadcast synchronization stream according to embodiments of the present disclosure is shown.
[0033] Figure 6 An exemplary broadcast synchronization stream included in a broadcast synchronization group according to embodiments of the present disclosure is shown. Figure 5
[0034] Figure 7 An exemplary message for key transmission according to embodiments of the present disclosure is shown.
[0035] Figure 8 A flowchart of an exemplary audio transmission method for an audio sending device according to embodiments of the present disclosure is shown.
[0036] Figure 9 A block diagram of an exemplary audio receiving device according to embodiments of the present disclosure is shown.
[0037] Figure 10 A block diagram of an exemplary audio sending device according to embodiments of the present disclosure is shown.
[0038] Figure 11 A block diagram of an exemplary audio transmission device according to embodiments of the present disclosure is shown. DETAILED DESCRIPTION
[0039] To enable those skilled in the art to better understand the technical solutions of this disclosure, the disclosure will be further described in detail below with reference to the accompanying drawings and specific embodiments, but this is not intended to limit the disclosure. The various embodiments in this disclosure can be independent embodiments or combined with other embodiments in this disclosure, and this disclosure does not limit them in this way.
[0040] Figure 1 An exemplary audio transmission system 100 according to an embodiment of this disclosure is illustrated. System 100 includes an audio transmitting device 110 and a plurality of audio receiving devices 120-1 to 120-m, 130-1 to 130-n. The audio transmitting device 110 communicates with these audio receiving devices via a Bluetooth network 140. Figure 1 As shown, the audio transmitting device 110 creates a first BIG 150-1 and a second BIG 150-2. The first BIG 150-1 includes a plurality of (e.g., m) BIS (BIS 1, ..., BIS m) for a plurality of audio receiving devices 120-1 to 120-m, and the second BIG 150-2 includes a plurality of (e.g., n) BIS (BIS 1, ..., BIS n) for a plurality of audio receiving devices 130-1 to 130-n. For example, at least one BIS in at least one of the first BIG 150-1 and the second BIG 150-2 is encrypted, and the audio transmitting device 110 broadcasts at least one encrypted BIS via the Bluetooth network 140. The audio transmitting device 110 also broadcasts information describing the BIS in the BIG via the Bluetooth network 140, so that the audio receiving device (e.g., any of 120-1 to 120-m, 130-1 to 130-n) can determine whether the BIG includes one or more encrypted BIS based on the description information. Figure 1 In one embodiment, an audio data packet (e.g., a first audio data packet) is locally acquired at the audio transmitting device 110 and broadcast via the at least one encrypted BIS through the Bluetooth network 140.
[0041] Figure 2 An exemplary audio transmission system 200 according to an embodiment of this disclosure is shown. Unlike system 100, the audio transmitting device 110 in system 200 does not locally acquire the first audio data packet. Instead, it generates the first audio data packet by acquiring a second audio data packet transmitted by the computing device based on an audio transmission protocol from a computing device separate from the audio transmitting device (e.g., from a first computing device 160-1 via wireless connection 170, or from a second computing device 160-2 via wired connection 180), and broadcasts the generated first audio data packet via at least one encrypted BIS broadcast through Bluetooth network 140. Figure 2The scenario can also be referred to as Multi-stream Bluetooth Relay Technology (MBRT), in which the audio sending device 110 acts as an MBRT source device by obtaining an audio source through Bluetooth or connecting to the Internet, etc. The audio sending device 110 locally plays the audio source data and broadcasts the audio source data through BIS. Within the signal coverage range, multiple audio receiving devices (e.g., 120-1~120-m, 130-1~130-n) acting as MBRT sink devices can be synchronized with the audio sending device acting as an MBRT source device to play the audio source data.
[0042] Figure 3 A flowchart of an example audio transmission method 300 for an audio receiving device according to embodiments of the present disclosure is shown. The method 300 can be implemented by any one of Figure 1 or Figure 2 an audio receiving device, Figure 9 an example audio receiving device 900, or Figure 11 an example audio transmission device 1100. As shown in Figure 3 , the method 300 includes steps 302~308.
[0043] At step 302, information (or referred to as description information) describing the BIS in the BIG broadcasted by the audio sending device is received via the Bluetooth network. For example, Figure 1 or Figure 2 The audio receiving device 120-1 in
[0044] At step 304, it is determined whether the BIG includes one or more encrypted BIS based on the received description information. For example, Figure 1 or Figure 2 The audio receiving device 120-1 in
[0045] At step 306, if it is determined that the BIG includes one or more encrypted BIS, a first secret key for decrypting at least one encrypted BIS is obtained without requesting the first secret key from the audio sending device, wherein the first secret key is encrypted. For example, if Figure 1 or Figure 2If the audio receiving device 120-1 in the BIG 150-1 determines that the first BIG 150-1 includes one or more encrypted BISs, the audio receiving device 120-1 acquires the first secret key (e.g., broadcast_code) used to decrypt at least one encrypted BIS without requesting the first secret key from the audio sending device 110 (e.g., through a broadcast_code required request).
[0046] At step 308, the encrypted first secret key is decrypted to join the BIG. For example, Figure 1 or Figure 2 The audio receiving device 120-1 in the BIG 150-1 decrypts the encrypted first secret key to join the first BIG 150-1. For example, the first secret key is broadcast_code, which is used to generate a group session key (GSK, group session key) used in the final broadcast link encryption, that is, the broadcast_code provides an access mechanism, only authorized listeners can decode a specific broadcast audio stream to join the BIG.
[0047] Compared with the prior art, the audio receiving device of the present disclosure can join the BIG without requesting the secret key for the BIS from the audio sending device, avoiding the problem that the connection competition exists when multiple audio receiving devices join the BIG via the Bluetooth network, which affects the teaming speed of the BIS, thereby improving the teaming speed and providing teaming security by encrypting the secret key.
[0048] In some examples, step 304 can include determining whether the BIG includes one or more encrypted BISs based on at least one of a length of the description information, a parameter included in the description information, or a value range of the parameter included in the description information. This will be described in detail below in connection with Figure 4 .
[0049] Figure 4An example description information 400 according to embodiments of the present disclosure is shown. The description information 400 can include a header 402 and a payload 404. For example, the payload 404 can include an optional field 406 (e.g., placed at the tail or other location) so as to have a variable length, when the payload 404 has the field 406 filled, the information 400 has a first length, when the payload 404 does not have the field 406 filled, the information 400 has a second length smaller than the first length, for example, the first length can indicate that the BIG includes one or more encrypted BISs, the second length can indicate that the BIG does not include one or more encrypted BISs, or vice versa. To facilitate the evaluation of the length of the information 400, the optional field 406 can be unencrypted, for example, in plaintext. For example, the payload 404 can include a parameter 408, which can directly indicate whether the BIG includes one or more encrypted BISs, or indicate whether the BIG includes one or more encrypted BISs by the range of the value of the parameter.
[0050] In some examples, the method 300 can further include obtaining a second key for decrypting the first key. And, the step 308 can include decrypting the encrypted first key using the second key to join the BIG.
[0051] Further, the obtaining the second key for decrypting the first key can include at least one of: obtaining the second key from a storage device associated with the audio receiving device; obtaining the second key in an out-of-band manner. For example, the storage device associated with the audio receiving device can include, but not limited to, a storage device (e.g., a memory) integrated in the audio receiving device, a storage device (e.g., a database or a cloud device) communicatively connected with the audio receiving device, and the like. For example, the out-of-band manner can include, but not limited to, scanning a graphic code (e.g., a QR code), NFC (Near Field Communication) or other proximity technology, obtaining the second key through a certificate issued by an authoritative CA (Certificate Authority) authority, and the like, instead of obtaining the second key in-band via the Bluetooth network.
[0052] In some examples, the method 300 can further include receiving the at least one encrypted BIS via the Bluetooth network; decrypting the BIS using the first key; when detecting an audio data packet in a sub-event of the decrypted BIS, parsing the audio data packet to generate audio data; and playing the audio data. The above will be described in detail in connection with Figure 5 and Figure 6 .
[0053] Figure 5 An example BIG 500 including BISs according to embodiments of the present disclosure is shown. The BIG 500 includes m BISs (e.g., for m = 3, as shown in FIG. 5). Figure 1BIS 1,..., BIS m) of the plurality of audio receiving devices. Figure 6 FIG. 1 shows an example BIG including a plurality of BISs i,..., i, according to an embodiment of the present disclosure. Figure 5 FIG. 1 shows an example BIG including a plurality of BISs i,..., i, according to an embodiment of the present disclosure.
[0054] In some examples, the method 300 can further include obtaining, from the decrypted BIS, time information for synchronously playing the generated audio data, and playing the audio data synchronously with the audio sending device based on the time information. For example, the time information (e.g., a timestamp) can indicate or be used to generate a time instant (e.g., a start time instant or an end time instant, or referred to as a synchronous play point) on a time axis to play the audio data, such that both the audio sending device and the audio receiving device play the audio data at the indicated time instant (i.e., synchronously).
[0055] In some examples, the method 300 can further include obtaining, from the decrypted BIS, control information for synchronously playing the audio data, the control information being related to a buffer of the audio sending device for buffering the audio data packets; adjusting a play parameter for playing the audio data based on the control information; and playing the audio data synchronously with the audio sending device based on the time information and the adjusted play parameter. For example, the control information can be related to a usage status (e.g., a remaining available size or proportion) of the buffer of the audio sending device for buffering the audio data packets, and the usage status of the buffer is changed (empty, low usage, medium usage, high usage, near full, full, etc.) by setting the control information. For example, when the usage status of the buffer is not enough (e.g., which can cause audio stuttering), the control information can be set such that the audio sending device and the receiving device adjust the play parameter based on the control information, so as to dynamically adjust the played sample values according to the adjusted play parameter (e.g., a faster or slower play speed, a shorter play duration, etc.) at the synchronous play point. By passing the control information between the sending end and the receiving end, the synchronous playing of the audio data can be dynamically adjusted, so as to avoid audio playing problems (e.g., audio stuttering) caused by the usage status of the buffer being not enough. For example, when the audio data to be played in the buffer is less than a predetermined value, the audio can be played slower by adjusting the play parameter (e.g., reducing the sampling rate of playing the audio), so as to reduce the audio stuttering.
[0056] In some examples, obtaining the first secret key for decrypting the at least one encrypted BIS in step 306 can include at least one of: receiving a message including the first secret key broadcasted by the audio transmitting device via a Bluetooth network; obtaining the first secret key in an out-of-band manner. The receiving of the message including the first secret key broadcasted by the audio transmitting device via the Bluetooth network is described in detail below in connection with Figure 7
[0057] Figure 7 An exemplary (advertising, AD) message 700 for secret key transmission is shown according to embodiments of the present disclosure. The message 700 can include a plurality of advertising structures (ADs) 701-703 with substantive content and a padding structure 704 with non-substantive content (e.g., for byte alignment, etc.). Taking AD 1 as an example, the AD 1 701 can include a header 710 indicating a length and a valid data payload 711. The valid data payload 711 includes an AD type field 720 and an AD data field 721, when the AD type field 720 indicates a secret key, the AD data field 721 can include the secret key (e.g., the first secret key), and at least a portion of the AD data field 721 is encrypted such that the secret key is included in the encrypted portion of the AD data field 721. Thus, the audio receiving device can obtain the first secret key, for example, by receiving a message such as the advertising message 700 broadcasted by the audio transmitting device via a Bluetooth network.
[0058] In some examples, obtaining the first secret key in an out-of-band manner can include, but is not limited to, scanning a QR code (e.g., a QR code), NFC (near field communication) or other proximity technology, through a certificate issued by an authoritative CA (Certificate Authority) authority, etc. to obtain the first secret key, rather than obtaining the first secret key in-band via a Bluetooth network.
[0059] Figure 8 A flowchart of an exemplary audio transmission method 800 for an audio transmitting device is shown according to embodiments of the present disclosure. The method 800 can be implemented by any one of the audio transmitting device 110 of Figure 1 or Figure 2 the exemplary audio transmitting device 1000 of Figure 10 or Figure 11 the exemplary audio transmitting device 1100. As shown in Figure 8 , the method 800 includes steps 802-810.
[0060] In step 802, a first audio data packet is obtained. As described above in connection with Figure 1 and Figure 2 , the audio transmitting device 110 can obtain the first audio data packet.
[0061] At step 804, a BIG including the BIS is created. As described above in connection with Figure 1 and Figure 2 The audio sending device 110 can create a BIG (e.g., the first BIG 150-1, the second BIG 150-2) including a plurality of BISs for a plurality of audio receiving devices.
[0062] At step 806, description information for describing the BIS in the BIG is broadcasted via the Bluetooth network, wherein the description information indicates that the BIG includes one or more encrypted BISs. As described above in connection with Figure 1 and Figure 2 The audio sending device 110 broadcasts the description information for describing the BIS in the BIG via the Bluetooth network 140, which can indicate that the BIG includes one or more encrypted BISs.
[0063] At step 808, a transmission message including a first secret key for decrypting at least one encrypted BIS is broadcasted via the Bluetooth network, wherein the first secret key is included in an encrypted part of the transmission message. As described above in connection with Figure 1 , Figure 3 and Figure 7 The audio sending device 110 can broadcast a transmission message (e.g., the message 700) including a first secret key for decrypting at least one encrypted BIS via the Bluetooth network 140, wherein the first secret key is included in an encrypted part of the message.
[0064] At step 810, a first audio data packet is broadcasted via the Bluetooth network by at least one encrypted BIS. As described above in connection with Figure 1 , Figure 3 , Figure 5 and Figure 6 The audio sending device 110 can broadcast a first audio data packet via the Bluetooth network 140 by delivering the first audio data packet in a sub-event in at least one encrypted BIS.
[0065] Compared with the prior art, the audio sending device of the present disclosure can directly provide a secret key to an audio receiving device to join a BIG without the need for the audio receiving device to request the secret key for the BIS from the audio sending device, avoiding the problem that the connection competition when a plurality of audio receiving devices join the BIG via the Bluetooth network affects the teaming speed of the BIS, thereby improving the teaming speed and providing teaming security by encrypting the secret key.
[0066] In some examples, the description information has at least one of a variable information length, a variable parameter, or a variable parameter value. For example, the description information can be an example message 400 as described above in connection with Figure 4 .
[0067] In some examples, step 802 can include obtaining, from a computing device separate from the audio transmitting device, a second audio data packet transmitted by the computing device based on an audio transmission protocol; parsing the second audio data packet to obtain second audio data; and encoding the second audio data to obtain the first audio data packet based on a Bluetooth transmission protocol supported by the audio transmitting device, wherein the Bluetooth transmission protocol is different from the audio transmission protocol of the computing device. As described above in connection with Figure 2 As described, the audio transmitting device 110 can obtain, from a computing device separate from the audio transmitting device (e.g., from a first computing device 160-1 over a wireless connection 170 (e.g., a Bluetooth connection), or from a second computing device 160-2 over a wired connection 180 (e.g., a wired network connection to the cloud)), a second audio data packet transmitted by the computing device based on an audio transmission protocol, parse the second audio data packet to obtain second audio data; and encode (e.g., L3 encode) the second audio data to obtain the first audio data packet based on a Bluetooth transmission protocol (e.g., Bluetooth LE Audio) supported by the audio transmitting device, wherein the Bluetooth transmission protocol is different from the audio transmission protocol of the computing device (e.g., an audio transmission protocol of classic Bluetooth or an audio transmission protocol of a wired manner). In some cases, parsing the second audio data packet can include decoding (i.e., decompressing audio encoded) the second audio data packet to obtain the second audio data. Similarly, “parsing an audio data packet” as described elsewhere in this application can include decoding (i.e., decompressing audio encoded) the audio data packet to obtain the audio data. For example, an LC3 encoded audio data packet can be decoded to obtain the audio data.
[0068] In some examples, step 810 can be based on a Bluetooth Low Energy Audio transmission protocol (Bluetooth LE Audio) supported by the audio transmitting device.
[0069] In some examples, the method 800 can further include determining time information for synchronously playing the first audio corresponding to the first audio data packet; and broadcasting, via the Bluetooth network, the time information over the at least one BIS. For example, the audio transmitting device 110 can determine time information that indicates or is used to generate a time instant (e.g., a start time instant or an end time instant, or referred to as a synchronous play point) on a timeline to play the audio data, such that both the audio transmitting device and the audio receiving device play the audio data at the indicated time instant (i.e., synchronously). And, the audio transmitting device 110 can communicate the time information in each audio data frame in the BIS for reception by the audio receiving device.
[0070] In some examples, the method 800 can further include determining control information for synchronously playing the first audio, the control information being related to a buffer of the audio sending device for buffering the audio data packets; and broadcasting, via the Bluetooth network, the control information by the at least one BIS. As described above in connection with the method 300, the audio sending device can change the occupancy status (empty, low occupancy, medium occupancy, high occupancy, near full, full, etc.) of the audio data packets in the buffer by setting the control information. For example, when the usage status of the buffer is not enough (e.g., which can cause audio stuttering), the control information can be set so that the audio sending device and the receiving device adjust the playing parameters based on the control information, so as to dynamically adjust the playing sample values according to the adjusted playing parameters (e.g., faster or slower playing speed, shorter playing time, etc.) at the synchronization playing point. For example, when the audio data to be played in the buffer is less than a predetermined value, the audio can be played slower by adjusting the playing parameters (e.g., reducing the sampling rate of the played audio), so as to reduce the audio stuttering.
[0071] Figure 9 A block diagram of an example audio receiving device 900 according to embodiments of the present disclosure is shown. The audio receiving device 900 can be an audio receiving device (e.g., any of 120-1 ~ 120-m, 130-1 ~ 130-n) and be adapted to perform any of the steps in the audio transmission method 300 for the audio receiving device as described above. Figure 1 or Figure 2 The audio receiving device 900 is adapted to perform any of the steps in the audio transmission method 300 for the audio receiving device as described above. Figure 9 As shown, the audio receiving device 900 includes a receiving module 910, a determining module 920, an obtaining module 930, and a decrypting module 940.
[0072] The receiving module 910 is configured to receive, via the Bluetooth network, the information broadcast by the audio sending device for describing the BIS in the BIG.
[0073] The determining module 920 is configured to determine, based on the information, whether the BIG includes one or more encrypted BISs.
[0074] The obtaining module 930 is configured to, if it is determined that the BIG includes the encrypted one or more BISs, obtain a first secret key for decrypting the at least one encrypted BIS without requesting the first secret key from the audio sending device, wherein the first secret key is encrypted.
[0075] The decrypting module 940 is configured to decrypt the encrypted first secret key to join the BIG.
[0076] Further, the receiving module 910 can also be configured to perform other processes as described above in connection with step 302 of the method 300, which will not be described in detail.
[0077] Further, the determining module 920 can be further configured to perform other procedures as described above in relation to step 304 of the method 300, which are not described in detail again.
[0078] Further, the obtaining module 930 can be further configured to perform other procedures as described above in relation to step 306 of the method 300, which are not described in detail again.
[0079] Further, the decrypting module 940 can be further configured to perform other procedures as described above in relation to step 308 of the method 300, which are not described in detail again.
[0080] Further, the audio receiving device 900 can further include additional modules configured to perform additional procedures as described above in relation to additional steps of the method 300, which are not described in detail again.
[0081] Figure 10 A block diagram of an exemplary audio transmitting device 1000 according to an embodiment of the present disclosure is shown. The audio transmitting device 1000 can be an audio transmitting device 110 of Figure 1 or Figure 2 and is adapted to perform any of the steps in the audio transmission method 800 for an audio transmitting device as described above. As shown in Figure 10 , the audio transmitting device 1000 includes an obtaining module 1010, a creating module 1020, and a broadcasting module 1030.
[0082] The obtaining module 1010 is configured to obtain a first audio data packet.
[0083] The creating module 1020 is configured to create a BIG including BISs.
[0084] The broadcasting module 1030 is configured to broadcast, via a Bluetooth network, information describing the BISs in the BIG, wherein the information indicates that the BIG includes one or more encrypted BISs; broadcast, via the Bluetooth network, a message including a first secret key for decrypting at least one encrypted BIS, wherein the first secret key is included in an encrypted portion of the message; and broadcast, via the Bluetooth network, the first audio data packet through the at least one encrypted BIS.
[0085] Further, the obtaining module 1010 can be further configured to perform other procedures as described above in relation to step 802 of the method 800, which are not described in detail again.
[0086] Further, the creating module 1020 can be further configured to perform other procedures as described above in relation to step 804 of the method 800, which are not described in detail again.
[0087] Further, the broadcast module 1030 is further configured to perform other procedures as described above with respect to steps 806-810 of method 800, which are not described in detail again.
[0088] Further, the audio transmitting device 1000 can further include additional modules configured to perform additional procedures as described above with respect to additional steps of method 800, which are not described in detail again.
[0089] Figure 11 A block diagram of an example audio transmitting device 1100 according to embodiments of the present disclosure is shown. The audio transmitting device 1100 includes at least one processor 1110 and a memory 1120 coupled to the at least one processor 1110. The memory 1120 is used to store computer executable instructions that when executed by the processor 1110 cause the processor 1110 to perform the methods in the above embodiments (e.g., any one or more steps of the aforementioned method 300 or 800).
[0090] Further, alternatively, the above-described methods can be implemented by a computer readable storage medium. The computer readable storage medium has computer readable program instructions stored therein for performing various embodiments of the present disclosure. The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium can be, for example but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any appropriate combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch cards or punched tape, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
[0091] Accordingly, in another embodiment, the present disclosure provides a computer readable storage medium having stored thereon computer executable instructions for performing the methods in various embodiments of the present disclosure.
[0092] Furthermore, although example embodiments have been described herein, the scope of coverage of this patent will include any and all embodiments having equivalent elements, modifications, omissions, combinations (e.g., of the various embodiments
[0093] The foregoing description is intended to be illustrative and not exclusive. For example, the above-described examples (or one or more aspects thereof) can be used in combination with each other. For example, other embodiments can be utilized which will become apparent to those skilled in the art upon reading the above description. Furthermore, in the specific description of the embodiments above, various features can be grouped together or divided up so that the disclosure can be written as a number of acts to implement the disclosure as a whole, which will be apparent to those skilled in the art. The disclosure is not to be limited in terms of the specific embodiments described herein, which are intended as single implementations, learning tools, and concision mechanisms to aid the reader. Rather, the claims shall cover all apparatuses (and / or processes) coming within the scope of the claims and their equivalents.
[0094] Accordingly, the claims are hereby incorporated into the detailed description as examples or embodiments, in which each claim is independently a separate embodiment, and the disclosure can be combined with each of the embodiments in various combinations or permutations. The scope of the disclosure should be determined, therefore, with reference to the appended claims and the full scope of equivalents to be afforded them.
[0095] According to the context, as used herein, the term "if' is optionally interpreted as meaning "when or "in response to a determination" or "in response to a detection." Similarly, according to the context, the phrases "if determined" or "if [a stated condition or event] is detected" are optionally interpreted as meaning "upon a determination" or "in response to a determination" or "upon detecting [a stated condition or event]" or "in response to detecting [a stated condition or event]."
Claims
1. An audio transmission method for an audio receiving device, the method comprising: receiving, via a Bluetooth network, information broadcasted by an audio transmitting device for describing a broadcast synchronization stream in a broadcast synchronization group; based on the information, determining whether the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams; if it is determined that the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams, obtaining a first secret key for decrypting at least one encrypted broadcast synchronization stream without requesting the first secret key from the audio transmitting device, wherein the first secret key is included in an encrypted part of a message broadcasted by the audio transmitting device via the Bluetooth network; obtaining a second secret key for decrypting the first secret key; decrypting the encrypted first secret key using the second secret key to join the broadcast synchronization group.
2. The method of claim 1, wherein, based on the information, determining whether the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams comprises: based on evaluating at least one of a length of the information, a parameter included in the information, or a value range of a parameter included in the information, determining whether the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams.
3. The method of claim 1, wherein, obtaining a second secret key for decrypting the first secret key comprises at least one of: obtaining the second secret key from a storage device associated with the audio receiving device; obtaining the second secret key in an out-of-band manner.
4. The method of claim 1, further comprising: receiving, via the Bluetooth network, the at least one encrypted broadcast synchronization stream; decrypting the broadcast synchronization stream using the first secret key; when detecting an audio data packet in a sub-event of the decrypted broadcast synchronization stream, parsing the audio data packet to generate audio data; playing the audio data.
5. The method of claim 4, further comprising: obtaining, from the decrypted broadcast synchronization stream, time information for synchronously playing the audio data; and playing the audio data comprises playing the audio data synchronously with the audio transmitting device based on the time information.
6. The method of claim 5, further comprising: obtaining, from the decrypted broadcast synchronization stream, control information for synchronously playing the audio data, the control information relating to a buffer of the audio transmitting device for buffering audio data packets; based on the control information, adjusting a play parameter for playing the audio data; and playing the audio data comprises playing the audio data synchronously with the audio transmitting device based on the time information and the adjusted play parameter.
7. An audio transmission method for an audio transmitting device, the method comprising: obtaining a first audio data packet; creating a broadcast synchronization group comprising a broadcast synchronization stream; broadcasting, via a Bluetooth network, information for describing a broadcast synchronization stream in a broadcast synchronization group, wherein the information indicates that the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams; broadcasting, via the Bluetooth network, a message including a first key for decrypting at least one encrypted broadcast synchronization stream without requesting the first key by the audio receiving device from the audio transmitting device, wherein the first key is included in an encrypted portion of the message; broadcasting, via the Bluetooth network, the first audio data packet through the at least one encrypted broadcast synchronization stream.
8. The method of claim 7, wherein, The information has at least one of a variable information length, a variable parameter, or a variable parameter value.
9. The method of claim 7, wherein, Obtaining the first audio data includes: locally obtaining, at the audio transmitting device, the first audio data packet.
10. The method of claim 7, wherein, Obtaining the first audio data packet includes: obtaining, from a computing device separate from the audio transmitting device, a second audio data packet transmitted by the computing device based on an audio transmission protocol; parsing the second audio data packet to obtain second audio data; encoding the second audio data to obtain the first audio data packet based on a Bluetooth transmission protocol supported by the audio transmitting device, wherein the Bluetooth transmission protocol is different from the audio transmission protocol of the computing device.
11. The method of claim 7 or 10, wherein, Broadcasting the first audio data packet via the Bluetooth network is based on a Bluetooth Low Energy audio transmission protocol supported by the audio transmitting device.
12. The method of claim 7 or 10, further comprising: determining time information for synchronously playing first audio corresponding to the first audio data packet; broadcasting, via the Bluetooth network, the time information through the at least one broadcast synchronization stream.
13. The method of claim 12, further comprising: determining control information for synchronously playing the first audio, the control information relating to a buffer of the audio transmitting device for buffering audio data packets; broadcasting, via the Bluetooth network, the control information through the at least one broadcast synchronization stream.
14. An audio receiving device, comprising: a receiving module configured to receive, via a Bluetooth network, information broadcast by an audio transmitting device for describing broadcast synchronization streams in a broadcast synchronization group; a determining module configured to determine, based on the information, whether the broadcast synchronization group includes one or more encrypted broadcast synchronization streams; an obtaining module configured to, if it is determined that the broadcast synchronization group includes one or more encrypted broadcast synchronization streams, obtain a first key for decrypting at least one encrypted broadcast synchronization stream without requesting the first key from the audio transmitting device, and obtain a second key for decrypting the first key, wherein the first key is included in an encrypted portion of a message broadcast by the audio transmitting device via the Bluetooth network; a decrypting module configured to decrypt the encrypted first key using the second key to join the broadcast synchronization group.
15. An audio transmitting device, comprising: an obtaining module configured to obtain a first audio data packet; a creating module configured to create a broadcast synchronization group including a broadcast synchronization stream; a broadcasting module configured to: broadcasting, via a Bluetooth network, information describing a broadcast synchronization stream in a broadcast synchronization group, wherein the information indicates that the broadcast synchronization group comprises one or more encrypted broadcast synchronization streams; broadcasting, via the Bluetooth network, a message comprising a first key for decrypting at least one encrypted broadcast synchronization stream without requiring the first key to be requested by an audio receiving device from the audio transmitting device, wherein the first key is comprised in an encrypted portion of the message; broadcasting, via the Bluetooth network, the first audio data packet over the at least one encrypted broadcast synchronization stream.
16. An audio transmitting device comprising: at least one processor; and a memory for storing computer-executable instructions that, when executed, cause the at least one processor to perform the audio transmitting method according to any one of claims 1 to 6 or the audio transmitting method according to any one of claims 7 to 13.
17. A computer-readable storage medium having stored thereon computer- executable instructions for performing the audio transmitting method according to any one of claims 1 to 6 or the audio transmitting method according to any one of claims 7 to 13.