Audio data transmission method, device, chip and electronic device

By using Bluetooth link and LE ISOC link in wireless headphones combined with LC3 encoding format, the audio data transmission problem is solved, and the audio quality experience is improved and compatibility is improved.

CN114982369BActive Publication Date: 2024-11-29SHENZHEN GOODIX TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202080093146.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-05-08
Publication Date
2024-11-29
Estimated Expiration
2040-05-08

AI Technical Summary

Technical Problem

Existing wireless headphones have a large delay in audio data transmission, which affects the user's listening experience and sound quality experience, and is difficult to be compatible with other Bluetooth standard protocols.

Method used

Receive target audio data through Bluetooth links and transmit audio data to the secondary device using the LE ISOC link. Combined with the LC3 encoding format, the transmission time slot and code rate are optimized to ensure the accuracy and expected delivery of audio data, and reduce delays.

Benefits of technology

It realizes the delay of audio data transmission, improves the user's sound quality experience, and improves compatibility with source devices, avoiding the waste and synchronization of audio data during transmission.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114982369B_ABST
    Figure CN114982369B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a method, device, chip and electronic device for audio data transmission, which can reduce the transmission delay of audio data. The method includes: a first end receives target audio data sent by a third end through a Bluetooth link, the target audio data is used to obtain first audio data, and the first audio data is used to play on the second end side; the first end transmits the first audio data to the second end through an LE ISOC link.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of wireless communication technology, and more specifically, to a method, device, chip and electronic device for audio data transmission. Background Art

[0002] With the rapid development of mobile terminal technology and chip technology, the headphone market has developed rapidly, especially the wireless headphone market. Among many wireless headphone products, True Wireless Stream (TWS) headphones can achieve stereo playback of left and right channels, which is convenient to wear and provides users with high-quality playback sound quality, so they are favored by consumers.

[0003] At present, users have high requirements for the latency of TWS headphones. Therefore, how to reduce the transmission latency of audio data on the headphone end is an urgent problem to be solved. Summary of the invention

[0004] The embodiments of the present application provide a method, device, chip and electronic device for audio data transmission, which can reduce the transmission delay of audio data.

[0005] In a first aspect, a method for audio data transmission is provided, the method comprising: a first end receives target audio data sent by a third end via a Bluetooth link, the target audio data is used to obtain first audio data, and the first audio data is used to be played on a second end side; the first end transmits the first audio data to the second end via an LE ISOC link.

[0006] In some possible implementations, the method further includes: the first end obtains the second audio data according to the target audio data; the first end determines the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link, and the refresh timeout FT, wherein the original starting point of the second audio data is a starting point determined according to the Bluetooth audio transmission model agreement A2DP protocol;

[0007] The first end transmits the first audio data to the second end through a low-power synchronous LE ISOC link, including: the first end transmits the first audio data to the second end through the LE ISOC link at the original starting point of the second audio data.

[0008] In some possible implementations, the first end determines the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link, and the refresh timeout FT, including:

[0009] The first end determines the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the refresh timeout FT;

[0010] The starting point of the second audio data satisfies the formula:

[0011] T=K+S+(FT-1)*I

[0012] Among them, T is the starting point of the second audio data, K is the original starting point of the second audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and I is the sum of the transmission time slot of the Bluetooth link, the transmission time slot of the LE ISOC link, and the transmission time slot of the LE ACL link.

[0013] In some possible implementations, I=10ms.

[0014] In some possible implementations, S=2.5ms.

[0015] In some possible implementations, the method further includes: the first end sending request information to the second end through the LE ACL link, where the request information is used to request to establish the LE ISOC link.

[0016] In some possible implementations, before establishing the LE ISOC link, the method further includes: the first end establishing the Bluetooth link with the third end.

[0017] In some possible implementations, before the first end transmits the first audio data to the second end, the method further includes: the first end encodes the first audio data using a low complexity LC3 encoding format.

[0018] In some possible implementations, the method further includes: the first end is switched to the second end, wherein, during the process of switching the first end to the second end, transmission of the first audio data between the first end and the second end is not stopped.

[0019] In some possible implementations, the bit rate at which the first end transmits the first audio data is 96 kbps.

[0020] In some possible implementations, the third terminal does not support the low power audio standard.

[0021] In a second aspect, a method for audio data transmission is provided, the method comprising: a second end receives first audio data sent by a first end through an LE ISOC link, wherein the first audio data is used to be played on the second end side, the first audio data is audio data obtained by the first end based on target audio data sent by a third end, and the first end and the third end are connected through a Bluetooth link.

[0022] In some possible implementations, the first audio data is partial audio data obtained by the first end decoding the target audio data.

[0023] In some possible implementations, the method further includes: the second end determines the starting point of the first audio data based on the time point when the first audio data is received or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link, and the refresh timeout FT.

[0024] In some possible implementations, the second end determines the starting point of the first audio data according to the time point when the first audio data is received or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link, and the refresh timeout FT, including: the second end determines the starting point of the first audio data according to the time point when the first audio data is received or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the refresh timeout FT;

[0025] The starting point of the first audio data satisfies the formula:

[0026] T = K + S + (FT-1) * I

[0027] Among them, T is the starting point of the first audio data, K is the time point when the second end receives the first audio data or the time point when the first end sends the first audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and I is the sum of the transmission time slot of the Bluetooth link, the transmission time slot of the LE ISOC link, and the transmission time slot of the LE ACL link.

[0028] In some possible implementations, I=10ms.

[0029] In some possible implementations, S=2.5ms.

[0030] In some possible implementations, the method further includes: the second end receiving, through the LE ACL link, request information sent by the first end, where the request information is used to request to establish the LE ISOC link.

[0031] In some possible implementations, the first audio data is audio data encoded using a low complexity LC3 encoding format.

[0032] In some possible implementations, the method further includes: the second end is switched to the first end, wherein, in the process of the second end being switched to the first end, transmission of the first audio data between the first end and the second end is not stopped.

[0033] In some possible implementations, the third terminal does not support the low power audio standard.

[0034] In some possible implementations, the third terminal does not support the low power audio standard.

[0035] According to a third aspect, a device for audio data transmission is provided, wherein the device is a first end and is configured to execute the method in the first aspect or each of its implementations.

[0036] Specifically, the first end includes a functional module for executing the method in the above-mentioned first aspect or its various implementation modes.

[0037] In a fourth aspect, a device for audio data transmission is provided, wherein the device is a second end, and is used to execute the method in the above-mentioned second aspect or its various implementation modes.

[0038] Specifically, the second end includes a functional module for executing the method in the above-mentioned second aspect or its various implementation modes.

[0039] In a fifth aspect, a chip is provided, for executing the audio data transmission method in the first aspect, comprising a memory and a processor;

[0040] The memory is coupled to the processor;

[0041] A memory for storing program instructions;

[0042] The processor is used to call the program instructions stored in the memory so that the chip executes the audio data transmission method of the first aspect above.

[0043] In a sixth aspect, a chip is provided, for executing the audio data transmission method in the second aspect, comprising a memory and a processor;

[0044] The memory is coupled to the processor;

[0045] A memory for storing program instructions;

[0046] The processor is used to call the program instructions stored in the memory so that the chip executes the audio data transmission method of the second aspect above.

[0047] In a seventh aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store a computer program, wherein when the computer program is executed by a processor, the processor executes the method in the first aspect or any possible implementation of the first aspect.

[0048] In an eighth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium is used to store a computer program, wherein when the computer program is executed by a processor, the processor executes the method in the second aspect or any possible implementation of the second aspect.

[0049] In a ninth aspect, a computer program product is provided, comprising computer program instructions, which enable a computer to execute the method in the first aspect or any possible implementation of the first aspect.

[0050] In a tenth aspect, a computer program product is provided, comprising computer program instructions, which enable a computer to execute the method in the above-mentioned second aspect or any possible implementation of the second aspect.

[0051] In an eleventh aspect, an electronic device is provided, comprising: the main device in the third aspect or any possible implementation of the third aspect; the secondary device in the fourth aspect or any possible implementation of the fourth aspect;

[0052] The main device is connected to the secondary device via a Bluetooth link, and there is at least one wireless communication link between the main device and the secondary device, and the at least one wireless communication link includes a low-power LE ISOC link.

[0053] In the above technical solution, audio data is transmitted between the third end (such as the source device) and the first end (such as the main device) via a Bluetooth link, and the first end transmits audio data to the second end (such as the slave device) via a LE ISOC link. In this way, the delivery time of the audio data sent by the first end to the second end is accurate and predictable. Therefore, the second end does not need to cache a large amount of audio data to achieve synchronization, thereby reducing the delay of audio data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 This is a schematic topology diagram of a current Bluetooth audio solution.

[0055] Figure 2This is another topology diagram of the Bluetooth audio solution.

[0056] Figure 3 This is another topology diagram based on the Bluetooth audio solution.

[0057] Figure 4 It is a schematic flow chart of audio data transmission according to an embodiment of the present application.

[0058] Figure 5 It is a schematic topological diagram of an embodiment of the present application.

[0059] Figure 6 It is a time slot allocation diagram of the BT link and LE link of an embodiment of the present application.

[0060] Figure 7 It is a flowchart of target audio data transmission according to an embodiment of the present application.

[0061] Figure 8 It is a schematic diagram of role switching between a master device and a slave device in an embodiment of the present application.

[0062] Fig. 9 It is a schematic block diagram of an apparatus for audio data transmission implemented in the present application.

[0063] Fig.10 It is a schematic block diagram of an apparatus for audio data transmission implemented in the present application.

[0064] Fig.11 It is a schematic block diagram of an electronic device according to an embodiment of the present application.

[0065] Fig.12 It is a schematic block diagram of the chip of an embodiment of the present application.

[0066] Fig.13 It is a schematic block diagram of the chip of an embodiment of the present application. DETAILED DESCRIPTION

[0067] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0068] At present, some headphones on the market have achieved wireless stereo transmission of Bluetooth audio data, which not only takes into account the quality of audio data but also eliminates the constraints of cables. Typical topologies include Figure 1 shown.

[0069] like Figure 1The topology shown is composed of a master earphone and a slave earphone that can switch between master and slave freely, wherein the master earphone is directly connected to the source device via a Bluetooth (BT) link, for example, the source device can be a mobile phone, the master earphone and the slave earphone are connected via a Low Energy (LE) link, and the master earphone can guide the slave earphone to monitor the link between the master earphone and the source device through the connection with the slave earphone, so as to realize a one-to-many communication topology, so that the master earphone and the slave earphone can simultaneously receive the audio data sent by the source device, thereby realizing a one-send-to-many mechanism. Afterwards, the master earphone and the slave earphone deinterleave the audio data, so as to present a wireless stereo effect.

[0070] Figure 2 This is another topology diagram based on Bluetooth audio solution. As you can see, the main headset is directly connected to the source device, and the main headset is also connected to the secondary headset. When the main headset receives the audio data sent by the source device, the main headset does not process the received audio data, and can directly forward it to the secondary headset through the BT link or the Low Band Bluetooth Retransmission Technology (LBRT) link.

[0071] Since the source device sends the audio data to the main earphone, the main earphone then forwards the audio data to the auxiliary earphone, so the delay of this solution is large and it will seriously waste wireless bandwidth. In addition, in this solution, it is difficult to synchronize the starting point of the audio data played by the main earphone and the auxiliary earphone, which will affect the user's listening experience.

[0072] Figure 3 FIG. 1 is a topology diagram of another Bluetooth audio solution. In this solution, the source device establishes a connection with the primary earphone and the secondary earphone through the BT link at the same time. The source device can transmit audio data to the primary earphone and the secondary earphone respectively, and the primary earphone and the secondary earphone can play the received audio data synchronously.

[0073] This Bluetooth audio solution has significant restrictions on source devices. Source devices must use customized chips for this solution and are not compatible with other Bluetooth standard protocols.

[0074] Figure 4 is a schematic flow chart of the method for transmitting audio data according to an embodiment of the present application. Figure 4 The method 100 can be performed by the third end, the first end of the audio data playback end, and the second end of the audio data playback end. The first end, the second end, and the third end can be chips or devices. The first end, the second end, and the third end can be, for example, the master device, the slave device, and the source device mentioned above, respectively. The following describes the embodiment of the present application by taking the first end, the second end, and the third end as the master device, the slave device, and the source device, respectively.

[0075] As an example and not limitation, the source device may be a portable or mobile computing device such as a terminal device, a mobile phone, a tablet computer, a laptop computer, a desktop computer, a gaming device, an in-vehicle electronic device, or a wearable smart device. The main device may be a Bluetooth headset, a hearing aid, a Bluetooth speaker, etc. that establishes a wireless communication link with the source device for audio data transmission. The secondary device may be a Bluetooth headset, a hearing aid, a Bluetooth speaker, etc. that is not directly connected to the source device. Exemplarily, the main device may be the main headset in a TWS headset, and the secondary device may be the secondary headset in a TWS headset.

[0076] Figure 5 1 is a possible topology diagram applicable to the method 100. It can be seen that the source device and the master device are connected via a BT link, and the master device and the slave device are connected via a Low Energy (LE) synchronous channel (ISOC) link.

[0077] The source device may support the LE Audio standard or may not support the LE Audio standard, that is, the embodiment of the present application is compatible with electronic devices that do not support the LE Audio standard. In this way, the embodiment of the present application can improve the compatibility of the source device.

[0078] The LE ISOC link can allow retransmission within a certain period of time. That is, if the master device fails to successfully transmit audio data to the slave device through the LE ISOC link, the master device can retransmit the audio data. If the master device and the slave device are TWS headphones, since the distance between the two headphones is usually close, the audio data transmission can have a high transmission success rate, such as more than 90%, and the number of retransmissions can be 1.

[0079] The certain time mentioned above can refer to the flush timeout (FT). Figure 5 The FT can be determined when the topology is shown. The value of FT is a positive integer, such as FT can be 1, 2 or 3, and the unit of FT is Interval. Preferably, FT=1.

[0080] For the convenience of description, the embodiment of the present application refers to the link between the primary device and the secondary device as the first link. Optionally, the first link may include an LE ISOC link; or, the first link may include an LE ISOC link and an LE asynchronous connectionless (Asynchronous Connection-Less Link, ACL) link.

[0081] Among them, the LE ACL link can be mainly used to transmit control signaling, and the next control signaling can be sent only after receiving the response from the other end. The LE ISOC link can be mainly used as a transmission channel for audio data between the main device and the slave device, and can be used to ensure data transmission timing, data transmission synchronization and playback synchronization.

[0082] In an embodiment of the present application, the total transmission time slot of the BT link and the first link (that is, the sum of the transmission time slot of the BT link and the transmission time slot of the first link) can be 10ms. The embodiment of the present application uses 625μs as the transmission unit, that is, one time slot is 625μs. In other words, the BT link and the first link can occupy a total of 16 time slots. Of course, the embodiment of the present application can also refer to the total transmission time slot of the BT link and the first link as a communication interval (Interval) or ISOC Interval or scheduling period.

[0083] refer to Figure 6 The time slot may be understood as, for example, the interval between the moment when the source device sends audio data to the master device and the moment when the master device sends a response to the audio data to the source device. Figure 6 The M in the figure indicates the data packet sent by the source device to the master device. The data packet may include audio data. The number after M indicates the sequence number of the data packet. Different sequence numbers indicate different data packets. The Y in the figure indicates the response of the master device to the data packet sent by the source device. It is usually an empty packet and is only a response to the data packet sent by the source device. Therefore, Figure 6 The sequence number of the master device's response to the data packet is not emphasized.

[0084] Figure 6 The first link in the figure includes the LE ISOC link and the LE ACL link. Sub ISOC1 is the time slot when the master device transmits audio data to the slave device for the first time through the LE ISOC link, and sub ISOC2 is the time slot when the master device retransmits the audio data through the LE ISOC link. It can be seen that the total transmission time slot of the first link and the BT link is 10ms, occupying 16 time slots.

[0085] Based on the LE Audio standard, when the bit rate of the main device transmitting audio data to the secondary device through the LE ISOC link is 124 kbps, the audio data played on the main device side and the secondary device side has the best sound quality. However, when the bit rate of the main device transmitting audio data to the secondary device is 124 kbps, the transmission time slot occupied by the first link is more, for example, it can reach 3.75ms. In this case, the transmission time slot occupied by the BT link will be reduced, so that the bandwidth of the Bluetooth link may not guarantee the transmission of audio data between the source device and the main device, thereby affecting the transmission quality of the audio data. Therefore, the bit rate of the main device transmitting audio data to the secondary device in the embodiment of the present application is less than 124 kbps. In this case, when the transmission bit rate of the audio data transmitted between the main device and the secondary device is 96kbps, the quality of the audio data transmitted between the main device and the secondary device is the highest, that is, the sound quality of the audio data played on the main device side and the secondary device side is the best. Therefore, the transmission bit rate of the audio data transmitted between the main device and the secondary device is set to 96kbps in the embodiment of the present application. In this way, the user's sound quality experience can be improved.

[0086] The transmission bit rate of the audio data transmitted between the master device and the slave device is 96kbps, indicating that 12 (96k / 8=12k) bytes of audio data can be transmitted between the master device and the slave device in one second, that is, 120 bytes of audio data can be transmitted in 10ms, and the protocol data unit (PDU) where the audio data is located occupies 120+2+4=126 bytes. Among them, 2 is the byte occupied by the header of the PDU, and 4 is the byte occupied by the message integrity check (MIC). Furthermore, the preamble occupies 2 bytes, the access address occupies 4 bytes, and the cyclic redundancy check (CRC) occupies 3 bytes, so a total of 126+2+4+3=135 bytes are occupied.

[0087] The slave device responds to the PDU ( Figure 6 The Preamble (not shown) occupies 2 bytes, further, the Preamble occupies 2 bytes, the Access-Address occupies 4 bytes, and the CRC occupies 3 bytes, which takes up a total of 2+2+4+3=11 bytes.

[0088] The PDU sent by the master device to the slave device and the slave device's response to the PDU occupy a total of 146 bytes, that is, 146*8=1168 bits. Due to the 2M physical layer (PHY), the transmission time of the PDU sent by the master device to the slave device and the slave device's response to the PDU is 1168 / 2=584μs. Furthermore, since the interval between transmission and reception is 150μs, the single transmission time of the LE ISOC link can be 584+150*2=884μs.

[0089] According to the above, the LE ISOC link has one retransmission opportunity, so the maximum transmission time of the LE ISOC link can be 884μs*2=1768μs. It should be understood that when the master device sends audio data to the slave device through the LE ISOC link, in most cases, the transmission is successful once, and the retransmission opportunity is rarely used, so the optimal transmission time of the LE ISOC link can be 884μs.

[0090] The maximum transmission time of the LE ACL link can be 636 μs, and the maximum transmission time of the first link can be 1768 μs+636 μs=2404 μs. Based on this, the first link can occupy 4 time slots, that is, the transmission time slot of the first link can be set to 2.5 ms.

[0091] Reference again Figure 6 The BT link occupies 12 time slots and the first link occupies 4 time slots, that is, the transmission time slot of the first link is 2.5ms, which can ensure the quality of the audio data transmitted through the BT link and the first link.

[0092] It should be understood that Figure 6 These are merely examples and should not be construed as limiting the embodiments of the present application.

[0093] During the audio data transmission process, the master device needs to take into account two different links, namely the BT link between the source device and the first link between the slave device. In order to avoid the mutual influence of the two different links, the transmission time slots between the two links should be avoided as much as possible. Figure 6 , we can see that the transmission time slots of the BT link are the first 12 time slots out of 16 time slots, and the transmission time slots of the first link are the last 4 time slots. Figure 6 The transmission time slot allocation for the BT link and the transmission time slot allocation for the first link avoids the transmission time slot overlap between two different links.

[0094] That is to say, when the master device is communicating with the slave device, it does not communicate with the source device. For example, when the master device is communicating with the slave device, the master device can turn off the transceiver for communicating with the source device. In this case, after the source device sends audio data to the master device, it does not receive a response from the master device. At this time, the source device can automatically retransmit the audio data.

[0095] Reference again Figure 6 In the transmission time slot of the first link between the master device and the slave device, the source device sends an M7 data packet to the master device. Since the master device is communicating with the slave device and not with the source device in the transmission time slot of the first link, the master device does not respond to the M7 data packet to the source device. If the source device does not receive a response from the master device, the source device continues to send the M7 data packet to the master device.

[0096] Alternatively, the master device does not communicate with the slave device when communicating with the source device.

[0097] The following takes the scenario where the embodiment of the present application is applied to a TWS headset as an example to introduce in detail Figure 5 The topology shown is constructed.

[0098] Step 1: Multiple sink devices are in low power mode before joining the topology, waiting to be awakened. After the sink device is awakened, for example, after the earphone charging box is opened, multiple sink devices can be configured through other physical connections other than Bluetooth connection to bind the peer device addresses to each other. For example, the multiple sink devices include a first device and a second device, and the first device and the second device can bind the peer device addresses to each other.

[0099] Step 2: The first device is taken out of the earphone charging box and performs LE broadcasting.

[0100] The embodiment of the present application does not specifically limit the time for the first device to perform LE broadcast. For example, the embodiment of the present application may specify that the time for the first device to perform LE broadcast is 1 ms. For another example, the time for the first device to perform LE broadcast may be determined by the product form of the first device.

[0101] Step 3: After the first device performs LE broadcasting, if a source device that supports the LE Audio standard establishes a connection with the first device within a certain period of time, the first device executes the existing LE Audio solution.

[0102] If no source device supporting the LE Audio standard attempts to establish a connection with the first device within a certain period of time, the first device may send a broadcast using the address bound in step 1.

[0103] Optionally, the first device may continue broadcasting for 1.28 seconds.

[0104] Optionally, the first device may send a high duty cycle directional broadcast. In this way, only a sink device that has bound a device address to the first device may establish a connection with the first device, and the first device sends a high duty cycle broadcast, which can save time for establishing a connection with other sink devices.

[0105] Step 4: After the first device finishes broadcasting, it starts LE scanning to scan other sink devices. If the first device scans and finds that the sink device with the bound device address is broadcasting, for example, the sink device is the second device, the first device can establish an LE ACL link with the second device, where the first device is the primary device and the second device is the secondary device.

[0106] If the first device is scanned by other sink devices bound to the device address during the broadcast process, for example, by the second device, the first device establishes an LE ACL link with the second device, the first device is the slave device, and the second device is the master device.

[0107] The second device may be a device that ends broadcasting before the first device. For example, the second device may be a sink device that is first taken out of the headset charging box, that is, the second device may be a device that broadcasts before the first device broadcasts. Alternatively, the second device may also be a device that broadcasts after the first device broadcasts or simultaneously with the first device. In this case, the duration of the second device broadcast may be shorter than that of the first device broadcast.

[0108] If the first device does not scan a sink device bound to a device address after the first device has finished broadcasting and scanning other sink devices, the first device is the master device.

[0109] Step 5: The master device starts the BT pairing connection process and waits to establish a BT connection with a source device that supports BT.

[0110] If the first device does not scan the sink device bound to the device address, the first device can scan other sink devices bound to the device address again while starting the BT pairing connection process, or can broadcast again.

[0111] Step 6: After the source device and the master device have established a BT link, and the master device and the slave device have established an LE ACL link, the master device can send a request message to the slave device through the LE ACL link, and the request message is used to request the establishment of an LE ISOC link. After the master device and the slave device negotiate, an LE ISOC link is established between the master device and the slave device.

[0112] It should be understood that the above steps 1 to 6 are only Figure 5 The exemplary construction process of the topology shown does not constitute any limitation to the embodiments of the present application.

[0113] After the topology is constructed, the implementation process of method 100 is described below. Figure 4 As shown, the method 100 may include at least part of the following contents.

[0114] In 110, the source device sends target audio data to the master device via the BT link.

[0115] Accordingly, the master device can receive the target audio data sent by the source device through the BT link.

[0116] The target audio data may be used to obtain first audio data, and the first audio data is used to be played on the second end side.

[0117] When the source device supports the LE Audio standard, the source device can encode the target audio data using encoding formats such as Sub-band Coding (SBC), Advanced Audio Coding (AAC), LDAC, and Low Complexity (LC) 3.

[0118] When the source device does not support the LE Audio standard, the source device can encode the target audio data in SBC, AAC, or LDAC encoding formats.

[0119] In this way, the embodiments of the present application have no special requirements for the source device. If the source device supports the LE Audio standard, the LE Audio solution or the solution of the embodiments of the present application can be executed; if the source device does not support the LE Audio standard, the solution of the embodiments of the present application can be executed.

[0120] After receiving the target audio data, the master device can first decode the target audio data. Specifically, the master device can decode the target audio data into pulse code modulation (PCM) data that can be directly output to the digital to analog converter (DAC) through other hardware units such as digital signal processor (DSP).

[0121] The master device decodes the target audio data to obtain, in addition to the first audio data, second audio data, which is used for playing on the master device side.

[0122] It should be understood that both the first audio data and the second audio data are PCM data.

[0123] In 120 , the master device transmits first audio data to the slave device via the LE ISOC link.

[0124] As an example, after the master device decodes the target audio data, it is temporarily uncertain which audio data is played on the master device side and which audio data is played on the master device side. At this time, the master device can transmit all the decoded audio data to the slave device through the LE ISOC link, that is, the master device can transmit both the first audio data and the second audio data to the slave device through the LE ISOC link.

[0125] As another example, usually, the PCM data decoded by the master device is stereo, in which case the master device can deinterleave the PCM data, that is, separate the left and right channels. After that, the master device can send the second audio data to the DAC buffer for playback, and send the first audio data to the DSP or other hardware unit for encoding, and put the encoded first audio data into the transmission buffer of the LE ISOC link.

[0126] Since the main device does not need to send all decoded audio data to the secondary device, it only needs to send the audio data corresponding to the secondary device to the secondary device, thereby avoiding the waste of wireless bandwidth.

[0127] The audio data corresponding to the auxiliary device can be understood as follows: if the auxiliary device is a right earphone, the audio data corresponding to the auxiliary device, that is, the first audio data, is the audio data output by the right channel.

[0128] Optionally, the master device may encode the first audio data using an LC3 encoding format.

[0129] Since the LC3 encoding format is a coding format specially developed for LE ISOC links, it has the advantages of low latency, high sound quality, and packet loss compensation, so it can reduce the delay of audio data transmission and improve the user's sound quality experience. Furthermore, since the LC3 encoding format has a high compression rate, if the size of the first audio data is 256 bytes, the master device can compress the first audio data to 128 bytes, thereby further saving wireless bandwidth and further reducing power consumption.

[0130] Of course, the host device may also encode the first audio data using encoding formats such as SBC, AAC or LDAC.

[0131] Since the frame length of the LC3 coding format is 10 ms, when the total transmission time slot of the first link and the BT link is 10 ms, the LC3 coding format can be better matched.

[0132] If only the main device is working and the slave device is not working, for example, the power of the slave device is exhausted or the user puts the slave device back into the charging box, the main device can discard the first audio data, or the main device can play two channels simultaneously on the same speaker according to the application configuration.

[0133] After receiving the encoded first audio data, the secondary device may decode the encoded first audio data through the DSP, and then send the decoded first audio data to the DAC buffer for playing.

[0134] If the master device fails to successfully transmit the first audio data to the slave device through the LE ISOC link, the master device may retransmit the first audio data.

[0135] Combine the following Figure 7 The method 100 is described by way of example.

[0136] like Figure 7 As shown, the main device is the left earphone and the slave device is the right earphone. The source device sends the target audio data to the main device via the BT link, wherein the source device encodes the target audio data in the AAC encoding format. After receiving the target audio data, the main device decodes the target audio data to obtain PCM data. Then, the main device deinterleaves the PCM data to obtain the second audio data corresponding to the left channel (CH_L) and the first audio data corresponding to the right channel (CH_R). The main device caches the second audio data DAC for playback, encodes the first audio data in the LC3 encoding format, and then sends the encoded first audio data to the slave device via the LE ISOC link. After receiving the encoded first audio data via the LE ISOC link, the slave device decodes the encoded first audio data and sends the decoded PCM data (i.e., the first audio data) to the DAC cache for playback.

[0137] After the audio data is transmitted, the master device starts playing the second audio data, and the slave device starts playing the first audio data.

[0138] Since stereo audio data is transmitted between the main device and the slave device, if the audio data synchronization accuracy is not high, the left and right channels may become out of sync, which seriously affects the user's listening experience.

[0139] After the slave device decodes and obtains the first audio data, the master device and the slave device can time-align the first audio data and the second audio data, and start playing the first audio data and the second audio data at the same time. In other words, the starting point of the first audio data is the same as the starting point of the second audio data.

[0140] Optionally, the master device and the slave device may time-align the first audio data and the second audio data according to a synchronization time reference specified by the LE ISOC protocol.

[0141] Optionally, the master device and the slave device may time-align the first audio data and the second audio data based on the time of any one of the master device and the slave device.

[0142] Optionally, the master device and the slave device may negotiate a synchronization time reference to time-align the first audio data and the second audio data.

[0143] It should be noted that in the embodiment of the present application, in addition to the clock synchronization between the master device and the slave device, the clock synchronization between the master device and the source device is also required. Optionally, the master device can use the source device as a reference to perform clock calibration every time audio data is sent or received, thereby avoiding the problem of clock asynchrony between different devices.

[0144] Optionally, the embodiment of the present application can utilize the characteristics of synchronous transmission of the LE ISOC link to perform audio start and audio synchronization operations, and perform real-time audio synchronization in each time unit to achieve an accurate audio synchronization effect. Exemplarily, the time unit can be a time slot.

[0145] Since audio data needs to be transferred between the main device and the slave device, the audio data transfer process requires additional time. The main device can determine the starting point of the second audio data based on the original starting point of the second audio data, the transmission time slot of the first link, the transmission time slot of the BT link and the FT.

[0146] Among them, the original starting point of the second audio data is the starting point determined according to the Bluetooth audio transmission model agreement (Advanced Audio Distribution Profile, A2DP) protocol. Optionally, the original starting point of the second audio data may be related to the number of frames of the target audio data sent by the source device. For example, the original starting point of the second audio data may be the time point after the source device sends N frames of target audio data to the main device. The determination of the original starting point of the second audio data can refer to the prior art and will not be described in detail in the embodiments of the present application.

[0147] It should be noted that, assuming that the first link only includes the LE ISOC link, the transmission time slot of the first link is the transmission time slot of the LE ISOC link.

[0148] refer to Figure 6 If the first link includes an LE ISOC link and an LE ACL link, the transmission time slot of the first link may be the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link.

[0149] Optionally, the starting point of the second audio data may satisfy the following formula:

[0150] T=K+S+(FT-1)*I

[0151] Among them, T is the starting point of the second audio data, K is the original starting point of the second audio data, S is the transmission time slot of the first link, and I is the transmission time slot of the Bluetooth link and the first link.

[0152] Alternatively, if Figure 6 As shown, S can be equal to 2.5ms.

[0153] Alternatively, if Figure 6 As shown, I can be equal to 10ms.

[0154] In the above technical solution, if S=2.5ms and FT=1, after the source device sends the target audio data to the master device, the master device and the slave device can play the first audio device and the second audio data 2.5ms after the source device sends the target audio data to the master device. Normally, the transmission delay of the BT link is more than 100ms, and only increasing it by 2.5ms has little effect on the overall delay.

[0155] The main device can send the first audio data to the secondary device at the original starting point of the second audio data. After receiving the first audio data, the secondary device can determine the starting point of the first audio data based on the time point when the first audio data is received, the transmission time slot of the first link, the transmission time slot of the BT link and the FT.

[0156] Optionally, the starting point T of the first audio data may satisfy the following formula:

[0157] T=K+S+(FT-1)*I

[0158] Alternatively, K may also be the time point at which the master device sends the first audio data to the slave device. Exemplarily, the master device may tell the slave device the time point at which it sends the first audio data through the LE ACL link. Again exemplarily, in an embodiment of the present application, the time point at which the master device sends the first audio data and the time point at which the slave device receives the first audio data may be the same, that is, in this embodiment, K may also be the time point at which the slave device receives the first audio data.

[0159] The above technical solution can realize the synchronous playback of the first audio data and the second audio data.

[0160] It should be noted that the audio synchronization in the embodiment of the present application only involves the synchronization between the master device and the slave device, and does not involve the audio synchronization between the master device and the source device.

[0161] It should also be noted that if the transmission delay between the main device and the slave device is small, the transmission delay between the main device and the slave device can be ignored, that is, the embodiment of the present application can consider that the time point when the main device sends the first audio data to the slave device is the same as the time point when the slave device receives the first audio data. If the transmission delay between the main device and the slave device is large, the slave device can arbitrarily select a time point as K between the time point when the main device sends the first audio data to the slave device and the time point when the slave device receives the first audio data.

[0162] For an electronic device including a main device and a slave device, at least one of the following situations may occur but is not limited to: the user puts away the main device, such as putting the main earphones into the charging box; the power consumption of the main device and the slave device is inconsistent, for example, the main device consumes power faster. When the power of the main device is too low, even if the power of the slave device is sufficient, both the main device and the slave device can no longer be used by the user.

[0163] Therefore, the method 100 may further include: performing a role switch between the master device and the slave device, that is, the original master device is switched to a new slave device, and the original slave device is switched to a new master device.

[0164] In an embodiment of the present application, during the process of role switching between the main device and the slave device, the transmission of audio data between the main device and the slave device through the LE ISOC link will not stop. For example, when the main device and the slave device switch roles, the main device can continue to send the first audio data to the slave device through the LE ISOC link, and the slave device can continue to receive the first audio data sent by the main device through the LE ISOC link. It should be understood that the "audio data" in "the transmission of audio data between the main device and the slave device through the LE ISOC link will not stop" here can be other audio data in addition to the first audio data, and the embodiment of the present application does not specifically limit this.

[0165] In this way, when the master device and the slave device switch roles, continuous transmission of audio data between the master device and the slave device can be guaranteed.

[0166] During the role switching between the master device and the slave device, the master device can transfer the BT link between the master device and the source device to the slave device. Specifically, after obtaining the link parameters of the BT link between the master device and the source device, the master device can send first information to the slave device, where the first information includes the link parameters.

[0167] Optionally, the primary device may send the first information to the secondary device through the LE ACL link.

[0168] Optionally, the link parameters may include but are not limited to time information, channel information, frequency hopping information, encryption information, access code, etc.

[0169] After receiving the link parameters, the slave device can try to communicate with the source device according to the link parameters. If the slave device has started to communicate with the source device, it indicates that the slave device has switched to the new master device.

[0170] Next, the secondary device may send a second message to the original primary device, the second message being used to indicate that the secondary device has been switched to the new primary device. Optionally, the secondary device may send the second message to the original primary device via the LE ACL link. After receiving the second message, the original primary device may disconnect the BT link with the source device and switch to the new secondary device.

[0171] It can be seen that the slave device needs to switch to the new master device according to the link parameters between the master device and the source device. If the master device tells the link parameters to the slave device and then communicates with the source device, the link parameters will change. In this case, the slave device cannot successfully communicate with the source device based on the received link parameters.

[0172] Therefore, before the master device obtains the link parameters and the slave device starts to communicate with the source device, the master device can stop communicating with the source device, so as to ensure that the slave device can communicate with the source device according to the received link parameters.

[0173] Optionally, before the primary device and the secondary device perform role switching, the primary device may send switching request information to the secondary device through the LE ACL link, where the switching request information is used to request the primary device to perform role switching with the secondary device.

[0174] If the master device receives the switching request confirmation information sent by the slave device through the LE ACL link, and the switching request confirmation information is used to indicate that the slave device agrees with the switching request of the master device, the role switching between the master device and the slave device can begin.

[0175] If the master device receives a switching request confirmation message sent by the slave device through the LE ACL link, but the switching request confirmation message is used to indicate that the slave device does not agree to the switching request of the master device, or the master device does not receive the switching request confirmation message sent by the slave device within a preset time, then the role switching is not performed between the master device and the slave device.

[0176] The preset time may be specified by a protocol or may be agreed upon by the master device and the slave device.

[0177] In the case that the role switching between the master device and the slave device fails, the master device may restart the communication transmission with the source device, and then may perform the role switching with the slave device again.

[0178] The following situations may cause the primary device to fail to switch roles with the secondary device:

[0179] (1) The secondary device does not agree to the switching request of the primary device;

[0180] (2) The slave device agrees to the master device's switch request, but the slave device fails to successfully switch to the new master device;

[0181] (3) The slave device successfully switches to the new master device, but the master device does not receive the second message sent by the slave device;

[0182] (4) The slave device is successfully switched to the new master device, and the master device receives the second information sent by the slave device, but the master device is not successfully switched to the new slave device;

[0183] (5) After the master device tells the slave device the link parameters and the slave device has not yet switched to become the new master device, the master device communicates with the source device.

[0184] It should be understood that if there is no communication transmission between the main device and the source device for a long time, the BT link between the main device and the source device may be flushed. Therefore, if the main device fails to switch roles with the slave device successfully, the main device needs to restart the communication transmission with the source device.

[0185] Figure 8 The specific steps for switching roles between the primary device and the secondary device.

[0186] Step 1: The master device sends a switching request message to the slave device, where the switching request message is used to request a role switching with the slave device.

[0187] Step 2: The secondary device sends a switching request confirmation message to the primary device.

[0188] If the switching request confirmation information is used to indicate that the secondary device agrees with the switching request of the primary device, the primary device executes the following steps; if the switching request information is used to indicate that the secondary device rejects the switching request of the primary device, the role switching process ends.

[0189] Step 3: The master device obtains link parameters and determines the anchor point for role switching. After that, the master device sends second information to the slave device through the LE ACL link. The second information is used to instruct the slave device to start communication transmission with the source device according to the link parameters, that is, to notify the slave device to perform role switching.

[0190] Step 4: The slave device attempts to communicate with the source device based on the link parameters.

[0191] If the slave device successfully communicates with the source device, that is, the slave device is switched to the new master device, the master device sends a second message to notify the original slave device that it has been switched to the new master device. For example, the original slave device sends an acknowledgement (ACK) to the original master device, and the original master device executes step 5.

[0192] If the slave device fails to communicate with the source device, for example, the slave device sends a negative acknowledgement (NegativeAcknowledgement, NCK) to the master device, the master device executes step 6.

[0193] In step 3 and step 4, the original master device does not communicate with the source device.

[0194] Step 5: The original master device switches to a new slave device according to the determined anchor point. The anchor point can be understood as a time point agreed upon between two devices to perform a certain action. For example, the anchor point in the embodiment of the present application can be a time point agreed upon between the original master device and the original slave device for the original master device to switch to a new slave device.

[0195] At this point, the role switching process between the primary device and the secondary device is completed.

[0196] Step 6: The master device communicates with the source device via the BT link and switches roles with the slave device again.

[0197] In an embodiment of the present application, audio data is transmitted between the third end (such as the source device) and the first end (such as the main device) via a Bluetooth link, and the first end transmits audio data to the second end (such as the slave device) via an LE ISOC link. In this way, the delivery time of the audio data sent by the first end to the second end is accurate and predictable, so the second end does not need to cache a large amount of audio data to achieve synchronization, thereby reducing the delay in audio data transmission.

[0198] In the embodiments of the present application, the sequence numbers of the above processes do not mean the order of execution. The order of execution of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0199] Furthermore, under the premise of no conflict, the various embodiments and / or the technical features in the various embodiments described in the present application may be arbitrarily combined with each other, and the technical solutions obtained after the combination shall also fall within the protection scope of the present application.

[0200] The above describes in detail the method for audio data transmission of the embodiment of the present application, and the following describes the device for audio data transmission of the embodiment of the present application. It should be understood that the device for audio data transmission in the embodiment of the present application can execute the method for audio data transmission in the embodiment of the present application, and has the function of executing the corresponding method.

[0201] Fig. 9 FIG. 2 is a schematic block diagram of an audio data transmission device 200 according to an embodiment of the present application. Fig. 9 As shown, the audio data transmission device 200 may include:

[0202] The communication unit 210 is used to receive target audio data sent by the third end through a Bluetooth link, where the target audio data is used to obtain first audio data, and the first audio data is used to be played on the second end side.

[0203] The communication unit 210 is further configured to transmit the first audio data to the second end via the LE ISOC link.

[0204] Optionally, in the embodiments of the present application, Fig. 9 As shown, the device 200 also includes: a processing unit 220, which is used to obtain second audio data according to the target audio data; determine the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the first link, the transmission time slot of the Bluetooth link and the FT, wherein the original starting point of the second audio data is the starting point determined according to the A2DP protocol;

[0205] The communication unit 210 is specifically configured to transmit the first audio data to the second end via the LE ISOC link at the original start point of the second audio data.

[0206] Optionally, in the embodiment of the present application, the processing unit 220 is specifically used to: determine the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the FT;

[0207] The starting point of the second audio data satisfies the formula:

[0208] T=K+S+(FT-1)*I

[0209] Among them, T is the starting point of the second audio data, K is the original starting point of the second audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and I is the transmission time slot of the Bluetooth link, the sum of the transmission time slot of the LE ISOC link, and the transmission time slot of the LE ACL link.

[0210] Optionally, in an embodiment of the present application, I=10ms.

[0211] Optionally, in the embodiment of the present application, S=2.5ms.

[0212] Optionally, in the embodiment of the present application, the communication unit 210 is further used to: send request information to the second end through the LE ACL link, where the request information is used to request to establish a LE ISOC link.

[0213] Optionally, in the embodiments of the present application, Fig. 9 As shown, the apparatus 200 further includes an establishing unit 230, and the establishing unit 230 is configured to establish the Bluetooth link with the third end before establishing the LE ISOC link.

[0214] Optionally, in the embodiments of the present application, Fig. 9 As shown, the device 200 further includes: an encoding unit 240, which is used to encode the first audio data using an LC3 encoding format before the communication unit 210 transmits the first audio data to the second end.

[0215] Optionally, in the embodiments of the present application, Fig. 9 As shown, the device 200 further includes: a switching unit 250, configured to switch to the second end, wherein during the process of the switching unit 250 switching to the second end, the transmission of the first audio data between the communication unit 210 and the second end is not stopped.

[0216] Optionally, in the embodiment of the present application, the bit rate at which the communication unit 210 transmits the first audio data is 96 kbps.

[0217] Optionally, in the embodiment of the present application, the third terminal does not support the low power consumption audio standard.

[0218] It should be understood that the apparatus 200 for transmitting audio data may correspond to the main device in the method 100 and may implement the corresponding operations of the main device in the method 100, which will not be described in detail for the sake of brevity.

[0219] It should also be understood that Fig. 9 The connections between the various functional modules shown can be direct connections or indirect connections.

[0220] Fig.10 FIG. 3 is a schematic block diagram of an audio data transmission device 300 according to an embodiment of the present application. Fig.10 As shown, the audio data transmission device 300 may include:

[0221] The communication unit 310 is used to receive first audio data sent by the first end through a low-power LE ISOC link, wherein the first audio data is audio data obtained by the first end according to target audio data sent by the third end, and the first end and the third end are connected through a Bluetooth link.

[0222] The playing unit 320 is configured to play the first audio data.

[0223] Optionally, in the embodiment of the present application, the first audio data is partial audio data obtained by the first end decoding the target audio data.

[0224] Optionally, in the embodiments of the present application, Fig.10 As shown, the device 300 also includes: a processing unit 330, which is used to determine the starting point of the first audio data according to the time point when the communication unit 310 receives the first audio data or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the FT.

[0225] Optionally, in the embodiment of the present application, the processing unit 330 is specifically used to: determine the starting point of the first audio data according to the time point when the communication unit 310 receives the first audio data or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the FT;

[0226] The starting point of the first audio data satisfies the formula:

[0227] T = K + S + (FT-1) * I

[0228] Among them, T is the starting point of the first audio data, K is the time point when the communication unit 310 receives the first audio data or the time point when the first end sends the first audio data, S is the sum of the transmission time slots of the LE ISOC link and the transmission time slots of the LE ACL link, and I is the sum of the transmission time slots of the Bluetooth link, the transmission time slots of the LE ISOC link, and the transmission time slots of the LE ACL link.

[0229] Optionally, in an embodiment of the present application, I=10ms.

[0230] Optionally, in the embodiment of the present application, S=2.5ms.

[0231] Optionally, in the embodiment of the present application, the communication unit 310 is further used to: receive request information sent by the first end through the LE ACL link, where the request information is used to request to establish a LE ISOC link.

[0232] Optionally, in an embodiment of the present application, the first audio data is audio data encoded using an LC3 encoding format.

[0233] Optionally, in the embodiments of the present application, Fig.10 As shown, the device 300 further includes: a switching unit 340, configured to switch to the first end, wherein during the process of the switching unit 340 switching to the first end, the transmission of the first audio data between the first end and the communication unit 310 is not stopped.

[0234] Optionally, in the embodiment of the present application, the bit rate at which the communication unit 310 receives the first audio data is 96 kbps.

[0235] Optionally, in the embodiment of the present application, the third terminal does not support the low power consumption audio standard.

[0236] It should be understood that the audio data transmission device 300 may correspond to the auxiliary device in the method 100 and may implement the corresponding operations of the auxiliary device in the method 100. For the sake of brevity, it will not be described in detail here.

[0237] It should also be understood that Fig.10 The connections between the various functional modules shown can be direct connections or indirect connections.

[0238] The present application also provides an electronic device. Fig.11 As shown, the electronic device 400 may include a first end 410 and a second end 420. The first end 410 may correspond to the main device in the method 100, and may implement the corresponding operations of the main device in the method 100, and the second end 420 may correspond to the secondary device in the method 100, and may implement the corresponding operations of the secondary device in the method 100, which will not be described in detail for the sake of brevity.

[0239] The embodiment of the present application further provides a chip 500, the chip 500 includes a memory 510 and a processor 520;

[0240] The memory 510 is coupled to the processor 520;

[0241] Memory 510, used to store program instructions;

[0242] The processor 520 is used to call the program instructions stored in the memory so that the chip executes the corresponding operations of the master device in the audio data transmission method 100 proposed in any of the above embodiments.

[0243] The embodiment of the present application further provides a chip 600, the chip 600 includes a memory 610 and a processor 620;

[0244] The memory 610 is coupled to the processor 620;

[0245] Memory 610, used to store program instructions;

[0246] The processor 620 is used to call the program instructions stored in the memory so that the chip executes the corresponding operations of the secondary device in the audio data transmission method 100 proposed in any of the above embodiments.

[0247] The specific implementation process and beneficial effects of the chip provided in the embodiment of the present application are as mentioned above and will not be repeated here.

[0248] It should be understood that the terms used in the embodiments of the present application and the appended claims are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present application. For example, the singular forms "a", "above", and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0249] Those of ordinary skill in the art will appreciate that the units of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0250] In the several embodiments provided in the present application, it should be understood that the disclosed systems and devices can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0251] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0252] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0253] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program codes.

[0254] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for transmitting audio data, characterized in that: The method comprises: The first end establishes a Bluetooth link with the third end; The first end receives the target audio data sent by the third end through the Bluetooth link, the target audio data is used to obtain the first audio data, and the first audio data is used to be played on the second end; The first end sends a request message to the second end through a low-power asynchronous connectionless LE ACL link, where the request message is used to request to establish a low-power synchronous channel LE ISOC link; The first end transmits the first audio data to the second end through the LE ISOC link; The method further comprises: The first end obtains second audio data according to the target audio data, and the second audio data is used to be played on the first end; The first end determines the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT, wherein the original starting point of the second audio data is the starting point determined according to the Bluetooth audio transmission model agreement A2DP protocol.

2. The method according to claim 1, characterized in that The first end transmits the first audio data to the second end through the LE ISOC link, including: The first end transmits the first audio data to the second end through the LE ISOC link at an original starting point of the second audio data.

3. The method according to claim 1, characterized in that The first end determines the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link, and the refresh timeout FT, including: The first end determines the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the refresh timeout FT; The starting point of the second audio data satisfies the formula: T=K+S+(FT-1)*I Among them, T is the starting point of the second audio data, K is the original starting point of the second audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, I is the sum of the transmission time slot of the Bluetooth link, the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and the transmission time slot of the Bluetooth link and the transmission time slot of the LE ISOC link do not overlap.

4. The method according to claim 3, characterized in that I=10ms.

5. The method according to claim 3 or 4, characterized in that: S=2.5ms.

6. The method according to any one of claims 1 to 4, characterized in that Before the first end transmits the first audio data to the second end, the method further includes: The first end encodes the first audio data using a low complexity LC3 encoding format.

7. The method according to any one of claims 1 to 4, characterized in that The method further comprises: The first end is switched to the second end, wherein, in the process of switching the first end to the second end, the transmission of the first audio data between the first end and the second end is not stopped.

8. The method according to any one of claims 1 to 4, characterized in that The bit rate at which the first end transmits the first audio data is 96 kbps.

9. The method according to any one of claims 1 to 4, characterized in that The third terminal does not support the low power audio standard.

10. A method for transmitting audio data, characterized in that: The method comprises: The second end receives the request information sent by the first end through the low-power asynchronous connectionless LE ACL link, where the request information is used to request to establish a low-power synchronous channel LE ISOC link; The second end receives, through the LE ISOC link, first audio data sent by the first end, wherein the first audio data is used to be played at the second end, the first audio data is audio data obtained by the first end according to target audio data sent by the third end, and the first end and the third end are connected through a Bluetooth link; The second end determines the starting point of the first audio data according to the time point when the first audio data is received or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT.

11. The method according to claim 10, characterized in that The first audio data is partial audio data obtained by the first end decoding the target audio data.

12. The method according to claim 10 or 11, characterized in that: The second end determines the starting point of the first audio data according to the time point when the first audio data is received or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link, and the refresh timeout FT, including: The second end determines the start point of the first audio data according to the time point when the first audio data is received or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the refresh timeout FT; The starting point of the first audio data satisfies the formula: T=K+S+(FT-1)*I Among them, T is the starting point of the first audio data, K is the time point when the second end receives the first audio data or the time point when the first end sends the first audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, I is the sum of the transmission time slot of the Bluetooth link, the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and the transmission time slot of the Bluetooth link and the transmission time slot of the LE ISOC link do not overlap.

13. The method according to claim 12, characterized in that I=10ms.

14. The method according to claim 12, characterized in that S=2.5ms.

15. The method according to claim 10 or 11, characterized in that: The first audio data is audio data encoded using a low complexity LC3 encoding format.

16. The method according to claim 10 or 11, characterized in that The method further comprises: The second end is switched to the first end, wherein in the process of the second end being switched to the first end, the transmission of the first audio data between the first end and the second end is not stopped.

17. The method according to claim 10 or 11, characterized in that: The bit rate at which the second end receives the first audio data is 96 kbps.

18. The method according to claim 10 or 11, characterized in that The third terminal does not support the low power audio standard.

19. An audio data transmission device, characterized in that: The device is a first end, comprising: An establishing unit, used for establishing a Bluetooth link with a third terminal; A communication unit, configured to receive target audio data sent by the third end through the Bluetooth link, wherein the target audio data is used to obtain first audio data, and the first audio data is used to be played on the second end; The communication unit is further used to send a request message to the second end through a low-power asynchronous connectionless LE ACL link, where the request message is used to request to establish a low-power synchronous channel LE ISOC link; The communication unit is further configured to transmit the first audio data to the second end through the LE ISOC link; The device further comprises a processing unit, wherein the processing unit is configured to: Obtaining second audio data according to the target audio data, where the second audio data is used to be played on the first end; The starting point of the second audio data is determined according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT, wherein the original starting point of the second audio data is the starting point determined according to the Bluetooth audio transmission model agreement A2DP protocol.

20. The device according to claim 19, characterized in that The communication unit is specifically used for: At the original starting point of the second audio data, the first audio data is transmitted to the second end through the LE ISOC link.

21. The device according to claim 19, characterized in that The processing unit is specifically used for: Determine the starting point of the second audio data according to the original starting point of the second audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the LE ACL link, the transmission time slot of the Bluetooth link, and the refresh timeout FT; The starting point of the second audio data satisfies the formula: T=K+S+(FT-1)*I Among them, T is the starting point of the second audio data, K is the original starting point of the second audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, I is the sum of the transmission time slot of the Bluetooth link, the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and the transmission time slot of the Bluetooth link and the transmission time slot of the LE ISOC link do not overlap.

22. The device according to claim 21, characterized in that I=10ms.

23. The device according to claim 21 or 22, characterized in that S=2.5ms.

24. The device according to any one of claims 19 to 22, characterized in that The device also includes: The encoding unit is used to encode the first audio data by adopting a low complexity LC3 encoding format before the communication unit transmits the first audio data to the second end.

25. The device according to any one of claims 19 to 22, characterized in that The device also includes: The switching unit is used to switch to the second end, wherein during the process of the switching unit switching to the second end, the transmission of the first audio data between the communication unit and the second end is not stopped.

26. The device according to any one of claims 19 to 22, characterized in that The communication unit transmits the first audio data at a bit rate of 96 kbps.

27. The device according to any one of claims 19 to 22, characterized in that The third terminal does not support the low power audio standard.

28. An audio data transmission device, characterized in that: The device is a second end, comprising: A communication unit, configured to receive a request message sent by a first end through a low-power asynchronous connectionless LE ACL link, wherein the request message is used to request to establish a low-power synchronous channel LE ISOC link; The communication unit is further used to receive, through the LE ISOC link, first audio data sent by the first end, wherein the first audio data is audio data obtained by the first end according to target audio data sent by the third end, and the first end and the third end are connected through a Bluetooth link; A playing unit, configured to play the first audio data; The device also includes: A processing unit is used to determine the starting point of the first audio data according to the time point when the communication unit receives the first audio data or the time point when the first end sends the first audio data, the transmission time slot of the LE ISOC link, the transmission time slot of the Bluetooth link and the refresh timeout FT.

29. The device according to claim 28, characterized in that The first audio data is partial audio data obtained by the first end decoding the target audio data.

30. The device according to claim 28, characterized in that The processing unit is specifically used for: Determine a start point of the first audio data according to a time point when the communication unit receives the first audio data or a time point when the first end sends the first audio data, a transmission time slot of the LE ISOC link, a transmission time slot of the LE ACL link, a transmission time slot of the Bluetooth link, and a refresh timeout FT; The starting point of the first audio data satisfies the formula: T=K+S+(FT-1)*I Among them, T is the starting point of the first audio data, K is the time point when the communication unit receives the first audio data or the time point when the first end sends the first audio data, S is the sum of the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, I is the sum of the transmission time slot of the Bluetooth link, the transmission time slot of the LE ISOC link and the transmission time slot of the LE ACL link, and the transmission time slot of the Bluetooth link and the transmission time slot of the LE ISOC link do not overlap.

31. The device according to claim 30, characterized in that I=10ms.

32. The device according to claim 30, characterized in that S=2.5ms.

33. The device according to claim 28 or 29, characterized in that The first audio data is audio data encoded using a low complexity LC3 encoding format.

34. The device according to claim 28 or 29, characterized in that The device also includes: The switching unit is used to switch to the first end, wherein, during the process of the switching unit switching to the first end, the transmission of the first audio data between the first end and the communication unit is not stopped.

35. The device according to claim 28 or 29, characterized in that The communication unit receives the first audio data at a bit rate of 96 kbps.

36. The device according to claim 28 or 29, characterized in that The third terminal does not support the low power audio standard.

37. A chip for implementing a method for audio data transmission, characterized in that: including memory and processor; The memory is coupled to the processor; The memory is used to store program instructions; The processor is used to call the program instructions stored in the memory so that the chip executes the audio data transmission method according to any one of claims 1 to 9.

38. A chip for implementing a method for audio data transmission, characterized in that: including memory and processor; The memory is coupled to the processor; The memory is used to store program instructions; The processor is used to call the program instructions stored in the memory so that the chip executes the audio data transmission method according to any one of claims 10 to 18.

39. An electronic device, characterized in that: include: A first end as claimed in any one of claims 19 to 27; A second end as claimed in any one of claims 28 to 36; The first end is connected to the third end via a Bluetooth link, and a low-power synchronization channel LE ISOC link exists between the first end and the second end.

Citation Information

Patent Citations

  • Audio output method and device of Bluetooth earphone, and Bluetooth earphone

    CN107124674A