A dual-source wireless audio transmission method, device and system

Abstract

This invention relates to the field of wireless audio transmission technology, and discloses a method, device, and system for transmitting dual-source wireless audio. The method is applied to an audio device and includes: establishing a first communication link and a second communication link with a first audio source device and a second audio source device, respectively, to transmit a first audio stream and a second audio stream. The audio device serves as a peripheral device for the first communication link and a central device for the second communication link. When audio data transmission on the first and second communication links coexists, the link clocks of the first and second communication links are the same or synchronized, and the first and second communication links use time-division multiplexing and share time slots. This invention, by configuring the clocks of the two links to be synchronized and employing time-division multiplexing and shared time slots for coexistence, avoids the problem of time slot overlap and insufficient bandwidth when audio source devices simultaneously transmit and receive wireless audio, thus making fuller use of bandwidth resources.

Description

Technical Field

[0001] This invention relates to the field of wireless audio transmission technology, specifically to a method, device, and system for transmitting dual-source wireless audio. Background Technology

[0002] The rapid development of wireless connectivity technologies such as Classic Bluetooth (CBT), Bluetooth Low Energy (BLE), and Wi-Fi has made wireless audio and wireless communication an important part of people's lives. For example, CBT wireless audio terminal devices that use smartphones as audio sources, such as CBT audio headphones and CBT Audio speakers, have gained widespread popularity. BLE Audio, offering lower latency, lower power consumption, and higher performance wireless audio services, is also expected to attract even more attention.

[0003] However, existing CBT Audio or BLE Audio terminal devices can only connect to one CBT or BLE audio source device to transmit and receive wireless audio; they do not support connecting two or more CBT or BLE audio source devices to transmit and receive wireless audio simultaneously. For example, existing CBT or BLE Audio headsets cannot be used to hold an online meeting with one smartphone while making and receiving calls with another smartphone, nor can they be used to play a low-latency game with one smartphone while making and receiving calls with another smartphone. In other words, CBT or BLE wireless audio terminal devices cannot connect to two or more CBT or BLE audio source devices to transmit and receive wireless audio simultaneously; that is, they do not support Dual-Source Wireless Audio (DSWA) or Multi-Source Wireless Audio (MSWA). Summary of the Invention

[0004] In view of this, the present invention provides a method, device and system for transmitting dual-source wireless audio to solve the problem that current dual-source wireless audio cannot achieve synchronous transmission.

[0005] In a first aspect, the present invention provides a method for transmitting dual-source wireless audio, applied to an audio device, the method comprising:

[0006] A first communication link is established with a first audio source device to transmit a first audio stream based on the first communication link; the audio device is a peripheral device of the first communication link;

[0007] A second communication link is established with the second audio source device to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link;

[0008] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the first and second communication links are the same or synchronized, and the first and second communication links are time-division multiplexed and share time slots.

[0009] The dual-source wireless audio transmission method provided in this invention avoids time slot overlap caused by clock asynchrony or relative clock drift when dual-source wireless audio coexists. Furthermore, the time-division multiplexing method using shared time slots between communication links supports TSWA, improving time slot utilization and solving the bandwidth shortage problem faced by existing technologies in supporting TSWA. Therefore, this invention enables audio devices to support TSWA, providing a better and more convenient wireless audio service experience.

[0010] In one alternative implementation, the first communication link includes a CBT link; the second communication link has a different link protocol than the first communication link.

[0011] The dual-source wireless audio transmission method provided in this embodiment of the invention uses the CBT link with good compatibility as the first communication link, and on this basis, adopts a second communication link with a different communication protocol to ensure that other audio services can be provided while using CBT calls.

[0012] In one optional implementation, the second communication link includes an asynchronous connection link and a connection isochronous group link consisting of at least one connection isochronous stream link.

[0013] The first communication link includes asynchronous connection links and extended synchronous connection links;

[0014] The isochronous connection links in the second communication link share time slots with the extended synchronous connection links and the asynchronous connection links in the first communication link, respectively.

[0015] The asynchronous connection link in the first communication link shares a time slot with the asynchronous connection link in the second communication link.

[0016] The dual-source wireless audio transmission method provided in this invention, by configuring the isochronous connection group link in the second communication link to share time slots with the extended synchronous connection link and asynchronous connection link in the first communication link, and the asynchronous connection links of the two communication links to share time slots, makes more effective use of available communication time, reduces time slot waste, improves the overall bandwidth utilization, and can ensure the reliability and audio quality of TSWA audio transmission.

[0017] In one optional implementation, the duration of the isochronous interval of the extended synchronous connection link of the first communication link is the same as the duration of the isochronous interval of the connection isochronous group link of the second communication link.

[0018] The sub-interval of the isochronous group link of the second communication link is M times the sub-interval of the first communication link, where M is a positive integer;

[0019] The duration of a sub-interval of a first communication link is such that at least the central device and peripheral devices of the first communication link can each send and receive a data packet once on the extended synchronous connection link of the first communication link.

[0020] The dual-source wireless audio transmission method provided in this embodiment of the invention sets the duration relationship of the isochronous interval between the first communication link and the second communication link, as well as the duration relationship between the sub-interval of the second communication link connecting the isochronous group link and the sub-interval of the first communication link, so that the two links are aligned in time slots on the basis of clock synchronization, which is beneficial to further improve the time slot utilization.

[0021] In one optional implementation, the time interval between the starting point of the isochronous group link in the second communication link and the starting point of the extended synchronous connection link in the first communication link is N times the sub-interval of the isochronous group link in the second communication link, where N is a positive integer.

[0022] The communication duration of the asynchronous connection link of the second communication link is S times the sub-interval of the isochronous group link of the second communication link, where S is a positive integer.

[0023] The dual-source wireless audio transmission method provided in this embodiment of the invention further improves the time slot alignment effect of the two links by setting the offset value between the starting point of the isochronous group link in the second communication link and the starting point of the extended synchronous connection link in the first communication link, and the duration relationship between the offset value and the sub-interval of the second communication link, so as to fully share the time slot and improve the link efficiency.

[0024] In one alternative implementation, M, N, and S are equal.

[0025] In one alternative implementation, the second communication link includes a BLE link.

[0026] In one optional implementation, the asynchronous connection link in the second communication link shares a time slot with the connected isochronous group link in the second communication link;

[0027] The second communication link uses a packet interval smaller than the packet interval specified in the BLE link protocol, and / or the second communication link uses a minimum time slot interval smaller than the minimum time slot interval specified in the BLE link protocol.

[0028] The dual-source wireless audio transmission method provided in this embodiment of the invention, by adopting a packet interval and minimum time slot interval smaller than those specified in the BLE link protocol, not only further supports time slot alignment, but also helps the second communication link to transmit more data or achieve a higher coding rate per unit time. For example, a higher microphone sampling rate can be used.

[0029] In one optional implementation, when configured to prioritize audio services between the audio device and the first audio source device, at the same time, the link priority of the extended synchronous connection link of the first communication link, the link priority of the connection isochronous group link in the second communication link, the link priority of the asynchronous connection link in the second communication link, and the link priority of the asynchronous connection link in the first communication link decrease sequentially.

[0030] The dual-source wireless audio transmission method provided in this embodiment of the invention takes into account that time slot resources are limited. Therefore, by setting priorities for different links and audio data transmission services, the time slot resource configuration can be optimized. Specifically, when the audio service of the first audio source device has priority, the time slot required by that service is guaranteed first, while other services make full use of the remaining time slot resources. This time-division multiplexing method helps to improve the resource utilization and bandwidth efficiency of the system in a targeted manner, and ensures the high reliability of wireless audio transmission.

[0031] In one alternative implementation, when configured to prioritize audio services between the audio device and the second audio source device, at the same time, the link priority of the isochronous connection link in the second communication link, the link priority of the extended synchronous connection link in the first communication link, the link priority of the asynchronous connection link in the second communication link, and the link priority of the asynchronous connection link in the first communication link decrease sequentially.

[0032] The dual-source wireless audio transmission method provided in this embodiment of the invention takes into account that time slot resources are limited. Therefore, by setting priorities for different links and audio data transmission services, the time slot resource configuration can be optimized. Specifically, when the audio service of the second source device has priority, the time slot required by that service is guaranteed first, while other services make full use of the remaining time slot resources. This time-division multiplexing method helps to improve the resource utilization and bandwidth efficiency of the system in a targeted manner, and ensures the high reliability of wireless audio transmission.

[0033] In one alternative implementation, the first link clock of the first communication link is the same as or synchronized with the local clock of the first audio source device;

[0034] Furthermore, the clock of the second link of the second communication link is the same as or synchronized with the clock of the first link.

[0035] The dual-source wireless audio transmission method provided in this embodiment of the invention involves an audio device adjusting its local clock according to a first communication link and controlling the link clock of a second communication link based on its local clock, so that the second link clock of the second communication link is the same as or synchronized with the first link clock of the first communication link, thereby avoiding time slot overlap problems caused by clock asynchrony or relative drift.

[0036] Secondly, the present invention provides a method for transmitting dual-source wireless audio, applied to a second audio source device, the method comprising:

[0037] A second communication link is established with the audio device to transmit a second audio stream based on the second communication link; the audio device is the central device of the second communication link, and the second audio source device is used as a peripheral device of the second communication link;

[0038] The audio device also establishes a first communication link with the first audio source device. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clock of the second communication link is the same or synchronized with that of the first communication link. The first communication link and the second communication link are time-division multiplexed and share time slots.

[0039] The dual-source wireless audio transmission method provided in this invention establishes a second communication link between an audio device and a second audio source device. The second audio source device acts as a peripheral device on the second communication link. By changing the roles of the audio device and the second audio source device on the second communication link and performing clock synchronization control, the entire synchronous transmission system can maintain the same or synchronized clock, avoiding time slot overlap caused by clock asynchrony or relative clock drift. Furthermore, the time-division multiplexing method with shared time slots between the communication links supports TSWA, which can improve time slot utilization and solve the bandwidth shortage problem faced by existing technologies when supporting TSWA. Therefore, this invention enables audio devices to support TSWA, providing a better and more convenient wireless audio service experience.

[0040] In an optional implementation, the method further includes: adjusting the local clock of the second audio source device based on the second link clock of the second communication link, so that the adjusted local clock of the second audio source device is the same as or synchronized with the second link clock.

[0041] In an optional implementation, the method further includes: the second audio source device is provided with an asynchronous sampling rate converter for synchronizing the sampling rate of the audio data input to the second audio source device with the adjusted local clock of the second audio source device.

[0042] The dual-source wireless audio transmission method provided in this invention ensures that the audio data transmission of the second source device on the second communication link is synchronized with the entire system by adjusting the local clock of the second source device to be the same as or synchronized with the clock of the second link. Furthermore, in some application scenarios, when the sampling rate of the audio data is not synchronized with the local clock of the source device, it may lead to audio overflow or playback issues caused by audio asynchrony. Therefore, the sampling rate of the audio data input to the second source device can be adjusted to be synchronized with the adjusted local clock, thereby effectively avoiding audio data overflow or playback issues caused by clock asynchrony.

[0043] Thirdly, the present invention provides a dual-source wireless audio transmission system, the system comprising an audio device, a first audio source device, and a second audio source device;

[0044] An audio device establishes a first communication link with a first audio source device to transmit a first audio stream based on the first communication link; the first audio source device is the central device of the first communication link, and the audio device is a peripheral device of the first communication link.

[0045] The audio device establishes a second communication link with the second audio source device to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link, and the second audio source device is the peripheral device of the second communication link; the link clocks of the first communication link and the second communication link are the same or synchronized.

[0046] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first and second communication links are time-division multiplexed and share time slots.

[0047] Fourthly, the present invention provides an audio device, comprising:

[0048] The first communication unit is used to establish a first communication link with the first audio source device and to transmit the first audio stream based on the first communication link; the audio device is a peripheral device of the first communication link.

[0049] The second communication unit is used to establish a second communication link with the second audio source device and to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link;

[0050] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the first and second communication links are the same or synchronized, and the first and second communication links are time-division multiplexed and share time slots.

[0051] Fifthly, the present invention provides a second sound source device, comprising:

[0052] The third communication unit is used to establish a second communication link with the audio device to transmit the second audio stream based on the second communication link.

[0053] Among them, the audio device is the central device of the second communication link, and the second sound source device is the peripheral device of the second communication link;

[0054] The audio device also establishes a first communication link with the first audio source device. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clock of the second communication link is the same or synchronized with that of the first communication link. The first communication link and the second communication link are time-division multiplexed and share time slots. Attached Figure Description

[0055] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0056] Figure 1 This is a flowchart illustrating a dual-source wireless audio transmission method according to an embodiment of the present invention.

[0057] Figure 2 This is a schematic diagram of the dual-link time relationship of a dual-source wireless audio transmission method according to an embodiment of the present invention;

[0058] Figure 3 This is a flowchart illustrating another method for transmitting dual-source wireless audio according to an embodiment of the present invention.

[0059] Figure 4 This is a schematic diagram of the structure of a dual-source wireless audio transmission system according to an embodiment of the present invention;

[0060] Figure 5 This is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. Detailed Implementation

[0061] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0062] The rapid development of wireless connectivity technologies such as Classic Bluetooth (CBT), Bluetooth Low Energy (BLE), and Wi-Fi has made wireless audio and wireless communication an important part of people's lives. For example, CBT wireless audio terminal devices using smartphones as audio sources, such as CBT audio headphones and CBT Audio speakers, have gained widespread popularity. BLE Audio, offering lower latency, lower power consumption, and higher performance wireless audio services, is also expected to attract more attention. However, existing CBT Audio or BLE Audio terminal devices can only transmit and receive wireless audio through one CBT or BLE audio source device; they do not support simultaneous transmission and reception of wireless audio through two CBT or BLE audio source devices. For example, existing CBT Audio or BLE Audio headphones cannot be used to play online games on one smartphone while simultaneously answering phone calls on another. In other words, current technology does not support dual-source wireless audio (TSWA) or multi-source wireless audio (MSWA).

[0063] Analysis revealed two main reasons why CBT or BLE wireless audio terminal devices do not support MSWA. First, the bandwidth for simultaneous transmission and reception of wireless audio between the CBT or BLE wireless audio terminal device and multiple CBT or BLE audio source devices is insufficient, making it difficult to guarantee the reliability or quality of wireless audio transmission. Second, the clocks of the CBT or BLE wireless audio terminal device and multiple CBT or BLE audio source devices are not synchronized, preventing synchronous acquisition and playback of MSWA.

[0064] According to an embodiment of the present invention, a method for transmitting dual-source wireless audio is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0065] This embodiment provides a method for transmitting dual-source wireless audio, which is applied to an audio device.

[0066] The audio device wirelessly communicates with both the first and second audio source devices to achieve the dual-source wireless audio transmission. Specifically, the audio source device can be a mobile phone, portable game console, portable media player, personal computer, in-vehicle media player, or a dongle for connecting to multimedia devices, etc., which can send audio streams to the audio device. The audio stream data can be locally stored or externally received, such as locally stored audio data, voice data streams received via mobile cellular networks, or voice / audio data received via the internet. The first and second audio source devices can be of the same type or different types.

[0067] Audio devices can be various suitable wireless audio devices, such as wireless headphones, wireless speakers, augmented reality (AR) devices, and virtual reality (VR) devices. Audio devices can receive wireless audio from audio source devices. Furthermore, audio devices can also have audio input functionality; that is, they can not only receive audio streams from audio source devices but also capture local sound signals and send them to the audio source device. For example, a headset with a microphone, when used for voice calls, can capture the user's voice signal and send it to a mobile phone. Furthermore, audio devices can also have audio playback functionality, thus serving as wireless audio output devices.

[0068] Figure 1 This is a flowchart of a dual-source wireless audio transmission method according to an embodiment of the present invention, such as... Figure 1 As shown, the process includes the following steps:

[0069] Step S101: Establish a first communication link with the first audio source device to transmit the first audio stream based on the first communication link.

[0070] Specifically, the audio device is a peripheral device of the first communication link, and the first sound source device is a central device of the first communication link.

[0071] Step S102: Establish a second communication link with the second audio source device to transmit the second audio stream based on the second communication link.

[0072] Specifically, the audio device is the central device of the second communication link, and the second sound source device is the peripheral device of the second communication link.

[0073] Step S103: When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the first communication link and the second communication link are the same or synchronized, and the first communication link and the second communication link are time-division multiplexed and share time slots.

[0074] The shared time slot between two communication links can be understood as the overlap of at least some communication periods between one link and the other in the time domain. For example, if two links share a time slot for a certain communication period, then that communication period corresponds to the time slot for sending and receiving data packets on one link and also to the time slot for sending and receiving data packets on the other link. Therefore, the first and second communication links each have their own pre-allocated time slot structures in the time domain, and by sharing time slots, their time slot structures overlap at least partially, thereby minimizing the low data transmission efficiency and wasted time slot resources of traditional time-division multiplexing communication methods. This time-division multiplexing method with shared time slots will help solve the bandwidth shortage problem when dual-source wireless audio coexists. It is understood that the timing relationship between steps S101 and S102 can be flexible and is not limited to... Figure 1 The order shown.

[0075] It should be noted that both the first and second audio streams can be unidirectional or bidirectional audio data streams. That is, the audio device can receive only audio data from the audio source device, such as when listening to music from a mobile phone through headphones, the audio stream transmitted between the headphones and the mobile phone is unidirectional. Alternatively, the audio device can receive audio data from the audio source device and send audio data back to the audio source device, such as when making or receiving a phone call through headphones, the headphones not only receive the voice from the mobile phone but also send the user's voice back to the mobile phone. In this case, the audio stream transmitted between the headphones and the mobile phone is bidirectional.

[0076] The dual-source wireless audio transmission method provided in this invention avoids time slot overlap caused by clock asynchrony or relative clock drift when dual-source wireless audio coexists. Furthermore, the time-division multiplexing method using shared time slots between communication links supports TSWA, improving time slot utilization and solving the bandwidth shortage problem faced by existing technologies in supporting TSWA. Therefore, this invention enables audio devices to support TSWA, providing a better and more convenient wireless audio service experience.

[0077] In some optional implementations, the first link clock of the first communication link is the same as or synchronized with the local clock of the first audio source device, and the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0078] The first audio source device is the central device of the first communication link, and it uses its local clock to configure the link clock of the first communication link. The audio device, as a peripheral device of the first communication link, adjusts its local clock according to the link clock of the first communication link, so that its local clock is the same as or synchronized with the first link clock of the first communication link.

[0079] Furthermore, since the audio device is the central device of the second communication link, its local clock is used to configure the second link clock of the second communication link, so that the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0080] In some alternative implementations, the first communication link includes a CBT link; the second communication link has a different link protocol than the first communication link.

[0081] The second communication link can adopt the BLE link protocol or other link protocols suitable for this embodiment. These link protocols can be general standard protocols or custom proprietary protocols. For example, in some specific embodiments, the second communication link can also be an improved BLE link (IBLE), which is obtained by improving the existing BLE link protocol based on the core ideas of this application.

[0082] In some alternative implementations, the second communication link includes an asynchronous connection-oriented (ACL) link and a connected isochronous group (CIG) link consisting of at least one connected isochronous streaming (CIS) link.

[0083] The first communication link includes an asynchronous connection-oriented (ACL) link and an extended synchronous connection-oriented (eSCO) link;

[0084] The isochronous connection group links in the second communication link share time slots with the extended synchronous connection links and the asynchronous connection links in the first communication link, respectively.

[0085] The asynchronous connection link in the first communication link shares a time slot with the asynchronous connection link in the second communication link.

[0086] In this embodiment, by configuring the isochronous connection group links in the second communication link to share time slots with the extended synchronous connection links and asynchronous connection links in the first communication link, and the asynchronous connection links of the two communication links to share time slots, the effective bandwidth can be effectively improved, thereby ensuring the reliability and audio quality of TSWA audio transmission.

[0087] Based on clock synchronization, this application embodiment also employs a time slot alignment method to avoid the problem of time slots not being fully utilized.

[0088] In some optional implementations, the duration of the isochronous interval of the extended synchronous connection link of the first communication link is the same as the duration of the isochronous interval of the connection isochronous group link of the second communication link; the subinterval of the connection isochronous group link of the second communication link is M times the subinterval of the first communication link, where M is a positive integer.

[0089] The duration of a sub-interval of the first communication link is sufficient to allow the central device and peripheral devices of the first communication link to each send and receive a data packet once on the extended synchronous connection link of the first communication link.

[0090] Taking the first communication link as a CBT link as an example, the duration of the sub-interval is at least equal to the sum of the first time when the CBT central device sends a data packet to the CBT peripheral device (correspondingly, the CBT peripheral device receives the data packet at the first time) and the second time when the CBT peripheral device sends a data packet (correspondingly, the central device receives the data packet at the second time).

[0091] It is understandable that the central device and peripheral devices of the second communication link can each send and receive data packets once within a subinterval of a CIG link.

[0092] By setting the equal time interval between the first and second communication links to be of equal duration, and configuring the duration of their sub-intervals to be integer multiples, it is easier to control the time slot alignment of audio stream transmission on the basis of clock synchronization between the two links, thereby further improving the time slot utilization.

[0093] In some optional implementations, the time interval between the starting point of the isochronous group link in the second communication link and the starting point of the extended synchronous connection link in the first communication link is N times the sub-interval of the second communication link, where N is a positive integer.

[0094] The starting point refers to the initial time. The starting point of the second communication link connecting to the isochronous group link can be understood as the starting time of each isochronous interval on the second communication link connecting to the isochronous group link. The starting point of the extended synchronization connection link in the first communication link can be understood as the starting time of each isochronous interval on the extended synchronization connection link in the communication link. The time interval between the starting point of the second communication link connecting to the isochronous group link and the starting point of the extended synchronization connection link in the first communication link can be understood as the time interval between the starting point of a second communication link connecting to the isochronous group link and the starting point of the extended synchronization connection link of the first communication link whose time domain location is closest to it.

[0095] It is understandable that when the link clocks of two links are the same or synchronized, the starting time of each subsequent equal time interval can satisfy the difference in the starting interval mentioned above.

[0096] By configuring the offset between the equal time intervals of the two communication links and the duration relationship of the sub-intervals of the second communication link, the time slot alignment relationship can be further optimized and the time slot utilization rate can be improved.

[0097] In some optional implementations, the communication duration of the asynchronous connection link of the second communication link is S times the sub-interval of the second communication link, where S is a positive integer.

[0098] It is understood that the communication duration of the asynchronous connection link of the second communication link can be used at least for the central device and peripheral devices of the second communication link to each send and receive asynchronous link data packets once based on the asynchronous connection link.

[0099] The above configuration can further optimize the time slot alignment relationship and improve time slot utilization by constraining the communication duration of the ACL link and the duration of the sub-interval of the second communication link.

[0100] In the above optional embodiments, the values ​​of M, N, and S can be configured according to specific application scenarios, and this application does not impose specific limitations on this. In a specific application scenario, M, N, and S can be configured to be equal.

[0101] In some alternative implementations, the asynchronous connection links in the second communication link share time slots with the connected isochronous group links in the second communication link.

[0102] In this embodiment, the second communication link can further improve the time slot utilization rate by configuring the isochronous group link to share the time slot with the asynchronous connection link, thereby solving the problem of insufficient bandwidth.

[0103] In some optional implementations, the second communication link uses an inter-frame space (T_IFS) smaller than the inter-frame space specified by the BLE link protocol, and / or the second communication link uses a minimum slot space (T_MSS) smaller than the minimum slot space specified by the BLE link protocol.

[0104] The BLE link protocol specifies that both the packet interval and the minimum time slot interval are 150µs.

[0105] By using a smaller packet interval and minimum time slot interval than specified by the BLE link protocol, this link can not only further support time slot alignment, but also help the second communication link to transmit more data or achieve a higher coding rate per unit time, for example, by using a higher microphone sampling rate.

[0106] The above configuration allows multiple links to share time slots, thus enabling the configuration of link priorities to further optimize time slot resource allocation. It is understood that various link priority configuration methods can be adopted depending on the specific application scenario, and this application does not impose any specific restrictions on this.

[0107] In some alternative embodiments, link priorities can be configured based on the principle of prioritizing audio transmission, thereby prioritizing audio performance, that is, links that get time slot resources first have better audio performance.

[0108] For example, in the aforementioned embodiments, when the isochronous connection group links in the second communication link share time slots with the extended synchronous connection links and the asynchronous connection links in the first communication link, respectively, the link priority of the asynchronous connection links in the first communication link can be further configured to be lower than the link priority of the isochronous connection group links in the second communication link. Then, if both audio transmission services on the isochronous connection group links of the second communication link and asynchronous data transmission services on the asynchronous connection links of the first communication link exist within a shared time slot, the shared time slot will be used to process the audio transmission services of the isochronous connection group links first.

[0109] For example, in the aforementioned embodiments, when asynchronous links in the first communication link and asynchronous links in the second communication link share a time slot, the link priority of the asynchronous links in the first communication link can be further configured to be lower than the link priority of the isochronous connection group links in the second communication link. Then, if both a first asynchronous link data transmission service on the asynchronous link in the first communication link and a second asynchronous link data transmission service on the asynchronous link in the second communication link exist within a shared time slot, the shared time slot will be used to process the second asynchronous link data transmission service first.

[0110] For example, in the aforementioned embodiments, when the asynchronous connection link and the isochronous group link in the second communication link share a time slot, the link priority of the isochronous group link in the second communication link can be further configured to be higher than the link priority of the asynchronous connection link in the second communication link. Then, if both asynchronous link data transmission services on the asynchronous connection link and audio transmission services on the isochronous group link in the second communication link exist within a shared time slot, the shared time slot will be used to process the audio transmission services first.

[0111] In one specific implementation, when the audio service between the audio device and the first audio source device is configured to take priority, at the same time, the link priority of the extended synchronous connection link of the first communication link, the link priority of the connection isochronous group link in the second communication link, the link priority of the asynchronous connection link in the second communication link, and the link priority of the asynchronous connection link in the first communication link decrease in sequence.

[0112] Therefore, by configuring link priorities, when supporting the coexistence of dual-source wireless audio transmission using time-division multiplexing with shared time slots between the first and second communication links, the audio data packets of the first audio stream will be transmitted first within an equal time interval. If there are remaining time slots within the equal time interval, the audio data packets of the second audio stream will be transmitted then. If there are remaining time slots within the equal time interval, the remaining time slot resources will be used to process transmission services on asynchronous connection links.

[0113] In another specific implementation, when configured to prioritize audio services between the audio device and the second audio source device, at the same time, the link priority of the isochronous group link in the second communication link, the link priority of the extended synchronous connection link in the first communication link, the link priority of the asynchronous connection link in the second communication link, and the link priority of the asynchronous connection link in the first communication link decrease sequentially.

[0114] Therefore, by configuring link priorities, when supporting the coexistence of dual-source wireless audio transmission using time-division multiplexing with shared time slots between the first and second communication links, the audio data packets of the second audio stream will be transmitted first within an equal time interval. If there are remaining time slots within the equal time interval, the audio data packets of the first audio stream will be transmitted then. If there are remaining time slots within the equal time interval, the remaining time slot resources will be used to process transmission services on asynchronous connection links.

[0115] To facilitate understanding, the core ideas of the embodiments of the present invention will be further described below in conjunction with typical application scenarios. However, it should be understood that the scope of protection of this application is not limited thereto. As a typical application, a specific embodiment of an audio device is illustrated using a headset with a microphone (hereinafter also referred to as a TSWA headset). The first audio source device can be a smartphone, the second audio source device can be a USB adapter (dongle) plugged into another smartphone, and the audio device is a headset with a microphone. A typical application scenario is that the headset connects to the smartphone via a first communication link to make and receive calls, while simultaneously connecting to a USB dongle via a second communication link to play games. The game audio is bidirectional. Game audio requires low latency and high reliability, meaning it needs a sufficient number of retransmissions without excessive latency.

[0116] The first communication link is a CBT link, and the second communication link is an IBLE link.

[0117] The TSWA headphones connect to the smartphone of the first audio source device via a CBT link. The TSWA headphones act as a peripheral device of the CBT link, while the first audio source device acts as the central device of the CBT link.

[0118] The TSWA headphones connect to the USB dongle of the second audio source device via an IBLE link. The TSWA headphones act as the central device in the IBLE link, while the USB dongle acts as a peripheral device in the IBLE link.

[0119] When both CBT and IBLE links exist simultaneously, the TSWA headset establishes and maintains the CBT and IBLE links separately and in a time-division multiplexing manner. The clock of the CBT link is synchronized with the clock of the IBLE link and they share the same time slot.

[0120] Compared to BLE links, the main characteristics of IBLE links are reflected in two aspects: First, the inter-packet interval T_IFS is less than the existing 150us constraint, or the minimum time slot interval T_MSS is less than the existing 150us constraint. Second, IBLE asynchronous connection ACL links and connection isochronous group CIG links composed of at least one connection isochronous flow CIS link share time slots.

[0121] Specifically, the connection relationship between the audio device and the first audio source device and the second audio source device includes three types: First, a first communication link is established only with the first audio source device; second, a second communication link is established only with the second audio source device; third, a first communication link is established with the first audio source device and a second communication link is established with the second audio source device, that is, audio data transmission on the first communication link and the second communication link coexists.

[0122] In the specific application scenarios mentioned above, when TSWA headphones are connected to both the first and second audio source devices simultaneously, there are two situations:

[0123] The first method involves connecting the first audio source device first, followed by the second audio source device.

[0124] The second method is to connect the second audio source device first and then connect the first audio source device.

[0125] When TSWA headphones disconnect from both the first and second simultaneously connected audio source devices, there are two scenarios:

[0126] The first method is to disconnect the first audio source device first, and then disconnect the second audio source device.

[0127] The second method is to disconnect the second audio source device first, and then disconnect the first audio source device.

[0128] When the TSWA headset is connected to only the primary audio source device, it first establishes a CBT (Asynchronous Connection-oriented) link. When a call is required, it then establishes a CBT (Extended Synchronous Connection-Oriented) link, followed by an upper-layer hands-free protocol (HFP) application. The primary audio source device acts as the central device in the CBT link, while the TSWA headset acts as a peripheral device. The TSWA headset continuously adjusts its local clock's NCO (Neural Clock Control) based on the difference between its local clock and the clock of the CBT link or the primary audio source device, ensuring that the TSWA headset's local clock remains the same as or synchronized with the clock of the CBT link or the primary audio source device.

[0129] When the TSWA headset is connected to only a second audio source device, an IBLE ACL link is established first. When gaming is required, a Connected Isochronous Group (CIG) link is established, followed by the upper-layer Telephony and Media Audio Profile (TMAP) application. The TSWA headset acts as the central device in the IBLE link, while the USB dongle acts as a peripheral device. The USB dongle adjusts its local clock's NCO based on the difference between its local clock and the clock of the IBLE link or the TSWA headset, ensuring that the USB dongle's local clock is the same as or synchronized with the clock of the IBLE link or the TSWA headset.

[0130] When the TSWA headphones are connected to both the first and second audio source devices simultaneously, if the first audio source device is connected first and then the second, the clock relationship when connecting to the first audio source device is the same as when connecting the first audio source device alone. When connecting the second audio source device, the TSWA headphones establish an IBLE link using a local clock adjusted according to the CBT link. The clock of the IBLE link is the same as or synchronized with the TSWA headphones' local clock adjusted according to the CBT link. The USB dongle adjusts its local clock NCO based on the difference between its local clock and the IBLE link clock to ensure that the USB dongle's local clock is the same as or synchronized with the IBLE link clock, thereby ensuring that the USB dongle's local clock is the same as or synchronized with the CBT link clock.

[0131] When the TSWA headphones are connected to both the first and second audio source devices simultaneously, if the second audio source device is connected first and then the first, the clock relationship when connecting the second audio source device is the same as when connecting the second audio source device alone. When the first audio source device is then connected, the TSWA headphones adjust their local clock according to the CBT link. The IBLE link clock remains the same as or synchronized with the TSWA headphones' local clock adjusted according to the CBT link. Similarly, the USB dongle adjusts its local clock NCO based on the difference between its local clock and the IBLE link clock to ensure that its local clock is the same as or synchronized with the IBLE link clock, thereby ensuring that its local clock is the same as or synchronized with the CBT link clock.

[0132] When the TSWA headphones disconnect from both the first and second simultaneously connected audio source devices, if the second audio source device is disconnected first and then the first, the clock relationship when the TSWA headphones are connected to the first audio source device remains the same as when connected to the first audio source device alone. If the first audio source device is disconnected first and then the second, the TSWA headphones stop adjusting their local clock according to the CBT link. The clock relationship when the TSWA headphones are connected to the second audio source device remains similar to when connected to the second audio source device alone, except that the local clock previously adjusted according to the CBT link is no longer adjusted.

[0133] Furthermore, when the TSWA headphones are connected to a second audio source device, the USB dongle, via an IBLE link, the USB dongle needs to obtain USB audio from another smartphone. If the external input clock of the USB audio is inconsistent with the local clock of the USB dongle, the USB audio needs to undergo sampling rate conversion before it can be transmitted and received via the IBLE link. In other words, the USB dongle can use an asynchronous sampling rate converter (ASRC) to convert the sampling rate of the input USB audio based on its estimated deviation between the local clock and the external input clock before sending it to the TSWA headphones via the IBLE link.

[0134] Currently, almost all smartphones use 2EV3 packets when establishing eSCO links with their HFP function. Each slot on a CBT link is 625µs. The central device and peripheral devices on the CBT link each send and receive 2EV3 packets at least once, each occupying one slot, for a total of 1.25ms. Within each eSCO interval, there are generally two retransmissions, so the maximum time slot occupied within each eSCO interval may be 3.75ms. In addition, the CBT ACL link used by the TSWA headset to maintain the connection with the smartphone of the first audio source device also randomly occupies some slots for link maintenance or transmitting link management commands. Therefore, within each eSCO interval, very few slots are left for the IBLE link to transmit audio data and maintain the connection with the audio source device. To enable simultaneous transmission of two audio streams and ensure high reliability of game audio transmission, it is necessary to improve the slot utilization of both links to increase their effective bandwidth.

[0135] Based on the core idea of ​​the embodiments of the present invention, the IBLE CIG link can be configured with the following parameters in the typical application scenario. It should be understood that these link parameter configurations combined with this typical application scenario are merely illustrative and do not constitute a limitation on the scope of protection of this application.

[0136] IBLE CIG uses Low Complexity Communication Codec (LC3) with a frame length of 7.5ms. The central device of the IBLE CIG link, the mono microphone of the TSWA headset, has a sampling rate of 16kHz and an encoding rate of 32kbps. The peripheral device of the IBLE CIG link, the USB dongle, has a stereo sampling rate of 48kHz and an encoding rate of 96kbps per channel. The mono Service Data Unit (SDU) sent by the central device is 30 bytes, and the stereo SDU sent by the peripheral device is 180 bytes. IBLE CIG includes a CIS link, using a BLE 2Mbps physical layer (PHY). The CIS Protocol Data Unit (PDU) sent by the central device occupies 180µs of air time, and the CIS PDU sent by the peripheral device occupies 780µs of air time. The CIS link's Sub-Interval is 1.25ms, with the Inter-Frame Space (T_IFS) being 140µs and the Minimum Slot Space (T_MSS) being 150µs. Within the 7.5ms ISO Interval, there are a maximum of 6 sub-events, meaning the Number of Sub-Events (NSE) is 6. For low-latency game audio, the CIS link's Flush Timeout (FT) parameter is 1. The IBLE ACL link's Connection Interval is 45ms, with a maximum of 1.25ms of transmission and reception within each connection interval. The CIS link's offset relative to the IBLE ACL link (CIS Offset) is 2.5ms. Therefore, the transmit / receive time of the IBLE ACL link within each Connection Interval overlaps with the fifth CIS Sub-event within one of every six ISO Intervals of the CIS link. This means that if a CIS PDU within this time interval requires a fourth retransmission, it will occupy the transmit / receive time of the IBLE ACL link. To ensure IBLE Audio performance, when the transmit / receive time of the IBLE ACL overlaps with the IBLE CIG retransmission time, IBLE CIG takes priority.

[0137] In addition, since the duration of the ISO Interval of the CIG link is also configured to be an integer multiple of its sub-interval, all time slots within an ISO Interval of the CIG link can be used for game audio transmission when needed, so as to effectively guarantee the communication performance or reliability of wireless game audio.

[0138] Please see Figure 2 , Figure 2 This diagram illustrates the time coexistence relationship between IBLE links in TMAP applications and CBT links in HFP applications. The eSCO link interval (eSCO Interval) is 7.5ms, and the CIG link's isochronous interval (ISO Interval) is also 7.5ms. The CIG isochronous interval (ISO Interval) is the same as the eSCO interval of the CBT eSCO link. The offset of the start point of each ISO Interval of the CIG link relative to the start point of each eSCO Interval of the eSCO link is 1.25ms. Figure 2 In the diagram, HFP represents the timeline of the CBT link, where C1 represents the air time for the CBT central device to send 2EV3 (corresponding to the time for the CBT peripheral device to receive 2EV3), P1 represents the air time for the CBT peripheral device to send 2EV3 (corresponding to the time for the CBT central device to receive 2EV3), c1 represents the air time for the CBT central device to send 1 slot ACL packet, and p1 represents the air time for the CBT peripheral device to send 1 slot ACL. Figure 2 In the diagram, TMAP represents the timeline of the IBLE link, C2 represents the air time for the IBLE central device to send a CIS PDU (corresponding to the time for the IBLE peripheral device to receive a CIS PDU), and P2 represents the air time for the IBLE peripheral device to send a CIS PDU (corresponding to the time for the IBLE central device to receive a CIS PDU). Solid lines represent the first transmit / receive time slot of each eSCO interval for the eSCO link or each ISO interval for the CIG link, while dashed lines represent retransmission time slots or time slots that may not be transmitted or received. The maximum number of retransmissions within an eSCO interval for an eSCO link is 2, and the maximum number of retransmissions within an ISO interval for an IBLE CIG link is 5.

[0139] Depend on Figure 2As shown in the time coexistence diagram of TMAP and HFP applications, when the IBLE and CBT links of the TSWA headset are time-division multiplexed, as long as the clocks of the IBLE and CBT links remain the same or synchronized, the IBLE and CBT links can jointly obtain the maximum transmit and receive time, thus avoiding time slot waste caused by clock asynchrony or misalignment. Furthermore, the transmit and receive time slots of the CBT eSCO link within each eSCO interval can be shared with the IBLE CIG link. The time slots of the CBT ACL link and the IBLE ACL link can also be shared by the IBLE CIG link.

[0140] Specifically, with Figure 2 For example, if HFP call functionality takes priority, within each eSCO Interval, 2EV3 packets from eSCO are transmitted and received first. Once both the CBT central device and CBT peripheral devices have correctly received the 2EV3 packets, retransmission stops, and time slot priority is given to the IBLE CIG link. Within the CIG ISO Interval, once both the IBLE central device and IBLE peripheral devices have correctly received the CISPDU, retransmission stops, and time slot priority is then given to the CBT ACL link. When the transmit / receive time slots of the CBT ACL link conflict with those of the IBLE ACL link, the IBLE ACL link takes priority to ensure high reliability of wireless audio transmission.

[0141] If TMAP game audio functionality is prioritized, within each ISO Interval, CIS PDU transmission and reception are prioritized. Once both the IBLE central device and IBLE peripheral devices have correctly received the CIS PDU packet, retransmission stops, and time slot priority is given to the CBTESI link. Within the eSCO Interval, once both the CBT central device and CBT peripheral devices have correctly received the 2EV3 packet, retransmission stops, and time slot priority is then given to the CBT ACL link and the IBLE ACL link. When the transmit / receive time slots of the CBT ACL link conflict with those of the IBLE ACL link, the IBLE ACL link takes priority.

[0142] As seen in the examples of the typical application scenarios described above, the TSWA system can adjust the sampling rate and coding rate to adjust the airtime occupied by audio data packets, and adjust parameters such as T_IFS and T_MSS to adjust the sub-interval duration, ensuring that the sub-interval is a multiple of 1.25ms. Finally, by adjusting the offset between the starting points of the CIG and eSCO links to a multiple of 1.25ms, the IBLE and CBT links of the TSWA headset can fully share the time slots of time division multiplexing, improving the link efficiency of the CBT and IBLE links. This allows HFP calls and wireless game audio to coexist or be transmitted and received simultaneously, while ensuring the communication performance or reliability of the wireless game audio. Figure 2 As shown, voice calls on the CBT eSCO link can be retransmitted up to 2 times (and more if the smartphone supports it), while game audio on the IBLE CIG link can be retransmitted up to 5 times. The IBLE CIG link can further improve the communication performance or reliability of game audio by setting a larger refresh timeout parameter FT greater than 1, thereby increasing the appropriate latency.

[0143] This embodiment provides a dual-source wireless audio transmission method, applied to a second audio source device. Figure 3 This is a flowchart of a dual-source wireless audio transmission method according to an embodiment of the present invention, such as... Figure 3 As shown, the process includes the following steps:

[0144] Step S301: Establish a second communication link with the audio device to transmit the second audio stream based on the second communication link.

[0145] Specifically, the audio device is the central device of the second communication link, and the second sound source device is used as a peripheral device of the second communication link.

[0146] Specifically, the audio source device, as described in the above embodiments, can be a mobile phone, a portable game console, a portable media playback device, a personal computer, an in-vehicle media playback device, an adapter (dongle) for connecting to a multimedia device, etc., which can send audio streams to the audio device. Furthermore, the audio device can also have an audio input function.

[0147] In step S302, the audio device also establishes a first communication link with the first audio source device. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the second communication link and the first communication link are the same or synchronized. The first communication link and the second communication link are time-division multiplexed and share time slots.

[0148] Specifically, the first and second audio source devices can be the same type of device or different types of devices.

[0149] In one optional implementation, the local clock of the second audio source device is adjusted based on the second link clock of the second communication link, so that the adjusted local clock of the second audio source device is the same as or synchronized with the second link clock.

[0150] The second audio source device is equipped with an asynchronous sampling rate converter to synchronize the sampling rate of the audio data input to the second audio source device with the adjusted local clock of the second audio source device.

[0151] For example, in the above application scenario, when connecting a second audio source device, the TSWA headphones use a second link clock configured according to their local clock for the second communication link. The second audio source device, the USB dongle, adjusts its local clock's NCO based on the difference between its local clock and the second link clock, ensuring that the USB dongle's local clock is the same as or synchronized with the second link clock. Therefore, if the TSWA headphones' local clock is the same as or synchronized with the first link clock of the first communication link, the USB dongle's local clock will also be the same as or synchronized with the first link clock.

[0152] The dual-source wireless audio transmission method for a second audio source device provided in this embodiment can work in conjunction with the dual-source wireless audio transmission method for an audio device provided in the foregoing embodiment to solve the problem that dual-source wireless audio cannot be transmitted synchronously. Since the foregoing embodiment has been described in detail, it will not be repeated here to avoid repetition.

[0153] This embodiment provides a dual-source wireless audio transmission system, the system as follows: Figure 4 As shown, it includes an audio device, a first audio source device, and a second audio source device;

[0154] An audio device establishes a first communication link with a first audio source device to transmit a first audio stream based on the first communication link; the first audio source device is the central device of the first communication link, and the audio device is a peripheral device of the first communication link.

[0155] The audio device establishes a second communication link with the second audio source device to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link, and the second audio source device is the peripheral device of the second communication link; the link clocks of the first communication link and the second communication link are the same or synchronized.

[0156] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first and second communication links are time-division multiplexed and share time slots.

[0157] The dual-source wireless audio transmission system provided in this embodiment can realize the dual-source wireless audio transmission method in the aforementioned embodiment, and solve the problem that dual-source wireless audio cannot be transmitted synchronously at present. Since the aforementioned embodiments have been described in detail, they will not be repeated here to avoid repetition.

[0158] This embodiment provides an audio device, including:

[0159] The first communication unit is used to establish a first communication link with the first audio source device and to transmit the first audio stream based on the first communication link; the audio device is a peripheral device of the first communication link.

[0160] The second communication unit is used to establish a second communication link with the second audio source device and to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link;

[0161] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the first communication link and the second communication link are the same or synchronized, and the first communication link and the second communication link share time slots through time division multiplexing.

[0162] In practical implementation, audio devices can be any type of audio output device used to convert audio streams into audio signals and play them, such as speakers, in-ear headphones, over-ear headphones, and speaker enclosures. Additionally, audio devices can also have audio input functionality; that is, they can not only receive audio streams from audio source devices but also capture local sound signals and send them to the audio source device. For example, a headset with a microphone, when used for voice calls, can capture the user's voice signal and send it to the mobile phone.

[0163] The audio device provided in this embodiment can realize the various processes on the audio device side of the dual-source wireless audio transmission method in the aforementioned embodiments, and solve the problem that dual-source wireless audio cannot achieve synchronous transmission. Since the aforementioned embodiments have been described in detail, they will not be repeated here to avoid repetition.

[0164] This embodiment provides a second audio source device, including:

[0165] The third communication unit is used to establish a second communication link with the audio device to transmit the second audio stream based on the second communication link.

[0166] The audio device is the central device of the second communication link, and the second sound source device is the peripheral device of the second communication link;

[0167] The audio device also establishes a first communication link with the first audio source device. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clock of the second communication link is the same or synchronized with that of the first communication link. The first communication link and the second communication link are time-division multiplexed and share time slots.

[0168] The second audio source device provided in this embodiment can realize the various processes on the second audio source device side of the dual-source wireless audio transmission method in the aforementioned embodiments, and solve the problem that dual-source wireless audio cannot achieve synchronous transmission. Since the aforementioned embodiments have been described in detail, they will not be repeated here to avoid repetition.

[0169] This invention also provides a computer device for controlling the transmission of audio stream data between audio devices and audio source devices. (See also...) Figure 5 , Figure 5 This is a schematic diagram of the structure of a computer device provided in an optional embodiment of the present invention, such as... Figure 5 As shown, the computer device includes one or more processors 10, memory 20, and interfaces for connecting the components, including high-speed interfaces and low-speed interfaces. The components communicate with each other via different buses and can be mounted on a common motherboard or otherwise installed as needed. The processors can process instructions executed within the computer device, including instructions stored in or on memory to display graphical information of a GUI on external input / output devices (such as display devices coupled to the interfaces). In some alternative implementations, multiple processors and / or multiple buses can be used with multiple memories and multiple memory modules, if desired. Similarly, multiple computer devices can be connected, each providing some of the necessary operations (e.g., as a server array, a group of blade servers, or a multiprocessor system). Figure 5 Take a processor 10 as an example.

[0170] Processor 10 may be a central processing unit, a network processor, or a combination thereof. Processor 10 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The programmable logic device may be a complex programmable logic device (CAMP), a field-programmable gate array (FPGA), a general-purpose array logic (GDA), or any combination thereof.

[0171] The memory 20 stores instructions executable by at least one processor 10 to cause the at least one processor 10 to perform the method shown in the above embodiments.

[0172] The memory 20 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the computer device. Furthermore, the memory 20 may include high-speed random access memory and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid-state storage device. In some alternative embodiments, the memory 20 may optionally include memory remotely located relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0173] The memory 20 may include volatile memory, such as random access memory; the memory may also include non-volatile memory, such as flash memory, hard disk or solid-state drive; the memory 20 may also include a combination of the above types of memory.

[0174] The computer device also includes a communication interface 30 for communicating with other devices or communication networks.

[0175] This invention also provides a computer-readable storage medium for storing instructions for implementing the aforementioned communication protocol. The methods described in this invention can be implemented in hardware or firmware, or implemented as computer code that can be recorded on a storage medium, or downloaded via a network and originally stored on a remote storage medium or a non-transitory machine-readable storage medium and will be stored on a local storage medium. Thus, the methods described herein can be processed by software stored on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. The storage medium can be a magnetic disk, optical disk, read-only memory, random access memory, flash memory, hard disk, or solid-state drive, etc.; further, the storage medium may also include combinations of the above types of memory. It is understood that computers, processors, microprocessor controllers, or programmable hardware include storage components capable of storing or receiving software or computer code. When the software or computer code is accessed and executed by the computer, processor, or hardware, the methods shown in the above embodiments are implemented.

[0176] A portion of this invention can be applied as a computer program product, such as computer program instructions, which, when executed by a computer, can invoke or provide the methods and / or technical solutions according to the invention through the operation of the computer. Those skilled in the art will understand that the forms in which computer program instructions exist in a computer-readable medium include, but are not limited to, source files, executable files, installation package files, etc. Correspondingly, the ways in which computer program instructions are executed by a computer include, but are not limited to: the computer directly executing the instructions, or the computer compiling the instructions and then executing the corresponding compiled program, or the computer reading and executing the instructions, or the computer reading and installing the instructions and then executing the corresponding installed program. Here, the computer-readable medium can be any available computer-readable storage medium or communication medium accessible to a computer.

[0177] Although embodiments of the invention have been described in conjunction with the accompanying drawings, those skilled in the art can make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations all fall within the scope defined by the appended claims.

Claims

1. A method for transmitting wireless audio from two sources, characterized in that, Applied to an audio device, the method includes: A first communication link is established with a first audio source device to transmit a first audio stream based on the first communication link; the audio device is a peripheral device of the first communication link. A second communication link is established with a second audio source device to transmit a second audio stream based on the second communication link; the audio device is the central device of the second communication link. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the first communication link and the second communication link are the same or synchronized, and the first communication link and the second communication link are time-division multiplexed and share time slots.

2. The method according to claim 1, characterized in that, The first communication link includes a CBT link; the second communication link has a different link protocol than the first communication link.

3. The method according to claim 2, characterized in that, The second communication link includes an asynchronous connection link and a connection isochronous group link consisting of at least one connection isochronous stream link; The first communication link includes an asynchronous connection link and an extended synchronous connection link; The isochronous connection links in the second communication link share time slots with the extended synchronous connection links and the asynchronous connection links in the first communication link, respectively. The asynchronous connection link in the first communication link shares a time slot with the asynchronous connection link in the second communication link.

4. The method according to claim 3, characterized in that, The duration of the isochronous interval of the extended synchronous connection link of the first communication link is the same as the duration of the isochronous interval of the connection isochronous group link of the second communication link. The sub-interval of the second communication link isochronous group link is M times the sub-interval of the first communication link, where M is a positive integer; The duration of a sub-interval of the first communication link is sufficient to allow the central device and peripheral devices of the first communication link to each send and receive a data packet once on the extended synchronous connection link of the first communication link.

5. The method according to claim 4, characterized in that, The time interval between the starting point of the isochronous group link in the second communication link and the starting point of the extended synchronous connection link in the first communication link is N times the sub-interval of the isochronous group link in the second communication link, where N is a positive integer; The communication duration of the asynchronous connection link of the second communication link is S times the sub-interval of the isochronous connection group link of the second communication link, where S is a positive integer.

6. The method according to claim 5, characterized in that, The M, N, and S are equal.

7. The method according to any one of claims 3 to 6, characterized in that, The second communication link includes a BLE link.

8. The method according to any one of claims 3 to 6, characterized in that, The asynchronous connection links in the second communication link share time slots with the isochronous connection links in the second communication link; The second communication link uses a packet interval smaller than the packet interval specified in the BLE link protocol, and / or the second communication link uses a minimum time slot interval smaller than the minimum time slot interval specified in the BLE link protocol.

9. The method according to claim 8, characterized in that, When configured to prioritize audio services between the audio device and the first audio source device, at the same time, the link priority of the extended synchronous connection link of the first communication link, the link priority of the isochronous connection link in the second communication link, the link priority of the asynchronous connection link in the second communication link, and the link priority of the asynchronous connection link in the first communication link decrease in sequence.

10. The method according to claim 8, characterized in that, When configured to prioritize audio services between the audio device and the second audio source device, at the same time, the link priority of the isochronous connection link in the second communication link, the link priority of the extended synchronous connection link in the first communication link, the link priority of the asynchronous connection link in the second communication link, and the link priority of the asynchronous connection link in the first communication link decrease sequentially.

11. The method according to claim 1, characterized in that, The first link clock of the first communication link is the same as or synchronized with the local clock of the first audio source device; Furthermore, the second link clock of the second communication link is the same as or synchronized with the first link clock.

12. A method for transmitting wireless audio from two sources, characterized in that, Applied to a second audio source device, the method includes: A second communication link is established with an audio device to transmit a second audio stream based on the second communication link; the audio device is the central device of the second communication link, and the second audio source device is used as a peripheral device of the second communication link; The audio device also establishes a first communication link with the first audio source device. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clock of the second communication link is the same or synchronized with that of the first communication link. The first communication link and the second communication link are time-division multiplexed and share time slots.

13. The method according to claim 12, characterized in that, The method further includes: adjusting the local clock of the second audio source device based on the second link clock of the second communication link, so that the adjusted local clock of the second audio source device is the same as or synchronized with the second link clock; The second audio source device is equipped with an asynchronous sampling rate converter to synchronize the sampling rate of the audio data input to the second audio source device with the adjusted local clock of the second audio source device.

14. A dual-source wireless audio transmission system, characterized in that, The system includes an audio device, a first audio source device, and a second audio source device; The audio device establishes a first communication link with the first audio source device to transmit the first audio stream based on the first communication link; The first sound source device is the central device of the first communication link, and the audio device is a peripheral device of the first communication link; The audio device establishes a second communication link with the second audio source device to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link, and the second audio source device is a peripheral device of the second communication link; the link clocks of the first communication link and the second communication link are the same or synchronized. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are time-division multiplexed and share time slots.

15. An audio device, characterized in that, include: The first communication unit is used to establish a first communication link with the first audio source device and to transmit the first audio stream based on the first communication link; The audio device is a peripheral device of the first communication link; The second communication unit is used to establish a second communication link with the second audio source device and to transmit the second audio stream based on the second communication link; the audio device is the central device of the second communication link. Wherein, when audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clocks of the first communication link and the second communication link are the same or synchronized, and the first communication link and the second communication link are time-division multiplexed and share time slots.

16. A second sound source device, characterized in that, include: The third communication unit is used to establish a second communication link with the audio device to transmit the second audio stream based on the second communication link, wherein... The audio device is the central device of the second communication link, and the second sound source device is the peripheral device of the second communication link; The audio device also establishes a first communication link with the first audio source device. When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the link clock of the second communication link is the same or synchronized with that of the first communication link. The first communication link and the second communication link are time-division multiplexed and share time slots.

Images