Synchronous transmission system and method for dual-sound-source wireless audio

Abstract

The invention relates to the technical field of wireless audio transmission, in particular to a synchronous transmission system and method for double-sound-source wireless audios. The system comprises an audio device, a first sound source device and a second sound source device, the audio device comprises a main processor and a plurality of controllers, the first sound source device establishes a first communication link with the first controller so as to carry out audio data transmission for a first audio stream, and the second sound source device establishes a second communication link with the second controller so as to carry out audio data transmission for a second audio stream. When the audio data transmission on the first communication link and the audio data transmission on the second communication link coexist, the sending time of any one of the two communication links is not overlapped with the receiving time of the other communication link, and the two communication links are subjected to frequency division multiplexing. By adopting a frequency division multiplexing mode and designing a time synchronization mechanism, synchronous wireless transmission of double sound sources is realized, so that two communication links do not interfere with each other in the transmission process, and the reliability of wireless audio transmission is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless audio transmission, and in particular to a synchronous transmission system and method of dual-source wireless audio. Background Art

[0002] The rapid development of wireless connection technologies such as Classic Bluetooth (CBT), Bluetooth Low Energy (BLE), and Wireless Fidelity (WIFI) has made wireless audio and wireless calls an important part of people's lives. For example, CBT wireless audio terminal devices that use smartphones as audio source devices, such as CBT audio (Audio) headphones and CBT Audio speakers, have been widely loved by people. BLE Audio provides wireless audio services with lower latency, lower power consumption, and higher performance, and will also receive more attention.

[0003] However, existing CBT Audio or BLE Audio terminal devices can only connect to one CBT or BLE audio source device to send and receive wireless audio, and do not support connecting to two or more CBT or BLE audio source devices to send and receive wireless audio at the same time. For example, existing CBT or BLE Audio headsets cannot use one smartphone to hold an online meeting while using another smartphone to make or receive calls, nor can they use one smartphone to play a low-latency game while using another smartphone to make or receive calls. That is, CBT or BLE wireless audio terminal devices cannot connect to two or more CBT or BLE audio source devices to send and receive wireless audio at the same time, that is, dual-source wireless audio (DSWA: Dual-Source Wireless Audio) or multi-source wireless audio (MSWA: Multi-Source Wireless Audio) is not supported. Summary of the invention

[0004] In view of this, the present invention provides a dual-source wireless audio synchronous transmission system and method to solve the problem that the current dual-source wireless audio cannot achieve synchronous transmission.

[0005] In a first aspect, the present invention provides a dual-source wireless audio synchronous transmission system, the system comprising an audio device, a first audio source device and a second audio source device;

[0006] The audio device includes a main processor and a plurality of controllers;

[0007] The first audio source device establishes a first communication link with a first controller among the multiple controllers to transmit audio data for a first audio stream with the audio device based on the first communication link;

[0008] The second audio source device establishes a second communication link with a second controller among the multiple controllers to transmit audio data for a second audio stream with the audio device based on the second communication link;

[0009] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

[0010] The synchronous transmission system of dual-source wireless audio provided by the embodiment of the present invention adopts an audio device with a multi-controller structure, and different controllers are used to establish communication links with different audio source devices respectively. The communication links coexist in a frequency division multiplexing manner, and the system ensures that the sending time of any one of the first communication link and the receiving time of the other between the first communication link and the second communication link do not overlap with each other, thereby realizing that one audio device can support synchronous wireless audio transmission of at least two audio sources.

[0011] In an optional implementation, the first audio source device is used as a central device of the first communication link, the audio device is used as a peripheral device of the first communication link, and the first link clock of the first communication link is the same as or synchronized with the local clock of the first audio source device;

[0012] The second audio source device is used as a peripheral device of the second communication link, the audio device is used as a central device of the second communication link, and the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0013] The synchronous transmission system of dual-source wireless audio provided by the embodiment of the present invention uses one of the audio source devices as the central device on one communication link, and uses the audio device as the central device on another communication link. By changing the role of the audio device on different communication links, the audio transmission in the entire synchronous transmission system can maintain clock synchronization, thereby avoiding the relative drift of the clocks of the two links, which causes the sending time of one link to overlap with the receiving time of the other link.

[0014] In an optional implementation, when the second audio source device is used as a peripheral device of the second communication link, the local clock of the second audio source device is adjusted based on the second link clock of the second communication link, so that the adjusted local clock of the second audio source device is the same as or synchronized with the second link clock;

[0015] In an optional implementation, the second audio source device is provided with an asynchronous sampling rate converter for synchronizing the sampling rate of audio data input to the second audio source device with the adjusted local clock of the second audio source device.

[0016] The synchronous transmission system of dual-source wireless audio provided by the embodiment of the present invention can ensure that the audio data transmission of the second audio source device on the second communication link is synchronized with the entire system by adjusting the local clock of the second audio source device to be the same as or synchronized with the second link clock. Furthermore, in some application scenarios, when the sampling rate of the audio data is not synchronized with the local clock of the audio source device, it may cause overflow or blanking problems caused by audio asynchrony. The embodiment of the present invention can adjust the sampling rate of the audio data input to the second audio source device to be synchronized with the adjusted local clock through an asynchronous sampling rate converter, thereby effectively avoiding audio data overflow or blanking caused by clock asynchrony.

[0017] In a second aspect, the present invention provides a method for synchronous transmission of dual-source wireless audio, which is applied to an audio device, wherein the audio device includes a main processor and multiple controllers; the method includes:

[0018] Using a first controller among the multiple controllers to establish a first communication link with a first audio source device, and transmitting audio data for a first audio stream with the first audio source device based on the first communication link;

[0019] Using a second controller among the multiple controllers to establish a second communication link with a second audio source device, and transmitting audio data for a second audio stream with the second audio source device based on the second communication link;

[0020] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

[0021] The synchronous transmission method of dual-source wireless audio provided by the embodiment of the present invention adopts a structure with multiple controllers, so that an independent controller can be assigned to each audio source device, and different controllers are used to establish communication links with different audio source devices respectively. The communication links coexist in a frequency division multiplexing manner, and the sending time of either the first communication link or the second communication link does not overlap with the receiving time of the other, thereby achieving that one audio device can support synchronous wireless audio transmission of at least two audio sources.

[0022] In an optional embodiment, the method further includes:

[0023] The first audio source device is used as a central device of the first communication link, the audio device is used as a peripheral device of the first communication link, and a first link clock of the first communication link is the same as or synchronized with a local clock of the first audio source device;

[0024] The second audio source device is used as a peripheral device of the second communication link, the audio device is used as a central device of the second communication link, and the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0025] The synchronous transmission method of dual-source wireless audio provided by the embodiment of the present invention uses one of the audio source devices as the central device on one communication link, and uses the audio device as the central device on another communication link, so that by changing the role of the audio device on different communication links, the audio transmission in the entire synchronous transmission system can maintain clock synchronization, thereby avoiding the relative drift of the clocks of the two links, which causes the transmission time of one link to overlap with the reception time of another link.

[0026] In an optional embodiment, the method further includes:

[0027] When communicating with the first audio source device, obtaining a first link clock of the first communication link, and adjusting a local clock used by the first controller based on the first link clock, so that the adjusted local clock used by the first controller is the same as or synchronized with the first link clock;

[0028] When communicating with the second audio source device, a second link clock of the second communication link is established or maintained according to the adjusted local clock adopted by the first controller, so that the second link clock is the same as or synchronized with the adjusted local clock adopted by the first controller.

[0029] In an optional implementation, when communicating with the second audio source device, establishing or maintaining a second link clock of the second communication link according to the adjusted local clock used by the first controller so that the second link clock is identical or synchronized with the adjusted local clock used by the first controller includes:

[0030] According to the adjusted local clock adopted by the first controller, adjust the local clock adopted by the second controller so that the adjusted local clock adopted by the second controller is the same as or synchronized with the adjusted local clock adopted by the first controller, and establish or maintain the second link clock of the second communication link according to the adjusted local clock adopted by the second controller;

[0031] Alternatively, the first controller and the second controller use the same local clock, and the second controller establishes or maintains the second link clock of the second communication link according to the adjusted local clock.

[0032] The synchronous transmission method of dual-source wireless audio provided by the embodiment of the present invention configures the local clocks used by the first controller and the second controller so that the clocks of the first controller and the second controller are the same or synchronized, thereby not only effectively supporting the synchronous transmission of dual-source wireless audio, but also facilitating the synchronous collection or synchronous playback of the dual sources.

[0033] In an optional embodiment, the method further includes:

[0034] The first communication link is a CBT link, and the link protocol of the second communication link is different from that of the first communication link.

[0035] The synchronous transmission method of dual-source wireless audio provided by the embodiment of the present invention uses the CBT link with good compatibility and wide application as the first communication link. On this basis, two communication links with different communication protocols are adopted to ensure that other audio services can be provided while using CBT calls. A more flexible design of the communication protocol can also avoid overlapping of the sending and receiving time of the two links.

[0036] In an optional embodiment, the CBT link includes a CBT eSCO link, using a 2EV3 packet type;

[0037] The BLE link includes a BLE CIG link. The sub-event interval of the BLE CIG link is equal to 1.25ms. The air time occupied by transmitting an audio data packet is less than 858us.

[0038] In a third aspect, the present invention provides an audio device for the synchronous transmission method of dual-source wireless audio in the second aspect, the audio device comprising a main processor and a plurality of controllers; a first controller among the plurality of controllers establishes a first communication link with a first audio source device, so as to transmit audio data for a first audio stream with the first audio source device based on the first communication link; a second controller among the plurality of controllers also establishes a second communication link with a second audio source device, so as to transmit audio data for a second audio stream with the second audio source device based on the second communication link;

[0039] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

[0040] In an optional implementation, the processors are connected to multiple controllers respectively; or, multiple controllers are connected in series and connected to the main processor via one of the multiple controllers in the series.

[0041] In an optional implementation, the controller is a controller defined in the Bluetooth core specification;

[0042] The main controller includes a master-slave interface defined in the Bluetooth core specification for connecting to a main processor;

[0043] The master controller and the slave controller also include physical interfaces that can be used to cascade with each other.

[0044] In an optional implementation, the master controller and at least one slave controller are packaged in the same chip;

[0045] The antenna of the master controller is distributed at a specified distance from the antenna of at least one slave controller;

[0046] Alternatively, the master controller and at least one slave controller use the same antenna. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0048] Figure 1 is a schematic diagram of the system architecture of a dual-source wireless audio synchronous transmission system according to an embodiment of the present invention;

[0049] Figure 2 is a flow chart of a method for synchronously transmitting dual-source wireless audio according to an embodiment of the present invention;

[0050] Figure 3 is a schematic diagram of the dual-link time relationship of the dual-source wireless audio synchronous transmission method according to an embodiment of the present invention;

[0051] Figure 4 is a schematic diagram of a series connection of an audio device according to an embodiment of the present invention;

[0052] Figure 5 is a schematic diagram of parallel connection of audio devices according to an embodiment of the present invention;

[0053] Figure 6 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0055] CBT wireless audio terminal devices that use smartphones as audio source devices, such as CBT audio (Audio) headphones and CBT Audio speakers, have been widely loved by people. BLE Audio provides wireless audio services with lower latency, lower power consumption and higher performance, and will also receive more attention. However, existing CBT Audio or BLE Audio terminal devices can only connect to one CBT or BLE audio source device to send and receive wireless audio, and do not support connecting two or more CBT or BLE audio source devices to send and receive wireless audio at the same time. For example, existing CBT or BLE Audio headphones cannot use one smartphone to hold an online meeting while using another smartphone to make and receive calls, nor can they use one smartphone to play low-latency games while using another smartphone to make and receive calls. That is, CBT or BLE wireless audio terminal devices cannot connect to two or more CBT or BLE audio source devices to send and receive wireless audio at the same time, that is, dual-source wireless audio (DSWA: Dual-Source Wireless Audio) or multi-source wireless audio (MSWA: Multi-Source Wireless Audio) is not supported.

[0056] According to an embodiment of the present invention, an embodiment of a method for synchronous transmission of dual-source wireless audio is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0057] In this embodiment, a dual-source wireless audio synchronous transmission system is provided. Figure 1 It is a system structure diagram of a dual-source wireless audio synchronous transmission system, the system comprising an audio device, a first audio source device and a second audio source device;

[0058] The audio device includes a main processor and a plurality of controllers;

[0059] The first audio source device establishes a first communication link with a first controller among the multiple controllers to transmit audio data for a first audio stream with the audio device based on the first communication link;

[0060] The second audio source device establishes a second communication link with a second controller among the multiple controllers to transmit audio data for a second audio stream with the audio device based on the second communication link;

[0061] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

[0062] The inventors found that in the prior art, the effective bandwidth for wireless transmission between a CBT or BLE wireless audio terminal device and two or more CBT or BLE audio source devices is insufficient, especially the insufficient effective bandwidth caused by mutual interference due to overlapping transmission and reception time, which makes it difficult to support DSWA or MSWA.

[0063] In this embodiment, the frequency division multiplexing between the first communication link and the second communication link can be understood as that, at the same time, the audio device and each audio source device communicate using different frequency channels respectively.

[0064] In this embodiment, the sending time of any one of the first communication link and the receiving time of the other one of the second communication link does not overlap, which can be understood as, for the audio device, the sending time of its first controller on the first communication link and the receiving time of its second controller on the second communication link do not overlap, and the receiving time of the first controller on the first communication link and the sending time of its second controller on the second communication link do not overlap, that is, during the period when the first controller sends a data packet to the first audio source device on the first communication link, the second controller will not perform the action of receiving the data packet sent by the second audio source device on the second communication link, and vice versa. For any audio source device, during the period when it sends a data packet to the audio device, other audio source devices may send a data packet to the audio device or not, but will not perform the action of receiving a data packet from the audio device.

[0065] Therefore, this embodiment adopts an audio device with a multi-controller structure, and different controllers are used to establish communication links with different sound source devices respectively. The system controls the coexistence of each communication link by frequency division multiplexing, and when the system configures the transmit and receive time slots on each communication link, the transmission time of either the first communication link or the second communication link is controlled not to overlap with the reception time of the other, thereby increasing the bandwidth while controlling the transmit and receive times of each communication link to be relatively synchronized, and the transmit and receive signals of each sound source device and each controller of the audio device do not interfere with each other, so that one audio device can support at least two channels of wireless audio synchronous transmission of sound sources.

[0066] In a specific implementation, the audio source device may be a mobile phone, a portable game console, a portable media player, a personal computer, a car media player, an adapter (Dongle) for connecting to a multimedia device, etc., which may send an audio stream to the audio device, and the audio stream data may be locally stored or externally received, for example, locally stored audio data, a call voice data stream received through a mobile cellular network, voice / audio data received through the Internet, etc. The first audio source device and the second audio source device may be devices of the same type or devices of different types.

[0067] The audio device can be any type of audio output device for converting audio streams into audio signals and playing them, such as speakers, in-ear headphones, headsets, speakers, etc. In addition, the audio device can also have an audio input function, that is, it can not only receive audio streams from the sound source device, but also collect local sound signals and send them to the sound source device. For example, when a headset with a microphone is used for a voice call function, it can collect the voice signal of the headset user and send it to the mobile phone. For ease of understanding, an SDSWA headset with a microphone can be used as a specific embodiment of the audio device for illustration. Figure 1 In the system shown, the first sound source device can be a smartphone, the second sound source device can be a USB dongle plugged into another smartphone, and the audio device is an SDSWA headset with a microphone. A typical application scenario is that the SDSWA headset is connected to the smartphone via the first communication link to make calls, and is connected to the USB dongle via the second communication link to play games.

[0068] There are three types of connection relationships between the audio device and the first audio source device and the second audio source device: the first type is to establish a first communication link only with the first audio source device; the second type is to establish a second communication link only with the second audio source device; the third type is to establish a first communication link with the first audio source and a second communication link with the second audio source device, that is, audio data transmission on the first communication link and the second communication link coexist.

[0069] The audio device is composed of an application and host processor (APP&Host Processor) and a scalable controller (Scalable Controller), which includes multiple controllers, each of which can receive, send and process audio data transmitted between different audio source devices. That is, the first controller in the multiple controllers establishes a first communication link with the first audio source device to transmit the first audio stream, and the second controller in the multiple controllers establishes a second communication link with the second audio source device to transmit the second audio stream, thereby realizing synchronous transmission and playback when two audio streams between different audio sources coexist.

[0070] It can be understood that the first audio stream and the second audio stream can be both unidirectional audio data streams or bidirectional audio data streams, that is, the audio device can only receive audio data from the sound source device. For example, when listening to music from a mobile phone through headphones, a unidirectional audio stream is transmitted between the headphones and the mobile phone. The audio device can also receive audio data from the sound source device and send audio data to the sound source device. For example, when making a call through the headphones, the headphones not only receive the telephone voice from the mobile phone, but also send the voice of the headphone user to the mobile phone. At this time, a bidirectional audio stream is transmitted between the headphones and the mobile phone.

[0071] In some optional implementations, the first audio source device is used as a central device of the first communication link, the audio device is used as a peripheral device of the first communication link, and a first link clock of the first communication link is the same as or synchronized with a local clock of the first audio source device;

[0072] The second audio source device is used as a peripheral device of the second communication link, the audio device is used as a central device of the second communication link, and the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0073] The inventors have found that in the prior art, the clock of the CBT or BLE wireless audio terminal device is not synchronized with the CBT link or BLE link between two or more CBT or BLE audio source devices, which may also affect the system's synchronous acquisition, synchronous transmission and synchronous playback of DSWA or MSWA. In this embodiment, one of the audio source devices is used as the central device on one communication link, and the audio device is used as the central device on another communication link. By changing the role of the audio device on different communication links, the audio device is synchronized with the communication link clock established by the two audio source devices (also referred to as "synchronous dual audio sources"). Therefore, it can not only avoid the relative drift of the clocks of the two links, which causes the transmission time of one link to overlap with the reception time of another link, but also facilitate the synchronization of audio acquisition, transmission and playback in the dual audio source system.

[0074] For example, in the above application scenario, the SDSWA headset is connected to the first audio source device through a first communication link, the SDSWA headset serves as a peripheral device of the first communication link, and the first audio source device serves as a central device of the first communication link. At the same time, the SDSWA headset is connected to the second audio source device through a second communication link, the SDSWA headset serves as the central device of the second communication link, and the second audio source device serves as a peripheral device of the second communication link.

[0075] In some optional embodiments, when the second audio source device is used as a peripheral device of a second communication link, the local clock of the second audio source device is adjusted based on the second link clock of the second communication link, so that the adjusted local clock of the second audio source device is the same as or synchronized with the second link clock.

[0076] In some other optional implementations, the second audio source device may also be provided with an asynchronous sampling rate converter for synchronizing the sampling rate of audio data input into the second audio source device with the adjusted local clock of the second audio source device.

[0077] For example, in the above application scenario, the SDSWA headset is connected to the first audio source device and the second audio source device at the same time, and two situations may occur: first, the first audio source device is connected first and then the second audio source device; second, the second audio source device is connected first and then the first audio source device.

[0078] For the first case, a first communication link is established first, the first audio source device is used as the central device of the first communication link, and the SDSWA headset is used as the peripheral device of the first communication link. The first link clock of the first communication link is configured by the local clock of the first audio source device.

[0079] The SDSWA headset continuously adjusts the digitally controlled oscillator (NCO) of the local clock of the SDSWA headset according to the difference between its local clock and the first link clock, so that the local clock of the SDSWA headset remains the same or synchronized with the clock of the first communication link or the first audio source device.

[0080] When connecting to a second audio source device, the SDSWA headset uses the local clock adjusted according to the first communication link to establish a second communication link, and the second link clock is kept the same or synchronized with the local clock adjusted by the SDSWA headset according to the first link. The second audio source device USB Dongle adjusts the NCO of the local clock of the USB Dongle according to the difference between its local clock and the second link clock, so that the local clock of the USB Dongle is kept the same or synchronized with the second link clock, thereby keeping the local clock of the USB Dongle the same or synchronized with the first link clock.

[0081] If the USB Dongle is connected first and then the first audio source device is connected, the second communication link is established first. The SDSWA headset serves as the central device of the second communication link, and the USB Dongle serves as the peripheral device of the second communication link. The SDSWA headset configures the second link clock of the second communication link according to its local clock. The USB Dongle adjusts the NCO of the local clock of the USB Dongle according to the difference between its local clock and the second link clock, so that the local clock of the USB Dongle remains the same or synchronized with the second link clock.

[0082] In this application scenario, frequency division multiplexing is used between the first communication link and the second communication link, the receiving and transmitting time slots do not overlap with each other, and the clock synchronization of the entire system is controlled, which not only solves the bandwidth problem of dual-source audio transmission, but also solves the mutual interference of dual-source audio transmission and the problem of synchronous playback of audio input and output, and can effectively support dual-source wireless audio.

[0083] In this embodiment, a dual-source wireless audio synchronous transmission method is provided, which is applied to an audio device, wherein the audio device includes a main processor and multiple controllers. Figure 2 is a flow chart of a method for synchronously transmitting dual-source wireless audio according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0084] Step S101: A first controller among a plurality of controllers is used to establish a first communication link with a first audio source device, and audio data of a first audio stream is transmitted with the first audio source device based on the first communication link.

[0085] Specifically, the first controller identifies the first audio source device and establishes a first communication link with the first audio source device. The first controller can perform unidirectional or bidirectional audio data transmission with the first audio source device through the first communication link.

[0086] Step S102: A second controller among the multiple controllers is used to establish a second communication link with a second audio source device, and audio data for a second audio stream is transmitted with the second audio source device based on the second communication link.

[0087] Step S103, when audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

[0088] It is understandable that the timing relationship between steps S101 and S102 may be flexible and is not limited to Figure 2 in the order shown.

[0089] Specifically, inside the audio device, a main processor and a plurality of controllers are configured to support frequency division multiplexing, and a frequency channel different from that of the first communication link is allocated to the second communication link.

[0090] In addition, according to the protocol characteristics of the first communication link and the second communication link, various parameters such as adjusting the sampling rate, encoding rate, inter-packet interval duration, the offset between the starting points of the first communication link and the second communication link can be configured so that the sending time of either the first communication link or the second communication link does not overlap with the receiving time of the other, thereby ensuring that the audio data transmission on the two communication links is parallel and does not interfere with each other.

[0091] In some optional embodiments, the method further comprises:

[0092] The first audio source device is used as a central device of the first communication link, the audio device is used as a peripheral device of the first communication link, and a first link clock of the first communication link is the same as or synchronized with a local clock of the first audio source device;

[0093] The second audio source device is used as a peripheral device of the second communication link, the audio device is used as a central device of the second communication link, and the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0094] In some optional implementations, when communicating with the first audio source device, a first link clock of the first communication link is obtained, and a local clock used by the first controller is adjusted based on the first link clock, so that the adjusted local clock used by the first controller is the same as or synchronized with the first link clock;

[0095] When communicating with the second audio source device, a second link clock of the second communication link is established or maintained according to the adjusted local clock adopted by the first controller, so that the second link clock is the same as or synchronized with the adjusted local clock adopted by the first controller.

[0096] Since the audio device in this embodiment has a multi-controller structure and uses a first controller to work on the first communication link, when communicating with the first sound source device, the audio device needs to continuously adjust the NCO of the local clock used by the first controller according to the difference between the local clock used by its first controller and the first link clock, so that the local clock used by the first controller remains the same as or synchronized with the first link clock. Therefore, when communicating with the second sound source device, as the central device of the second communication link, when establishing or maintaining the second link clock of the second communication link according to the adjusted local clock used by the first controller, since the local clock used by the first controller will be adjusted following the first link clock, this adjustment can be transmitted to the second link clock, so that the second link clock of the second communication link is the same as or synchronized with the first link clock.

[0097] In some optional implementations, the local clock used by the first controller is different from the local clock used by the second controller. Therefore, when communicating with the second audio source device, a second link clock of the second communication link is established or maintained according to the adjusted local clock used by the first controller so that the second link clock is the same as or synchronized with the adjusted local clock used by the first controller, including:

[0098] According to the adjusted local clock adopted by the first controller, the local clock adopted by the second controller is adjusted so that the adjusted local clock adopted by the second controller is the same as or synchronized with the adjusted local clock adopted by the first controller; and according to the adjusted local clock adopted by the second controller, the second link clock of the second communication link is established or maintained.

[0099] In some other optional embodiments, the first controller and the second controller use the same local clock. Therefore, when communicating with the second audio source device, a second link clock of the second communication link is established or maintained according to the adjusted local clock used by the first controller, so that the second link clock is the same as or synchronized with the adjusted local clock used by the first controller, including: the second controller establishes or maintains the second link clock of the second communication link according to the adjusted local clock.

[0100] It is understandable that the system and method of the present application can also be applied to the synchronous transmission of multi-source wireless audio (MSWA), wherein multiple controllers in the audio source device can be enabled to establish different communication links with different audio source devices, respectively, and the first audio source device is defined as the main audio source device, the main audio source device is used as the central device of the first communication link, and the audio device is used as the peripheral device of the first communication link. Other audio source devices can be used as slave audio source devices, the audio device is used as the central device on the communication link of the slave audio source device, and the slave audio source device is used as a peripheral device. Thereby, the link clocks of all communication links are the same or synchronized with the local clock of the main audio source device.

[0101] In some optional implementations, the first communication link is a CBT link, and the link protocol of the second communication link is different from that of the first communication link. The second communication link may adopt a BLE link protocol, or other link protocols applicable to this embodiment, which may be general standard protocols or customized private protocols.

[0102] In an optional implementation, the first communication link is a CBT link, and the second communication link is a BLE link.

[0103] For example, in Figure 1 In the system shown, the first audio source device may be a smart phone, the second audio source device may be a USB dongle plugged into another smart phone, and the audio device may be a SDSWA headset with a microphone. The first audio source device is used as the main audio source device, and the second audio source device is used as the slave audio source device. The SDSWA headset has an expandable controller, which includes a main controller and at least one slave controller.

[0104] The SDSWA headset is connected to the main audio source device through the CBT link. The SDSWA headset is used as a peripheral device of the CBT link, and the main audio source device is used as the central device of the CBT link. The SDSWA headset is connected to the slave audio source device through the BLE link. The SDSWA headset is used as the central device of the BLE link, and the slave audio source device is used as a peripheral device of the BLE link.

[0105] When the CBT link and the BLE link exist at the same time, the SDSWA headset establishes and maintains the CBT link or the BLE link through the main controller or the sub-controller respectively.

[0106] When the CBT link and the BLE link exist independently, the SDSWA headset establishes and maintains the CBT link or the BLE link through any one of the main controller or the sub-controller.

[0107] The application scenario of this embodiment is that the SDSWA headset can be connected to a smartphone via a CBT link to make calls, and at the same time connected to a USB Dongle via a BLE link to play games, wherein the game audio is two-way low-latency audio.

[0108] The CBT link exists independently, that is, when the SDSWA headset is connected to the main audio source device only through the first communication link, it can first establish a CBT asynchronous connection (ACL: Asynchronous Connection-oriented) link with the main audio source device. When a call is required, a CBT extended synchronous connection (eSCO: Extended Synchronous Connection-Oriented) link is established, and then an upper-layer hands-free protocol (HFP: Hands-Free Profile) application is established. The main audio source device serves as the central device of the CBT link, and the SDSWA headset serves as the peripheral device of the CBT link. The SDSWA headset continuously adjusts the NCO of the local clock of the SDSWA headset according to the difference between its local clock and the clock of the CBT link or the main audio source device, so that the local clock of the SDSWA headset remains the same or synchronized with the clock of the CBT link or the main audio source device.

[0109] The BLE link exists independently, that is, when the SDSWA headset is only connected to the audio source device through the second communication link, a BLE ACL link is established first. When playing games, a connected isochronous group (CIG: Connected Isochronous Group) link is established, and then an upper-layer telephone and media audio protocol (TMAP: Telephony and Media Audio Profile) application is established. The SDSWA headset serves as the central device of the BLE link, and the USB Dongle serves as the peripheral device of the BLE link. The USB Dongle adjusts the NCO of the local clock of the USB Dongle according to the difference between its local clock and the clock of the BLE link or the SDSWA headset, so that the local clock of the USB Dongle is the same or synchronized with the clock of the BLE link or the SDSWA headset.

[0110] The CBT link and the BLE link exist at the same time, that is, when the SDSWA headset is connected to the main audio source device and the slave audio source device at the same time, if the main audio source device is connected first and then the slave audio source device, the clock relationship when connecting to the main audio source device is the same as when the main audio source device is connected alone. When connecting to the slave audio source device again, the SDSWA headset uses the local clock adjusted according to the CBT link to establish the BLE link, and the clock of the BLE link is the same or synchronized with the local clock adjusted by the SDSWA headset according to the CBT link. The USB Dongle adjusts the NCO of the local clock of the USB Dongle according to the difference between its local clock and the clock of the BLE link, so that the local clock of the USB Dongle is the same or synchronized with the clock of the BLE link, so that the local clock of the USB Dongle is the same or synchronized with the clock of the CBT link.

[0111] If the SDSWA headset is connected to the slave audio source device first and then to the master audio source device, the clock relationship when connecting to the slave audio source device is the same as when connecting to the slave audio source device alone. When connecting to the master audio source device again, the SDSWA headset adjusts the local clock according to the CBT link, and the clock of the BLE link remains the same or synchronized with the local clock adjusted by the SDSWA headset according to the CBT link. The USB Dongle adjusts the NCO of the local clock of the USB Dongle according to the difference between its local clock and the clock of the BLE link, so that the local clock of the USB Dongle remains the same or synchronized with the clock of the BLE link, thereby keeping the local clock of the USB Dongle the same or synchronized with the clock of the CBT link.

[0112] In addition, when the SDSWA headset disconnects the simultaneously connected master audio source device and slave audio source device, if the slave audio source device is disconnected first and then the master audio source device, after the BLE link is disconnected, the clock relationship of the SDSWA headset connected to the master audio source device is the same as when the master audio source device is connected alone. If the master audio source device is disconnected first and then the slave audio source device, after the CBT link is disconnected, the SDSWA headset stops adjusting the local clock according to the CBT link, and the clock relationship of the SDSWA headset when connected to the slave audio source device is similar to when the slave audio source device is connected alone, except that the local clock previously adjusted according to the CBT link is no longer adjusted.

[0113] When the SDSWA headset is connected to the audio source device via the BLE link, and another smartphone transmits USB Audio via the USB Dongle, the USB Audio external input clock may be inconsistent with the USB Dongle's local clock, so the USB Audio needs to be sampled before it can be sent and received via the BLE link. At this time, the USB Audio uses an asynchronous sampling rate converter (ASRC: Asynchronous Sampling Rate Converter) to perform sampling rate conversion based on the deviation between the local clock estimated by the USB Dongle and the external input clock before sending and receiving via the BLE link.

[0114] In an optional embodiment, the CBT link includes a CBT eSCO link, using a 2EV3 packet type;

[0115] The BLE link includes a BLE CIG link. The sub-event interval of the BLE CIG link is equal to 1.25ms. The air time occupied by transmitting an audio data packet is less than 858us.

[0116] At present, the HFP function of almost all smartphones uses the 2EV3 packet type when establishing an eSCO link, and the 2EV3 packet has a payload of 60 bytes and occupies 392us in the air. Each time slot of the CBT link is 625us. The central device and the peripheral device of the CBT link each send and receive 2EV3 at least once, each occupying one slot, a total of 1.25ms. Including 2-3 retransmissions, it may take up to 3.75ms or 5ms. The peripheral devices of the CBT link have 233us free after sending 2EV3 in each slot, and the time from the end of the last 2EV3 to the start of the next 2EV3 is at most 858us. In addition, after almost all smartphones establish an eSCO link, the types of packets sent and received by the CBT ACL link maintained at the same time are limited to one slot, and the air time occupied is less than 392us of the 2EV3 packet. Therefore, when the air time occupied by the BLE CIG link of the SDSWA headset to receive audio data packets is less than 858us, it can be guaranteed that the sending time slots of the 2EV3 packets of the CBT link do not overlap, thereby avoiding mutual interference. Similarly, the peripheral devices of the CBT link have 233us left after receiving 2EV3 in each slot, and the time from the end of the last reception of 2EV3 to the start of the next reception of 2EV3 is at most 858us. Therefore, when the air time occupied by the BLE CIG link of the SDSWA headset to send audio data packets is less than 858us, it can be guaranteed that the receiving time slots of the 2EV3 packets of the CBT link do not overlap, thereby avoiding mutual interference.

[0117] It can be seen that the sub-event interval of the BLE CIG link of the SDSWA headset is equal to 1.25ms. When the air time occupied by transmitting an audio data packet does not exceed 858us, mutual interference with the CBT link can be effectively avoided.

[0118] Exemplarily, the various system parameters of the above typical application scenarios can be configured as follows: the ISOInterval is 5ms, and the enhanced Low Complexity Communication Codec Plus (LC3 Plus) is adopted. The sampling rate of the mono microphone of the central device of the BLE CIG link, that is, the SDSWA headset, is 32kHz, and the encoding rate is 80kbps. The stereo sampling rate of the peripheral device of the BLE CIG link, that is, the USB Dongle, is 48kHz, and the encoding rate of each channel is 120kbps. The size of the mono service data unit (SDU: Service Data Unit) sent by the central device is 50 bytes, and the size of the stereo SDU sent by the peripheral device is 150 bytes. BLE CIG includes a CIS link, which adopts the BLE 2Mbps physical layer (PHY). The CIS protocol data unit (PDU: Protocol Data Unit) sent by the central device occupies an air time of 260us, and the CIS PDU sent by the peripheral device occupies an air time of 660us. The Sub_Interval of the CIS link is equal to 1.25ms, where the inter-packet interval (T_IFS: Time of InterFrame Space) is 150us and the minimum time slot interval (T_MSS: Time of Minimum Slot Space) is 180us (if the microphone uses a lower sampling rate, for example, 24kHz or 16kHz, its CIS PDU occupies less air time, and T_MSS can be increased to 230us or 280us to make the sub-interval at least equal to 1.25ms). In a 5ms equal time interval, there are at most 4 sub-events, that is, the number of sub-events (NSE: Number of Sub-Event) is equal to 4. The connection interval (Connection Interval) of the BLE ACL link is 20ms, and the transmission and reception in each connection interval takes up to 1.25ms. The offset value (CIS Offset) of the CIS link relative to the BLE ACL link is equal to 1.25ms. Therefore, the BLE ACL link's transceiver time in each connection interval overlaps with the 4th CIS Sub-event in one of every 4 equal time intervals of the CIS link, that is, when the CIS PDU is retransmitted for the third time in each equal time interval, the BLE ACL link's transceiver time is occupied. In order to ensure the performance of BLE Audio, when the BLE ACL's transceiver time overlaps with the BLE CIG retransmission time, the BLE CIG takes precedence.

[0119] Optionally, the CBT eSCO link may also use the 2EV5 packet type.

[0120] like Figure 3 The figure shows the time coexistence relationship between the BLE link of the TMAP application and the CBT link of the HFP application, where the interval of the eSCO link (eSCO Interval) is equal to 7.5ms, the equal time interval of the CIG link is 5ms, and every two eSCOIntervals are equal to three ISO Intervals. The offset value (Offset) of the starting point of the CIG link of every three ISO Intervals relative to the starting point of the eSCO link of every two eSCO Intervals is 740us (600us-800us is acceptable). In the figure, HFP represents the timeline of the CBT eSCO link, and TMAP represents the timeline of the BLE CIG link, where C1 represents the air time when the CBT central device sends 2EV3 (corresponding to the time when the CBT peripheral device receives 2EV3), P1 represents the air time when the CBT peripheral device sends 2EV3 (corresponding to the time when the CBT central device receives 2EV3), c1 represents the air time when the CBT central device sends 1slot ACL packet, and p1 represents the air time when the CBT peripheral device sends 1slot ACL; C2 represents the air time when the BLE central device sends CISPDU (corresponding to the time when the BLE peripheral device receives CIS PDU), and P2 represents the air time when the BLE peripheral device sends CIS PDU (corresponding to the time when the BLE central device receives CIS PDU); the solid line represents the time when transmission and reception must be carried out, and the dotted line represents the retransmission time slot or the time when transmission and reception may not be carried out.

[0121] Depend on Figure 3 It can be seen from the time coexistence relationship diagram of TMAP and HFP applications that when the BLE link and CBT link of the SDSWA headset are frequency-division multiplexed, the clocks of the BLE link and the CBT link are configured to be the same or synchronized, and the sending time of the BLE link is configured to be the same as the receiving time of the CBT link, and the sending time of the CBT link is configured to be the same as the receiving time of the BLE link, so that they do not overlap with each other, which can avoid the sending of the BLE link or the CBT link interfering with the receiving, that is, avoiding the two links from interfering with each other, thereby realizing the synchronous transmission of dual-source wireless audio. According to an embodiment of the present invention, an embodiment of an audio device is provided, which is used for the above-mentioned synchronous transmission method of dual-source wireless audio, and the audio device includes a main processor and multiple controllers; a first controller among the multiple controllers establishes a first communication link with a first audio source device to transmit audio data for a first audio stream with the first audio source device based on the first communication link; a second controller among the multiple controllers also establishes a second communication link with a second audio source device to transmit audio data for a second audio stream with the second audio source device based on the second communication link;

[0122] When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the sending time of either the first communication link or the second communication link does not overlap with the receiving time of the other, and the first communication link and the second communication link are frequency-division multiplexed.

[0123] For example, the structure of the audio device is as follows: Figure 1 As shown, it is composed of an application and a host processor (APP&HostProcessor) and a scalable controller (Scalable Controller). The scalable controller is composed of multiple controllers, such as a first controller and a second controller.

[0124] In an optional implementation, the processors are connected to multiple controllers respectively; or, multiple controllers are connected in series and connected to the main processor via one of the multiple controllers in the series.

[0125] The application and the main processor can be connected to the main controller and the sub-controller in series or in parallel. Figure 4 As shown, the parallel connection method is as follows Figure 5 shown.

[0126] In an optional implementation, the controller is a controller defined in the Bluetooth core specification;

[0127] The main controller includes a master-slave interface defined in the Bluetooth core specification for connecting to a main processor;

[0128] The master controller and the slave controller also include physical interfaces that can be used to cascade with each other.

[0129] The host-slave interface (HCI: Host Controller Interface) defined by CBT or BLE core specification (CoreSpecification) is used between the application and the main processor and the expandable controller. The physical interface of HCI can be UART, USB or SDIO, etc. When the series mode is adopted, the logical interface between the main controller and the sub-controller is similar to HCI, and the physical interface of HCI can be UART, USB or SDIO, etc.

[0130] Without loss of generality, the controller is the Controller defined in the BT core specification, including functions such as radio, baseband, link control (Link Controller), link management (Link Manager) or link layer (LinkLayer), HCI interface, etc. The application and main processor is a collection of all other functional modules of the SDSWA terminal device except the controller. In addition to executing the Host protocol defined in the CBT or BLE core specification, it also executes the configuration (Profiles) protocol, application functions, audio codec, audio algorithm, and audio input and output, etc.

[0131] In an optional implementation, the master controller and at least one slave controller are packaged in the same chip;

[0132] The antenna of the master controller is distributed at a specified distance from the antenna of at least one slave controller;

[0133] Alternatively, the master controller and at least one slave controller use the same antenna.

[0134] The master controller and the slave controller can use their own independent antennas or share the same antenna.

[0135] The embodiment of the present invention also provides a computer device, see Figure 6 , Figure 6 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Figure 6 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 6 A processor 10 is taken as an example.

[0136] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0137] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0138] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0139] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0140] The computer device also includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Figure 6 The example of connecting through bus is taken in the following.

[0141] The input device 30 can receive input digital or character information, and generate key signal input related to the user settings and function control of the computer device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0142] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0143] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0144] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A dual-source wireless audio synchronous transmission system, characterized in that: The system comprises an audio device, a first sound source device and a second sound source device; The audio device includes a main processor and a plurality of controllers; The first audio source device establishes a first communication link with a first controller among the multiple controllers to transmit audio data for a first audio stream with the audio device based on the first communication link; The second audio source device establishes a second communication link with a second controller among the multiple controllers to transmit audio data for a second audio stream with the audio device based on the second communication link; When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

2. The system according to claim 1, characterized in that The first sound source device is used as a central device of a first communication link, the audio device is used as a peripheral device of the first communication link, and a first link clock of the first communication link is the same as or synchronized with a local clock of the first sound source device; The second audio source device is used as a peripheral device of the second communication link, the audio device is used as a central device of the second communication link, and a second link clock of the second communication link is the same as or synchronized with the first link clock.

3. The system according to claim 2, characterized in that When the second sound source device is used as a peripheral device of the second communication link, adjusting the local clock of the second sound source device based on the second link clock of the second communication link, so that the adjusted local clock of the second sound source device is the same as or synchronized with the second link clock; The second sound source device is provided with an asynchronous sampling rate converter for synchronizing the sampling rate of the audio data input to the second sound source device with the adjusted local clock of the second sound source device.

4. A method for synchronous transmission of dual-source wireless audio, characterized in that: Applied to an audio device, the audio device includes a main processor and multiple controllers; the method includes: Using a first controller among the multiple controllers to establish a first communication link with a first audio source device, and transmitting audio data for a first audio stream with the first audio source device based on the first communication link; Using a second controller among the multiple controllers to establish a second communication link with a second audio source device, and transmitting audio data for a second audio stream with the second audio source device based on the second communication link; When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

5. The method according to claim 4, characterized in that The method further comprises: The first sound source device is used as a central device of a first communication link, the audio device is used as a peripheral device of the first communication link, and a first link clock of the first communication link is the same as or synchronized with a local clock of the first sound source device; The second audio source device is used as a peripheral device of the second communication link, the audio device is used as a central device of the second communication link, and a second link clock of the second communication link is the same as or synchronized with the first link clock.

6. The method according to claim 5, characterized in that The method further comprises: When communicating with the first audio source device, obtaining a first link clock of the first communication link, and adjusting a local clock used by the first controller based on the first link clock, so that the adjusted local clock used by the first controller is the same as or synchronized with the first link clock; When communicating with the second audio source device, a second link clock of the second communication link is established or maintained according to the local clock adopted by the adjusted first controller, so that the second link clock is the same as or synchronized with the local clock adopted by the adjusted first controller.

7. The method according to claim 6, characterized in that The method of establishing or maintaining a second link clock of the second communication link according to the adjusted local clock adopted by the first controller when communicating with the second audio source device, so that the second link clock is identical or synchronized with the adjusted local clock adopted by the first controller, comprises: adjusting the local clock used by the second controller according to the adjusted local clock used by the first controller, so that the adjusted local clock used by the second controller is the same as or synchronized with the adjusted local clock used by the first controller, and establishing or maintaining the second link clock of the second communication link according to the adjusted local clock used by the second controller; or The first controller and the second controller use the same local clock, and the second controller establishes or maintains a second link clock of the second communication link according to the adjusted local clock.

8. The method according to any one of claims 4 to 7, characterized in that: The method further comprises: The first communication link is a CBT link, and the link protocol of the second communication link is different from that of the first communication link.

9. The method according to claim 8, characterized in that The second communication link is a BLE link.

10. The method according to claim 9, characterized in that The CBT link includes a CBT eSCO link, using a 2EV3 packet type; The BLE link includes a BLE CIG link, the sub-event interval of the BLE CIG link is equal to 1.25 ms, and the air time occupied by transmitting an audio data packet is less than 858 us.

11. An audio device, used in the method according to any one of claims 4 to 10, characterized in that: The audio device includes a main processor and a plurality of controllers; a first controller among the plurality of controllers establishes a first communication link with the first sound source device, so as to transmit audio data for a first audio stream with the first sound source device based on the first communication link; a second controller among the plurality of controllers also establishes a second communication link with the second sound source device, so as to transmit audio data for a second audio stream with the second sound source device based on the second communication link; When audio data transmission on the first communication link coexists with audio data transmission on the second communication link, the first communication link and the second communication link are frequency-division multiplexed, and the sending time of either the first communication link and the receiving time of the other do not overlap.

12. The device according to claim 11, characterized in that The main processor is connected to the multiple controllers respectively; or, the multiple controllers are connected in series, and are connected to the main processor via one of the multiple controllers in the series.

13. The device according to claim 12, characterized in that The plurality of controllers include a master controller and at least one slave controller; The main processor is respectively connected to the main controller and at least one slave controller; Alternatively, the master controller is connected in series with the at least one slave controller, and the master controller is connected to the main processor.

14. The device according to claim 13, characterized in that The controller is a controller defined by the Bluetooth core specification; The main controller includes a master-slave interface defined in the Bluetooth core specification for connecting to the main processor; The master controller and the slave controller further include a physical interface that can be used for mutual cascading.

15. The device according to claim 14, characterized in that The master controller and the at least one slave controller are packaged in the same chip; The antenna of the master controller is distributed at a specified distance from the antenna of the at least one slave controller; Alternatively, the master controller and the at least one slave controller use the same antenna.

Images