Wireless multi-sound-source synchronous communication method and system

Abstract

The invention relates to the technical field of wireless communication, in particular to a wireless multi-sound-source synchronous communication method and system. The method comprises the steps that a first wireless link based on a first work clock is established with first center equipment, a second wireless link based on a second work clock is established with second center equipment, and the second work clock is generated by the second center equipment based on a local clock of the second center equipment; the first working clock is synchronous with the second working clock; and when the first audio service of the first central equipment and the second audio service of the second central equipment coexist, synchronously processing the first audio service and the second audio service on the first wireless link and the second wireless link based on the same time axis respectively. According to the invention, mutual interference among a plurality of wireless links can be reduced or eliminated when the external equipment transmits and receives the multi-sound-source audio service, so that the multi-sound-source audio service is played synchronously, and the transmission delay is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless communications, and in particular to a wireless multi-sound source synchronous communication method and system. Background Art

[0002] The rapid development of wireless connection technologies such as Bluetooth has made wireless audio sharing and unfettered free calls a part of people's lives.

[0003] At present, peripheral devices (Peripheral) with smartphones as central devices (Central), such as BT headsets (Bluetooth headsets) or BT speakers (Bluetooth speakers), have gained wide popularity. However, the wireless transmission between BT peripheral devices and multiple BT central devices will interfere with each other, resulting in insufficient effective bandwidth, and the BT clocks between BT peripheral devices and multiple BT central devices are not synchronized, which will also lead to the inability to synchronously transmit and play multi-source wireless audio (MSWA: Multi-Source Wireless Audio). Therefore, existing BT headsets can only connect to one BT central device to send, receive and play wireless audio. For example, existing BT headsets cannot use one smartphone to hold an online (On-line) meeting while using another smartphone to make a call, nor can they use one smartphone to hold an online meeting while listening to music played by another smartphone.

[0004] That is to say, in the above solution, the external device cannot simultaneously receive and transmit and synchronously play multi-source wireless audio when connected to multiple central devices. Summary of the invention

[0005] In view of this, the present invention provides a wireless multi-source synchronous communication method and system to solve the problem that an external device cannot simultaneously receive and send and synchronously play multi-source wireless audio when connected to multiple central devices.

[0006] In a first aspect, the present invention provides a wireless multi-source synchronous communication method, which is applied to an external device, and the method comprises:

[0007] Establishing a first wireless link based on a first working clock with a first central device, and establishing a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock;

[0008] When a first audio service with the first central device and a second audio service with the second central device coexist, the first audio service and the second audio service are synchronously processed based on the same time axis on the first wireless link and the second wireless link, respectively.

[0009] The above scheme can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously process the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when external devices communicate with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when external devices send and receive audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0010] In an optional implementation, the synchronously processing the first audio service and the second audio service based on the same time axis includes:

[0011] Based on the same time axis, data in different audio services are sent and received in each time interval of the time axis in a time division multiplexing or frequency division multiplexing manner.

[0012] The above solution can effectively allocate and manage the transmission of multiple audio services on the same timeline through time division multiplexing or frequency division multiplexing, maximize the use of limited wireless resources, improve spectrum utilization and bandwidth efficiency, and reduce resource waste.

[0013] In an optional embodiment, the external device includes one or more controllers;

[0014] The method of transmitting and receiving data in different audio services in a time division multiplexing or frequency division multiplexing manner includes:

[0015] Using one controller to receive and send data of the first audio service and the second audio service in a time division multiplexing manner; or,

[0016] A first controller and a second controller among the multiple controllers are used to receive and send data for the first audio service and the second audio service in a frequency division multiplexing manner, wherein the first controller corresponds to the first wireless link and the second controller corresponds to the second wireless link.

[0017] The above solution supports time division multiplexing or frequency division multiplexing by introducing one or more controllers. Time division multiplexing implements time slice division through one controller to ensure that different audio services are transmitted without conflicting in time. Frequency division multiplexing implements frequency division through multiple controllers, allowing different audio services to be transmitted in parallel on their respective frequency channels, further optimizing the performance and reliability of multi-source wireless audio synchronous transmission, improving user experience, and enhancing the flexibility and scalability of the system.

[0018] In an optional implementation manner, the external device uses a controller to receive and send data of the first audio service and the second audio service in a time division multiplexing manner.

[0019] The first wireless link includes a BLE ACL link and a BLE CIG link; the first audio service is that the first central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device;

[0020] The second wireless link includes a CBT ACL link; the second audio service is that the second central device acts as a sound source device and performs music data transmission based on the A2DP protocol with the external device; or,

[0021] The second wireless link includes a BLE ACL link and a BLE CIG link; the second audio service is that the second central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device.

[0022] The above solution uses a controller to process multiple audio services in a time-division multiplexing manner, which simplifies the system architecture and enables the reception and transmission of all audio data to be uniformly managed and optimized under the same control logic, helping to reduce system complexity and resource conflicts. In addition, the above solution supports multiple wireless link protocols such as BLE ACL link, BLE CIG link, CBT ACL link, as well as audio transmission protocols such as TMAP protocol and A2DP protocol, so that external devices can flexibly select appropriate protocols for audio transmission according to different application scenarios and requirements, thereby improving the compatibility and applicability of the system.

[0023] In an optional implementation, when the external device uses the first controller and the second controller of the multiple controllers to receive and send data of the first audio service and the second audio service in a frequency division multiplexing manner,

[0024] The first wireless link includes a BLE ACL link and a BLE CIG link; the first audio service is that the first central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device;

[0025] The second wireless link includes a CBT eSCO link and a CBT ACL link; the second audio service is that the second central device serves as an audio source device and performs voice data transmission based on the HFP protocol with the external device.

[0026] The above solution uses multiple controllers for frequency division multiplexing, so that external devices can process multiple audio services in parallel, thereby improving the overall processing power and efficiency, and helping to reduce delays or performance bottlenecks caused by a single controller processing multiple tasks. In addition, the above solution supports multiple link types such as BLE ACL link, BLE CIG link, CBT eSCO link and CBTACL link, as well as two audio transmission protocols, TMAP protocol and HFP protocol, so that external devices can flexibly adapt to different application scenarios and requirements, improving the compatibility and scalability of the system.

[0027] In an optional implementation, the using the first controller and the second controller among the multiple controllers to perform data reception and data transmission of the first audio service and the second audio service in a frequency division multiplexing manner includes:

[0028] In each time interval, when data reception and data transmission of the first audio service and the second audio service are performed in a frequency division multiplexing manner, the first controller and the second controller are configured so that the transmission time slot of the first controller does not overlap with the target reception time slot of the second controller, and the target reception time slot is the time slot that the second controller must receive based on a predetermined rule.

[0029] The above solution realizes efficient and stable transmission of audio services under frequency division multiplexing by configuring the data sending and receiving time slots of the controller, thereby improving user experience and system performance.

[0030] In an optional embodiment, the method further includes:

[0031] When a first audio service with a first central device and a second audio service with a second central device coexist, synchronous playback and / or synchronous collection of audio data in the first audio service and the second audio service are performed based on a local clock synchronized with the second working clock.

[0032] The above scheme is based on a local clock synchronized with the second working clock, ensuring the clock synchronization of audio data playback and collection, significantly improving the synchronization between the first audio service and the second audio service, and avoiding audio misalignment or delay problems caused by clock asynchrony.

[0033] In a second aspect, the present invention provides another wireless multi-source synchronous communication method, which is applied to a first central device, and the method includes:

[0034] Acquire a second working clock through a third wireless link between the second central device and the second central device, where the second working clock is a working clock of a second wireless link between the second central device and the external device;

[0035] Establishing a first wireless link based on a first working clock with the external device;

[0036] Based on a first working clock synchronized with the second working clock, communicating with the external device on the first wireless link to perform data transmission of a first audio service.

[0037] In an optional implementation manner, acquiring the second working clock through the third wireless link between the second central device includes:

[0038] The third wireless link is established with the second central device, and the second working clock is estimated, obtained and continuously tracked based on the third wireless link.

[0039] In an optional implementation manner, establishing a first wireless link based on a first working clock with the external device includes:

[0040] using the estimated second working clock as the first working clock, and using the first working clock to establish the first wireless link with the external device, and / or,

[0041] Based on the estimated second working clock, the working clock of the first wireless link is adjusted to the first working clock, so that the first working clock is synchronized with the estimated second working clock.

[0042] In a third aspect, the present invention provides a wireless multi-source synchronous communication system, the system comprising: an external device, a first central device and a second central device;

[0043] The external device is used to establish a first wireless link based on a first working clock with a first central device, and to establish a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock; when a first audio service with the first central device and a second audio service with the second central device coexist, the first audio service and the second audio service are synchronously processed on the first wireless link and the second wireless link based on the same time axis, respectively;

[0044] The first central device is used to obtain a second working clock through a third wireless link between the first central device and the second central device, where the second working clock is the working clock of the second wireless link between the second central device and the external device; establish a first wireless link based on the first working clock with the external device; and communicate with the external device on the first wireless link based on the first working clock synchronized with the second working clock to perform data transmission of a first audio service.

[0045] In an optional implementation, the external device, the first central device and the second central device are all Bluetooth devices.

[0046] In a fourth aspect, the present invention provides an external device, comprising: the external device comprises a main processor and one or more controllers;

[0047] The main processor configures the one or more controllers so that the external device executes the wireless multi-audio source synchronous communication method as described above.

[0048] In an optional embodiment, the multiple controllers include a master controller and one or more slave controllers;

[0049] The main controller includes a master-slave interface defined in the Bluetooth core specification for connecting to the main processor;

[0050] The master controller and the slave controller further include a physical interface that can be used for mutual cascading.

[0051] In an optional implementation, the master controller and the slave controller are packaged in the same chip;

[0052] Each of the controllers is provided with a radio frequency unit, a baseband unit, a link control unit, a link management or a link layer unit, and is connected to external independent antennas or the same antenna.

[0053] In a fifth aspect, the present invention provides an electronic device, wherein the electronic device is a first central device, and the first central device includes:

[0054] A transceiver module, used for acquiring a second working clock through a third wireless link between the second central device and the second central device, wherein the second working clock is a working clock of a second wireless link between the second central device and the external device;

[0055] A processing module, configured to establish a first wireless link based on a first working clock with the external device;

[0056] The transceiver module is further configured to communicate with the external device on the first wireless link based on a first working clock synchronized with the second working clock, so as to perform data transmission of a first audio service.

[0057] The technical solution provided by the present invention may include the following beneficial effects:

[0058] The present invention can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously processes the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when the external device communicates with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when the external device sends and receives audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0059] The present invention automatically adjusts the transmission strategy according to different network environments (such as bandwidth, delay, interference, etc.), adopts single-controller time division multiplexing when the bandwidth or time slot is sufficient, and adopts multi-controller frequency division multiplexing when the bandwidth or time slot is insufficient. This flexibility enables the system to maintain stable transmission performance in various complex network environments. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0061] Figure 1 is a structural schematic diagram of a wireless multi-audio source synchronous communication system according to an embodiment of the present invention;

[0062] Figure 2is a schematic structural diagram of another wireless multi-source synchronous communication system according to an embodiment of the present invention;

[0063] Figure 3 is a schematic diagram of the structure of an external device according to an embodiment of the present invention;

[0064] Figure 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

[0065] Figure 5 is a flow chart of a wireless multi-audio source synchronous communication method according to an embodiment of the present invention;

[0066] Figure 6 is a flow chart of another wireless multi-audio source synchronous communication method according to an embodiment of the present invention;

[0067] Figure 7 is a flow chart of another wireless multi-audio source synchronous communication method according to an embodiment of the present invention;

[0068] Figure 8 is a flow chart of another wireless multi-audio source synchronous communication method according to an embodiment of the present invention;

[0069] Fig. 9 is a schematic diagram of the A2DP and TMAP time slot structures according to an embodiment of the present invention;

[0070] Fig.10 is a schematic diagram of the HFP and TMAP time slot structures according to an embodiment of the present invention;

[0071] Fig.11 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0072] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0073] In this embodiment, a wireless multi-source synchronous communication system is provided. Figure 1 is a schematic diagram of the structure of a wireless multi-source synchronous communication system according to an embodiment of the present invention. Figure 1 As shown, the system includes: an external device, a first central device and a second central device;

[0074] The external device is used to establish a first wireless link based on a first working clock with a first central device, and to establish a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock; when a first audio service with the first central device and a second audio service with the second central device coexist, the first audio service and the second audio service are synchronously processed on the first wireless link and the second wireless link based on the same time axis, respectively;

[0075] The first central device is used to obtain a second working clock through a third wireless link between the second central device and the second central device, where the second working clock is the working clock of the second wireless link between the second central device and the external device; establish a first wireless link based on the first working clock with the external device; and communicate with the external device on the first wireless link based on the first working clock synchronized with the second working clock to perform data transmission of a first audio service.

[0076] In an optional implementation, the external device, the first central device and the second central device are all Bluetooth devices.

[0077] Further, in this embodiment, the external device is the source or receiving end of the audio data, and can establish a wireless connection with the first central device and the second central device at the same time. The external device establishes a first wireless link based on the first working clock with the first central device to ensure the synchronous transmission of the first audio service. At the same time, the external device also establishes a second wireless link based on the second working clock with the second central device. The second working clock is generated by the local clock of the second central device and is synchronized with the first working clock. When the external device processes the audio services from the first central device and the second central device at the same time, the external device can synchronously process these audio services on the same time axis to ensure the synchronous collection or synchronous playback of audio data. It can be understood that the audio service in this embodiment can include multiple types, such as media services, call services, etc. Specifically, it can be playing music, recording, playing music in the game center, incoming call prompt tone, phone, WeChat voice call, video call, voice chat in the game center, etc. The data transmission in the audio service can be audio data, voice data, and other types of data, such as confirmation information, control information, etc., so as to realize content transmission, information interaction and various control functions in the audio service.

[0078] Furthermore, in this embodiment, the first central device is a key node in the system, responsible for communicating audio services with external devices. The first central device obtains the second working clock from the second central device through the third wireless link to ensure that its first working clock is synchronized with the second working clock. Thereafter, based on the synchronized first working clock, the first central device transmits data with the external device through the first wireless link to achieve synchronous communication of the first audio service.

[0079] Furthermore, in this embodiment, the second central device is another key node, and the second central device generates a second working clock, which is used as a reference for communicating with external devices. The second central device not only performs synchronous transmission of audio services with external devices through the second wireless link, but also provides the second working clock information to the first central device through the third wireless link to achieve clock synchronization of the entire system.

[0080] In an optional implementation, this embodiment can be applied to the scenario of synchronous transmission and playback of multi-source wireless audio (MSWA: Multi-Source Wireless Audio). In this case, please refer to Figure 2 , which shows a structural diagram of another wireless multi-source synchronous communication system involved in an embodiment of the present application. The system is composed of an MSWA second central device, one or more (N≥1) MSWA first central devices, and an MSWA external device (Peripheral), wherein the MSWA second central device can be a primary control center device (Primary Central), and the MSWA first central device can be an MSWA secondary central device (Secondary Central). The MSWA first central device and the MSWA second central device indirectly or directly establish a BT link, the MSWA second central device is the BT central device (BT Central) of the BT link, and the MSWA secondary central device is the BT external device (BT Peripheral) of the BT link. The MSWA second central device and the MSWA first central device respectively establish different BT links with the MSWA external device for MSWA transmission, the MSWA primary control center device and the MSWA secondary central device are the BT Central of each BT link, and the MSWA external device is the BT Peripheral of each BT link. The MSWA external device transmits MSWA with the MSWA main control center device and the MSWA sub-center device through each BT link in time division multiplexing or frequency division multiplexing.

[0081] In an optional implementation, the BT link includes a classic Bluetooth (CBT: Classic Bluetooth) link, a Bluetooth Low Energy (BLE: Bluetooth Low Energy) link, and other improved CBT links or improved BLE links, and similar private wireless links.

[0082] Please refer to Figure 3 , which shows a schematic diagram of the structure of an external device involved in an embodiment of the present application. The external device includes a main processor and one or more controllers; the main processor can be Figure 3 The application and host processor (APP&Host Processor) in the one or more controllers can be Figure 3 Master Controller, SlaveController1 to Slave ControllerM.

[0083] The main processor configures the one or more controllers so that the external device executes a wireless multi-audio source synchronous communication method.

[0084] In an optional embodiment, the plurality of controllers include a master controller and one or more slave controllers;

[0085] The main controller includes a master-slave interface defined in the Bluetooth core specification for connecting to the main processor;

[0086] The master controller and the slave controller also include a physical interface that can be used for mutual cascading.

[0087] In an optional implementation, the master controller and the slave controller are packaged in the same chip;

[0088] Each controller is provided with a radio frequency unit, a baseband unit, a link control unit, a link management or link layer unit, and is connected to external independent antennas or the same antenna.

[0089] In an optional embodiment, if Figure 3As shown, the external device is composed of an application and host processor (APP&Host Processor) and a scalable controller (Scalable Controller). The scalable controller is composed of a master controller (Master Controller) and multiple (M≥0) slave controllers (Slave Controller). Among them, the master-slave interface (HCI: Host Controller Interface) defined by the BT core specification (Core Specification) is used between the application and host processor (APP&Host Processor) and the master controller (Master Controller). The physical interface of HCI can be UART, USB or SDIO, etc.

[0090] The master controller and the slave controller, and the slave controller and the slave controller are connected in a cascade manner, and their physical interfaces can be UART, USB or SDIO, etc. As many slave controllers as needed, they can be cascaded. Multiple controllers can share the same antenna or use their own independent antennas. Without loss of generality, the controller (including the master controller and the slave controller) is the Controller defined by the BT core specification, including radio frequency (Radio), baseband (Baseband), link control (Link Controller), link management (Link Manager) or link layer (Link Layer), HCI interface and other functions. The application and host processor (APP&Host Processor) is a collection of all other functional modules of the MSWA external device except the controller. In addition to executing the Host protocol defined by the BT core specification, it also executes the configuration (Profiles) protocol, application functions, audio codec, audio algorithm and audio input and output, etc.

[0091] The master controller or slave controller in the Scalable Controller can establish a BT link for MSWA transmission with one or more MSWA second center devices or MSWA first center devices. In the direction of receiving audio data, the slave controller submits the received audio data to the master controller through the HCI interface, and then the master controller submits it to the application and host processor. In the direction of sending audio data, the application and host processor send the audio data to the master controller, and then the master controller sends it to the slave controller.

[0092] Please refer to Figure 4 , which shows a schematic diagram of the structure of an electronic device involved in an embodiment of the present application. The electronic device is a first central device, and the first central device includes:

[0093] The transceiver module 401 is used to obtain a second working clock through a third wireless link between the second central device and the second central device, where the second working clock is a working clock of a second wireless link between the second central device and the external device;

[0094] The processing module 402 is configured to establish a first wireless link based on a first working clock with the external device;

[0095] The transceiver module 401 is further configured to communicate with the external device on the first wireless link based on a first working clock synchronized with the second working clock, so as to perform data transmission of a first audio service.

[0096] To summarize, the present invention can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously process the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when external devices communicate with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when external devices send and receive audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0097] The present invention automatically adjusts the transmission strategy according to different network environments (such as bandwidth, delay, interference, etc.), adopts single-controller time division multiplexing when the bandwidth or time slot is sufficient, and adopts multi-controller frequency division multiplexing when the bandwidth or time slot is insufficient. This flexibility enables the system to maintain stable transmission performance in various complex network environments.

[0098] According to an embodiment of the present invention, an embodiment of a wireless multi-source synchronous communication method is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0099] In this embodiment, a wireless multi-source synchronous communication method is provided, which can be used for the above-mentioned external device. Figure 5 is a flow chart of a wireless multi-source synchronous communication method according to an embodiment of the present invention. Figure 5 As shown, the process includes the following steps:

[0100] Step S501, establish a first wireless link based on a first working clock with a first central device, and establish a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock.

[0101] Furthermore, the first wireless link in this embodiment refers to a wireless connection established between an external device (the external device serves as a communication terminal) and a first central device (the first central device may be a first audio source or a control center). The first wireless link is established based on a first working clock, so that all data transmitted on the first wireless link needs to be transmitted according to the time reference of the first working clock.

[0102] The second wireless link in this embodiment refers to the external device also establishing another wireless connection with the second central device at the same time. The second wireless link is established based on the second working clock generated by the local clock of the second central device. During the establishment process, the first working clock is synchronized with the second working clock to make the time bases of the two central devices consistent.

[0103] Step S502: When a first audio service with the first central device and a second audio service with the second central device coexist, the first audio service and the second audio service are synchronously processed based on the same time axis on the first wireless link and the second wireless link respectively.

[0104] Furthermore, when there are coexisting audio services, that is, when multiple types of audio services such as music playback and voice calls coexist, in order to ensure that the audio heard by the user is synchronized, the external device in this embodiment needs to synchronize the audio services on the two wireless links based on the same timeline. Once the working clock on the wireless link is synchronized, the external device can synchronously collect or play audio data from different sources, thereby simultaneously receiving and processing audio services (the first audio service and the second audio service) from two central devices.

[0105] To summarize, the present invention can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously process the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when external devices communicate with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when external devices send and receive audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0106] In this embodiment, another wireless multi-source synchronous communication method is provided, which can be used for the above-mentioned external device. Figure 6 FIG. 1 is a flow chart of another wireless multi-source synchronous communication method according to an embodiment of the present invention. Figure 6 As shown, the process includes the following steps:

[0107] Step S601, establish a first wireless link based on a first working clock with a first central device, and establish a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock.

[0108] Furthermore, a piconet is a micro-network connected in a specific way through Bluetooth technology. A piconet can be just two connected devices or a network composed of multiple devices. In the BT protocol, the BT link of each piconet uses the native clock of the BT central device as the BT Clock, and the BT Clock is not synchronized with the local clock of the BT external device. Therefore, the BT external device needs to estimate, track and compensate for the deviation between its local clock and the BT Clock to obtain an estimated clock, that is, the estimated clock of the BT Clock. If the BT external device joins multiple piconet networks and thus connects to multiple BT central devices at the same time, it needs to use multiple estimated clocks to synchronize transmission and reception with multiple BT central devices. In this way, the BT external device needs to frequently switch between multiple estimated clocks to realize time-division multiplexing transmission and reception of multiple BT links established with multiple BT central devices.

[0109] Frequent switching of BT external devices between multiple estimated clocks or multiple piconets not only wastes a large number of time slots, resulting in insufficient effective bandwidth to support wireless audio transmission of more than two BT links, but also makes it difficult to solve the problem of overlapping time slots of more than two BT links. For example, the transmit and receive time slots of two extended synchronous connection (eSCO: Extended Synchronous Connection-Oriented) links in two piconets may overlap with each other due to clock drift, and the BT external device cannot transmit and receive with two BT central devices on the two eSCO links at the same time. For example, the transmit and receive time slots of two connected isochronous group (CIG: Connected Isochronous Group) links in two piconet may also overlap with each other due to clock drift, and the BT external device cannot transmit and receive with two BT central devices on the two CIG links at the same time. For example, a similar problem also exists for one eSCO link and one CIG link in two piconets. Even if BT external devices use multiple controllers to connect multiple eSCO links or CIG links respectively, multiple links will interfere with each other because they cannot send and receive at the same time. For example, when one link is sending while another link is receiving, the sending signal will seriously interfere with the receiving signal.

[0110] In order to solve the above problems, the goal of the MSWA synchronous transmission method implemented in this embodiment is to keep the phases of the BT Clocks of the multiple piconets where the BT external device is located relatively stable, that is, not drifting with each other. In this way, the BT external device can avoid wasting time slots when switching between multiple piconets, and can reduce or even eliminate the overlap of the sending time slots and receiving time slots between the multiple BT links of the multiple piconets where the BT external device is located, thereby reducing or even eliminating the mutual interference between the multiple BT links. It can also avoid the use of multiple asynchronous sampling rate converters (ASRC: Asynchronous Sampling Rate Converter) for the multi-channel wireless audio received by the BT external device and can play synchronously.

[0111] Step S602, when a first audio service with a first central device and a second audio service with a second central device coexist, data in different audio services are sent and received in a time division multiplexing or frequency division multiplexing manner on the first wireless link and the second wireless link, respectively, based on the same time axis and within each time interval of the time axis.

[0112] In an optional implementation, when the external device includes one or more controllers; the “transmitting and receiving data in different audio services in a time division multiplexing or frequency division multiplexing manner” in step S602 includes:

[0113] Step S6021, using a controller to receive and send data of the first audio service and the second audio service in a time division multiplexing manner; or,

[0114] The first controller and the second controller among the multiple controllers are used to receive and send data of the first audio service and the second audio service in a frequency division multiplexing manner, wherein the first controller corresponds to the first wireless link and the second controller corresponds to the second wireless link.

[0115] In an optional implementation, when the external device uses a controller to perform data reception and data transmission of the first audio service and the second audio service in a time division multiplexing manner, the first wireless link includes a BLE ACL link and a BLE CIG link; the first audio service is that the first central device acts as an audio source device to perform online two-way telephone and media audio data transmission based on the TMAP protocol with the external device;

[0116] The second wireless link includes a CBT ACL link; the second audio service is that the second central device acts as a sound source device and performs music data transmission based on the A2DP protocol with the external device; or,

[0117] The second wireless link includes a BLE ACL link and a BLE CIG link; the second audio service is that the second central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device.

[0118] In an optional implementation, when the external device uses the first controller and the second controller of the multiple controllers to perform data reception and data transmission of the first audio service and the second audio service in a frequency division multiplexing manner,

[0119] The first wireless link includes a BLE ACL link and a BLE CIG link; the first audio service is that the first central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device;

[0120] The second wireless link includes a CBT eSCO link and a CBT ACL link; the second audio service is that the second central device serves as an audio source device and performs voice data transmission based on the HFP protocol with the external device.

[0121] Furthermore, this embodiment uses a controller for time division multiplexing, that is, the external device uses a controller to manage the transmission and reception of all audio data. The controller divides the time into multiple time intervals on the same time axis, and alternately processes the audio data from the first central device or the second central device in each time interval. At this time, the first wireless link may include a BLE ACL link (asynchronous connectionless link) and a BLE CIG link, and the first audio service is based on the two-way telephone and media audio data transmission of the TMAP protocol; the second wireless link may be a CBT ACL link (asynchronous connectionless link based on ClassicBluetooth), which is used for music data transmission based on A2DP (Advanced Audio Distribution Profile); or it may also be a BLE ACL link (asynchronous connectionless link) and a BLE CIG link, but used for another audio data transmission based on the TMAP protocol.

[0122] This embodiment uses multiple controllers for frequency division multiplexing, and the external device uses multiple controllers (such as the first controller and the second controller), each controller is responsible for audio data transmission on a wireless link, and through frequency division multiplexing, different controllers can send and receive data at the same time on different frequencies, thereby improving data transmission efficiency. At this time, the first wireless link is the same as the above-mentioned time division multiplexing, and is used for audio data transmission based on the TMAP protocol; the second wireless link can include a CBT eSCO link (enhanced synchronous connection-oriented link) and a CBT ACL link for voice data transmission based on HFP (hands-free profile). This configuration is more suitable for scenarios requiring high-quality voice communication.

[0123] In an optional embodiment, this embodiment configures the first controller and the second controller when performing data reception and data transmission of the first audio service and the second audio service in a frequency division multiplexing manner within each time interval so that the transmission time slot of the first controller does not overlap with the target reception time slot of the second controller, and the target reception time slot is the time slot that the second controller must receive based on a predetermined rule.

[0124] Furthermore, when receiving and sending data for the first audio service and the second audio service in frequency division multiplexing, the present embodiment configures two controllers so that the sending time slot of one controller does not overlap with the target receiving time slot of the other controller, that is, if the target receiving time slot must be received, for example, when a controller does not complete the reception of a data packet in the previous time slot, it can be specified to continue receiving in a subsequent time slot, so that the subsequent time slot is the target receiving time slot. The present embodiment first clarifies the predetermined rule when each controller must receive data (i.e., the target receiving time slot), and the predetermined rule can be based on the communication protocol, the size of the data packet, the transmission rate, and any possible delay or retransmission mechanism.

[0125] Based on the above clock relationship, the second wireless link transmits and receives synchronously with the first wireless link, that is, the receiving time slot of the second wireless link does not overlap with the sending time slot of the first wireless link, and the sending time slot of the second wireless link does not overlap with the receiving time slot of the first wireless link, thereby avoiding mutual interference between the second wireless link and the first wireless link.

[0126] In summary, the external device of this embodiment adopts an expandable controller, wherein a second wireless link is established with a second central device through a main controller, and a first wireless link is established with a first central device through a slave controller, and the second wireless link and the first wireless link are synchronously sent and received by frequency division multiplexing to increase the effective bandwidth or reduce the transmission delay.

[0127] Step S603: When a first audio service with the first central device and a second audio service with the second central device coexist, synchronously play and / or synchronously collect audio data in the first audio service and the second audio service based on a local clock synchronized with the second working clock.

[0128] Furthermore, when the first audio service of the first central device and the second audio service of the second central device are running simultaneously, in order to achieve synchronous playback and / or synchronous collection of audio data, this embodiment uses a local clock synchronized with the second working clock as a reference, thereby ensuring synchronous collection or synchronous playback of different audio data, thereby avoiding problems such as delay, overlap or confusion in audio playback.

[0129] To summarize, the present invention can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously process the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when external devices communicate with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when external devices send and receive audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0130] The present invention automatically adjusts the transmission strategy according to different network environments (such as bandwidth, delay, interference, etc.), adopts single-controller time division multiplexing when the bandwidth or time slot is sufficient, and adopts multi-controller frequency division multiplexing when the bandwidth or time slot is insufficient. This flexibility enables the system to maintain stable transmission performance in various complex network environments.

[0131] In this embodiment, another wireless multi-source synchronous communication method is provided, which can be used for the first central device mentioned above. Figure 7 is a flow chart of another wireless multi-source synchronous communication method according to an embodiment of the present invention. Figure 7 As shown, the process includes the following steps:

[0132] Step S701: Acquire a second working clock through a third wireless link with a second central device, where the second working clock is a working clock of a second wireless link between the second central device and an external device.

[0133] Furthermore, the first central device in this embodiment obtains a second working clock through a third wireless link between the first central device and the second central device (the third wireless link can be a dedicated synchronization link, that is, a link directly established between the first central device and the second central device, or it can be a part of an indirect use of an existing communication link, that is, the first central device communicates with the second central device through the first wireless link and the second wireless link in turn to form an indirect third wireless link). The second working clock is the working clock of the second wireless link between the second central device and the external device, and represents the time base for communication between the second central device and the external device.

[0134] Step S702: Establish a first wireless link based on a first working clock with the external device.

[0135] Furthermore, a first wireless link based on a first working clock is established between the first central device and the external device, and the first wireless link is used to transmit data of the first audio service. In this embodiment, the first working clock is synchronized with the second working clock to enable synchronous communication of wireless multi-audio sources.

[0136] Step S703: Communicate with the external device on the first wireless link based on the first working clock synchronized with the second working clock to perform data transmission of the first audio service.

[0137] Furthermore, the first central device in this embodiment uses the acquired second working clock as a reference to adjust its local first working clock to achieve synchronization with the second working clock. Once the first working clock is synchronized with the second working clock, the first central device can communicate with the external device on the first wireless link based on the synchronized first working clock to perform data transmission of the first audio service. Since the first working clock is synchronized with the second working clock, the time consistency of the audio data during the transmission process can be ensured, avoiding problems such as audio delay, overlap or confusion caused by clock asynchrony.

[0138] To summarize, the present invention can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously process the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when external devices communicate with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when external devices send and receive audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0139] In this embodiment, another wireless multi-source synchronous communication method is provided, which can be used for the first central device mentioned above. Figure 8 is a flow chart of another wireless multi-source synchronous communication method according to an embodiment of the present invention. Figure 8 As shown, the process includes the following steps:

[0140] Step S801, establishing the third wireless link with the second central device, estimating and obtaining and continuously tracking the second working clock based on the third wireless link, the second working clock being the working clock of the second wireless link between the second central device and the external device.

[0141] Further, the first central device establishes a third wireless link with the second central device indirectly or directly. In the third wireless link, the first central device acts as a BT external device of the second central device and works on an estimated clock (Estimated Clock) based on the second BT Clock of the second central device, and the second BT Clock is the above-mentioned second working clock. The first central device uses the estimated clock (Estimated Clock) of the second BT Clock as the first BT Clock to establish a first wireless link with the external device, and the first BT Clock is the above-mentioned first working clock. In this way, the first working clock of the first wireless link and the second working clock of the second wireless link can be synchronized. The external device establishes a second wireless link with the second central device and works on an estimated clock (EstimatedClock) based on the second BT Clock of the second central device. At this time, the second BT Clock used in the second wireless link established by the external device with the second central device is synchronized with the first BT Clock used in the first wireless link established by the external device with the first central device. Based on the above clock relationship, the external device can synchronously play various audio services between the second central device and the first central device.

[0142] Furthermore, the method for the first central device to directly establish a third wireless link with the second central device is: the first central device obtains the BT address of the second central device through the first wireless link between the external device and the first central device, thereby establishing a third wireless link with the second central device through the BT protocol.

[0143] Furthermore, the method for indirectly establishing a third wireless link between the first central device and the second central device is: the first central device obtains the second wireless link information between the external device and the second central device and obtains the corresponding second working clock through the first wireless link between the external device and the first central device, thereby achieving synchronization of the estimated clock of the first working clock used by the first wireless link with the estimated clock of the second working clock used by the second wireless link by monitoring the second wireless link.

[0144] Step S802: using the estimated second working clock as the first working clock, and using the first working clock to establish the first wireless link with the external device, and / or,

[0145] The working clock of the first wireless link is adjusted to the first working clock based on the estimated second working clock, so that the first working clock is synchronized with the estimated second working clock.

[0146] Furthermore, the first central device synchronizes its local clock with the local clock of the second central device by adjusting the parameters of the local digital phase-locked loop (DPLL), thereby synchronizing the first working clock with the second working clock. The external device synchronizes its local clock with the second working clock by adjusting the parameters of the local DPLL. In this way, the estimated clock of the second wireless link used by the external device is synchronized with the estimated clock of the first wireless link.

[0147] Step S803: Based on the first working clock synchronized with the second working clock, communicate with the external device on the first wireless link to perform data transmission of the first audio service. Figure 7 Step S703 of the illustrated embodiment will not be described in detail here.

[0148] To summarize, the present invention can achieve high-precision clock synchronization between different central devices by ensuring that the first working clock of the first wireless link is synchronized with the second working clock of the second wireless link; and synchronously process the first audio service and the second audio service based on the same time axis, so that audio data from both the first central device and the second central device can be accurately processed and played at the same time point, achieving seamless multi-source synchronous playback, thereby avoiding audio misalignment or delay problems caused by clock asynchrony when external devices communicate with different central devices, and can reduce or eliminate mutual interference between multiple wireless links when external devices send and receive audio services of multiple sources, so as to increase the effective bandwidth and ensure the reliability of wireless multi-source synchronous transmission, and can also make the audio services of multiple sources play synchronously and reduce transmission delays.

[0149] The present invention automatically adjusts the transmission strategy according to different network environments (such as bandwidth, delay, interference, etc.), adopts single-controller time division multiplexing when the bandwidth or time slot is sufficient, and adopts multi-controller frequency division multiplexing when the bandwidth or time slot is insufficient. This flexibility enables the system to maintain stable transmission performance in various complex network environments.

[0150] The following two simple examples are used to explain the contents disclosed in the above embodiment:

[0151] Example 1:

[0152] This example uses the advanced audio distribution profile (A2DP: Advanced Audio Distribution Profile) based on the CBT asynchronous link (ACL: Asynchronous Connection-oriented Link) to implement music sharing and the telephony and media audio profile (TMAP: Telephony and Media Audio Profile) based on the BLE CIG link as examples to illustrate the wireless multi-source synchronous communication method.

[0153] In this example, it is assumed that the wireless multi-source synchronous communication system includes two smartphones and a BT headset, wherein one smartphone A is used as the second central device (i.e., the MSWA master control central device), the other smartphone B is used as the first central device (MSWA sub-central device), and the BT headset is used as the MSWA external device. While the BT headset establishes a CBT ACL link with smartphone A and plays music through the A2DP protocol, it establishes a BLE CIG link with smartphone B and opens a two-way online conference through the TMAP protocol. In addition, the BT headset also provides smartphone B with its CBT ACL link information with smartphone A through the BLE ACL link established with smartphone B, so that smartphone B can indirectly establish a third wireless link with smartphone A through monitoring to track the BT Clock of smartphone A. The BT headset can also provide smartphone B with the device address of smartphone A through the BLE ACL link established with smartphone B, so that smartphone B can directly establish a third wireless link with smartphone A to track the BT Clock of smartphone A. In this way, the second BT Clock used in the second wireless link established between the BT headset and smartphone A is synchronized with the first BT Clock used in the first wireless link established between the BT headset and smartphone B, that is, the second working clock is synchronized with the first working clock.

[0154] like Fig. 9 The schematic diagram of the A2DP and TMAP time slot structure shown in FIG. 1 shows that the A2DP time axis and the TMAP time axis are on the same time axis, the A2DP quality of service (QoS: Quality of Service) interval is 11.25ms, and the smartphone A sends an audio data packet once every 11.25ms on average (e.g. Figure 3 2DH5 as shown), after receiving 2DH5, the BT headset replies with a data packet carrying confirmation information (if the ACK solid line box shown in 3), if the BT headset does not receive 2DH5 or receives 2DH5 but does not send a data packet carrying confirmation information in order to avoid interfering with another link (if the dashed line small box shown in 3). 2DH5 occupies 5 BT time slots, one slot is 625us, and ACK occupies one BT time slot. In addition, smartphone A also sends other packet types such as polling (POLL) to the BT headset, and the BT headset replies with other packet types such as empty packets (NULL) to smartphone A. POLL and NULL each occupy a BT time slot. A2DP audio uses sub-band codec (SBC: Sub-Band Codec), and the stereo encoding rate of 48kHz sampling rate is 237kbps.

[0155] The ISO Interval of the bidirectional CIG link of the TMAP protocol is 10ms. Fig. 9 The uppercase M box on the TMAP timeline represents the connected isochronous stream (CIS: Connected Isochronous Stream) protocol data unit (PDU: Protocol Data Unit) sent by smartphone B to the BT headset, and the uppercase S represents the CIS PDU sent by the BT headset to smartphone B. The lowercase m represents the BLE ACL PDU sent by the smartphone to the BT headset, and the lowercase s represents the BLE ACL PDU sent by the BT headset to smartphone B. TMAP audio uses low complexity communication codec (LC3: Low Complexity Communication Codec), with a mono encoding rate of 80kbps at a 48kHz sampling rate and a coding frame length of 10ms. The size of the mono service data unit is 100 bytes. The inter-packet interval (T_IFS: Time of Inter Frame Space) between the CIS PDU represented by S and the CIS PDU represented by M is equal to 150us. The minimum time slot interval (T_MSS: Time of Minimum Slot Space) between the end time of the CIS PDU represented by S and the start time of the CIS PDU represented by M is 180us. LE 2M PHY is used to send CIS PDU, and the air time of each CIS PDU is 460us. The sub-event interval (Sub-Event Interval) occupied by smartphone B and BT headset to send and receive a CIS PDU is 1.25ms, the number of sub-events (NSE: Number of Sub-Event) is 3, and it takes up to 3.75ms, and the refresh time (FT: Flush Time) is 3. Fig. 9 On the TMAP time axis shown, the solid M and S boxes represent the time slots in which the CIS PDU must be sent and received, and the dotted boxes represent possible retransmission time slots. If the first transmission and reception in each ISO Interval is successful, no retransmission is required, and no CIS PDU needs to be sent or received.

[0156] Depend on Fig. 9 The figure shows that the BT headset as an MSWA external device uses a single controller to communicate with smartphone A and smartphone B in time division multiplexing. Fig. 9 As shown, the first BTClock of the second wireless link established between smartphone A and BT headset is synchronized with the second BT Clock of the first wireless link established between smartphone B and BT headset, so they can be sent and received synchronously. Fig. 9In the first QoS Interval or the first ISO Interval shown, while the BT headset was receiving the CIS PDU represented by M sent by smartphone B and replying to the CIS PDU represented by S, smartphone A sent 2DH5, which was not received by the BT headset, so the BT headset did not reply ACK (represented by the dotted box). Therefore, smartphone A retransmitted 2DH5, and the BT headset correctly received and replied ACK. In the second QoS Interval, when smartphone A sent 2DH5, the BT headset had completed the CIS PDU transmission and reception in the second ISO Interval, so it correctly received 2DH5 and replied ACK.

[0157] like Fig. 9 As shown, if the BT headset as an external device of MSWA uses dual controllers to communicate with smartphone A and smartphone B by frequency division multiplexing, that is, the main controller is connected to smartphone A, and the slave controller is connected to smartphone B. In the first QoSInterval, during the process of the main controller receiving 2DH5, the CIS PDU represented by S sent by the slave controller interferes with the reception of 2DH5. Therefore, the main controller of the BT headset will reply to smartphone A with confirmation information that the packet was not received correctly or will not send ACK (as represented by the dotted box). The effect of this situation is the same as that of the BT headset using a single controller. Therefore, for the application scenario of this example, it is not necessary for the BT headset to use multiple controllers.

[0158] Example 2:

[0159] This example uses a call using the hands-free protocol (HFP: Hands-Free Profile) based on a CBT eSCO link and an online conference using the telephone and media audio protocol (TMAP: Telephony and Media Audio Profile) based on a BLE CIG link as examples to illustrate the wireless multi-source synchronous communication method.

[0160] In this example, it is assumed that the wireless multi-source synchronous communication system includes two smartphones and a BT headset, wherein one smartphone A is used as the second central device (i.e., the MSWA master control central device), the other smartphone B is used as the first central device (MSWA sub-central device), and the BT headset is used as the MSWA external device. While the BT headset establishes a CBT eSCO link with smartphone A and makes a call through the HFP protocol, it also establishes a BLE CIG link with smartphone B and opens a two-way online conference through the TMAP protocol. In addition, the BT headset also provides smartphone B with its CBT ACL link information with smartphone A through the BLE ACL link established with smartphone B, so that smartphone B can indirectly establish a first BT link with smartphone A through monitoring to track the BT Clock of smartphone A. The BT headset can also provide smartphone B with the device address of smartphone A through the BLE ACL link established with smartphone B, so that smartphone B can directly establish a first BT link with smartphone A to track the BT Clock of smartphone A. In this way, the second BT Clock used in the second wireless link established by the BT headset with smartphone A is synchronized with the first BT Clock used in the first wireless link established by the BT headset with smartphone B, that is, the second working clock is synchronized with the first working clock.

[0161] like Fig.10 The HFP and TMAP time slot structure diagram is shown in FIG. 1 , where the HFP time axis and the TMAP time axis are on the same time axis. The eSCO interval of HFP is 7.5 ms, and the smartphone A and the BT headset send at least one 2EV3 packet every 7.5 ms (e.g. Fig.10 The uppercase M solid line box shown in the figure represents the 2EV3 packet sent by smartphone A, and the uppercase S solid line box represents the 2EV3 packet sent by BT headset), which occupies two BT time slots, and one slot is 625us. In one eSCO interval, smartphone A and BT headset can also retransmit 2EV3 packets multiple times (such as Fig.10 The uppercase M dashed box shown represents the 2EV3 packet that may be sent by smartphone A, and the uppercase S dashed box represents the 2EV3 packet that may be sent by BT headset. In addition, smartphone A also sends other packets such as polling (POLL) packets to BT headset (such as lowercase m solid box), and BT headset replies to smartphone A with other packets such as NULL (such as lowercase s solid box or dashed box). POLL and NULL each occupy a BT time slot. HFP uses a modified version of SBC (mSBC: modified version of SBC) with a coding rate of 64kbps.

[0162] The ISO Interval of the bidirectional CIG link of the TMAP protocol is 7.5ms (the same as the eSCO Interval). The capital M represents the Connected Isochronous Stream (CIS) PDU (Protocol Data Unit) sent by smartphone B to the BT headset, and the capital S represents the CIS PDU sent by the BT headset to smartphone B. The lowercase m represents the BLE ACL PDU sent by the smartphone to the BT headset, and the lowercase s represents the BLE ACL PDU sent by the BT headset to smartphone B. TMAP audio uses the Low Complexity Communication Codec (LC3), with a mono encoding rate of 96kbps at a 48kHz sampling rate and a coding frame length of 7.5ms. The size of the mono service data unit is 90 bytes. The inter-packet interval (T_IFS: Time of Inter Frame Space) between the CIS PDU represented by S and the CIS PDU represented by M is equal to 150us. The minimum time slot interval (T_MSS: Time of Minimum Slot Space) between the end time of the CIS PDU represented by S and the start time of the CIS PDU represented by M is 260us. LE 2M PHY is used to send CIS PDU, and the air time of each CIS PDU is 420us. The sub-event interval (Sub-Event Interval) occupied by smartphone B and BT headset to send and receive a CIS PDU is 1.25ms, and the number of sub-events (NSE: Number of Sub-Event) is 5, which takes up to 6.25ms. Fig.10 On the TMAP time axis shown, the solid M and S boxes represent the time slots in which CIS PDUs must be sent and received, and the dotted boxes represent possible retransmission time slots. If the first transmission and reception in each ISO Interval is successful, no retransmission is required, and no CIS PDU needs to be sent or received.

[0163] Depend on Fig.10 As shown in the figure, the BT headset as an external device of MSWA uses dual controllers to communicate with smartphone A and smartphone B by frequency division multiplexing, that is, the main controller is connected to smartphone A, and the slave controller is connected to smartphone B. Fig.10 As shown, the first BT Clock of the third BT link established between the smartphone A and the BT headset is synchronized with the second BT Clock of the second BT link established between the smartphone B and the BT headset, so they can transmit and receive synchronously. Fig.10In the process, the eSCO link takes 1.25ms to send and receive once, and the CIG link also takes 1.25ms to send and receive once. During the process that the BT headset receives 2EV3 of the eSCO link through the main controller, its slave controller is receiving the CIS PDU of the CIG link. During the process that the BT headset sends 2EV3 of the eSCO link through the main controller, its slave controller is sending the CIS PDU of the CIG link. That is, the third BT link and the second BT link of the BT headset connected to smartphone A and smartphone B respectively can transmit and receive simultaneously without interfering with each other.

[0164] like Fig.10 As shown in FIG. 1 , since the eSCO link takes up to 3.75 ms including retransmission, the CIG link takes up to 6.25 ms including retransmission, and the eSCO Interval and ISO Interval are both 7.5 ms, the total time slot is insufficient to support the two links simultaneously. Therefore, in the application of this embodiment, the BT headset as an MSWA external device is not suitable for communicating with smartphones A and B in time division multiplexing using a single controller.

[0165] See also Fig.11 , Fig.11 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Fig.11 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig.11 A processor 10 is taken as an example.

[0166] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0167] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0168] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0169] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0170] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0171] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0172] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0173] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A wireless multi-source synchronous communication method, characterized in that: Applied to an external device, the method comprises: Establishing a first wireless link based on a first working clock with a first central device, and establishing a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock; When a first audio service with the first central device and a second audio service with the second central device coexist, the first audio service and the second audio service are synchronously processed based on the same time axis on the first wireless link and the second wireless link, respectively.

2. The method according to claim 1, characterized in that The synchronously processing the first audio service and the second audio service based on the same time axis includes: Based on the same time axis, data in different audio services are sent and received in each time interval of the time axis in a time division multiplexing or frequency division multiplexing manner.

3. The method according to claim 2, characterized in that The external device includes one or more controllers; The method of transmitting and receiving data in different audio services in a time division multiplexing or frequency division multiplexing manner includes: Using one controller to receive and send data of the first audio service and the second audio service in a time division multiplexing manner; or, A first controller and a second controller among the multiple controllers are used to receive and send data for the first audio service and the second audio service in a frequency division multiplexing manner, wherein the first controller corresponds to the first wireless link and the second controller corresponds to the second wireless link.

4. The method according to claim 3, characterized in that When the external device uses a controller to receive and send data of the first audio service and the second audio service in a time division multiplexing manner, The first wireless link includes a BLE ACL link and a BLE CIG link; the first audio service is that the first central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device; The second wireless link includes a CBT ACL link; the second audio service is that the second central device acts as a sound source device and performs music data transmission based on the A2DP protocol with the external device; or, The second wireless link includes a BLE ACL link and a BLE CIG link; the second audio service is that the second central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device.

5. The method according to claim 3, characterized in that: When the external device uses the first controller and the second controller of the plurality of controllers to receive and send data of the first audio service and the second audio service in a frequency division multiplexing manner, The first wireless link includes a BLE ACL link and a BLE CIG link; the first audio service is that the first central device acts as an audio source device and performs online two-way telephone and media audio data transmission based on the TMAP protocol with the external device; The second wireless link includes a CBT eSCO link and a CBT ACL link; the second audio service is that the second central device serves as an audio source device and performs voice data transmission based on the HFP protocol with the external device.

6. The method according to claim 3, characterized in that The method of using the first controller and the second controller among the multiple controllers to receive and send data of the first audio service and the second audio service in a frequency division multiplexing manner includes: In each time interval, when data reception and data transmission of the first audio service and the second audio service are performed in a frequency division multiplexing manner, the first controller and the second controller are configured so that the transmission time slot of the first controller does not overlap with the target reception time slot of the second controller, and the target reception time slot is the time slot that the second controller must receive based on a predetermined rule.

7. The method according to claim 1, characterized in that The method further comprises: When a first audio service with a first central device and a second audio service with a second central device coexist, synchronous playback and / or synchronous collection of audio data in the first audio service and the second audio service are performed based on a local clock synchronized with the second working clock.

8. A wireless multi-source synchronous communication method, characterized in that: Applied to the first central device, the method includes: Acquire a second working clock through a third wireless link between the second central device and the second central device, where the second working clock is a working clock of a second wireless link between the second central device and the external device; Establishing a first wireless link based on a first working clock with the external device; Based on a first working clock synchronized with the second working clock, communicating with the external device on the first wireless link to perform data transmission of a first audio service.

9. The method according to claim 8, characterized in that The obtaining of the second working clock through the third wireless link with the second central device includes: The third wireless link is established with the second central device, and the second working clock is estimated, obtained and continuously tracked based on the third wireless link.

10. The method according to claim 8, characterized in that The establishing a first wireless link based on a first working clock with the external device includes: using the estimated second working clock as the first working clock, and using the first working clock to establish the first wireless link with the external device, and / or, Based on the estimated second working clock, the working clock of the first wireless link is adjusted to the first working clock, so that the first working clock is synchronized with the estimated second working clock.

11. A wireless multi-source synchronous communication system, characterized in that: The system comprises: an external device, a first central device and a second central device; The external device is used to establish a first wireless link based on a first working clock with a first central device, and to establish a second wireless link based on a second working clock with a second central device, wherein the second working clock is generated by the second central device based on its local clock; the first working clock is synchronized with the second working clock; when a first audio service with the first central device and a second audio service with the second central device coexist, the first audio service and the second audio service are synchronously processed on the first wireless link and the second wireless link based on the same time axis, respectively; The first central device is used to obtain a second working clock through a third wireless link between the first central device and the second central device, where the second working clock is the working clock of the second wireless link between the second central device and the external device; establish a first wireless link based on the first working clock with the external device; and communicate with the external device on the first wireless link based on the first working clock synchronized with the second working clock to perform data transmission of a first audio service.

12. The system according to claim 11, characterized in that The external device, the first central device and the second central device are all Bluetooth devices.

13. An external device, characterized in that: The external device includes a main processor and one or more controllers; The main processor configures the one or more controllers so that the external device executes a wireless multi-audio source synchronous communication method as described in any one of claims 1 to 7.

14. The external device according to claim 13, characterized in that: The plurality of controllers include a master controller and one or more slave controllers; The main controller includes a master-slave interface defined in the Bluetooth core specification for connecting to the main processor; The master controller and the slave controller further include a physical interface that can be used for mutual cascading.

15. The external device according to claim 14, characterized in that: The master controller and the slave controller are packaged in the same chip; Each of the controllers is provided with a radio frequency unit, a baseband unit, a link control unit, a link management or a link layer unit, and is connected to external independent antennas or the same antenna.

16. An electronic device, characterized in that: The electronic device is a first central device, and the first central device includes: A transceiver module, used for acquiring a second working clock through a third wireless link between the second central device and the second central device, wherein the second working clock is a working clock of a second wireless link between the second central device and the external device; A processing module, configured to establish a first wireless link based on a first working clock with the external device; The transceiver module is further configured to communicate with the external device on the first wireless link based on a first working clock synchronized with the second working clock, so as to perform data transmission of a first audio service.

Images