Audio data receiving and sending method, audio receiving device and audio sending device

By using the audio receiving device as the main device in Bluetooth technology to establish a synchronous link of a consistent number of synchronous sub-links with multiple audio sending devices, the problem that the audio receiving device in the prior art needs to maintain multiple independent links, and memory saving and system resource optimization are achieved.

CN115226080BActive Publication Date: 2025-03-07GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110431117.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-04-21
Publication Date
2025-03-07
Estimated Expiration
2041-04-21

AI Technical Summary

Technical Problem

In the existing Bluetooth technology, the audio receiving device needs to establish multiple independent synchronization links with multiple audio sending devices, resulting in high memory footprint and large system overhead.

Method used

By using the audio receiving device as the master device and the audio sending device as the slave device, a synchronization link including a synchronous sublink consistent with the number of synchronous sublinks is established based on the number of audio sending devices in the audio sending device, and data packets are sent to the audio sending device through the synchronous sublink and audio data is received.

Benefits of technology

It realizes that the audio receiving device only needs to maintain one synchronization link, which reduces memory usage and saves system resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115226080B_ABST
    Figure CN115226080B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides an audio data receiving and sending method, an audio receiving device and an audio sending device, and relates to the field of Bluetooth technology. The method includes: establishing a connection with each audio sending device in the audio sending device set, the audio sending device set includes n audio sending devices, and n is a positive integer; sending a synchronization link establishment request to each audio sending device, the synchronization link includes n synchronization sub-links, and the synchronization sub-links correspond to the audio sending device one by one; establishing a synchronization link; sending a first data packet to the target audio sending device corresponding to the target synchronization sub-link in the audio sending device set through the target synchronization sub-link; receiving a second data packet from the target audio sending device, and the second data packet is sent by the target audio sending device through the target synchronization sub-link. The embodiment of the present application can reuse the protocol stack, saving the memory space of the audio receiving device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of Bluetooth technology, and in particular to an audio data receiving and sending method, an audio receiving device, and an audio sending device. Background Art

[0002] Bluetooth is a radio technology that supports short-range communication between devices. It can exchange wireless information between devices including mobile phones, PCs (Personal Computers), Bluetooth headsets, tablets, TVs, etc.

[0003] Bluetooth technology stipulates that when devices communicate with each other, one must be the master device and the other must be the slave device. During communication, the master device searches for the slave device and initiates pairing. After the pairing link is successfully established, data can be sent and received between the master and slave devices. Summary of the invention

[0004] The embodiment of the present application provides an audio data receiving and sending method, an audio receiving device and an audio sending device. The technical solution is as follows:

[0005] On the one hand, an embodiment of the present application provides a method for receiving audio data, the method comprising:

[0006] Establishing a connection with each audio sending device in the audio sending device set, the audio sending device set includes n audio sending devices, where n is a positive integer;

[0007] Sending a synchronous link establishment request to each audio sending device, wherein the synchronous link establishment request is used to request to establish a synchronous link, wherein the synchronous link includes n synchronous sub-links, and the synchronous sub-links correspond to the audio sending devices one by one;

[0008] Establishing the synchronization link;

[0009] Sending a first data packet to a target audio sending device in the audio sending device set corresponding to the target synchronization sublink through a target synchronization sublink, wherein the first data packet is used to instruct the target audio sending device to send a second data packet;

[0010] A second data packet is received from the target audio sending device, wherein the second data packet includes audio data and is sent by the target audio sending device through the target synchronous sub-link.

[0011] On the other hand, an embodiment of the present application provides a method for sending audio data, the method comprising:

[0012] Establishing a connection with an audio receiving device;

[0013] receiving a synchronization link establishment request from the audio receiving device, the synchronization link request being used to request establishment of a synchronization link, the synchronization link comprising n synchronization sub-links, where n is the number of audio sending devices in the audio sending device set, and the synchronization sub-links correspond one-to-one to the audio sending devices;

[0014] receiving a first data packet from the audio receiving device, wherein the first data packet is sent by the audio receiving device through a target synchronous sub-link, and the first data packet is used to instruct a target audio sending device corresponding to the target synchronous sub-link to send a second data packet;

[0015] After receiving the first data packet, a second data packet is sent to the audio receiving device via the target synchronous sub-link, wherein the second data packet includes audio data.

[0016] On the other hand, an embodiment of the present application provides an audio data receiving device, the device comprising:

[0017] a connection establishing module, configured to establish a connection with each audio sending device in a set of audio sending devices, wherein the set of audio sending devices includes n audio sending devices, where n is a positive integer;

[0018] A request sending module, used to send a synchronous link establishment request to each audio sending device, wherein the synchronous link establishment request is used to request to establish a synchronous link, wherein the synchronous link includes n synchronous sub-links, and the synchronous sub-links correspond to the audio sending devices one by one;

[0019] A link establishing module, used for establishing the synchronization link;

[0020] a data packet sending module, configured to send a first data packet to a target audio sending device in the audio sending device set corresponding to the target synchronous sublink through a target synchronous sublink, wherein the first data packet is used to instruct the target audio sending device to send a second data packet;

[0021] The data packet receiving module is used to receive a second data packet from the target audio sending device, wherein the second data packet includes audio data and is sent by the target audio sending device through the target synchronous sub-link.

[0022] On the other hand, an embodiment of the present application provides an audio data sending device, the device comprising:

[0023] A connection establishing module, used to establish a connection with an audio receiving device;

[0024] a request receiving module, configured to receive a synchronization link establishment request from the audio receiving device, wherein the synchronization link request is used to request the establishment of a synchronization link, wherein the synchronization link includes n synchronization sub-links, wherein n is the number of audio sending devices in the audio sending device set, and the synchronization sub-links correspond one-to-one to the audio sending devices;

[0025] a data packet receiving module, configured to receive a first data packet from the audio receiving device, wherein the first data packet is sent by the audio receiving device through a target synchronous sublink, and the first data packet is used to instruct a target audio sending device corresponding to the target synchronous sublink to send a second data packet;

[0026] The data packet sending module is used to send a second data packet to the audio receiving device through the target synchronous sub-link after receiving the first data packet, wherein the second data packet includes audio data.

[0027] On the other hand, an embodiment of the present application provides an audio receiving device, which includes a processor and a memory, wherein the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the audio data receiving method as described in the above aspects.

[0028] On the other hand, an embodiment of the present application provides an audio sending device, which includes a processor and a memory, wherein the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the audio data sending method as described in the above aspects.

[0029] On the other hand, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the audio data receiving method or the audio data sending method as described in the above aspects.

[0030] In another aspect, an embodiment of the present application provides a computer program product, the computer program product including computer instructions, the computer instructions stored in a computer-readable storage medium. A processor of an audio receiving device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the audio receiving device performs the above-mentioned audio data receiving method.

[0031] In another aspect, an embodiment of the present application provides a computer program product, the computer program product including computer instructions, the computer instructions stored in a computer-readable storage medium. A processor of an audio sending device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the audio sending device performs the above-mentioned audio data sending method.

[0032] The technical solution provided in the embodiments of the present application can bring the following beneficial effects:

[0033] By taking the audio receiving device as the master device and the audio sending device as the slave device, the audio receiving device establishes a synchronization link including synchronization sub-links consistent with the number of audio sending devices included in the audio sending device set, and sends data packets to the audio sending device and receives audio data from the audio sending device through the synchronization sub-links. The audio receiving device in the embodiment of the present application only needs to maintain one synchronization link. Compared with the audio receiving device in the related technology that needs to maintain multiple synchronization links, the embodiment of the present application can reuse the protocol stack, saving the memory space of the audio receiving device. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 is a schematic diagram of an audio data receiving system provided by an embodiment of the present application;

[0035] Figure 2 is a flowchart of an audio data receiving method provided by an embodiment of the present application;

[0036] Figure 3 It is a schematic diagram of a master device and a slave device provided by the related art;

[0037] Figure 4 It is a schematic diagram of events and sub-events provided by the related art;

[0038] Figure 5 It is a schematic diagram of an audio receiving device and an audio sending device provided by the related art;

[0039] Figure 6 It is a schematic diagram of CIG and CIS provided by the related art;

[0040] Figure 7 is a schematic diagram of a master device and a slave device provided by an embodiment of the present application;

[0041] Figure 8 is a schematic diagram of a CIS and a CIG provided by an embodiment of the present application;

[0042] Fig. 9 is a flowchart of an audio data receiving method provided by another embodiment of the present application;

[0043] Fig.10 is a timing diagram of an audio data receiving method provided by an embodiment of the present application;

[0044] Fig.11 A block diagram of an audio data receiving device provided by an embodiment of the present application;

[0045] Fig.12 is a block diagram of an audio data sending device provided by an embodiment of the present application;

[0046] Fig.13 is a structural block diagram of an audio receiving device provided by an embodiment of the present application;

[0047] Fig.14 It is a structural block diagram of an audio sending device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0048] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0049] Please refer to Figure 1 , which shows a schematic diagram of an audio data receiving system provided by an embodiment of the present application. The system includes an audio receiving device 101 and at least one audio sending device 102.

[0050] In the embodiment of the present application, the audio receiving device 101 refers to a device for receiving audio data. The audio receiving device 101 includes any one of the following: an audio receiving device, a Bluetooth chip. Exemplarily, the audio receiving device may include devices such as a Bluetooth headset, a Bluetooth speaker, and a Bluetooth stereo. Exemplarily, when the audio receiving device 101 is an audio receiving device, the audio receiving device 101 can play the audio data after receiving the audio data. At this time, the audio receiving device 101 also has a playback function, and at this time, the audio receiving device 101 can be called an audio player.

[0051] In the embodiment of the present application, the audio sending device 102 refers to a device for sending audio data. The audio sending device 102 includes any one of the following: an audio sending device, a Bluetooth chip. Exemplarily, the audio sending device may include a mobile phone, a tablet computer, a television, a PC (Personal Computer), a multimedia playback device, and the like. Exemplarily, when the audio sending device 102 is an audio sending device, the audio sending device may also be referred to as an audio source, a terminal, and the like, which is not limited in the embodiment of the present application.

[0052] The audio receiving device 101 and the audio sending device 102 can communicate via Bluetooth. Of course, the audio receiving device 101 and the audio sending device 102 can also communicate in an out-of-band manner. For example, the audio receiving device 101 and the audio sending device 102 can communicate via wireless link, visible light communication, sound wave communication, magnetic communication, etc.

[0053] The present application is described below through several embodiments.

[0054] Please refer to Figure 2 , which shows a flow chart of an audio data receiving method provided by an embodiment of the present application. The method can be executed by an audio receiving device, and the method can include the following steps.

[0055] Step 201: Establish a connection with each audio sending device in an audio sending device set, where the audio sending device set includes n audio sending devices, where n is a positive integer.

[0056] The number of audio sending devices included in the audio sending device set may be one or more (more means greater than 1), that is, the value of n may be 1 or greater than 1, and this is not limited in the embodiments of the present application. When the audio sending device set includes multiple audio sending devices, and the audio sending devices are audio sending devices, the device types of the multiple audio sending devices may be completely consistent, partially consistent, or completely inconsistent. For example, assuming that the audio sending device set includes 3 audio sending devices, the 3 audio sending devices may all be mobile phones, or the above 3 audio sending devices may include 2 mobile phones and 1 tablet computer, or the above 3 audio sending devices may include a mobile phone, a tablet computer, and a television.

[0057] Step 202: Send a synchronization link establishment request to each audio sending device.

[0058] In the embodiment of the present application, the synchronous link establishment request is used to request the establishment of a synchronous link, and the synchronous link includes n synchronous sub-links, and the synchronous sub-links correspond one-to-one to the audio sending devices.

[0059] The n synchronous sub-links correspond to the n audio transmitting devices one by one. For example, assuming that the number of audio transmitting devices included in the audio transmitting device set is 2: audio transmitting device 1 and audio transmitting device 2, the synchronous link includes 2 synchronous sub-links: synchronous sub-link 1 and synchronous sub-link 2. The audio transmitting device 1 corresponds to the synchronous sub-link 1, and the audio transmitting device 2 corresponds to the synchronous sub-link 2. The time of the n synchronous sub-links included in the synchronous link is synchronized.

[0060] In an exemplary embodiment, the audio receiving device establishes a BLE (Bluetooth Low Energy) link with each audio sending device in the audio sending device set. The audio receiving device sends a synchronization link establishment request to each audio sending device via the BLE link.

[0061] In the embodiment of the present application, the audio receiving device is used as the master device, and each audio sending device in the audio sending device set is used as a slave device. One master device corresponds to one synchronization link, and the synchronization link refers to the link through which the audio receiving device interacts with each audio sending device. The synchronization sub-link refers to the link through which the audio receiving device interacts with the audio sending device.

[0062] In a possible implementation, the synchronization link includes a CIG (Connected Isochronous Group) link, and the synchronization sub-link includes a CIS (Connected Isochronous Stream) link.

[0063] In related technologies, LE (Low Energy) Audio proposed the concepts of CIS and CIG. Simply put, it defines a transmission channel and transmission strategy for time-dependent data. That is, for the single-send-multiple-receive scenario, the protocol determines how the sender and receiver allocate the sending and receiving time slices, thereby ensuring that all receivers can meet the transmission requirements under certain synchronization requirements. In related technologies, the most obvious application of CIG / CIS is Bluetooth headsets, such as Figure 3 As shown, the left earphone 310 and the right earphone 320 each correspond to a CIS, and they can form a CIG. The audio sending device (main device) 330 corresponds to a CIG, and the time between the left earphone 310 and the right earphone 320 is synchronized with each other.

[0064] like Figure 4 As shown in the figure, each event X can be regarded as a CIG, in which each subevent can be regarded as a CIS. In each CIS, the master device sends data to the slave device, that is, Figure 4 The slave device will also reply to the master device. Figure 4 In this way, a master device can communicate with several slave devices at the same time. One event corresponds to one synchronization interval. In one synchronization interval, the time of sub-event 1 and sub-event 2 is synchronized.

[0065] Under the LE Audio solution provided by the related art, two audio sending devices (audio sending device 1 and audio sending device 2) will respectively establish a connection with the audio receiving device (slave device) as the master device. Figure 5As shown, the audio transmitting device 1 and the audio transmitting device 2 are respectively Master 1 (master device 1, abbreviated as M1) and Master 2 (master device 2, abbreviated as M2), and the audio receiving device is a slave (slave device, abbreviated as S). Under the scheme provided by the related art, each audio transmitting device will establish a CIG link with an audio receiving device respectively, and each CIG link contains a CIS link, such as Figure 6 As shown, assuming that there are two audio sending devices, an audio receiving device needs to maintain two CIG links: CIG1 and CIG2, and ensure that the timing of the two CIG links will not conflict. Each CIG link includes a CIS link. During each CIS period, the audio sending device sends the audio data to the audio receiving device through the M->S data packet. M1->S means that the audio sending device 1 sends a data packet to the audio receiving device, and S->M1 means that the audio receiving device sends a data packet to the audio sending device 1; M2->S means that the audio sending device 2 sends a data packet to the audio receiving device, and S->M2 means that the audio receiving device sends a data packet to the audio sending device 2.

[0066] In the related art, the audio receiving device acts as a slave device and the audio sending device acts as a master device. Whether it is a traditional Bluetooth device or a low-power Bluetooth device, in order to achieve multiple connections, the audio receiving device needs to establish n independent synchronous links with n audio sending devices at the same time. Assuming that the audio receiving device is connected to 3 audio sending devices, the audio receiving device needs to establish 3 CIGs with the 3 audio sending devices respectively. In the related art, the audio receiving device needs to maintain a set of independent protocol stack service instances for each established synchronous link, which requires the use of more variables and occupies more memory space.

[0067] The embodiment of the present application is implemented based on LE Audio.

[0068] In the embodiments of the present application, Figure 7 As shown, assuming that the audio sending device set includes two audio sending devices: audio sending device 1 and audio sending device 2, the embodiment of the present application uses the audio receiving device 710 as the master device (Master, abbreviated as M), and the audio sending device 720 (including the audio sending device 1 and the audio sending device 2) as the slave device (Slaver, abbreviated as S), the audio sending device 1 corresponds to S1, and the audio sending device 2 corresponds to S2.

[0069] For example, it is assumed that the audio transmitting device set includes two audio transmitting devices (audio transmitting device 1 and audio transmitting device 2) and the audio receiving device is a Bluetooth headset. Figure 8As shown, the Bluetooth headset needs to establish multiple connections with two audio sending devices to achieve the establishment and transmission of two audio data streams. The Bluetooth headset establishes a CIG link, which includes two CISs: CIS1 and CIS2. The Bluetooth headset (M) and the audio sending device 1 (S1) transmit data through CIS1. The Bluetooth headset (M) and the audio sending device 2 (S2) transmit data through CIS2. M->S1 means that the Bluetooth headset sends a data packet to the audio sending device 1, and S1->M means that the audio sending device 1 sends a data packet to the Bluetooth headset; M->S2 means that the Bluetooth headset sends a data packet to the audio sending device 2, and S2->M means that the audio sending device 2 sends a data packet to the Bluetooth headset.

[0070] Of course, in addition to being applicable to multi-connection scenarios between headphones and multiple audio sending devices, the embodiments of the present application can also be further expanded to multi-connection applications between other Bluetooth devices, such as connections between Bluetooth speakers and multiple Bluetooth microphones, etc., which are not limited by the embodiments of the present application.

[0071] Step 203: Establish a synchronous link.

[0072] In the embodiment of the present application, the synchronous link is established by the audio receiving device.

[0073] Step 204: Send a first data packet to a target audio sending device in the audio sending device set corresponding to the target synchronous sub-link through the target synchronous sub-link, where the first data packet is used to instruct the target audio sending device to send a second data packet.

[0074] The target synchronization sub-link is any one or more synchronization sub-links among the n synchronization sub-links.

[0075] The target audio sending device is any one or more audio sending devices among the n audio sending devices, the target audio sending device has a corresponding relationship with the target synchronous sub-link, and the audio receiving device sends a first data packet to the target audio sending device through the target synchronous sub-link. Exemplarily, assuming that the audio sending device set includes two audio sending devices (audio sending device 1, audio sending device 2), the synchronous link includes two synchronous sub-links: synchronous sub-link 1 and synchronous sub-link 2, the audio sending device 1 corresponds to synchronous sub-link 1, the audio sending device 2 corresponds to synchronous sub-link 2, the audio receiving device sends a first data packet to the audio sending device 1 through the synchronous sub-link 1, and the audio receiving device sends a first data packet to the audio sending device 2 through the synchronous sub-link 2.

[0076] In a possible implementation, the first data packets sent by the audio receiving device to different audio sending devices may be the same or different. For example, the audio receiving device may send an empty packet to each audio sending device in the audio sending device set, or the audio receiving device may send a feedback packet to each audio sending device in the audio sending device set, or the audio receiving device may send an empty packet to some of the audio sending devices in the audio sending device set, and send a feedback packet to other audio sending devices, which is not limited in this embodiment of the present application. Of course, in other possible implementations, the first data packet may be other data packets in addition to the empty packet and the feedback packet, which may be determined according to the actual application scenario, which is not limited in this embodiment of the present application.

[0077] Step 205: Receive a second data packet from a target audio sending device, wherein the second data packet includes audio data and is sent by the target audio sending device through a target synchronous sub-link.

[0078] In the embodiment of the present application, after receiving the first data packet from the audio receiving device, the target audio sending device sends a second data packet to the audio receiving device through the target synchronous sub-link, where the second data packet includes audio data.

[0079] After receiving the first data packet, the target audio sending device sends a second data packet to the audio receiving device through the target synchronous sub-link.

[0080] Audio data refers to data that has been processed and can be played as sound through an audio receiving device.

[0081] In the field of Bluetooth applications, an audio receiving device is a Bluetooth TWS (True Wireless Stereo) headset, and at least one audio sending device includes a mobile phone, a computer, and a TV. The Bluetooth TWS headset is connected to the computer, mobile phone, and TV via Bluetooth at the same time. The computer, mobile phone, and TV output audio data streams to the Bluetooth TWS headset via Bluetooth connection. The Bluetooth protocol stack of the Bluetooth TWS headset can decide which synchronous link to play the audio data stream based on the user's choice and the configuration of the application layer. The significance of this multi-connection scenario is that the Bluetooth TWS headset can maintain multiple synchronous sub-links at the same time, which can ensure that the audio data stream is quickly switched from one synchronous sub-link to another in a short time, thereby achieving seamless switching of the sound source and improving the convenience of work and life.

[0082] In a possible implementation, when an audio receiving device receives audio data from multiple audio sending devices, the audio receiving device can play the audio data of one audio sending device, part of the audio sending devices, or all of the audio sending devices based on the user's selection. For example, the audio sending device set includes three audio sending devices: audio sending device 1, audio sending device 2, and audio sending device 3. The audio receiving device receives audio data from audio sending device 1 and audio sending device 2. At this time, the audio receiving device can play the audio data of audio sending device 1 or choose to play the audio data of audio sending device 2 or choose to play the audio data of audio sending device 1 and audio sending device 2 at the same time according to the user's selection. Exemplarily, the audio receiving device receives a device selection instruction triggered by the user, and the audio receiving device plays the audio data corresponding to the device selection instruction. The device selection instruction refers to an instruction for selecting the audio data of the audio sending device for playback. The user can trigger the device selection instruction by touching the physical button of the audio receiving device. The technicians can set different physical button triggering modes for different audio sending devices to trigger the device selection instruction. For example, the simplest way is to correspond the number of times the user touches the physical button to the audio sending device. Assuming that the audio sending device set includes 3 audio sending devices, the user touches the physical button once, which means the audio data of audio sending device 1 is selected to be played, the user touches the physical button twice, which means the audio data of audio sending device 2 is played, and the user touches the physical button three times, which means the audio data of audio sending device 3 is played. Of course, in other possible implementations, other touch modes can also be set, and the embodiments of the present application are not limited to this.

[0083] In a possible implementation, when the audio receiving device receives audio data from multiple audio transmitting devices, the audio receiving device can select which audio data of the audio transmitting device or devices to play based on the playback priority of the audio transmitting device. The playback priority of the audio transmitting device can be preset by the user and then stored in the audio receiving device. The playback priority of the audio transmitting device is used to indicate which audio transmitting device or devices can be played first. For example, it is assumed that the audio transmitting device set includes 3 audio transmitting devices: audio transmitting device 1, audio transmitting device 2 and audio transmitting device 3. The playback priority of the audio transmitting device is: the playback priority of the audio transmitting device 1 is higher than the playback priority of the audio transmitting device 2, and the playback priority of the audio transmitting device 2 is higher than the playback priority of the audio transmitting device 3. When the audio receiving device receives the audio data from the audio transmitting device 1 and the audio data from the audio transmitting device 3, the audio receiving device selects to play the audio data of the audio transmitting device 1. It should be noted that the playback priority of the audio transmitting device in the embodiment of the present application is only exemplary, and the playback priority of the audio transmitting device can be changed according to the number of audio transmitting devices included in the audio transmitting device set and the user's settings, and the embodiment of the present application does not limit this. In a possible implementation, when there are multiple audio sending devices with the same priority, the audio receiving device can choose to play the audio data of all audio sending devices with the same priority, or can arbitrarily select the audio data of one audio sending device to play. The embodiment of the present application is not limited to this, and it can change dynamically according to different scenarios.

[0084] Exemplarily, one synchronization link corresponds to one synchronization interval (ISO Interval), and the audio receiving device and the audio sending device complete one interaction within one synchronization interval.

[0085] To sum up, in the technical solution provided in the embodiment of the present application, by taking the audio receiving device as the master device and the audio sending device as the slave device, the audio receiving device establishes a synchronous link including synchronous sub-links consistent with the number of audio sending devices included in the audio sending device set, and sends data packets to the audio sending device and receives audio data from the audio sending device through the synchronous sub-links. The audio receiving device in the embodiment of the present application only needs to maintain one synchronous link. Compared with the audio receiving device in the related technology that needs to maintain multiple synchronous links, the embodiment of the present application can reuse the protocol stack, thereby saving the memory space of the audio receiving device.

[0086] Please refer to Fig. 9 , which shows a flow chart of an audio data receiving method provided by another embodiment of the present application. The method can be executed by an audio receiving device, and the method can include the following steps.

[0087] Step 901: Establish a connection with each audio sending device in the audio sending device set.

[0088] In a possible implementation, step 901 may include the following sub-steps:

[0089] Step 901a: Send a broadcast message to each audio sending device in the audio sending device set, where the broadcast message includes the Bluetooth device address of the audio receiving device.

[0090] Step 901b: receiving the Bluetooth device address of each audio sending device in the audio sending device set.

[0091] Step 901c: Establish a connection based on the Bluetooth device address of the audio receiving device and the Bluetooth device addresses of each audio sending device.

[0092] The Bluetooth device address is a unique 48-bit identifier assigned to each device by the manufacturer. It is used to uniquely identify a physical device. The Bluetooth device address is usually displayed as 6 bytes, expressed in hexadecimal, separated by colons. The Bluetooth address includes: NAP (Non-significant Address Part), UAP (Upper Address Part), and LAP (Lower Address Part). NAP includes 2 bytes, which are the first 16 bits of OUI (Organizationally Unique Identifier), which can be used for frequency hopping synchronization frames; UAP includes 1 byte, which is the remaining 8 bits of OUI, used as a seed in various Bluetooth specification algorithms; LAP includes 3 bytes, which are allocated by the device vendor itself and are used to uniquely identify the Bluetooth device. LAP and UAP constitute the important address part (Significant Address Part, SAP) of the Bluetooth device address.

[0093] The Bluetooth device address of the audio receiving device is used to identify the audio receiving device, and the Bluetooth device address of the audio sending device is used to identify the audio sending device.

[0094] In a possible implementation, the audio receiving device sends a connection request to the audio sending device based on the Bluetooth device address of the audio sending device, and the connection request is used to request to establish a connection with the audio sending device; after receiving the connection request from the audio receiving device, the audio sending device sends a connection response to the audio receiving device based on the Bluetooth device address of the audio receiving device, and the connection response is used to indicate whether the audio sending device responds to the connection request of the audio receiving device; if the audio sending device responds to the connection request of the audio receiving device, the audio sending device establishes a connection with the audio receiving device.

[0095] The audio receiving device establishing a connection with the audio sending device may also be understood as the audio receiving device establishing a communication link with the audio sending device, for example, establishing a BLE link.

[0096] A Bluetooth device (audio transmitter) working in slave mode can only be searched by a master device (audio receiver) and cannot actively search. A master device (audio receiver) is a device that can search for others and actively establish a connection, while a slave device (audio transmitter) cannot actively establish a connection and can only wait for others to connect to it.

[0097] Exemplarily, the audio receiving device creates a CIG within a synchronization interval, and the CIG includes n CISs.

[0098] Step 902: Send a synchronous link establishment request to each audio sending device. The synchronous link establishment request is used to request to establish a synchronous link. The synchronous link includes n synchronous sub-links. The synchronous sub-links correspond to the audio sending devices one by one.

[0099] Step 903: receiving configuration parameters from each audio sending device in the audio sending device set, where the configuration parameters refer to parameters used to configure the synchronization link.

[0100] Each audio transmitting device in the audio transmitting device set will send its own configuration parameters to the audio receiving device. The configuration parameters sent by each audio transmitting device to the audio receiving device may be different, but at least include one option that is mandatory to be supported in the Bluetooth protocol.

[0101] Step 904: configure the synchronization link based on the configuration parameters.

[0102] In the embodiment of the present application, the synchronous link includes n synchronous sub-links, where n is a positive integer, and the audio sending device corresponds to the synchronous sub-link.

[0103] Exemplarily, the audio receiving device determines the target configuration parameter based on the configuration parameters of each audio sending device; and configures the synchronization link based on the target configuration parameter. The audio receiving device sends the target configuration parameter to the audio sending device so that the audio sending device configures the host (state machine) based on the target configuration parameter. Exemplarily, the target configuration parameter is the same parameter in the configuration parameters of each audio sending device.

[0104] The audio receiving device acts as the master device, and the host of the master device shall configure each CIG by notifying the link layer of the Num_CIS value of the CIG (used to indicate the number of CISs) and the individual configuration of each CIS in the CIG. Once the host requests the link layer to create the first CIS of the CIG, the host shall not change the configuration. If the link layer cannot schedule the configuration requested by the CIG, it will notify the host without creating any CIS in the CIG. The controller can use the configuration information to determine whether it can schedule all CISs in the CIG without conflicts with each other or other activities. If this is not possible, the host can be notified when requesting the creation of the first CIS. After successful creation, subsequent CISs can be created without the risk of conflict.

[0105] CIS is a logical transport that enables connected devices to transmit synchronous data in either direction. Data can be fixed or variable size and can be framed or unframed. Synchronous data can be transmitted in LE-S or LE-F logical links using the CIS logical transport. Each CIS should be associated with an ACL (Asynchronous Connectionless). CIS supports variable-sized packets and the transmission of one or more packets in each synchronization event, thereby supporting a range of data rates. Data traffic between devices is unidirectional or bidirectional. There is an acknowledgment protocol to improve the reliability of packet delivery in the CIS. The host of the master device (audio receiving device) uses the HCI_LE_Set_CIG_Parameters command to set the parameters of one or more CISs associated with the CIG in the controller. If no CIS is created in this CIG, this command can also be used to modify or add a CIS to the CIG. Each CIS carries a separate isochronous synchronous data stream, and one or more CISs can form a CIG, with each CIG containing up to 31 CISs.

[0106] CIG has a corresponding CIG_ID parameter, which is used to identify CIG. 0x00 to 0xEF can be used to identify CIG. This parameter is assigned by the host of the master device (audio receiving device) and passed to the host of the slave device (audio sending device) through the link layer during the establishment of CIS. If CIG_ID does not exist, the controller shall create a new CIG. Otherwise, the controller shall modify or add CIS in the CIG identified by CIG_ID and update all parameters applicable to CIG.

[0107] The ISO_Interval parameter specifies the time between two consecutive CIS anchor points. The size of the synchronization interval is 2 bytes, and the value of the synchronization interval N is N = 0xXXXX. The time between consecutive CIS anchor points ranges from 0x0004 to 0x0C80, and the time is N*1.25ms, and the time range is 5ms to 4s.

[0108] In the same synchronization interval, CIS occupies different time slots to ensure synchronization.

[0109] Step 905: Establish a synchronization link.

[0110] In a possible implementation, the audio receiving device sends a CIS establishment request to the audio sending device, the audio sending device sends a CIS establishment confirmation message to the audio receiving device, and the audio receiving device completes the establishment of the CIS.

[0111] Step 906: Send a first data packet to a target audio sending device in the audio sending device set corresponding to the target synchronous sub-link through the target synchronous sub-link.

[0112] In the embodiment of the present application, the first data packet is used to instruct the target audio sending device to send the second data packet.

[0113] In a possible implementation, the first data packet is an empty packet, where an empty packet refers to a packet that does not include data content.

[0114] In a possible implementation, the first data packet is a feedback data packet of the audio receiving device for the third data packet, and the third data packet refers to a data packet from the target audio sending device in the last synchronization interval. Exemplarily, when the audio receiving device confirms that the third data packet is correct, the feedback data packet is an ACK (Acknowledge) packet; when the audio receiving device confirms that the third data packet is wrong, the feedback data packet is a NACK (Negative Acknowldge) packet.

[0115] In a possible implementation, the first data packet includes audio data collected by a microphone of an audio receiving device. Exemplarily, a microphone is provided in the audio receiving device, and the microphone can be used to collect audio data. The audio receiving device can send the audio data collected by the microphone to the audio sending device through the first data packet. In a possible application scenario, the audio receiving device is a headset and the audio sending device is a mobile phone as an example for description. When the user needs to play music in the mobile phone through the headset, the mobile phone only needs to transmit audio data to the headset in one direction; when the user needs to make a call through the headset, the headset and the mobile phone need to transmit audio data in two directions, that is, when the mobile phone transmits audio data to the headset, the headset also needs to transmit the audio data collected by the headset microphone to the mobile phone. At this time, the headset can send the first data packet to the mobile phone to send the audio data collected by the headset microphone to the mobile phone.

[0116] Exemplarily, after the audio receiving device establishes CIG, the M->S data packet (first data packet) sent can be an empty packet, or it can be a feedback packet of the audio receiving device to the previous group of S->M data packets (third data packet), which can be flexibly configured according to the application scenario. Exemplarily, the audio receiving device can choose to send an empty packet or a feedback packet according to the characteristics of the audio sending device. If the audio sending device has high requirements for transmission reliability, the audio receiving device can choose to send a feedback packet; or, the audio receiving device can also choose to send an empty packet or a feedback packet according to the negotiation result between the audio receiving device and the audio sending device, which is not limited in the embodiments of the present application.

[0117] Step 907: Receive a second data packet from the target audio sending device, where the second data packet includes audio data.

[0118] In the embodiment of the present application, the second target data packet is sent by the target audio sending device through the target synchronization sub-link.

[0119] The audio receiving device establishes a CIG with the audio sending device, and the audio sending device carries the audio data in the S->M data packet, thereby realizing multi-connection transmission of the audio data. Figure 8 As shown, the headset is used as an example for the audio receiving device. The headset, as the master device, establishes a CIG link, which includes two CIS links: CIS1 and CIS2, corresponding to the audio transmitting device 1 and the audio transmitting device 2, respectively. In each CIS time slot, the headset first sends an M->S data packet, and the audio transmitting device brings the audio data in the reply S->M data packet. Among them, M->S1 and M->S2 correspond to the data packets sent by the headset to the audio transmitting device 1 and the audio transmitting device 2, respectively; S1->M and S2->M correspond to the data packets including audio data sent by the audio transmitting device 1 and the audio transmitting device 2 to the headset, respectively.

[0120] In the related art, n synchronous links are independent of each other. For each synchronous link, it is necessary not only to ensure that the timing requirements of the link itself are met, but also to ensure that there is no conflict with other links in time and radio frequency, which puts forward high requirements on the processing power and scheduling performance of the CPU (Central Processing Unit) of the audio receiving device. The embodiment of the present application realizes the synchronization and management of multiple audio data streams by establishing a reverse synchronous link, reduces the system overhead of the audio receiving device, and enhances the reliability, availability and scalability of the system. For multiple audio data streams, the audio receiving device coordinates the processing of the audio data streams by establishing a CIG and multiple CISs, can reuse the protocol stack, avoid establishing multiple service instances, and save memory space. Through the unified management of CIG or CIS, conflicts and complex scheduling between multiple links are avoided, the requirements for CPU performance are reduced, and the reliability of transmission is improved. The embodiment of the present application can manage multi-channel audio through multi-channel CIS. Since the audio receiving device controls the establishment of CIG / CIS, the arrival time of multi-channel connected audio data streams is controllable and synchronized, which can be used in applications such as mixing and sound enhancement, thereby enhancing usability and scalability.

[0121] In a possible implementation, after the audio receiving device receives the second data packet from the target audio sending device, it sends a feedback packet for the second data packet to the target audio sending device. After the audio sending device sends audio data to the audio receiving device, the audio receiving device confirms that, in addition to confirming by sending an M->S packet in the next time slot CIS, other out-of-band methods such as wireless links, visible light communication, sound wave communication, magnetic communication, etc. may be used for confirmation, which is not limited in the embodiments of the present application.

[0122] Below, an embodiment of the present application is introduced and explained by taking the audio receiving device as headphones, the audio sending device set including two audio sending devices: audio sending device 1 and audio sending device 2, the synchronization link including CIG, and the synchronization sub-link including CIS as an example.

[0123] Please refer to Fig.10 , which shows a timing diagram of an audio data receiving method provided by an embodiment of the present application. The method can be applied to Figure 1 In the audio data receiving system shown, the method may include the following steps.

[0124] Step 1001 : The headset sends a broadcast message to audio sending device 1 and audio sending device 2 .

[0125] The broadcast message carries the Bluetooth device address of the headset.

[0126] Step 1002: the audio sending device 1 sends the Bluetooth device address of the audio sending device 1 to the headset.

[0127] Step 1003: the audio sending device 2 sends the Bluetooth device address of the audio sending device 2 to the headset.

[0128] It should be noted that step 1002 and step 1003 may be executed simultaneously; step 1002 may be executed first and then step 1003; step 1003 may be executed first and then step 1002, and this embodiment of the present application does not limit this.

[0129] Step 1004 : The headset establishes a connection with the audio sending device 1 and the audio sending device 2 .

[0130] The headset establishes a BLE link with the audio sending device 1 and the audio sending device 2.

[0131] Step 1005: the audio sending device 1 sends the CIG configuration parameters supported by itself to the headset.

[0132] Step 1006: The audio sending device 2 sends the CIG configuration parameters supported by itself to the headset.

[0133] It should be noted that step 1005 and step 1006 may be executed simultaneously; step 1005 may be executed first and then step 1006; step 1006 may be executed first and then step 1005, and this embodiment of the present application does not limit this.

[0134] Step 1007: The headset sends target configuration parameters to the audio sending device 1 and the audio sending device 2 to establish a CIG.

[0135] Step 1008 : The headset sends a CIS1 establishment request to the audio sending device 1 .

[0136] Step 1009: the audio sending device 1 sends a CIS1 establishment confirmation message to the headset.

[0137] Step 1010 : The headset sends a CIS2 establishment request to the audio sending device 2 .

[0138] Step 1011: the audio sending device 2 sends a CIS2 establishment confirmation message to the headset.

[0139] It should be noted that step 1008 and step 1010 can be executed simultaneously, and step 1009 and step 1011 can be executed simultaneously; alternatively, step 1010 and step 1011 can be executed first, and then step 1008 and step 1009; alternatively, step 1008 and step 1009 can be executed first, and then step 1010 and step 1011, and the embodiments of the present application are not limited to this.

[0140] Step 1012 : The earphone transmits audio data streams to the audio sending device 1 and the audio sending device 2 .

[0141] The audio data stream transmission process between the earphone and the audio sending device 1 and the audio sending device 2 can be as follows: the earphone sends a first data packet to the audio sending device 1 and the audio sending device 2; after receiving the first data packet, the audio sending device 1 and the audio sending device 2 send a second data packet to the earphone, and the second data packet includes audio data.

[0142] In the embodiment of the present application, the headset is first discovered by the audio sending device through broadcasting. Audio sending device 1 and audio sending device 2 respectively establish connections with the headset and synchronize link information. The headset uses relevant information to connect to audio sending device 1 and audio sending device 2, and configures ASE (Audio Stream Endpoint, audio data stream endpoint) (which can be understood as the process of sending configuration parameters to the audio sending device), establishes CIG or CIS, and thus starts audio data stream transmission.

[0143] It should be noted that the above steps performed by the audio sending device can be independently implemented as an audio data sending method on the audio sending device side, and the steps performed by the audio receiving device can be independently implemented as an audio data receiving method on the audio receiving device side.

[0144] It should be noted that, in the above embodiment, only one audio receiving device is used as an example for description. If it is applied to a pair of audio receiving devices, such as a left ear earphone and a right ear earphone, the left ear earphone and the right ear earphone each act as a master device and use the audio data receiving method described above. However, data can be transmitted using different time slots (CIS) within a synchronization interval, thereby achieving information synchronization between the left ear earphone and the right ear earphone.

[0145] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0146] Please refer to Fig.11 , which shows a block diagram of an audio data receiving device provided by an embodiment of the present application, the device has the function of implementing the above-mentioned audio data receiving method example, and the function can be implemented by hardware, or by hardware executing corresponding software. The device 1100 may include:

[0147] A connection establishing module 1110, configured to establish a connection with each audio sending device in the audio sending device set, wherein the audio sending device set includes n audio sending devices, where n is a positive integer;

[0148] A request sending module 1120, configured to send a synchronous link establishment request to each audio sending device, wherein the synchronous link establishment request is used to request the establishment of a synchronous link, wherein the synchronous link includes n synchronous sub-links, and the synchronous sub-links correspond to the audio sending devices one by one;

[0149] A link establishing module 1130, configured to establish the synchronization link;

[0150] The data packet sending module 1140 is configured to send a first data packet to a target audio sending device in the audio sending device set corresponding to the target synchronous sublink through a target synchronous sublink, wherein the first data packet is used to instruct the target audio sending device to send a second data packet;

[0151] The data packet receiving module 1150 is used to receive a second data packet from the target audio sending device, wherein the second data packet includes audio data and is sent by the target audio sending device through the target synchronous sub-link.

[0152] To sum up, in the technical solution provided in the embodiment of the present application, by taking the audio receiving device as the master device and the audio sending device as the slave device, the audio receiving device establishes a synchronous link including synchronous sub-links consistent with the number of audio sending devices included in the audio sending device set, and sends data packets to the audio sending device and receives audio data from the audio sending device through the synchronous sub-links. The audio receiving device in the embodiment of the present application only needs to maintain one synchronous link. Compared with the audio receiving device in the related technology that needs to maintain multiple synchronous links, the embodiment of the present application can reuse the protocol stack, thereby saving the memory space of the audio receiving device.

[0153] In an exemplary embodiment, the device further comprises:

[0154] A parameter receiving module (not shown in the figure), used to receive configuration parameters of each audio sending device in the audio sending device set, wherein the configuration parameters refer to parameters used to configure the synchronization link;

[0155] A link configuration module (not shown in the figure) is used to configure the synchronization link based on the configuration parameters.

[0156] In an exemplary embodiment, the first data packet is an empty packet, which refers to a packet that does not include data content.

[0157] In an exemplary embodiment, the first data packet is a feedback data packet of the audio receiving device in response to a third data packet, and the third data packet refers to a data packet from the target audio sending device in a previous synchronization interval.

[0158] In an exemplary embodiment, when the audio receiving device confirms that the third data packet is correct, the feedback data packet is an ACK packet;

[0159] When the audio receiving device confirms that the third data packet is erroneous, the feedback data packet is a negative acknowledgement (NACK) packet.

[0160] In an exemplary embodiment, the first data packet includes audio data collected by a microphone of the audio receiving device.

[0161] In an exemplary embodiment, the connection establishing module 1110 is used to:

[0162] Sending a broadcast message to each audio sending device in the audio sending device set, wherein the broadcast message includes the Bluetooth device address of the audio receiving device;

[0163] Receiving a Bluetooth device address from each audio sending device in the audio sending device set;

[0164] A connection is established based on the Bluetooth device address of the audio receiving device and the Bluetooth device addresses of each audio sending device.

[0165] In an exemplary embodiment, the synchronization link includes a connection synchronization group CIG link, and the synchronization sub-link includes a connection synchronization stream CIS link.

[0166] Please refer to Fig.12 , which shows a block diagram of an audio data sending device provided by an embodiment of the present application, the device has the function of implementing the above-mentioned audio data sending method example, and the function can be implemented by hardware, or by hardware executing corresponding software. The device 1200 may include:

[0167] A connection establishing module 1210, configured to establish a connection with an audio receiving device;

[0168] a request receiving module 1220, configured to receive a synchronization link establishment request from the audio receiving device, wherein the synchronization link request is used to request the establishment of a synchronization link, wherein the synchronization link includes n synchronization sub-links, wherein n is the number of audio sending devices in the audio sending device set, and the synchronization sub-links correspond one-to-one to the audio sending devices;

[0169] The data packet receiving module 1230 is used to receive a first data packet from the audio receiving device, where the first data packet is sent by the audio receiving device through a target synchronous sublink, and the first data packet is used to instruct a target audio sending device corresponding to the target synchronous sublink to send a second data packet;

[0170] The data packet sending module 1240 is used to send a second data packet to the audio receiving device through the target synchronous sub-link after receiving the first data packet, where the second data packet includes audio data.

[0171] To sum up, in the technical solution provided in the embodiment of the present application, by taking the audio receiving device as the master device and the audio sending device as the slave device, the audio receiving device establishes a synchronous link including synchronous sub-links consistent with the number of audio sending devices included in the audio sending device set, and sends data packets to the audio sending device and receives audio data from the audio sending device through the synchronous sub-links. The audio receiving device in the embodiment of the present application only needs to maintain one synchronous link. Compared with the audio receiving device in the related technology that needs to maintain multiple synchronous links, the embodiment of the present application can reuse the protocol stack, thereby saving the memory space of the audio receiving device.

[0172] In an exemplary embodiment, the connection establishing module 1210 is used to:

[0173] After receiving a broadcast message from the audio receiving device, sending a Bluetooth device address of a target audio sending device to the audio receiving device, wherein the broadcast message includes the Bluetooth device address of the audio receiving device;

[0174] A connection is established based on the Bluetooth device address of the audio receiving device and the Bluetooth device address of the target audio sending device.

[0175] It should be noted that the device provided in the above embodiment only uses the division of the above functional modules as an example to implement its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and their specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0176] Please refer to Fig.13 , which shows a structural block diagram of an audio receiving device provided by an embodiment of the present application.

[0177] The audio receiving device in the embodiment of the present application may include one or more of the following components: a processor 1310 and a memory 1320. Exemplarily, the audio receiving device further includes a transceiver.

[0178] The processor 1310 may include one or more processing cores. The processor 1310 uses various interfaces and lines to connect various parts of the entire audio receiving device, and executes various functions of the audio receiving device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 1320, and calling data stored in the memory 1320. Optionally, the processor 1310 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1310 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU) and a modem. Among them, the CPU mainly processes the operating system and application programs, etc.; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1310, and can be implemented separately through a chip.

[0179] Optionally, when the processor 1310 executes the program instructions in the memory 1320 , the method provided by each of the above-mentioned audio data receiving method embodiments is implemented.

[0180] The memory 1320 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 1320 includes a non-transitory computer-readable storage medium. The memory 1320 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1320 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data created according to the use of the audio receiving device, etc.

[0181] The structure of the above audio receiving device is only illustrative. In actual implementation, the audio receiving device may include more or fewer components, such as a display screen, etc. This embodiment does not limit this.

[0182] Those skilled in the art will understand that Fig.13 The structure shown in the figure does not constitute a limitation on the audio receiving device, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0183] Please refer to Fig.14 , which shows a structural block diagram of an audio sending device provided by an embodiment of the present application.

[0184] The audio transmission device in the embodiment of the present application may include one or more of the following components: a processor 1410 and a memory 1420. Exemplarily, the audio transmission device further includes a transceiver.

[0185] The processor 1410 may include one or more processing cores. The processor 1410 uses various interfaces and lines to connect various parts of the entire audio transmission device, and executes various functions of the audio transmission device and processes data by running or executing instructions, programs, code sets or instruction sets stored in the memory 1420, and calling data stored in the memory 1420. Optionally, the processor 1410 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1410 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU) and a modem. Among them, the CPU mainly processes the operating system and application programs, etc.; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1410, and can be implemented separately through a chip.

[0186] Optionally, when the processor 1410 executes the program instructions in the memory 1420, the methods provided by the above-mentioned various audio data sending method embodiments are implemented.

[0187] The memory 1420 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 1420 includes a non-transitory computer-readable storage medium. The memory 1420 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data created according to the use of the audio sending device, etc.

[0188] The structure of the above-mentioned audio sending device is only illustrative. In actual implementation, the audio sending device may include more or fewer components, such as a display screen, etc., which is not limited in this embodiment.

[0189] Those skilled in the art will understand that Fig.14 The structure shown in the figure does not constitute a limitation on the audio sending device, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0190] In an exemplary embodiment, a computer-readable storage medium is further provided, in which a computer program is stored. The computer program is loaded and executed by a processor of an audio receiving device to implement the various steps in the above-mentioned audio data receiving method embodiment.

[0191] In an exemplary embodiment, a computer-readable storage medium is further provided, in which a computer program is stored. The computer program is loaded and executed by a processor of an audio sending device to implement the various steps in the above-mentioned audio data sending method embodiment.

[0192] In an exemplary embodiment, a computer program product is provided, the computer program product includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of an audio receiving device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the audio receiving device performs the above-mentioned audio data receiving method.

[0193] In an exemplary embodiment, a computer program product is provided, the computer program product includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of an audio transmitting device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the audio transmitting device performs the above-mentioned audio data transmitting method.

[0194] It should be understood that the "plurality" mentioned herein refers to two or more than two.

[0195] The above description is only an exemplary embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for receiving audio data, characterized in that: The method comprises: Establishing a connection with each audio sending device in the audio sending device set, the audio sending device set includes n audio sending devices, where n is a positive integer; Sending a synchronization link establishment request to each of the audio sending devices, wherein the synchronization link establishment request is used to request the establishment of a connection synchronization group CIG link, wherein the CIG link includes n connection synchronization stream CIS links, and the CIS links correspond to the audio sending devices one by one; receiving configuration parameters from each of the audio sending devices, wherein the configuration parameters refer to parameters used to configure the CIG link; Based on the configuration parameters, configuring the CIG link; Sending a CIS establishment request to each of the audio sending devices; Receiving CIS establishment confirmation messages from each of the audio sending devices to complete the establishment of the n CIS links; Sending a first data packet to a target audio sending device in the audio sending device set corresponding to the target CIS link through a target CIS link, wherein the first data packet is used to instruct the target audio sending device to send a second data packet; A second data packet is received from the target audio sending device, wherein the second data packet includes audio data and is sent by the target audio sending device through the target CIS link.

2. The method according to claim 1, characterized in that The first data packet is an empty packet, which refers to a packet that does not include data content.

3. The method according to claim 1, characterized in that The first data packet is a feedback data packet of the audio receiving device in response to the third data packet, and the third data packet refers to a data packet from the target audio sending device in the last synchronization interval.

4. The method according to claim 3, characterized in that When the audio receiving device confirms that the third data packet is correct, the feedback data packet is an ACK packet; When the audio receiving device confirms that the third data packet is erroneous, the feedback data packet is a negative acknowledgement (NACK) packet.

5. The method according to claim 1, characterized in that The first data packet includes audio data collected by a microphone of the audio receiving device.

6. The method according to claim 1, characterized in that The establishing of connection with each audio sending device in the audio sending device set includes: Sending a broadcast message to each audio sending device in the audio sending device set, wherein the broadcast message includes a Bluetooth device address of the audio receiving device; Receiving a Bluetooth device address from each audio sending device in the audio sending device set; A connection is established based on the Bluetooth device address of the audio receiving device and the Bluetooth device addresses of each audio sending device.

7. A method for sending audio data, characterized in that: The method comprises: Establishing a connection with an audio receiving device; receiving a synchronization link establishment request from the audio receiving device, the synchronization link request being used to request establishment of a connection synchronization group CIG link, the CIG link comprising n connection synchronization stream CIS links, where n is the number of audio sending devices in the audio sending device set, and the CIS links correspond one-to-one to the audio sending devices; Sending configuration parameters to the audio receiving device, where the configuration parameters refer to parameters used to configure the CIG link; receiving a CIS establishment request from the audio receiving device; Sending a CIS establishment confirmation message to the audio receiving device to complete the establishment of the target CIS link; receiving a first data packet from the audio receiving device, wherein the first data packet is sent by the audio receiving device through the target CIS link, and the first data packet is used to instruct a target audio sending device corresponding to the target CIS link to send a second data packet; After receiving the first data packet, a second data packet is sent to the audio receiving device via the target CIS link, wherein the second data packet includes audio data.

8. The method according to claim 7, characterized in that The step of establishing a connection with the audio receiving device comprises: After receiving a broadcast message from the audio receiving device, sending the Bluetooth device address of the target audio sending device to the audio receiving device, wherein the broadcast message includes the Bluetooth device address of the audio receiving device; A connection is established based on the Bluetooth device address of the audio receiving device and the Bluetooth device address of the target audio sending device.

9. An audio data receiving device, characterized in that: The device comprises: a connection establishing module, configured to establish a connection with each audio sending device in a set of audio sending devices, wherein the set of audio sending devices includes n audio sending devices, where n is a positive integer; A request sending module, used for sending a synchronization link establishment request to each audio sending device, wherein the synchronization link establishment request is used for requesting to establish a connection synchronization group CIG link, wherein the CIG link includes n connection synchronization stream CIS links, and the CIS link corresponds to the audio sending device one by one; A parameter receiving module, used to receive configuration parameters from each of the audio sending devices, wherein the configuration parameters refer to parameters used to configure the CIG link; A link configuration module, configured to configure the CIG link based on the configuration parameters; A link establishment module, used to send a CIS establishment request to each audio sending device; The link establishment module is further used to receive CIS establishment confirmation messages from each of the audio sending devices to complete the establishment of the n CIS links; a data packet sending module, configured to send a first data packet to a target audio sending device in the audio sending device set corresponding to the target CIS link through a target CIS link, wherein the first data packet is used to instruct the target audio sending device to send a second data packet; The data packet receiving module is used to receive a second data packet from the target audio sending device, wherein the second data packet includes audio data and is sent by the target audio sending device through the target CIS link.

10. An audio data sending device, characterized in that: The device comprises: A connection establishing module, used to establish a connection with an audio receiving device; a request receiving module, configured to receive a synchronization link establishment request from the audio receiving device, wherein the synchronization link request is used to request the establishment of a connection synchronization group CIG link, wherein the CIG link includes n connection synchronization stream CIS links, wherein n is the number of audio sending devices in the audio sending device set, and the CIS link corresponds one-to-one to the audio sending device; The device is also used to send configuration parameters to the audio receiving device, wherein the configuration parameters refer to parameters used to configure the CIG link; receive a CIS establishment request from the audio receiving device; and send a CIS establishment confirmation message to the audio receiving device to complete the establishment of the target CIS link; a data packet receiving module, configured to receive a first data packet from the audio receiving device, wherein the first data packet is sent by the audio receiving device via the target CIS link, and the first data packet is used to instruct a target audio sending device corresponding to the target CIS link to send a second data packet; The data packet sending module is used to send a second data packet to the audio receiving device through the target CIS link after receiving the first data packet, wherein the second data packet includes audio data.

11. An audio receiving device, characterized in that: The audio receiving device comprises a processor and a memory, wherein the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the audio data receiving method according to any one of claims 1 to 6.

12. An audio transmitting device, characterized in that: The audio sending device includes a processor and a memory, the memory stores a computer program, and the computer program is loaded and executed by the processor to implement the audio data sending method according to any one of claims 7 to 8.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the audio data receiving method according to any one of claims 1 to 6, or to implement the audio data sending method according to any one of claims 7 to 8.

14. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium. The computer instructions are read and executed by a processor from the computer-readable storage medium to implement the audio data receiving method as described in any one of claims 1 to 6, or to implement the audio data sending method as described in any one of claims 7 to 8.

Citation Information

Patent Citations

  • Control method and communication method of Bluetooth audio transmitter

    CN111294777A