Wireless audio data transmission method and device

Abstract

The invention provides a wireless audio data transmission method and related equipment, and relates to the technical field of wireless audio, a first device communicates with N1 second devices in continuous equal time intervals based on N1 communication links, one equal time interval comprises a plurality of sub-events, and the first device communicates with N1 second devices based on N1 communication links. One sub-event comprises a plurality of audio transmission time slots used for carrying out Bluetooth low-power audio data transmission, and the method comprises the following steps: configuring a time slot resource allocation instruction, the time slot resource allocation instruction is used for allocating a corresponding audio transmission time slot in a first sub-event to target equipment which needs to perform audio data transmission in the first sub-event; sending the time slot resource allocation instruction and performing audio data transmission in the first sub-event; the first sub-event is any sub-event in the current equal time interval; n1 and M1 are natural numbers, and M1 is smaller than or equal to N1. The method provided by the invention can improve the link efficiency when the audio data stream is transmitted.

Description

Technical Field

[0001] The present disclosure relates to the technical field of wireless audio, and in particular to a method and device for wireless audio data transmission. Background Art

[0002] In Bluetooth Low Energy (BLE) audio applications, the prior art uses synchronous isochronous channels (Isochronous Channels) protocols, i.e., a connected isochronous stream (CIS) link for point-to-point communication and a connected isochronous group (CIG) protocol consisting of multiple CIS links, and a broadcast isochronous stream (BIS) link for point-to-multipoint communication and a broadcast isochronous group (BIG) protocol consisting of multiple BIS links, to provide wireless audio services to users; for example, a multi-point to single-point wireless multi-microphone (WMM) application implemented by a CIG using multiple CIS links. A multiple input multiple output (MIMO) wireless audio system consisting of wireless multi-microphones and wireless multi-channel audio devices implemented by a hybrid CIG link consisting of multiple unidirectional or bidirectional CIS links.

[0003] It is found in applications that the link efficiency of WMM or MIMO implemented using CIG is low. Summary of the invention

[0004] The purpose of the present disclosure is to provide a wireless audio data transmission method and related equipment, which are used to solve the technical problem of low link efficiency when transmitting audio data streams in the prior art.

[0005] As a first aspect of the present disclosure, an embodiment of the present disclosure provides a wireless audio data transmission method, which is applied to a first device, wherein the first device communicates with N1 second devices respectively in continuous equal time intervals based on N1 communication links, wherein one of the equal time intervals includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission; the method includes:

[0006] A time slot resource allocation instruction is configured, wherein the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event; the target device includes M1 target second devices among the N1 second devices; when allocating audio transmission time slots, all audio transmission time slots in the first sub-event are used as candidate audio transmission time slots for the M1 target second devices;

[0007] Sending the time slot resource allocation instruction, wherein the time slot resource allocation instruction is sent to the N1 second devices based on N1 communication links;

[0008] Performing audio data transmission in the first sub-event, wherein, in the audio transmission time slot of the first sub-event, receiving a second audio data packet sent by the target second device based on the target second device and the corresponding communication link corresponding to the audio transmission time slot;

[0009] The first sub-event is any sub-event within the current equal time interval;

[0010] Both N1 and M1 are natural numbers, and M1≤N1.

[0011] Optionally, each of the audio transmission time slots may be used by the first device to receive audio data and send audio data;

[0012] The first device also communicates with N2 third devices respectively within the equal time interval based on N2 communication links;

[0013] The target device also includes M2 target third devices among the N2 third devices; when allocating audio transmission time slots, all audio transmission time slots in the first sub-event are also used as candidate audio transmission time slots for the M2 target third devices;

[0014] Sending the time slot resource allocation instruction further includes sending the time slot resource allocation instruction to the N2 third devices based on the N2 communication links;

[0015] The performing audio data transmission in the first sub-event further includes, in the audio transmission time slots of the first sub-event, based on the target third devices respectively corresponding to the respective audio transmission time slots, sending a first audio data packet to the corresponding target third device on the corresponding communication link;

[0016] N2 and M2 are both natural numbers, and N1+N2≥2, M2≤N2.

[0017] As a second aspect of the present disclosure, an embodiment of the present disclosure provides a wireless audio data transmission method, which is applied to a second device, wherein the second device communicates with a first device in continuous equal time intervals based on a communication link, wherein one equal time interval includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission; the method includes:

[0018] Based on the communication link, receiving a time slot resource allocation instruction sent by the first device; the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event;

[0019] Based on the time slot resource allocation instruction, when confirming that the second device is the target device, sending a second audio data packet to the first device in a corresponding audio transmission time slot in the first sub-event;

[0020] The first sub-event is any sub-event within the current equal time interval.

[0021] As a third aspect of the present disclosure, an embodiment of the present disclosure provides a wireless audio data transmission method, which is applied to a third device, wherein the third device communicates with the first device in continuous equal time intervals based on a communication link, wherein one equal time interval includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission; the method includes:

[0022] Based on the communication link, receiving a time slot resource allocation instruction sent by the first device; the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event;

[0023] Based on the time slot resource allocation instruction, when confirming that the third device is the target device, receiving a first audio data packet sent by the first device in a corresponding audio transmission time slot in the first sub-event;

[0024] The first sub-event is any sub-event within the current equal time interval.

[0025] As the fourth aspect of the present disclosure, an embodiment of the present disclosure provides an electronic device, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the wireless audio data transmission method described in any one of the first aspect, the second aspect and the third aspect of the present disclosure by executing the computer instructions.

[0026] In the above-mentioned embodiment of the present invention, the first device configures time slot resources for each target device that needs to transmit audio data in the current sub-event for each sub-event and sends a time slot resource allocation instruction, and transmits audio data packets according to the configured time slot resources. The audio transmission time slot in any sub-event can be flexibly allocated without being limited by fixed time slots, so that the first device has the ability to scientifically and reasonably configure time slot resources according to different communication conditions, thereby improving the link efficiency and transmission reliability of the wireless audio data transmission system. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a flowchart of a wireless audio data transmission method applied to a first device provided by an embodiment of the present disclosure;

[0028] Figure 2 is a schematic diagram of a wireless audio data transmission system provided by an embodiment of the present disclosure;

[0029] Figure 3 is a flowchart of a wireless audio data transmission method applied to a second device provided by an embodiment of the present disclosure;

[0030] Figure 4 is a schematic diagram of the structure of an AHISM PDU extension header provided by an embodiment of the present disclosure;

[0031] Figure 5 is a schematic diagram of the structure of an AHISS PDU extension header provided by an embodiment of the present disclosure;

[0032] Figure 6 is a schematic diagram of a time slot allocation scheme provided by an embodiment of the present disclosure;

[0033] Figure 7 is a schematic diagram of another time slot allocation scheme provided by an embodiment of the present disclosure;

[0034] Figure 8 is a flowchart of another wireless audio data transmission method applied to a first device provided by an embodiment of the present disclosure;

[0035] Fig. 9 is a schematic diagram of another wireless audio data transmission system provided by an embodiment of the present disclosure;

[0036] Fig.10 It is a structural diagram of an AISM PDU extended packet header provided by an embodiment of the present disclosure;

[0037] Fig.11 It is a structural diagram of an AISD PDU extension header provided by an embodiment of the present disclosure;

[0038] FIG12 is a schematic diagram of a time slot allocation scheme provided in an embodiment of the present disclosure;

[0039] Fig.13 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure;

[0040] Fig.14 It is a schematic diagram of the structure of another electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0042] In order to solve the problem of low link efficiency in the prior art when transmitting audio data streams, the embodiments of the present disclosure provide a wireless audio data transmission method, system and related devices.

[0043] Example 1

[0044] refer to Figure 1 This embodiment provides a wireless audio data transmission method, which is applied to a first device, wherein the first device communicates with N1 second devices respectively in continuous equal time intervals based on N1 communication links, and one of the equal time intervals includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission.

[0045] The method comprises:

[0046] Step 101, configuring a time slot resource allocation instruction, wherein the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event; the target device includes M1 target second devices among the N1 second devices; when allocating audio transmission time slots, all audio transmission time slots in the first sub-event are used as candidate audio transmission time slots for the M1 target second devices;

[0047] Step 102, sending the time slot resource allocation instruction, wherein the time slot resource allocation instruction is sent to the N1 second devices based on N1 communication links;

[0048] Step 103, performing audio data transmission in the first sub-event, wherein, in the audio transmission time slot of the first sub-event, receiving a second audio data packet sent by the target second device based on the target second device and the corresponding communication link corresponding to the audio transmission time slot;

[0049] It can be understood that the first sub-event is any sub-event in the current equal-time interval. The current equal-time interval is any one of the continuous equal-time intervals.

[0050] Both N1 and M1 are natural numbers, and M1≤N1.

[0051] For example, see Figure 2 , Figure 2 A wireless audio data transmission system is shown, which takes a wireless multi-microphone audio system as a specific application scenario, wherein the system includes a wireless microphone audio receiving device (equivalent to a first device) and multiple wireless microphone audio sending devices (equivalent to a second device).

[0052] It is understandable that the wireless audio data transmission solution of the present application can also be applied to other specific application scenarios to perform audio data transmission.

[0053] In this embodiment, the communication time of the wireless audio data transmission system for audio data stream transmission is divided into multiple continuous equal time intervals, one equal time interval includes multiple sub-events (Subevent, SE), the length of the air time slot occupied by each Subevent is a sub-interval (Sub_Interval, SE interval), and each sub-event can be further subdivided into multiple sub-time slots for performing different communication tasks.

[0054] Exemplarily, an SE interval may include an instruction transmission time slot and one or more audio transmission time slots. The instruction transmission time slot may be the first sub-time slot in the corresponding SE interval, and the audio receiving device, i.e., the first device, sends the first data packet carrying the time slot resource allocation instruction to multiple audio sending devices, i.e., the second device, in the system in a broadcast form in the sending sub-time slot; and each audio transmission time slot may be used by the first device to receive audio data, and the first device transmits an audio data packet with a target device once in an audio transmission time slot.

[0055] It is understandable that, in some embodiments, the total number of time slot resources that can be used for audio transmission can also be dynamically changed, for example, in the communication process, some sub-events in some equal time intervals, or some sub-time slots in some sub-events, are currently in an idle state, and these idle sub-events or sub-time slots can be used as the audio data transmission. The idle state can be understood as that there is no need to perform a communication event in the current equal time interval or the current sub-event. For example, the relevant communication event has been completed in the previous equal time interval or the previous sub-event, or it is determined that there is no relevant communication event in the current equal time interval or the current sub-event. Usually, in an equal time interval, after the first audio data transmission, the audio data can be retransmitted in the subsequent sub-event, and when retransmitting, the audio data packet that has been correctly received in the previous sub-event does not need to be retransmitted in the subsequent sub-event, so the transmission time slot used to transmit the correctly received audio data packet in the previous sub-event becomes an idle time slot in the subsequent sub-event. The embodiment of the present application can make full use of these idle time slots to improve link efficiency and transmission reliability.

[0056] In the above-mentioned embodiment of the present invention, the first device configures time slot resources and sends time slot resource allocation instructions for each sub-event, and transmits audio data packets according to the configured time slot resources. It can flexibly allocate the audio transmission time slot in any sub-event without being limited by fixed time slots, so that the first device has the ability to scientifically and reasonably configure time slot resources according to different communication conditions, thereby improving the link efficiency and transmission reliability of the wireless audio data transmission system.

[0057] In step 101, the audio receiving device allocates a time slot resource in the first sub-event in the current equal time interval to the target device, specifically, allocates a corresponding audio transmission time slot to the target device.

[0058] In some specific embodiments, the audio receiving device can configure the time slot resource allocation instruction based on a predetermined rule, for example, allocating time slot resources according to the communication quality of each communication link. In other specific embodiments, the audio receiving device can also select the audio sending device that needs to retransmit data in the current communication event as the target device according to the data transmission situation before the current communication event, and allocate time slot resources to it. In addition, the audio receiving device can also allocate time slot resources within a period of time to a specific audio sending device to meet the data transmission requirements of the specific audio sending device.

[0059] In some specific embodiments, the audio receiving device (first device) may also allocate time slot resources according to the following principles:

[0060] When the number of the target devices is equal to the number of the audio transmission time slots in the first sub-event, one target device corresponds to one audio transmission time slot;

[0061] When the number of the target devices is less than the number of the audio transmission time slots within the first sub-event, one target device corresponds to at least one audio transmission time slot, and at least some of the target devices correspond to multiple audio transmission time slots, thereby improving the audio data transmission link efficiency and transmission reliability of at least some of the target devices.

[0062] To further improve the flexibility of time slot resource configuration and transmission reliability, in some specific embodiments, the allocation of corresponding audio transmission time slots within the first sub-event to the target device also includes: there is at least one target device, whose time slot distribution of the corresponding audio transmission time slots in the first sub-event is different from the time slot distribution of the corresponding audio transmission time slots in the second sub-event, the second sub-event is a sub-event that is later than the first sub-event, and the second sub-event and the first sub-event are within the same equal time interval.

[0063] The different time slot distributions may include a variety of situations, including different time slot orders, different time slot numbers, or different time slot orders and numbers. For example, a sub-event includes 5 audio transmission time slots numbered 1, 2, 3, 4, and 5. A target device is assigned an audio transmission time slot numbered 1 in the first sub-event and an audio transmission time slot numbered 3 in the second sub-event, or two audio transmission time slots numbered 1 and 3 are assigned in the second sub-event. These are all situations where the time slot distributions are different.

[0064] Based on the inventive concept of this embodiment, if the first device fails to successfully transmit audio data with some target devices within a first sub-event of an equal time interval, but successfully transmits audio data with other target devices, then within a second sub-event of the equal time interval, the time slot resources allocated to other target devices in the first sub-event can be reallocated to some target devices that failed to transmit successfully, thereby increasing the success rate of audio transmission in the second sub-event.

[0065] Based on the inventive concept of this embodiment, if some of the second devices are devices that need priority transmission guarantee, the first device can also preferentially allocate time slot resources within the first sub-event of an equal time interval to some of the second devices, and after confirming that the audio transmission is correct, allocate time slot resources to other second devices in subsequent sub-events of the equal time interval.

[0066] It is understandable that, based on the inventive concept of this embodiment, various solutions for selecting target devices and configuring time slot resources may be adopted according to specific application scenarios, and the present invention does not specifically limit this.

[0067] In some specific embodiments, the first device may configure corresponding audio transmission time slots for one or more second devices among the multiple audio sending devices within a sub-event interval, and indicate the configuration status through the first data packet.

[0068] After receiving the first data packet, the M1 target second devices may select the allocated audio transmission time slot in the first sub-event according to the time slot resource allocation instruction, and send the second audio data packet based on their respective corresponding communication links.

[0069] Correspondingly, the first device executes the step 103 to receive the second audio data packet sent by the target second device in the audio transmission time slot of the first sub-event based on the target second device corresponding to the audio transmission time slot and the corresponding communication link.

[0070] Among them, the execution process of step 103 can be understood as: in the audio transmission time slot of the first sub-event interval, the first device receives the second audio data packet transmitted by the target second device through the communication link; exemplarily, when there are multiple audio transmission time slots allocated to a target second device, if the first device correctly receives the second audio data packet in the previous audio transmission time slot, it may no longer perform the receiving operation in the subsequent audio transmission time slot, or the first device may also perform a receiving operation once in each audio transmission time slot, regardless of whether it is correctly received in the previous audio transmission time slot.

[0071] If the first device successfully receives the second audio data packet transmitted by the target second device in the current first sub-event, the target second device may no longer be allocated an audio transmission time slot in a subsequent sub-event to retransmit the second audio data packet. Otherwise, the target second device may be instructed to retransmit in a subsequent sub-event. The number of retransmissions may be limited to the flush time (FT) of the second audio data packet.

[0072] refer to Figure 3 This embodiment provides a wireless audio data transmission method, which is applied to a second device, wherein the second device communicates with the first device in continuous equal time intervals based on a communication link, wherein one equal time interval includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission; the method includes:

[0073] Step 301: Based on the communication link, a time slot resource allocation instruction sent by the first device is received; the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event;

[0074] Step 302: Based on the time slot resource allocation instruction, when confirming that the second device is the target device, send a second audio data packet to the first device in the corresponding audio transmission time slot in the first sub-event;

[0075] The first sub-event is any sub-event within the current equal time interval.

[0076] In one embodiment, the second audio data packet includes audio data and preset parameters, wherein the preset parameters include at least one of the following:

[0077] The sixth sub-parameter is used to indicate the sequence number of the communication link corresponding to the audio data packet;

[0078] The seventh sub-parameter is used to indicate the data packet sequence number corresponding to the audio data packet.

[0079] The step 302, based on the time slot resource allocation instruction, when confirming that the second device is the target device, sends the second audio data packet to the first device in the corresponding audio transmission time slot in the first sub-event. It can be understood that the target second device distributes the second audio data packet in each audio transmission time slot allocated by the first device according to the time slot resource allocation instruction. For example, in the time slot resource allocation instruction, the second device is allocated two audio transmission time slots in the current first sub-event, and the second audio data packet to be transmitted is sent twice in the two audio transmission time slots respectively. It can be understood that this embodiment does not limit the situation where different second audio data packets are transmitted in different audio transmission time slots, and can be specifically configured according to the actual application scenario.

[0080] It can be understood that when the second device determines that the second device is not the target second device based on the time slot resource allocation instruction, the second device will not send an audio data packet to the first device in the first sub-event.

[0081] It should be noted that Figure 3 The embodiment shown is Figure 1 The corresponding method embodiment of the embodiment shown in the figure, therefore, can refer to the above Figure 1 The related descriptions in the method embodiment shown in the figure can achieve the same beneficial effects. In order to avoid repeated descriptions, they will not be repeated here.

[0082] The following combination Figure 2 A typical application example of this embodiment is described.

[0083] For example, in Figure 2In the application scenario shown, the link protocol for wireless communication by the wireless audio data transmission method can be called an Agile Hybrid Isochronous Stream (AHIS) link protocol, and the communication link established based on the AHIS link protocol can be called an AHIS link. Two or more AHIS links constitute an Agile Hybrid Isochronous Group (AHIG) link. In a specific embodiment, the AHIS link can be implemented as a data link in wireless communication.

[0084] The first device uses an Agile Hybrid Isochronous Stream Master (AHISM) protocol data unit (PDU) to send the first data packet.

[0085] The time slot resource allocation instruction may be configured in a header portion or a payload portion of the first data packet.

[0086] The structure of the AHISM PDU may be in a customized form, or may be obtained by expanding the structure of the currently used broadcast data packet so as to be compatible with existing technologies.

[0087] Exemplarily, the AHISM PDU may have the same structure as a Bluetooth Low Energy (BLE) Broadcast Isochronous Stream (BIS) PDU but a different header format.

[0088] Among them, the header of the AHISM PDU can set a 1-bit reserved field (Reserved for Future Use, RFU) to the AHIGM field on the basis of the header of the BIS PDU to indicate whether the AHISM PDU is enabled; when the AHIGM field is assigned a value of 0, it indicates that the AHISM PDU is not enabled. At this time, the PDU is a broadcast data packet that complies with the BIS link protocol, and when the AHIGM field is assigned a value of 1, it indicates that the AHISM PDU is enabled. At this time, the PDU is a broadcast data packet that complies with the AHIS link protocol;

[0089] When the AHISM PDU is enabled, the header of the AHISM PDU is further extended based on the header of the BIS PDU, and the extended part of the header is used to carry the time slot resource allocation instruction.

[0090] It is understandable that the payload portion of the AMISM PDU may also carry audio data sent by the audio receiving device to the audio sending device or other audio devices.

[0091] It can be understood that the specific form of the time slot resource allocation instruction can be set according to the actual application scenario.

[0092] In order to reduce the bit resource overhead occupied by the time slot resource allocation instruction, the time slot resource allocation instruction can be set by element value and element order. In one embodiment, the time slot resource allocation instruction includes a first sequence, the first sequence includes at least one first element indicating the communication link, and the order of the at least one first element in the first sequence is used to indicate that within the first sub-event, the target device is allowed to perform audio data transmission with the first device through the communication link for at least one audio transmission time slot.

[0093] For example, if there are three target second devices, and the link sequence numbers of the communication links established with the first device are 1, 2 and 3 respectively, and the first sequence carried in the AHISM PDU is

[1231] , then the indication means that, within the first sub-event, there are four enabled audio transmission time slots, among which the first audio transmission time slot is allocated to the communication link with sequence number 1, the second audio transmission time slot is allocated to the communication link with sequence number 2, the third audio transmission time slot is allocated to the communication link with sequence number 3, and the fourth audio transmission time slot is allocated to the communication link with sequence number 1.

[0094] In another embodiment, the time slot resource allocation instruction includes a first parameter group corresponding to each audio transmission time slot respectively, and the first parameter group includes a first sub-parameter and a second sub-parameter, wherein the first sub-parameter is used to indicate whether an audio transmission time slot is enabled, and the second sub-parameter is used to indicate the parameter of the serial number of the communication link corresponding to the audio transmission time slot, that is, to indicate the target second device corresponding to the first parameter group.

[0095] Exemplarily, if there are 4 audio transmission time slots and 4 communication links in the first sub-event, and the time slot resource allocation instruction includes multiple parameter groups arranged in order, which is [211233], then the multiple parameter groups indicate: in the first sub-event, the audio transmission time slot with sequence number 2 is enabled and allocated as the communication link with sequence number 1, the audio transmission time slot with sequence number 1 is enabled and allocated as the communication link with sequence number 2, and the audio transmission time slot with sequence number 3 is enabled and allocated as the communication link with sequence number 3. If the audio transmission time slot with sequence number 4 does not appear in the time slot resource allocation instruction, it means that the audio transmission time slot with sequence number 4 is not enabled. If the communication link with sequence number 4 also does not appear in the time slot resource allocation instruction, it means that the second device corresponding to the communication link with sequence number 4 is not allowed to perform audio transmission in the current first sub-event.

[0096] In another embodiment, the time slot resource allocation instruction includes multiple groups of parameters, each group of parameters includes a first sub-parameter, a second sub-parameter and a third sub-parameter, wherein the first sub-parameter is used to indicate whether an audio transmission time slot is enabled, the second sub-parameter is used to indicate the parameter of the serial number of the communication link corresponding to the audio transmission time slot, and the third sub-parameter is used to indicate the serial number of the audio data packet transmitted in the audio transmission time slot.

[0097] Exemplarily, the first sub-parameter may occupy 1 bit of resources, the second sub-parameter may occupy 3 bits of resources, and the third sub-parameter may occupy 4 bits of resources.

[0098] Exemplarily, the time slot resource allocation instruction includes a plurality of parameter groups arranged in order, and for each parameter group, the parameter value of the first sub-parameter may be 0 or 1 (a value of 0 indicates that the corresponding audio transmission time slot is not enabled, and a value of 1 indicates that the corresponding audio transmission time slot is enabled), and the audio transmission time slot corresponding to the parameter group may be determined based on the order of the parameter groups in the time slot resource allocation instruction, and whether the audio transmission time slot corresponding to the parameter group is enabled may be determined based on the parameter value of the first sub-parameter in the parameter group;

[0099] Among them, the audio transmission time slot corresponding to the parameter group can be determined based on the order of the parameter groups in the time slot resource allocation instruction, which can be understood as: the i-th parameter group in the time slot resource allocation instruction indicates the i-th audio transmission time slot in the corresponding sub-event, and i is a positive integer.

[0100] As a specific implementation method, Figure 4The figure shows a schematic diagram of the structure of an AHISM PDU extended header. In the AHISM PDU, based on the BIS PDU header, a 1-bit reserved field is set as the AHIGM field to indicate the enabling of the AHISMPDU; when the AHIGM field is assigned a value of 0, it indicates that the AHISM PDU is not enabled, and when the AHIGM field is assigned a value of 1, it indicates that the AHISM PDU is enabled.

[0101] When the AHISM PDU is enabled, a certain number of bytes are added to the extended packet header as a batch resource allocation table (Block Resource Allocation Table, BSAT), wherein the batch resource allocation table can be used to configure the time slot resource allocation instruction.

[0102] BSAT includes several resource allocation units for allocating corresponding time slot resources in batches to different AHIS links. It should be noted that the number of resource allocation units can be equal to the number of wireless microphone audio transmitting devices, or can be greater than the number of wireless microphone audio transmitting devices, or can be less than the number of wireless microphone audio transmitting devices.

[0103] For a resource allocation unit in a BSAT, the resource allocation unit may include: an enable signal (EN_n), a link sequence number AHIS Num and a protocol data unit sequence number PDU Num. At this time, the resource allocation unit can be understood as the aforementioned parameter group, the enable signal (EN_n) can be understood as the aforementioned first sub-parameter, the link sequence number AHIS Num can be understood as the aforementioned second sub-parameter, and the protocol data unit sequence number PDU Num can be understood as the aforementioned third sub-parameter.

[0104] EN_n is set to 1 to enable the time slot resource corresponding to sequence number n, and EN_n is set to 0 to disable the time slot resource corresponding to sequence number n.

[0105] When EN_n is set to 1, AHIS Num in the resource allocation unit with sequence number n indicates that the time slot resource with sequence number n is used for the AHIS link with link sequence number AHIS Num or its corresponding wireless microphone audio sending device to send its corresponding second audio data packet AHISS PDU.

[0106] When EN_n is set to 1, the PDU Num in the resource allocation unit with serial number n indicates that the time slot resource with serial number n is used for the AHIS link with link serial number AHIS Num or its corresponding wireless microphone audio sending device to send its corresponding second audio data packet AHISS PDU with serial number PDU Num.

[0107] The functions and usage of other fields in the AHISM PDU extended header are the same as those of the BIS PDU, including the logical link identifier (LLID) used to indicate the AHISM PDU payload type, the control subevent sequence number (CSSN), the control subevent transmission flag (CSTF), the length of the AHISM PDU payload (Length), and 1-bit RFU, where n is a positive integer.

[0108] In a specific embodiment, the method further includes: after successfully completing audio data transmission with a target device in a sub-event of the current equal time interval, prohibiting audio data transmission with the target device in the remaining sub-events of the current equal time interval.

[0109] For example, the current equal time interval includes two sub-events, the first sub-event and the second sub-event. For target device A, the first device has successfully received the second audio data packet from target device A in an audio transmission time slot of the first sub-event, and then no longer allocates time slot resources to the target device A in the second sub-event, thereby prohibiting audio data transmission with target device A. The first device can cancel the time slot resource allocation information of the target device A in the time slot resource allocation instruction, or indicate that the corresponding time slot resource of the target device A is disabled. If the first device completes the audio data transmission of all target devices in the first sub-event, it can send an AHISM PDU in the second sub-event, and all enable signals (EN_n) therein are set to be disabled. Thus, by utilizing the transmission of an AHISM PDU once, while allocating corresponding audio transmission time slots to multiple audio sending devices, transmission feedback to multiple audio sending devices is realized at the same time, the reception confirmation process between the audio sending device and the audio receiving device is simplified, and the resource overhead of the entire wireless audio data transmission system is reduced.

[0110] Exemplarily, the audio sending device uses an Agile Hybrid Isochronous Stream Slave (AHISS) PDU to send the second audio data packet.

[0111] The structure of the AHISS PDU may be in a customized form, or may be obtained by expanding the structure of a currently used audio data packet, so as to be compatible with the existing technology.

[0112] Exemplarily, the AHISS PDU may have the same format as the BLE Connected Isochronous Stream (CIS) PDU but a different header format, that is, the AHISS PDU may be understood as a CIS PDU using an extended header.

[0113] As a specific implementation method, Figure 5 The following is a schematic diagram of the structure of an AHISS PDU extension header. The header of the AHISS PDU can set a 1-bit reserved field (Reserved for Future Use, RFU) to the AHIGS field based on the header of the CIS PDU to indicate whether the AHISS PDU is enabled; when the AHIGS field is assigned a value of 0, it indicates that the AHISS PDU is not enabled, and the PDU is an audio data packet that complies with the CIS link protocol; and when the AHIGS field is assigned a value of 1, it indicates that the AHISS PDU is enabled, and the PDU is an audio data packet that complies with the AHIS link protocol.

[0114] When AHISS PDU is enabled, the header of AHISM PDU is further extended based on the header of CIS PDU, and the extended part of the header includes parameters indicating the communication link and / or parameters indicating the sequence number of the audio data packet.

[0115] In one example, a parameter indicating a link sequence number of a communication link may occupy 3 bits of resources, and a parameter indicating a sequence number of an audio data packet may occupy 5 bits of resources.

[0116] like Figure 5 As shown, the header extension of the AHISS PDU includes the AHIS Num field and the PDU Num field, where:

[0117] AHIS Num indicates the serial number of the AHIS link corresponding to the current AHISS PDU, and PDU Num indicates the PDU serial number of the AHIS link corresponding to the current AHISS PDU.

[0118] The meanings of other fields in the AHISS PDU header are the same as those of the CIS PDU header. LLID (Logical Link Identifier) ​​is a logical link identifier used to indicate the load type of the AHISS PDU.

[0119] NESN (Next Expected Sequence Number) is the next expected sequence number, and SN (Sequence Number) is the current sequence number.

[0120] CIE (Close Isochronous Event) is to close the isochronous event, indicating whether to end the isochronous event.

[0121] NPI (Null PDU Indicator) is the Null PDU identifier, which indicates in the AHISS PDU whether the PDU is an AHISS Data PDU or an AHISS Null PDU.

[0122] Length indicates the payload length of the AHISS PDU.

[0123] The working principle of the wireless audio data transmission method of this embodiment is described in detail below using a wireless four-microphone audio system as an example.

[0124] The wireless audio data transmission system is set to include an audio receiving device (equivalent to the first device) and four audio sending devices (equivalent to the second device), wherein a maximum of four AHIS links are established between the audio receiving device and the four audio sending devices, and the four AHIS links are set to be AHIS1 link (corresponding to AHIS Num equal to 1), AHIS2 link (corresponding to AHIS Num equal to 2), AHIS3 link (corresponding to AHIS Num equal to 3) and AHIS4 link (corresponding to AHIS Num equal to 4), and AHIS1, AHIS2, AHIS3 and AHIS4 constitute AHIG.

[0125] Among them, the sampling rate of the digital audio signal of each audio sending device is 48kHz, the number of quantization bits of each sampling point is 16, the digital audio signal is encoded by Low Complexity Communication Codec (LC3), the encoding frame length is 10ms, the encoding rate is 80kbps, and each frame of audio data after encoding is 100 bytes.

[0126] In the wireless audio data transmission system, the communication time is divided into 10ms isochronous intervals, and the BLE 2Mbps transmission rate is adopted; the load length (Length) of the AHISM PDU carrying resource allocation information is 0 (Length is not 0 when audio data is sent), and the occupied air time is 60us; the AHISSData PDU carrying wireless microphone audio data occupies an air time of 464us.

[0127] Each equal time interval includes 3 sub-event (SE) intervals; each SE interval includes 1 command transmission slot and 4 audio transmission slots, wherein the command transmission slot is used for the audio receiving device to send AHISM PDU to the audio transmitting device, and the audio transmission slot is used for the audio transmitting device to send AHISS PDU to the audio receiving device; and, specifically, each SE interval is 2.666ms, and the interval between each sub-slot (Time of Minimum Slot Space, T_MSS) is 150us.

[0128] like Figure 6 As shown, within an equal time interval with a sequence number of k, the audio receiving device first sends an AHISM PDU with a sequence number of k in the command transmission time slot of the first SE interval, namely, AHISM PDU k, wherein the payload length (Length) is 0, the AHIGM field of the extended packet header is assigned a value of 1, and the extended packet header indicates that all four audio transmission time slots are enabled and are sequentially allocated to the four links of AHIS1, AHIS2, AHIS3 and AHIS4, and the audio data packet PDU sequence numbers are all k.

[0129] Among them, the audio data packet PDU sequence number can also be k-1, k-2, k-3, etc. Without loss of generality, k is taken as an example in this example; after the audio receiving device sends the AHISM PDU, the audio sending device corresponding to the AHIS link with sequence numbers 1, 2, 3, and 4 sends the AHISS PDU with sequence number k in sequence, that is, AHISS1 PDU k, AHISS2 PDU k, AHISS3 PDU k, AHISS4 PDU k, and the AHIS Num of their extended packet headers are 1, 2, 3, and 4 respectively, and the PDU Num of their extended packet headers is all k.

[0130] Assuming that the audio receiving device correctly receives AHISS2 PDU k and AHISS3 PDU k, but fails to correctly receive AHISS1PDU k and AHISS4 PDU k, then the AHIGM field value of the extended packet header of AHISM PDU k sent by the audio receiving device in the second SE interval is still assigned to 1, and the extended packet header indicates that all four audio transmission time slots are enabled and are allocated to the AHIS1, AHIS4, AHIS1 and AHIS4 links in sequence, and the PDU sequence number is still k. At this time, the audio sending device corresponding to the AHIS link with link sequence number 1 sends AHISS1PDU k in the first and third audio transmission time slots respectively, and the audio sending device corresponding to the AHIS link with link sequence number 4 sends AHISS4PDU k in the second and fourth audio transmission time slots respectively. That is to say, in the second SE interval, the AHISS PDU with PDU sequence number k of the AHIS links with link sequence numbers 1 and 4 are sent twice respectively. After receiving AHISM PDU k, the audio sending devices corresponding to the AHIS links with link sequence numbers 2 and 3 do not perform a sending operation in the second SE interval because they are not allocated an audio transmission time slot.

[0131] Assuming that the audio receiving device correctly receives AHISS1 PDU k and AHISS4 PDU k in the second SE interval, the AHIGM field of the extended packet header of the AHISM PDU k sent by the audio receiving device in the third SE interval is still assigned a value of 1, and the extended packet header indicates that the four audio transmission time slots are not enabled. This means that the audio data packets transmitted by the four audio sending devices have been correctly received. Therefore, the AHISM PDU k sent in the third SE interval is equivalent to transmitting batch confirmation information to the four audio sending devices, confirming that the four audio sending devices do not need to retransmit the corresponding AIHSS PDU, so there is no need to allocate time slot resources to the four AHIS links.

[0132] It can be seen from the above that in the first SE interval and the second SE interval, the AHIS links with sequence numbers 2 and 3 respectively used one transmission opportunity, while the AHIS links with sequence numbers 1 and 4 respectively obtained three transmission opportunities.

[0133] like Figure 7As shown, in an equal time interval with a sequence number of k+1, the audio receiving device first sends an AHISM PDU with a sequence number of k+1 in the first SE interval, that is, AHISM PDU k+1, wherein the payload length (Length) is 0, the AHIGM field of the extended packet header is assigned a value of 1, and the extended packet header indicates that all four audio transmission time slots are enabled and are sequentially allocated to the four links of AHIS1, AHIS2, AHIS3 and AHIS4, and the PDU sequence numbers are all k+1.

[0134] After receiving the AHISM PDU, the audio sending devices corresponding to the AHIS links with serial numbers 1, 2, 3, and 4 send AHISS PDUs with serial number k+1 in sequence, namely AHISS1 PDU k+1, AHISS2 PDU k+1, AHISS3 PDU k+1, and AHISS4 PDU k+1.

[0135] Assuming that in the first SE interval, the audio receiving device correctly received AHISS1 PDU k+1 and AHISS4 PDUk+1, but did not correctly receive AHISS2 PDU k+1 and AHISS3 PDU k+1, then the AHIGM field value of the extended packet header of AHISM PDU k+1 sent by the audio receiving device in the second SE interval is still 1, and the extended packet header indicates that all four audio transmission time slots are enabled and are allocated to the AHIS2, AHIS3, AHIS2 and AHIS3 links in sequence, with the PDU sequence numbers being k+1. That is to say, in the second SE interval, the AHISS PDUs with PDU sequence number k+1 of the AHIS links with link sequence numbers 2 and 3 are sent twice respectively.

[0136] Assuming that in the second SE interval, the audio receiving device correctly receives the AHISS2 PDU k+1, but does not correctly receive the AHISS3 PDU k, then the AHIGM field of the extended header of the AHISM PDU k sent by the audio receiving device in the third SE interval is still assigned to 1, and the extended header indicates that all four audio transmission time slots are enabled and allocated to the AHIS3 link, and the PDU sequence number is k+1, that is, in the third SE interval, the AHISS PDU of the AHIS link with sequence number 3 is sent four times. It can be seen that in an equal time interval with sequence number k+1, the AHIS links with sequence numbers 1 and 4 use one transmission opportunity respectively, the AHIS link with sequence number 2 uses three transmission opportunities, and the AHIS link with sequence number 3 obtains 7 transmission opportunities.

[0137] It can be understood that, within the equal time interval with sequence number k+1, if any one of AHISS1 PDU k+1, AHISS2 PDU k+1, AHISS3 PDU k+1, AHISS4 PDU k+1 is not successfully received by the audio receiving device, it can be repeatedly sent within the equal time interval with sequence number k+2, K+3, ... until the refresh time (Flush Time, FT) times out, wherein the PDU sequence number remains unchanged.

[0138] Among them, FT=1 means that the data is sent only in the current equal time interval and no retransmission is performed in the next equal time interval; FT=2 means that the data can be retransmitted in two consecutive equal time intervals, and so on. The larger the FT, the higher the transmission reliability, but the greater the transmission delay.

[0139] As can be seen from the above examples, the allocation of time slot resources available to each AHIS link in this application is relatively flexible, which allows the audio receiving device to flexibly allocate different time slot resources to different audio sending devices or different AHIS links according to the channel quality or receiving status of different AHIS links. And when the audio receiving device does not receive the audio data packet transmitted by the audio sending device in a sub-event, then in at least one subsequent sub-event interval, a time slot configuration different from that in the previous sub-event interval is set for the audio sending device, so as to increase the probability of the audio sending device successfully transmitting the audio data packet in the subsequent sub-event interval by adjusting the time slot resources corresponding to the audio sending device, avoid the defects of the related technology caused by the fixed configuration of time slot resources, and improve the link efficiency and transmission reliability of the wireless audio data transmission system when transmitting audio data streams.

[0140] Embodiment 2:

[0141] refer to Figure 8 This embodiment provides a wireless audio data transmission method, which is applied to a first device, wherein the first device communicates with N1 second devices in consecutive equal time intervals based on N1 communication links, and communicates with N2 third devices in the equal time intervals based on N2 communication links;

[0142] One of the equal time intervals includes multiple sub-events, and one of the sub-events includes multiple audio transmission time slots for Bluetooth low energy audio data transmission. Each of the audio transmission time slots can be used by the first device to receive audio data and send audio data.

[0143] The method comprises:

[0144] Step 801, configure a time slot resource allocation instruction, the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in a first sub-event to a target device that needs to perform audio data transmission in a first sub-event. The first sub-event is any sub-event in the current equal time interval.

[0145] The target devices include M1 target second devices among the N1 second devices and M2 target third devices among the N2 third devices. The N1, M1 and M2 are all natural numbers, and M1≤N1, N1+N2≥2, and M2≤N2.

[0146] When allocating audio transmission time slots, all audio transmission time slots within the first sub-event may be used as candidate audio transmission time slots for the M1 target second devices and the M2 target third devices.

[0147] The target device may be selected by referring to the scheme in the aforementioned embodiment, and time slot resources may be allocated to each target device. To avoid repetition, details will not be given here.

[0148] Step 802: Send the time slot resource allocation instruction, wherein the time slot resource allocation instruction is sent to the N1 second devices based on N1 communication links, and the time slot resource allocation instruction is sent to the N2 third devices based on N2 communication links.

[0149] Step 803: Perform audio data transmission in the first sub-event. In the audio transmission time slot of the first sub-event, receive the second audio data packet sent by the target second device based on the target second device and the corresponding communication link corresponding to the audio transmission time slot, and send the first audio data packet to the corresponding target third device on the corresponding communication link based on the target third device corresponding to the audio transmission time slot.

[0150] In the above-mentioned embodiment of the present invention, the first device configures time slot resources for each sub-event and sends time slot resource allocation instructions, and transmits audio data packets according to the configured time slot resources. It can flexibly allocate all audio transmission time slots in any sub-event without being limited by the fixed time domain position of the time slot corresponding to each second device or third device, and without being limited by the use of each audio transmission time slot for audio input or audio output. This enables the first device to have the ability to scientifically and reasonably configure time slot resources according to different communication conditions, thereby improving the link efficiency and transmission reliability of the wireless audio data transmission system.

[0151] For example, see Fig. 9 , Fig. 9A wireless audio data transmission system (or: Almighty Multiple Input Multiple Output (AMIMO) wireless audio system) is shown. The AMIMO system includes a master device (equivalent to a first device) and multiple slave devices. The master device wirelessly communicates with the multiple slave devices in continuous equal time intervals based on multiple communication links, and the multiple slave devices include a wireless audio input device (equivalent to a second device) and a wireless audio output device (equivalent to a third device).

[0152] Exemplarily, the master device can be a smart phone, a personal computer, a tablet computer, a smart TV, an audio entertainment device, a wireless game console, a smart gateway or other electronic device; the audio input slave device can be a wireless microphone, a wireless audio source device or a musical instrument or other electronic device; the audio output slave device can be a wireless headset, a wireless speaker or other electronic device; it should be noted that the audio input slave device and the audio output slave device can also be devices that support both wireless audio input and wireless audio output functions, such as earphones. For example, an AMIMO wireless audio system can be formed based on a smart phone as an AMIMO wireless audio gateway device, two independent wireless microphones as wireless audio input devices, and two independent wireless mono headphones consisting of TWS headphones as wireless audio output devices.

[0153] The AMIMO system adopts a flexible isochronous stream (AIS) link protocol implemented based on the wireless audio data transmission method provided by the present disclosure, and a flexible isochronous group (AIG) link protocol consisting of at least two AIS links, and sets the time slots used for audio data transmission to be used for both receiving audio data packets and sending audio data packets, so as to realize flexible multiplexing of time slot resources between audio input slave devices and audio output slave devices, and improve the ability of multiple audio input links and multiple audio output links to adapt to changes in wireless channels

[0154] The AMIMO wireless audio gateway device is connected to each wireless audio input device or wireless audio output device through a flexible isochronous stream link and transmits audio data. The AIS link established between the AMIMO wireless audio gateway device and all wireless audio input devices or wireless audio output devices constitutes a flexible isochronous group link. The AMIMO wireless audio gateway device can be called an AIS master device, an AIG master device, or an AMIMO master device, and all wireless audio input devices or wireless audio output devices can be called AIS slave devices, AIG slave devices, or AMIMO slave devices.

[0155] In some specific embodiments, as described in the aforementioned embodiments, a sub-event also includes an instruction transmission time slot for the first device to send instructions, and the sending of the time slot resource allocation instruction includes: sending a first data packet in the instruction transmission time slot, and the first data packet carries the time slot resource allocation instruction.

[0156] The first device may configure corresponding audio transmission time slots for one or more target devices among the multiple second devices and the third devices respectively within a sub-event interval, and indicate the configuration status through the first data packet.

[0157] After receiving the first data packet, the target device may select the allocated audio transmission time slot in the first sub-event according to the time slot resource allocation instruction, and send the second audio data packet or receive the third audio data packet based on the respective corresponding communication links.

[0158] Among them, the execution process of step 103 can be understood as: the first device can perform corresponding audio data transmission in the audio transmission time slot of the first sub-event in sequence according to the result of the time slot resource allocation. Exemplarily, when the first audio transmission time slot corresponds to a target second device, the second audio data packet sent by the target second device is received in the first audio transmission time slot. If the reception is successful, it is no longer received in the subsequent audio transmission time slot corresponding to the target second device. When the second audio transmission time slot corresponds to a target third device, the third audio data packet corresponding to the target third device is sent in the second audio transmission time slot. If there is an audio transmission time slot corresponding to the target third device later, the first device can send the third audio data packet corresponding to the target third device again.

[0159] In some embodiments, in order to improve the transmission reliability of the audio data packet sent by the first device, a sub-event also includes K confirmation time slots for transmitting confirmation information, where K is a positive integer. The method also includes:

[0160] configuring an instruction requiring reply confirmation information for one or more target third devices among the M2 target third devices, and sending the instruction requiring reply confirmation information based on the first data packet;

[0161] In the K confirmation time slots, confirmation data packets sent by the target third device that is required to reply with confirmation information are received in sequence.

[0162] As a specific implementation, the number of confirmation time slots K can be set equal to the number of audio transmission time slots. Because each audio transmission time slot may be used to send the third audio data packet in one sub-event. Therefore, each audio transmission time slot corresponds to a confirmation time slot, which can ensure that confirmation information can be received in time after each third audio data packet is sent.

[0163] As another specific implementation, in order to save time slot resources, the number of confirmation time slots K can be set to be smaller than the number of audio transmission time slots. When configuring the instruction requiring the reply of confirmation information, one or more target third devices among the M2 target third devices can be selected according to the number of confirmation time slots, and the instruction requiring the reply of confirmation information can be required; in addition, the target third device requiring the reply of confirmation information in the next sub-event can be selected according to the situation of the target third device requiring the reply of confirmation information selected in the previous sub-event. In short, it can be configured according to the specific application scenario, and this application does not make specific limitations on this.

[0164] In some specific embodiments, the first data packet carries a batch resource allocation table and a confirmation information mapping table.

[0165] A batch resource allocation table, used to carry the time slot resource allocation instruction, including multiple groups of parameters, each group of parameters including a first sub-parameter, a second sub-parameter, a third sub-parameter and a fourth sub-parameter, the first sub-parameter is used to indicate whether an audio transmission time slot is enabled, the second sub-parameter is used to indicate the parameter of the serial number of the communication link corresponding to the audio transmission time slot, the third sub-parameter is used to indicate the serial number of the audio data packet transmitted in the audio transmission time slot; the fourth sub-parameter is used to indicate the transmission direction of the audio data, the transmission direction of the audio data includes an audio output direction and an audio input direction, the audio output direction is for the first device to send audio data, and the audio input direction is for the first device to receive audio data.

[0166] The confirmation information mapping table is used to carry instructions requiring reply of confirmation information, wherein one bit corresponds to a communication link, and the bit value is used to indicate that the corresponding communication link replies to the confirmation information.

[0167] In some specific embodiments, the first audio data packet and the second audio data packet carry the following sub-parameters:

[0168] A fifth sub-parameter is used to indicate a transmission direction of audio data; the transmission direction of the audio data includes an audio output direction and an audio input direction, the audio output direction is for the first device to send audio data, and the audio input direction is for the first device to receive audio data;

[0169] The sixth sub-parameter is used to indicate the sequence number of the communication link corresponding to the audio data packet;

[0170] The seventh sub-parameter is used to indicate the data packet sequence number corresponding to the audio data packet.

[0171] It can be understood that many aspects of this embodiment can adopt the same description as in the previous embodiments and obtain similar effects. For example, the configuration and communication of the first device of this embodiment with respect to the second device, and the communication of the second device with respect to the first device, can be the same as or similar to those in the previous embodiments. For the sake of simplicity, they will not be repeated here.

[0172] This embodiment provides a wireless audio data transmission method, which is applied to a third device, wherein the third device communicates with the first device in continuous equal time intervals based on a communication link, wherein one equal time interval includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission; the method includes:

[0173] Based on the communication link, receiving a time slot resource allocation instruction sent by the first device; the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event;

[0174] Based on the time slot resource allocation instruction, when confirming that the third device is the target device, receiving a first audio data packet sent by the first device in a corresponding audio transmission time slot in the first sub-event;

[0175] The first sub-event is any sub-event within the current equal time interval.

[0176] In some specific embodiments, a sub-event also includes K confirmation time slots for transmitting confirmation information, where K is a positive integer.

[0177] The method further comprises:

[0178] Obtaining an instruction configured by the first device for one or more target third devices among the target third devices requiring reply confirmation information;

[0179] When the third device is the target third device that the first device requires to reply confirmation information, based on a predetermined rule, a confirmation data packet is sent within the K confirmation time slots.

[0180] Exemplarily, the first device may send the instruction requiring reply confirmation information based on the first data packet, and the third device may obtain the instruction after receiving the first data packet.

[0181] When the third device confirms that it is designated by the first device to reply confirmation information, it can generate a confirmation data packet according to the situation of receiving the first audio data packet, for example, generate an ACK confirmation packet when it is received correctly, and generate a NACK confirmation packet when it is not received correctly.

[0182] The third device may send the confirmation data packet within the K confirmation time slots according to a predetermined rule. There may be multiple predetermined rules. Exemplarily, the first device may simultaneously indicate the confirmation time slots that the target third device can use to reply to the confirmation information in the instruction requiring the reply of the confirmation information. Exemplarily, the third device may select confirmation time slots of the same order from the K confirmation time slots according to the order of all target third devices requiring the reply of the confirmation information indicated by the first device. For example, the first device instructs the third devices 1, 3, and 5 to reply to the confirmation information, and the third device 3 selects the second confirmation time slot to send the confirmation data packet. When the first device instructs the third devices 1, 2, and 3 to reply to the confirmation information, the third device 3 selects the third confirmation time slot to send the confirmation data packet.

[0183] It is understandable that when the third device determines that the present device is not the target third device based on the time slot resource allocation instruction, the third device will not receive the first audio data packet sent by the first device in the first sub-event. When it is determined that the present device is not required to reply to the confirmation information, it will not send the confirmation data packet in the first sub-event. Therefore, based on the wireless audio data transmission method of this embodiment, the function of selective audio sending / receiving can be realized, and the function of selective feedback confirmation information can also be realized.

[0184] The following combination Fig. 9 A typical application example of this embodiment is described.

[0185] For example, in Fig. 9In the application scenario shown, two protocol data units (PDU: Protocol Data Unit) can be defined: one is flexible isochronous stream management (AISM: Agile Isochronous Stream Manager) PDU, and the other is flexible isochronous stream data (AISD: Agile Isochronous Stream Data) PDU; the AMIMO master device mainly uses AISM PDU as the first data packet to send the time slot resource allocation instruction or batch confirmation information, and the AMIMO master device and the AMIMO slave device use AISD PDU with audio load to transmit audio data to each other, and can also use AISD PDU without load to transmit confirmation information. The AISM PDU has the same structure as the BLE Broadcast Isochronous Stream (BIS) PDU but a different header format, that is, the BIS PDU with an extended header is used as the header of the AISM PDU. The AISD PDU has the same format as the BLE Connected Isochronous Stream (CIS) PDU but a different header format, that is, the CIS PDU with an extended header is used as the header of the AISD PDU.

[0186] For example, Fig.10 As shown, the AISM PDU header sets the 1-bit reserved field (Reserved for Future Use, RFU) to AISM based on the BIS PDU header, which is used to indicate that the AISM PDU is enabled; when the AISM field is assigned a value of 0, it indicates that the AISM PDU is not enabled, and when the AISM field is assigned a value of 1, it indicates that the AISM PDU is enabled.

[0187] Among them, when AISM PDU is not enabled, AISM PDU can be understood as BIS PDU;

[0188] When AISM PDU is enabled, the AISM PDU header will have a certain number of bytes added to it compared to the BIS PDU header, including one or more fields such as Num_AIS, ACK MT, SE_SN and BRAT. ;

[0189] Specifically, Num_AIS represents the number of AIS links currently established.

[0190] ACK MT is used to indicate a mapping table (Mapping Table, MT) of the AIS audio output link that is required to reply to the confirmation information (Acknowledgement, ACK), which is the aforementioned confirmation information mapping table, in which each bit corresponds to an AIS audio output link or a wireless audio output device connected to the AIS link. For example, the bits from low to high correspond to the AIS link sequence numbers (Sequence Number, SN) from low to high. A bit is set to 1 to indicate that the corresponding AIS link is required to reply to the confirmation information, and is set to 0 to indicate that the corresponding AIS link is not required to reply to the confirmation information.

[0191] SE_SN represents the sequence number of a sub-event (SE) within an AIG ISO Interval or the sequence number of an AISM PDU within an AIG ISO Interval.

[0192] BRAT stands for Block Resource Allocation Table (BRAT), which contains Num_RU of resource allocation units, and is used to allocate Num_RU of resource units (RU) or time slot resources to different AIS links in batches. The number of resource units Num_RU generally corresponds to the total number N of AMIMO slave devices, and may also be greater than or less than N.

[0193] The resource allocation unit with sequence number n in BRAT corresponds to the time slot resource with sequence number n, including an enable signal (EN_n), a transmission direction (Direction), a link sequence number AIS SN and a protocol data unit sequence number PDU SN, wherein EN_n can be understood as the aforementioned first sub-parameter, Direction can be understood as the aforementioned fourth sub-parameter, AIS SN can be understood as the aforementioned second sub-parameter, and PDU SN can be understood as the aforementioned third sub-parameter;

[0194] For example, EN_n is set to 1 to enable the time slot resource corresponding to sequence number n, and EN_n is set to 0 to disable the time slot resource corresponding to sequence number n.

[0195] When EN_n is set to 1, the transmission direction is set to 0 to represent the audio output direction, that is, the direction in which the AMIMO master device sends AISD PDU to the wireless audio output device (the transmission direction can also be set to 0 to represent the audio input direction, and the transmission direction is set to 1 to represent the audio output direction); the transmission direction (Direction) is set to 1 to represent the audio input direction, that is, the direction in which the wireless audio input device sends AISD PDU to the AMIMO master device;

[0196] When EN_n is set to 1, the AIS SN in the resource allocation unit with sequence number n indicates that the time slot resource with sequence number n is used for the AIS link with sequence number AIS SN to receive or send AISD PDU;

[0197] When EN_n is set to 1, the PDU SN in the resource allocation unit with sequence number n indicates that the time slot resource with sequence number n is used for the AIS link with sequence number AIS SN to send or receive the AISD PDU with sequence number PDU SN.

[0198] The functions and usage of other fields in the AISM PDU header are the same as those of the BIS PDU, including the logical link identifier (LLID) used to indicate the AISM PDU load type, the control subevent sequence number (CSSN), the control subevent transmission flag (CSTF), the length of the AISM PDU load (Length), and a 1-bit RFU.

[0199] For example, Fig.11 As shown, the AISD PDU header sets the 1-bit reserved field to AISM based on the BIS PDU header to indicate enabling the AISM PDU; when the AISM field is assigned a value of 0, it indicates that the AISM PDU is not enabled, and when the AISM field is assigned a value of 1, it indicates that the AISM PDU is enabled.

[0200] When AISD PDU is enabled, a certain number of bytes are added to the header of AISD PDU, including at least one or more fields such as Direction, AIS SN or PDU SN, wherein the Direction field can be understood as the aforementioned fifth sub-parameter, the AIS SN field can be understood as the aforementioned sixth sub-parameter, and the PDU SN field can be understood as the aforementioned seventh sub-parameter;

[0201] The Direction field represents the audio transmission direction. If Direction is set to 0, it represents the audio output direction, that is, the AMIMO master device sends AISD PDU to the wireless audio output device; if Direction is set to 1, it represents the audio input direction, that is, the wireless audio input device sends AISD PDU to the AMIMO master device;

[0202] The AIS SN field indicates the sequence number of the AIS link corresponding to the current AISD PDU;

[0203] The PDU SN field indicates the PDU sequence number corresponding to the current AISD PDU.

[0204] The meanings of other fields in the AISD PDU header are the same as those of the CIS PDU header. LLID (Logical Link Identifier) ​​is the logical link identifier, which is used to indicate the load type of the AISD PDU; NESN (Next Expected Sequence Number) is the next expected sequence number, and SN (Sequence Number) is the current sequence number; CIE (Close Isochronous Event) is the close isochronous event, indicating whether the isochronous event is ended; NPI (Null PDU Indicator) is the Null PDU identifier, which indicates whether the PDU is a CIS Data PDU (data PDU) or a CISNull PDU (empty PDU) in the CIS PDU, and indicates whether the PDU is an AISD Data PDU or an AISD Null PDU in the AISD PDU. The AISD Null PDU is used to carry confirmation information; Length indicates the load length of the AISD PDU.

[0205] It should be noted that for Fig. 9 For the AMIMO wireless audio system shown in the figure, the AIG link protocol can flexibly configure the number of audio input links and audio output links under the constraint of the total number of links. For example, when applied to an AMIMO wireless audio system composed of a mixture of wireless multi-microphones and wireless multi-channel playback devices, any number of wireless multi-microphones and any number of wireless multi-channel playback devices can be configured; and the AIG link protocol supports sharing of wireless time slot resources between all AIS links (that is, each time slot used for audio data transmission can be used to receive audio data packets and send audio data packets), which overcomes the shortcomings of BLE Audio's BIG and CIG protocols in that wireless time slot resources are fixedly allocated to each link, and can improve the ability of multiple audio input links and multiple audio output links to adapt to changes in wireless channels; in addition, for wireless multi-microphone application scenarios, the AMIMO master device uses AISM PDU to send batch resource allocation information to multiple wireless microphones, which can be regarded as a batch reply to confirmation information. This overcomes the shortcomings of the CIG protocol in which time slot resources are wasted by replying confirmation information to each wireless microphone separately, and can improve link efficiency.

[0206] The working principle of the AMIMO wireless audio transmission method is described in detail by taking a wireless game console audio system as a specific embodiment. It is assumed that the wireless game console audio system includes an AMIMO master device and four AMIMO slave devices.

[0207] The AMIMO master device is mainly a smartphone, but it can also be a personal computer, tablet computer, smart TV, etc.; the four AMIMO slave devices include two wireless audio input devices and two wireless audio output devices, corresponding to the TWS microphone composed of two mono wireless microphones and the TWS headset composed of two mono headsets.

[0208] The AMIMO master device is set to establish an AIS0 link with the left channel headphone (the corresponding AIS_SN is equal to 0), an AIS1 link with the right channel headphone (the corresponding AIS_SN is equal to 1), an AIS2 link with the left channel wireless microphone (the corresponding AIS_SN is equal to 2), and an AIS3 link with the right channel wireless microphone (the corresponding AIS_SN is equal to 3). The AIS0, AIS1, AIS2 and AIS3 links constitute AHIG.

[0209] make Fig.10 The AISM value of the AISM PDU header shown is 1, and the AISM PDU header increases by 6 bytes, namely 3 bits Num_AIS, 4 bits ACK MT, 9 bits SE_SN, and 32 bits BRAT.

[0210] make Fig.11 The AISD value of the AISD PDU header shown is 1, and the AISD PDU header is increased by 1 byte, including 1 bit Direction, 3 bits AIS SN, and 4 bits PDU SN.

[0211] In the above-mentioned wireless game console audio system, the sampling rate of the digital audio signal of each channel is 48kHz, and the number of quantization bits of each sampling point is 16; the digital audio signal of each channel is encoded using a low complexity communication codec (LC3), with a coding frame length of 10ms and a coding rate of 80kbps. After encoding, each frame of audio data is 100 bytes.

[0212] The wireless game console audio system based on the AIG protocol adopts the time slot structure as shown in Figure 12(a) / Figure 12(b), where the communication time is divided into 10ms equal time intervals (ISO Interval), and the starting point of each ISO interval is the starting point for sending the first AISM PDU.

[0213] Using the BLE 2Mbps transmission rate, an AISM PDU without a payload occupies 68us in the air, an AISD Data PDU containing 100 bytes of audio data occupies 448us in the air, and an AISD NULL PDU that only carries confirmation information and no payload occupies 48us in the air.

[0214] The interval between PDUs (T_MSS: Time of Minimum Slot Space) is 120us, that is, the interval between the last bit of the previous PDU and the first bit of the next PDU is 120us.

[0215] In each equal time interval, three subevents are included for sending and receiving AISM PDU and AISD PDU between the AMIMO master device and four AMIMO slave devices of the wireless gaming audio system.

[0216] Each Subevent includes the time when the AMIMO master device broadcasts an AISM PDU, the time when the AMIMO master device sends and receives 4 AISD Data PDUs to and from four AMIMO slave devices, and the time when the AMIMO slave device sends 2 AISD Data PDUs carrying confirmation information to the AMIMO master device. Therefore, the interval Sub_Interval between two Subevents is equal to 2.796ms.

[0217] The three Subevents occupy a total of 8.388ms. In each equal time interval, it also includes the time for the extended advertisement (ADV_EXT_IND) PDU sent by the AMIMO master device on the primary advertising channel, the auxiliary advertisement (AUX_ADV_IND) PDU sent on the secondary advertising channel, and the synchronization control (AUX_SYNC_CTR) PDU sent on the periodic advertising channel. In order to save time slot resources, these PDUs are sent in time-sharing, that is, they are sent in different equal time intervals, such as the XA time slot shown in Figure 12 (a) / Figure 12 (b), where XA represents the above three advertising PDUs. AUX_SYNC_CTR PDU carries link information AIGInfo similar to BIGInfo, which specifically includes AIG_Offset equal to 1.25ms, ISO_Interval equal to 10ms, Nun_AIS equal to 4, Num_RU equal to 4, NSE equal to 3, Sub_Interval equal to 2.796ms, Max_PDU1 equal to 0, Max_PDU2 equal to 100 bytes, ChM all bits are set to 1, PHY configuration is 1 (corresponding to BLE 2M PHY), and EventCount starts counting from 0.

[0218] In the example corresponding to Figure 12(a), within an equal time interval numbered k, the AMIMO master device first sends an AISM PDU numbered k in the first SE (sub-event), namely, AISM PDU k, wherein the payload length (Length) is 0, the AISM field of the extended packet header is assigned a value of 1, Num_AIS is equal to 4, indicating that 4 AIS links are connected, SE_SN is equal to 0, indicating that the SE sequence number is 0, the BRAT field contains 4 resource allocation units, and the enable signals EN_0, EN_1, EN_2 and EN_3 numbered from 0 to 3 are all assigned a value of 1.

[0219] The link numbers AIS SN corresponding to the resource allocation units numbered 0 to 3 are 0, 1, 2, and 3 respectively, and the number PDU SN of the AISD PDU is k (PDU SN can also be k-1, k-2, k-3, etc., representing the sending of AISD PDUs numbered k-1, k-2, and k-3 at equal time intervals.

[0220] The Direction of the resource allocation units numbered from 0 to 3 are 0, 0, 1, and 1 respectively, indicating that the AIS links with AIS SNs 0 and 1 are in the audio output direction, and the AIS links with AIS SNs 2 and 3 are in the audio input direction; bit 0 and bit 1 of the ACK MT are set to 1, and the other bits are 0, indicating that the AIS links with AIS SNs 0 and 1 in the audio output direction are required to reply with confirmation information.

[0221] After the AMIMO master device sends the AISM PDU k in the first SE, it first sends the AISD0 PDU k to the left channel headset connected to the AIS link with an AIS SN of 0, and then sends the AISD1 PDU k to the right channel headset connected to the AIS link with an AIS SN of 1 according to the resource allocation information of the BRAT; then, it first receives the AISD2 PDU k sent by the left channel wireless microphone connected to the AIS link with an AIS SN of 2, and then receives the AISD3 PDU k sent by the right channel wireless microphone connected to the AIS link with an AIS SN of 3; finally, it first receives the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel headset, and then receives the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel headset, wherein the NPI of ACK0 is set to 1, the Length is set to 0, the Direction is set to 0, the AIS SN is set to 0, and the PDU SN is set to k; the NPI of ACK1 is set to 1, the Length is set to 0, the Direction is set to 0, the AIS SN is set to 1, and the PDU SN is set to k. SN is set to k.

[0222] If the AISD0 PDU k sent by the AMIMO master device in the first SE is not correctly received by the left channel headphone, the AISD1 PDU k sent by the AMIMO master device is correctly received by the right channel headphone and the replied ACK1 is also correctly received by the AMIMO master device, the AISD2 PDU k sent by the left channel wireless microphone is correctly received by the AMIMO master device, but the AISD3 PDU k sent by the right channel wireless microphone is not correctly received by the AMIMO master device.

[0223] Then, the AMIMO master device can send the AISM PDU numbered k again in the second SE, that is, AISMPDU k, where SE_SN is equal to 1, and the enable signals EN_0, EN_1, EN_2 and EN_3 numbered from 0 to 3 in the BRAT are all assigned a value of 1; the link numbers AIS SN corresponding to the resource allocation units numbered from 0 to 3 are 3, 0, 3, 0 respectively (different links are arranged alternately, and can also be arranged as 0, 3, 0, 3), and the PDU numbers PDU SN are all k. The Direction of the resource allocation units numbered from 0 to 3 is 1, 0, 1, 0 respectively. Bit 0 of ACK MT is set to 1, and the other bit positions are 0, indicating that only the AIS link reply confirmation information of the audio output direction with AIS SN of 0 is required, that is, AISD0 PDU k and AISD3 PDU k are sent twice in the second SE.

[0224] After the AMIMO master device sends AISM PDU k in the second SE, it first receives the AISD3 PDU k sent by the right channel wireless microphone connected to the AIS link with AIS SN of 3, and then sends AISD0PDU k to the left channel headphone connected to the AIS link with AIS SN of 0 according to the resource allocation information of BRAT; then, if the AISD3 PDU k is not received correctly, it can receive the AISD3 PDU k sent by the right channel wireless microphone connected to the AIS link with AIS SN of 3 again, and send AISD0PDU k to the left channel headphone connected to the AIS link with AIS SN of 0 again; finally, receive the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel headphone, where the NPI of ACK0 is set to 1, Length is set to 0, Direction is set to 0, AIS SN is set to 0, and PDU SN is set to k.

[0225] If the AISD0 PDU k sent by the AMIMO master device in the second SE is correctly received by the left channel earphone and the replied ACK1 is also correctly received by the AMIMO master device, the AISD3 PDU k sent by the right channel wireless microphone is also correctly received by the AMIMO master device.

[0226] At this time, when the AMIMO master device can send the AISM PDU numbered k again in the third SE, SE_SN is equal to 2, and the enable signals EN_0, EN_1, EN_2 and EN_3 numbered 0 to 3 in the BRAT are all assigned to 0. After the AMIMO slave device receives the AISM PDU in the third SE, it ends the sending and receiving of the AISD PDU in the equal time interval numbered k.

[0227] It can be seen that within the two SEs, the AIS links numbered 1 and 2 used one transmission opportunity respectively, while the AIS links numbered 0 and 3 obtained three transmission opportunities respectively. This realizes the flexible configuration of time slot resources between different AIS links, improves the overall link efficiency, and improves the transmission reliability of the AIS links numbered 0 and 3.

[0228] In the example corresponding to Figure 12(b), within an equal time interval numbered k+1, the AMIMO master device first sends an AISM PDU numbered k in the first SE, i.e., AISM PDU k+1, wherein the payload length (Length) is 0, the AISM field of the extended packet header is assigned a value of 1, Num_AIS is equal to 4, indicating that 4 AIS links are connected, SE_SN is equal to 0, the BRAT field contains 4 resource allocation units, and the enable signals EN_0, EN_1, EN_2, and EN_3 numbered from 0 to 3 are all assigned a value of 1.

[0229] The link numbers AIS SN corresponding to the resource allocation units numbered 0 to 3 are 0, 1, 2, and 3 respectively. The PDU numbers PDU SN are all k+1. The Direction of the resource allocation units numbered 0 to 3 are 0, 0, 1, and 1 respectively, indicating that the AIS links with AIS SNs 0 and 1 are in the audio output direction, and the AIS links with AIS SNs 2 and 3 are in the audio input direction. Bit 0 and bit 1 of ACK MT are set to 1, and the other bit positions are 0, indicating that the AIS links in the audio output direction with AIS SNs 0 and 1 are required to reply with confirmation information.

[0230] After the AMIMO master device sends AISM PDU k+1 in the first SE, it first sends AISD0 PDU k+1 to the left channel headphone connected to the AIS link with AIS SN 0, and then sends AISD1 PDU k+1 to the right channel headphone connected to the AIS link with AISSN 1 according to the resource allocation information of BRAT.

[0231] Then, receive the AISD2 PDU k+1 sent by the left channel wireless microphone connected to the AIS link with the AIS SN of 2, and receive the AISD3 PDU k+1 sent by the right channel wireless microphone connected to the AIS link with the AIS SN of 3;.

[0232] Finally, receive the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel headphone and the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel headphone, where the NPI of ACK0 is set to 1, the Length is set to 0, the Direction is set to 0, the AIS SN is set to 0, and the PDU SN is set to k+1. The NPI of ACK1 is set to 1, the Length is set to 0, the Direction is set to 0, the AIS SN is set to 1, and the PDU SN is set to k+1.

[0233] If the AISD1 PDU k+1 sent by the AMIMO master device in the first SE is not correctly received by the right channel headphone, the AISD0 PDU k+1 sent by the AMIMO master device is correctly received by the left channel headphone and the replied ACK0 is also correctly received by the AMIMO master device, the AISD3 PDU k+1 sent by the right channel wireless microphone is correctly received by the AMIMO master device, but the AISD2 PDU k sent by the left channel wireless microphone is not correctly received by the AMIMO master device;.

[0234] Then, the AMIMO master device can send the AISM PDU numbered k+1 again in the second SE, that is, AISMPDU k+1, where SE_SN is equal to 1, and the enable signals EN_0, EN_1, EN_2 and EN_3 numbered 0 to 3 in the BRAT are all assigned a value of 1;.

[0235] The link numbers AIS SN corresponding to the resource allocation units numbered 0 to 3 are 2, 1, 2, and 1 respectively. The PDU numbers PDU SN are all k+1. The Direction of the resource allocation units numbered 0 to 3 are 1, 0, 1, and 0 respectively. Bit 1 of the ACK MT is set to 1, and the other bits are 0, indicating that the AIS link reply confirmation information for the audio output direction with AIS SN 1 is required, that is, AISD1 PDU k+1 and AISD2 PDU k+1 are sent twice in the second SE;.

[0236] After the AMIMO master device sends AISM PDU k+1 in the second SE, it first receives AISD2 PDU k+1 sent by the left channel wireless microphone connected to the AIS link with AIS SN 2 according to the resource allocation information of BRAT, and then sends AISD1 PDU k+1 to the right channel headphone connected to the AIS link with AIS SN 1;.

[0237] Then, if the AISD2 PDU k+1 is not received correctly, the AISD2 PDU k+1 sent by the left channel wireless microphone connected to the AIS link with AIS SN 2 can be received again, and the AISD1 PDU k+1 can be sent again to the right channel earphone connected to the AIS link with AIS SN 1;.

[0238] Finally, the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel headphone is received, wherein the NPI of ACK1 is set to 1, the Length is set to 0, the Direction is set to 0, the AIS SN is set to 0, and the PDU SN is set to k+1.

[0239] If the AISD1 PDU k+1 sent by the AMIMO master device in the second SE is correctly received by the right channel headphone and the replied ACK1 is also correctly received by the AMIMO master device, but the AISD2 PDU k+1 sent by the left channel wireless microphone is not correctly received by the AMIMO master device;.

[0240] Then, when the AMIMO master device can send the AISM PDU numbered k+1 again in the third SE, SE_SN is equal to 2, the enable signals EN_0, EN_1, EN_2 and EN_3 numbered from 0 to 3 in the BRAT are assigned values ​​of 1, 0, 1, 0 respectively, the link numbers AIS SN corresponding to the resource allocation units numbered 0 and 3 are both 2, and the PDU numbers PDU SN are both k+1. The Direction of the resource allocation units numbered 0 and 3 is both 1, and all bit positions of the ACK MT are 0, that is, AISD2 PDU k+1 is sent twice in the third SE;.

[0241] After the AMIMO master device sends AISM PDU k+1 in the third SE, it only receives AISD2 PDU k+1 sent by the left channel wireless microphone connected to the AIS link with AIS SN 2 according to the resource allocation information of BRAT. If it is not received correctly the first time, it can be received the second time. It can be seen that in the three SEs, the AIS links numbered 0 and 3 used one sending opportunity respectively, while the AIS link numbered 1 obtained 3 sending opportunities and the AIS link numbered 2 obtained 5 sending opportunities.

[0242] Furthermore, in the third SE, four time slot resources may be allocated to the AIS link numbered 2, so that the AIS link numbered 2 may obtain a maximum of 7 transmission opportunities.

[0243] Based on the example corresponding to FIG. 12( a ) and the example corresponding to FIG. 12( b ), it can be seen that by flexibly configuring time slot resources between different AIS links, links with poor communication performance can naturally obtain more time slot resources or transmission opportunities, thereby improving the transmission reliability of the links.

[0244] It should be noted that for the example corresponding to Figure 12(a) and the example corresponding to Figure 12(b), if any of AISD1 PDU k+1, AISD2 PDU k+1, AISD3 PDU k+1, and AISD4 PDU k+1 is not successfully and correctly transmitted in the equal time interval numbered k+1, it can also be repeatedly transmitted in the equal time intervals numbered k+2, K+3, ... until the flush time (FT) times out, wherein the PDU SN remains unchanged. FT=1 means that it is only sent in the current equal time interval and will not be retransmitted in the next equal time interval; FT=2 means that it can be retransmitted in two consecutive equal time intervals; the larger the FT, the higher the transmission reliability, but the greater the transmission delay; in order to make the transmission delay as low as possible in actual application, FT=1 can be set.

[0245] According to the above typical embodiments, it can be seen that in this embodiment, the time slot used for audio data transmission is set to be used for both receiving audio data packets and sending audio data packets, so as to realize flexible multiplexing of time slot resources between the audio input slave device and the audio output slave device, and improve the ability of multiple audio input links and multiple audio output links to adapt to changes in wireless channels; it is set to be able to support flexible adjustment of the time slot resources of the audio input slave device and / or audio output slave device where the audio transmission fails in a subsequent sub-event when the audio input slave device and / or the audio output slave device fails in audio transmission in a certain sub-event, so as to increase the probability that the audio input slave device and / or the audio output slave device successfully completes the audio transmission action in the subsequent sub-event, thereby avoiding the defects caused by the fixed configuration of time slot resources in the related technology, and improving the link efficiency and transmission reliability of the MIMO wireless audio system when transmitting audio data streams.

[0246] It should be noted that the multiple optional implementations of the multiple embodiments introduced in the present disclosure can be implemented in combination with each other or can be implemented separately if they do not conflict with each other, and the present disclosure does not limit this.

[0247] The embodiment of the present disclosure also provides an electronic device, the electronic device includes a baseband data and protocol processor and a radio frequency transceiver module. The baseband data and protocol processor is used to implement the wireless audio data transmission method described in the embodiment of the present disclosure, and the radio frequency transceiver module is used to perform the transmission and reception of the wireless communication signal. The electronic device can be used to implement the first device, the second device, and the third device in the embodiment of the present disclosure.

[0248] See also Fig.13 ,when Fig.13 When the electronic device shown is the second device, that is, the structure of a wireless audio input device (e.g., a wireless microphone), it may include a user interface, an audio input unit, an audio processing unit, a baseband data and protocol processor, and a BLE radio frequency transceiver module.

[0249] The audio input unit obtains the digital audio signal and transmits it to the audio processing unit; the audio processing unit compresses and encodes the digital audio signal into audio data using LC3; the baseband data and protocol processor executes the BLE protocol related to BLE Audio and the aforementioned wireless audio data transmission method, and processes the audio data into a second audio data packet suitable for sending by the BLE RF transceiver module; the BLE RF transceiver module is used for BLE wireless signal or PDU transceiver; the BLE RF transceiver module can also support BLE high-speed physical layer technology, for example, 4Mbps, 6Mbps, 8Mbps, etc.

[0250] The user interface may be a button, a touch pad, a wireless control interface, etc.

[0251] when Fig.13 When the electronic device shown is the second device, that is, the structure of a wireless audio output device (wireless mono headset), it can also include a user interface, an audio output unit, an audio processing unit, a baseband data and protocol processor, and a BLE radio frequency transceiver module.

[0252] At this time, the baseband data and protocol processor executes the BLE protocol related to BLE Audio and the aforementioned wireless audio data transmission method, processes the first audio data packet received by the BLE RF transceiver module, and sends it to the audio processing unit; the audio processing unit is used for LC3 audio decoding, packet loss processing, equalization and sound effects and other post-processing; the audio output unit is used to convert the audio signal into a sound signal; the BLE RF transceiver module is used for BLE wireless signal or various PDU transceiver, and the BLE RF transceiver module can also support BLE high-speed physical layer technology, such as 4Mbps, 6Mbps, 8Mbps, etc.;

[0253] The user interface can be buttons, touch pads, wireless control interfaces, etc.

[0254] when Fig.13 When the electronic device shown is the first device, that is, the structure of the main device, it may also include a user interface, an audio input unit, an audio output unit, an audio processing unit, a baseband data and protocol processor, and a BLE radio frequency transceiver module.

[0255] At this time, the audio input unit obtains the digital audio signal and transmits it to the audio processing unit, and the audio processing unit compresses and encodes the digital audio signal into audio data using LC3;

[0256] The baseband data and protocol processor executes the BLE protocol related to BLE Audio and the aforementioned wireless audio data transmission method, and processes the audio data into a first audio data packet suitable for transmission by the BLE radio frequency transceiver module;

[0257] The baseband data and protocol processor also executes the BLE protocol related to BLE Audio and the aforementioned wireless audio data transmission method, processes the second audio data packet received by the BLE radio frequency transceiver module, and sends it to the audio processing unit;

[0258] The audio processing unit is used for post-processing such as LC3 audio decoding, packet loss processing, equalization and sound effects;

[0259] The audio output unit is used to convert the audio signal into a sound signal;

[0260] The BLE radio frequency transceiver module is used for BLE wireless signal or PDU transmission and reception. The BLE radio frequency transceiver module can also support BLE high-speed physical layer technology, such as 4Mbps, 6Mbps, 8Mbps, etc.;

[0261] The user interface can be buttons, touch pads, wireless control interfaces, etc.

[0262] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device.

[0263] Fig.14 A schematic block diagram of an example electronic device 1200 that can be used to implement an embodiment of the present disclosure is shown. The electronic device can be implemented as various forms of integrated circuits, chips, devices, equipment, etc. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0264] like Fig.14As shown, the device 1200 includes a computing unit 1201, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1202 or a computer program loaded from a storage unit 1208 to a random access memory (RAM) 1203. In the RAM 1203, various programs and data required for the operation of the device 1200 can also be stored. The computing unit 1201, the ROM 1202, and the RAM 1203 are connected to each other via a bus 1204. An input / output (I / O) interface 1205 is also connected to the bus 1204.

[0265] A number of components in the device 1200 are connected to the I / O interface 1205, including: an input unit 1206, such as a keyboard, a mouse, etc.; an output unit 1207, such as various types of displays, speakers, etc.; a storage unit 1208, such as a disk, an optical disk, etc.; and a communication unit 1209, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1209 allows the device 1200 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0266] The computing unit 1201 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1201 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSP), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1201 performs the various methods and processes described above, such as wireless audio data transmission methods. For example, in some embodiments, the wireless audio data transmission method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1208. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1200 via the ROM 1202 and / or the communication unit 1209. When the computer program is loaded into the RAM 1203 and executed by the computing unit 1201, one or more steps of the wireless audio data transmission method described above may be performed. Alternatively, in other embodiments, the computing unit 1201 may be configured to execute the wireless audio data transmission method in any other appropriate manner (eg, by means of firmware).

[0267] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0268] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0269] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0270] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0271] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A wireless audio data transmission method, applied to a first device, wherein the first device communicates with N1 second devices respectively in consecutive equal time intervals based on N1 communication links, wherein one of the equal time intervals includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for Bluetooth low energy audio data transmission; characterized in that: The method comprises: A time slot resource allocation instruction is configured, wherein the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event; the target device includes M1 target second devices among the N1 second devices; when allocating audio transmission time slots, all audio transmission time slots in the first sub-event are used as candidate audio transmission time slots for the M1 target second devices; Sending the time slot resource allocation instruction, wherein the time slot resource allocation instruction is sent to the N1 second devices based on N1 communication links; Performing audio data transmission in the first sub-event, wherein, in the audio transmission time slot of the first sub-event, receiving a second audio data packet sent by the target second device based on the target second device and the corresponding communication link corresponding to the audio transmission time slot; The first sub-event is any sub-event within the current equal time interval; Both N1 and M1 are natural numbers, and M1≤N1.

2. The method as described in 1, characterized in that Each of the audio transmission time slots can be used by the first device to receive audio data and send audio data; The first device also communicates with N2 third devices respectively within the equal time interval based on N2 communication links; The target device also includes M2 target third devices among the N2 third devices; when allocating audio transmission time slots, all audio transmission time slots in the first sub-event are also used as candidate audio transmission time slots for the M2 target third devices; Sending the time slot resource allocation instruction further includes sending the time slot resource allocation instruction to the N2 third devices based on the N2 communication links; The performing audio data transmission in the first sub-event further includes, in the audio transmission time slots of the first sub-event, based on the target third devices respectively corresponding to the respective audio transmission time slots, sending a first audio data packet to the corresponding target third device on the corresponding communication link; N2 and M2 are both natural numbers, and N1+N2≥2, M2≤N2.

3. The method according to 1 or 2, characterized in that: The allocating a corresponding audio transmission time slot in the first sub-event to the target device includes: When the number of the target devices is equal to the number of the audio transmission time slots in the first sub-event, one target device corresponds to one audio transmission time slot; When the number of the target devices is less than the number of the audio transmission time slots in the first sub-event, one target device corresponds to at least one audio transmission time slot, and at least some of the target devices correspond to multiple audio transmission time slots.

4. The method according to claim 3, characterized in that The allocating corresponding audio transmission time slots in the first sub-event to the target device also includes: ensuring that there is at least one target device whose time slot distribution of the corresponding audio transmission time slots in the first sub-event is different from that of the corresponding audio transmission time slots in the second sub-event, The second sub-event is a sub-event that occurs later than the first sub-event, and the second sub-event and the first sub-event are located within the same equal time interval.

5. The method according to claim 3, characterized in that A sub-event also includes a command transmission time slot for the first device to send a command, The sending of the time slot resource allocation instruction includes: sending a first data packet in the instruction transmission time slot, wherein the first data packet carries the time slot resource allocation instruction.

6. The method as claimed in claim 5, characterized in that A sub-event also includes K confirmation slots for transmitting confirmation information. The method further comprises: configuring an instruction requiring reply confirmation information for one or more target third devices among the M2 target third devices, and sending the instruction requiring reply confirmation information based on the first data packet; receiving, in the K confirmation time slots, confirmation data packets sent by the target third device that is required to reply confirmation information; K is a positive integer.

7. The method according to claim 5, characterized in that The first data packet carries one or more of the following information: a batch resource allocation table, used to carry the time slot resource allocation instruction, including multiple groups of parameters, each group of parameters including a first sub-parameter, a second sub-parameter and a third sub-parameter, the first sub-parameter is used to indicate whether an audio transmission time slot is enabled, the second sub-parameter is used to indicate a parameter of a sequence number of a communication link corresponding to the audio transmission time slot, and the third sub-parameter is used to indicate a sequence number of an audio data packet transmitted in the audio transmission time slot; The confirmation information mapping table is used to carry instructions requiring reply of confirmation information, wherein one bit corresponds to a communication link, and the bit value is used to indicate that the corresponding communication link replies to the confirmation information.

8. The method according to claim 7, characterized in that Each group of parameters in the batch resource allocation table also includes a fourth sub-parameter, The fourth sub-parameter is used to indicate the transmission direction of the audio data. The transmission direction of the audio data includes an audio output direction and an audio input direction. The audio output direction is for the first device to send audio data, and the audio input direction is for the first device to receive audio data.

9. The method according to claim 5, characterized in that The first audio data packet and / or the second audio data packet carries at least one of the following sub-parameters: A fifth sub-parameter is used to indicate a transmission direction of audio data; the transmission direction of the audio data includes an audio output direction and an audio input direction, the audio output direction is for the first device to send audio data, and the audio input direction is for the first device to receive audio data; The sixth sub-parameter is used to indicate the sequence number of the communication link corresponding to the audio data packet; The seventh sub-parameter is used to indicate the data packet sequence number corresponding to the audio data packet.

10. The method according to claim 1 or 2, characterized in that: The method further includes, after successfully completing the audio data transmission with a target device in a sub-event of the current equal time interval, prohibiting the audio data transmission with the target device in the remaining sub-events of the current equal time interval.

11. A wireless audio data transmission method, applied to a second device, wherein the second device communicates with a first device in continuous equal time intervals based on a communication link, wherein one equal time interval includes a plurality of sub-events, and one sub-event includes a plurality of audio transmission time slots for performing Bluetooth low energy audio data transmission; characterized in that: The method comprises: Based on the communication link, receiving a time slot resource allocation instruction sent by the first device; the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event; Based on the time slot resource allocation instruction, when confirming that the second device is the target device, sending a second audio data packet to the first device in a corresponding audio transmission time slot in the first sub-event; The first sub-event is any sub-event within the current equal time interval.

12. A wireless audio data transmission method, applied to a third device, wherein the third device communicates with the first device in continuous equal time intervals based on a communication link, wherein one equal time interval includes multiple sub-events, and one sub-event includes multiple audio transmission time slots for performing Bluetooth low energy audio data transmission; characterized in that: The method comprises: Based on the communication link, receiving a time slot resource allocation instruction sent by the first device; the time slot resource allocation instruction is used to allocate a corresponding audio transmission time slot in the first sub-event to a target device that needs to perform audio data transmission in the first sub-event; Based on the time slot resource allocation instruction, when confirming that the third device is the target device, receiving a first audio data packet sent by the first device in a corresponding audio transmission time slot in the first sub-event; The first sub-event is any sub-event within the current equal time interval.

13. The method according to claim 12, characterized in that A sub-event also includes K confirmation slots for transmitting confirmation information. The method further comprises: Obtaining an instruction configured by the first device for one or more target third devices among the target third devices requiring reply confirmation information; When the third device is the target third device to which the first device requires to reply confirmation information, based on a predetermined rule, sends a confirmation data packet within the K confirmation time slots; K is a positive integer.

14. An electronic device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the wireless audio data transmission method according to any one of claims 1 to 13 by executing the computer instructions.

Images