Wireless audio data transmission method and related equipment

Abstract

The invention provides a wireless audio data transmission method and related equipment, relates to the technical field of wireless audios, and is applied to central equipment which comprises an application, a main processor, a main control element and at least one auxiliary control element. The central device wirelessly communicates with N peripheral devices in a mixed domain based on N communication links, the N peripheral devices comprise an audio input device and / or an audio output device, the mixed domain at least comprises a time domain and a frequency domain, and N is an integer greater than or equal to 2. Based on the setting of a main control element and at least one auxiliary control element, transmission resources can be expanded from a single time domain to a mixed domain comprising a time domain and a frequency domain when central equipment transmits audio with peripheral equipment, and a more flexible resource scheduling strategy is supported, so that the link efficiency during audio data stream transmission is improved, and the user experience is improved. And more effective bandwidths are provided for audio transmission, and the transmission reliability is correspondingly improved.

Description

Technical Field

[0001] The present application relates to the technical field of wireless audio, and in particular to a wireless audio data transmission method and related equipment. Background Art

[0002] In Bluetooth Low Energy (BLE) audio applications, the prior art uses a synchronous isochronous channel (Isochronous Channels) protocol, namely a connected isochronous stream (CIS) link for point-to-point communication and a connected isochronous group (CIG) protocol consisting of multiple CIS links, as well as a broadcast isochronous stream (BIS) link for point-to-multipoint communication and a broadcast isochronous group (BIG) protocol consisting of multiple BIS links, to provide users with wireless audio services; for example, a multiple input multiple output (MIMO) wireless audio system consisting of wireless multi-microphones and wireless multi-channel audio devices, implemented using a hybrid CIG link consisting of multiple unidirectional or bidirectional CIS links.

[0003] It is found in applications that the transmission bandwidth of a MIMO wireless audio system implemented by multiple bidirectional CIS links or multiple unidirectional CIS links is relatively limited. Summary of the invention

[0004] The purpose of the present application is to provide a wireless audio data transmission method and related equipment, which are used to solve the technical problem of insufficient transmission bandwidth when transmitting audio data streams in a MIMO wireless audio system in the prior art.

[0005] In a first aspect, an embodiment of the present application provides a wireless audio data transmission method, which is applied to a central device, wherein the central device includes: an application and a main processor, a main control component, and at least one sub-control component;

[0006] The central device wirelessly communicates with N peripheral devices in a hybrid domain based on N communication links, respectively, wherein the N peripheral devices include an audio input device and / or an audio output device, the hybrid domain includes at least a time domain and a frequency domain, and N is an integer greater than or equal to 2;

[0007] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit an audio data packet with any one of the N peripheral devices;

[0008] The method comprises:

[0009] During a control transmission period of a target secondary event, the main control component and / or the secondary control component are enabled to send a same control data packet to the N peripheral devices, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, a resource unit allocated to each target peripheral device in the target secondary event, wherein the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events;

[0010] During the audio transmission period of the target secondary event, based on the resource configuration information, the main control component and / or the sub-control component are enabled to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit.

[0011] In a second aspect, an embodiment of the present application provides a wireless audio data transmission method, which is applied to a peripheral device, wherein the peripheral device wirelessly communicates with a central device in a hybrid domain based on a communication link, wherein the hybrid domain includes at least a time domain and a frequency domain, and the peripheral device is an audio input device or an audio output device;

[0012] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with the central device;

[0013] The method comprises:

[0014] receiving a control data packet sent by the central device within a control transmission period of a target secondary event, the control data packet carrying resource configuration information, and in the case where the peripheral device is allowed to send / receive a corresponding audio data packet based on the communication link within the target secondary event, the resource configuration information is used to indicate: a resource unit allocated to the peripheral device in the target secondary event;

[0015] During the audio transmission period of the target secondary event, the corresponding audio data packet is transmitted with the central device in the corresponding resource unit based on the resource configuration information.

[0016] In a third aspect, an embodiment of the present application provides a wireless audio data transmission system, the system comprising:

[0017] N peripheral devices and one central device, N being an integer greater than or equal to 2, the central device comprising: an application and a main processor, a main control component, and at least one secondary control component;

[0018] The central device wirelessly communicates with the N peripheral devices in a hybrid domain based on N communication links, respectively, wherein the N peripheral devices include an audio input device and / or an audio output device, and the hybrid domain includes at least a time domain and a frequency domain;

[0019] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used for the central device to transmit audio data packets with any one of the N peripheral devices;

[0020] The central device is used for:

[0021] During a control transmission period of a target secondary event, the main control component and / or the secondary control component are enabled to send a same control data packet to the N peripheral devices, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, a resource unit allocated to each target peripheral device in the target secondary event, wherein the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events;

[0022] During the audio transmission period of the target secondary event, based on the resource configuration information, the main control component and / or the sub-control component are enabled to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit.

[0023] In a fourth aspect, an embodiment of the present application provides a wireless audio data transmission device, which is applied to a central device, wherein the central device includes: an application and a main processor, a main control component, and at least one sub-control component;

[0024] The central device wirelessly communicates with N peripheral devices in a hybrid domain based on N communication links, respectively, wherein the N peripheral devices include an audio input device and / or an audio output device, the hybrid domain includes at least a time domain and a frequency domain, and N is an integer greater than or equal to 2;

[0025] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit an audio data packet with any one of the N peripheral devices;

[0026] The device comprises:

[0027] a control packet first transmission module, used for enabling the main control component and / or the sub-control component to send the same control data packet to the N peripheral devices within the control transmission period of the target secondary event, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, the resource unit allocated to each target peripheral device in the target secondary event, the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events;

[0028] The first audio packet transmission module is used to enable the main control component and / or the sub-control component to transmit the corresponding audio data packet with each target peripheral device in the corresponding resource unit based on the resource configuration information during the audio transmission period of the target secondary event.

[0029] In a fifth aspect, an embodiment of the present application provides a wireless audio data transmission device, which is applied to a peripheral device, wherein the peripheral device wirelessly communicates with a central device in a hybrid domain based on a communication link, wherein the hybrid domain includes at least a time domain and a frequency domain, and the peripheral device is an audio input device or an audio output device;

[0030] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with the central device;

[0031] The device comprises:

[0032] A control packet second transmission module, used for receiving a control data packet sent by the central device within a control transmission period of a target secondary event, wherein the control data packet carries resource configuration information, and when the peripheral device is allowed to send / receive a corresponding audio data packet based on the communication link within the target secondary event, the resource configuration information is used to indicate: a resource unit allocated to the peripheral device in the target secondary event;

[0033] The second audio packet transmission module is used to transmit the corresponding audio data packet in the corresponding resource unit with the central device based on the resource configuration information during the audio transmission period of the target secondary event.

[0034] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the wireless audio data transmission method as described in the first aspect or the second aspect.

[0035] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the wireless audio data transmission method as described in the first aspect or the second aspect are implemented.

[0036] In an eighth aspect, an embodiment of the present application provides a computer program product, comprising computer instructions, which, when executed by a processor, implement the steps of the wireless audio data transmission method as described in the first aspect or the second aspect.

[0037] The present application sets a main control component and at least one sub-control component in a MIMO wireless audio system to support a central device to expand the transmission resources used for receiving or sending packets from a single time domain to a mixed domain including time domain and frequency domain when transmitting audio data packets with peripheral devices, and supports more flexible resource scheduling strategies, which can not only improve the link efficiency of the MIMO wireless audio system when transmitting audio data streams, but also provide more effective bandwidth for audio transmission, and correspondingly improve the transmission reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 It is a flowchart of a wireless audio data transmission method provided by an embodiment of the present application;

[0039] Figure 2 It is a structural schematic diagram of a central device provided in an embodiment of the present application;

[0040] Figure 3 is a structural diagram of another central device provided in an embodiment of the present application;

[0041] Figure 4 is a schematic diagram of an extended packet header of an HD-AISM PDU provided in an embodiment of the present application;

[0042] Figure 5 is a schematic diagram of an extended packet header of an HD-AISD PDU provided in an embodiment of the present application;

[0043] Figure 6 is a schematic diagram of a data packet corresponding to a synchronization control process provided by an embodiment of the present application;

[0044] Figure 7 for Figure 6 A schematic diagram of an extended header of a data packet shown;

[0045] Figure 8 is a schematic diagram of HD-AIG link information provided by an embodiment of the present application;

[0046] Fig. 9 is a schematic diagram of a control command provided in an embodiment of the present application;

[0047] FIG10(1) is a schematic diagram of control data for random access of HD-AIS provided in an embodiment of the present application;

[0048] FIG10(2) is a schematic diagram of control data of an HD-AIS access request provided in an embodiment of the present application;

[0049] FIG10(3) is a schematic diagram of control data of an HD-AIS access permission provided in an embodiment of the present application;

[0050] FIG10(4) is a schematic diagram of control data for HD-AIS termination provided in an embodiment of the present application;

[0051] Fig.11 A flowchart of another wireless audio data transmission method provided by an embodiment of the present application;

[0052] Fig.12 is a schematic diagram of a peripheral device access process provided by an embodiment of the present application;

[0053] Fig.13 It is a structural schematic diagram of a wireless audio data transmission system provided in an embodiment of the present application;

[0054] FIG14( a ) is a schematic diagram of a time slot structure provided in an embodiment of the present application;

[0055] FIG14( b ) is a schematic diagram of another time slot structure provided in an embodiment of the present application;

[0056] Fig.15 It is a structural schematic diagram of a wireless audio data transmission device provided in an embodiment of the present application;

[0057] Fig.16 is a schematic structural diagram of another wireless audio data transmission device provided in an embodiment of the present application;

[0058] Fig.17 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0059] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0060] An embodiment of the present application provides a wireless audio data transmission method, which is applied to a central device. The central device includes: an application and a main processor, a main control component, and at least one sub-control component.

[0061] The central device wirelessly communicates with N peripheral devices in a hybrid domain based on N communication links, wherein the N peripheral devices include an audio input device and / or an audio output device. The hybrid domain includes at least a time domain and a frequency domain, and N is an integer greater than or equal to 2.

[0062] The time domain included in the mixed domain is divided into multiple sub-events (SE), each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes multiple resource units, different resource units correspond to different time slots in the time domain and / or different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with any one of the N peripheral devices.

[0063] Exemplarily, the mixed domain may also include a spatial domain, a code domain, and the like.

[0064] For example, if two different resource units are set as resource unit A and resource unit B, then:

[0065] The time slot corresponding to resource unit A in the time domain is time slot 1, the time slot corresponding to resource unit B in the time domain is time slot 2, and resource unit A and resource unit B correspond to the same frequency channel in the frequency domain;

[0066] or,

[0067] The frequency channel corresponding to resource unit A in the frequency domain is frequency channel 1, the frequency channel corresponding to resource unit B in the frequency domain is frequency channel 2, and resource unit A and resource unit B correspond to the same time slot in the time domain;

[0068] or,

[0069] The time slot corresponding to the resource unit A in the time domain is time slot 1, the time slot corresponding to the resource unit B in the time domain is time slot 2, and the frequency channel corresponding to the resource unit A in the frequency domain is frequency channel 1, and the frequency channel corresponding to the resource unit B in the frequency domain is frequency channel 2;

[0070] Among them, time slot 1 and time slot 2 are different time slots in the time domain, and frequency channel 1 and frequency channel 2 are different frequency channels in the frequency domain.

[0071] Any resource unit can be used to transmit audio data packets with any one of the N peripheral devices. It should be understood that any resource unit can be allocated to any one of the N peripheral devices so that the peripheral device can send corresponding audio data packets to the central device / receive audio data packets sent by the central device on the time slot and frequency channel indicated by the allocated resource unit.

[0072] like Figure 1 As shown, the method includes:

[0073] Step 101: During a control transmission period of a target secondary event, enable the main control component and / or the sub-control component to send a same control data packet to the N peripheral devices.

[0074] The control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, the resource unit allocated to each target peripheral device in the target sub-event, and the target peripheral device is the peripheral device that is allowed to send audio data packets to the central device or receive audio data packets sent by the central device in the target sub-event, wherein the target sub-event is one of the multiple sub-events.

[0075] It is understandable that the central device can adaptively configure the time domain resources and frequency domain resources occupied by the resource unit according to the frequency hopping conditions of the communication link of the target peripheral device and the transmission requirements of the target peripheral device in the target secondary event, thereby realizing flexible scheduling and sharing of hybrid domain resources.

[0076] Step 102: During the audio transmission period of the target secondary event, based on the resource configuration information, enable the main control component and / or the sub-control component to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit.

[0077] The present application sets a main control component and at least one sub-control component in a MIMO wireless audio system to support a central device to expand the transmission resources used for receiving or sending packets from a single time domain to a mixed domain including time domain and frequency domain when transmitting audio data packets with peripheral devices, and supports more flexible resource scheduling strategies, which can not only improve the link efficiency of the MIMO wireless audio system when transmitting audio data streams, but also provide more effective bandwidth for audio transmission, and correspondingly improve the transmission reliability.

[0078] In one embodiment, the main control element is a main controller, the sub-control element is a sub-controller, the at least one sub-controller is connected to the main controller, and the main controller and the application are connected to a main processor;

[0079] or,

[0080] The main control component is a main radio frequency unit, the sub-control component is a sub-radio frequency unit, the central device also includes a controller baseband and a protocol processor, the at least one sub-radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application, and the main radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application.

[0081] In one embodiment, the structure of the central device can be as follows Figure 2As shown, it includes an application and a main processor (APP&Host Processor) and an expandable controller, wherein the expandable controller includes a main controller (PrimaryController) and at least one secondary controller (Secondary Controller). The master-slave interface (Host ControllerInterface, HCI) defined in the BT core specification is adopted between the APP&Host Processor and the Primary Controller of the expandable controller. For example, the physical interface of the HCI can be UART, USB or SDIO, etc.

[0082] The Primary Controller and the Secondary Controller, as well as the Secondary Controller and the Secondary Controller are connected in a cascade manner, and their physical interfaces may be UART, USB, or SDIO.

[0083] In the application, the number of connected Secondary Controllers can be selected according to the needs, that is, the number of Secondary Controllers required for cascading. Multiple controllers of the scalable controller can use their own independent antennas or share the same antenna.

[0084] For example: the main controller uses a main antenna, each of the sub-controllers uses a sub-antenna, and different sub-controllers use different sub-antennas; or, the main controller and at least one sub-controller share the same antenna.

[0085] Without loss of generality, the aforementioned main controller and sub-controller can be understood as the Controller defined in the BT core specification, including functions such as radio frequency (Radio), baseband (Baseband), link control (Link Controller), link management (Link Manager) or link layer (Link Layer), HCI interface, etc.

[0086] The application and host processor (APP&Host Processor) can be understood as a collection of all other functional modules in the central device except the controller. In addition to executing the Host protocol defined by the Bluetooth (BT) core specification (CoreSpecification), it also executes configuration (Profiles), application functions, audio codecs, audio algorithms, audio input, and audio input and output, etc.

[0087] The main controller and the sub-controller in the aforementioned expandable controller can support one or more of the N communication links in time-division multiplexing. Specifically, the APP&Host Processor sends the audio data to the main controller through the HCI interface, and the main controller sends it to the sub-controller, or the sub-controller sends the received audio data to the main controller, and the main controller submits it to the APP&Host Processor through the HCI interface.

[0088] In addition to supporting BLE's 1Mbps and 2Mbps physical layer (PHY), the scalable controller can also support the next-generation BLE specification HDT PHY, including 3Mbps, 4Mbps, 6Mbps and 7.5Mbps.

[0089] In one embodiment, the structure of the central device can also be as follows Figure 3 As shown, it includes a multi-radio controller (Multi-Radio Controller) and an application and a main processor, wherein the multi-radio controller includes a controller baseband and a protocol processor, a main radio frequency unit and at least one secondary radio frequency unit, wherein the controller baseband and the protocol processor are connected to the aforementioned application and the main processor, and the controller baseband and the protocol processor are also connected to a main radio frequency unit and at least one secondary radio frequency unit respectively; a main radio frequency unit and at least one secondary radio frequency unit use their own independent antennas (i.e. Figure 3 As shown: the main RF unit is connected to the main antenna (Primary Antenna), each secondary RF unit is connected to a secondary antenna (Secondary Antenna), and different secondary RF units are connected to different secondary antennas), or they can share the same antenna.

[0090] The APP&Host Processor and the multi-RF controller use the host controller interface (HCI) defined in the BT core specification. For example, the physical interface of the HCI can be UART, USB or SDIO.

[0091] The main RF unit and the sub-RF unit in the aforementioned multi-RF controller can support one or more of the N communication links in time division multiplexing. Specifically, the APP&Host Processor sends the audio data to the controller baseband and protocol processor through the HCI interface, and then the controller baseband and protocol processor send it to the main controller or the sub-controller, or the main controller or the sub-controller sends the received audio data to the controller baseband and protocol processor, and then the controller baseband and protocol processor submit it to the APP&Host Processor through the HCI interface.

[0092] Among them, in addition to supporting BLE's 1Mbps and 2Mbps physical layer (PHY), the multi-RF controller can also support the next-generation BLE specification HDT PHY, including 3Mbps, 4Mbps, 6Mbps and 7.5Mbps.

[0093] In one embodiment, when the number of resource units included in the target secondary event is greater than or equal to the number of target peripheral devices, one target peripheral device is allocated at least one resource unit included in the target secondary event, and different target peripheral devices are allocated different resource units.

[0094] Specifically, when the number of resource units included in the target secondary event is equal to the number of the target peripheral devices, each of the target peripheral devices is allocated one resource unit included in the target secondary event, and different target peripheral devices are allocated different resource units;

[0095] In the case where the number of resource units included in the target secondary event is greater than the number of target peripheral devices, it can be configured to allocate one resource unit included in the target secondary event to each target peripheral device, and different target peripheral devices are allocated different resource units, which can free up all resource units in the target secondary event that exceed the number of target peripheral devices, so as to be used for other purposes or for the central device to sleep to reduce energy consumption;

[0096] It can also be set that each target peripheral device in a part of the target peripheral devices is allocated one resource unit included in the target secondary event, and each target peripheral device in another part of the target peripheral devices is allocated multiple resource units included in the target secondary event. Different target peripheral devices are allocated different resource units, and different target peripheral devices allocated with multiple resource units may have different numbers of resource units allocated. For example, if it is set that the multiple target peripheral devices include target peripheral device a, target peripheral device b and target peripheral device c, then the following resource configuration schemes can be supported:

[0097] Configuration plan 1:

[0098] Allocate resource unit 1 in the target secondary event to target peripheral device a;

[0099] Allocate resource unit 2 and resource unit 3 in the target secondary event to target peripheral device b;

[0100] Allocate resource unit 4 and resource unit 5 in the target secondary event to target peripheral device c;

[0101] Configuration scheme 2:

[0102] Allocate resource unit 1 in the target secondary event to target peripheral device a;

[0103] Allocate resource unit 2, resource unit 3 and resource unit 4 in the target secondary event to target peripheral device b;

[0104] The resource unit 5 and the resource unit 6 in the target secondary event are allocated to the target peripheral device c.

[0105] It should be pointed out that, when the number of resource units included in the target sub-event is greater than the number of target peripheral devices, and two or more resource units included in the target sub-event are allocated to at least one target peripheral device, the total number of resource units allocated to all target peripheral devices can be equal to the number of resource units included in the target sub-event, or can be less than the number of resource units included in the target sub-event, so as to make the allocation of multiple resource units in the target sub-event more flexible.

[0106] It should be noted that, based on the above settings, the present application can support the allocation of more transmission units and / or higher quality transmission units to one or more target peripheral devices within the target sub-event to improve the transmission success rate of the target peripheral devices, thereby improving the overall link efficiency. For example: if a peripheral device is set to be allocated resource unit A within a sub-event, and the peripheral device fails to successfully transmit a data packet in the resource unit A of the sub-event, then, in the next sub-event of the sub-event, resource unit A' and resource unit B' can be allocated to the peripheral device to increase the transmission opportunities of the peripheral device, or only resource unit B' can be allocated to the peripheral device to utilize the resource unit B' with better communication quality (compared to resource unit A') to increase the probability of the peripheral device successfully transmitting the corresponding data packet.

[0107] In one embodiment, among the multiple resource units included in any one of the secondary events, the resource unit allocated to the audio input device is the target input resource unit, and the resource unit allocated to the audio output device is the target output resource unit;

[0108] Among them, the time slot corresponding to any of the target input resource units in the time domain is different from the time slot corresponding to any of the target output resource units in the time domain, that is, two different resource units sharing the same time slot resources, that is, corresponding to the same time slot in the time domain, are prohibited from being respectively allocated to the audio input link (that is, the communication link corresponding to the audio input device) and the audio output link (that is, the communication link corresponding to the audio output device) to avoid the RF transmission of the output link of the central device interfering with the RF reception of the input link of the central device.

[0109] In one embodiment, within the audio transmission period of the target secondary event, based on the resource configuration information, enabling the main control component and / or the sub-control component to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit includes:

[0110] In a first resource unit of an audio transmission period of the target secondary event, based on the resource configuration information, enabling a first control element to transmit a corresponding audio data packet with a target peripheral device on a communication link corresponding to the target peripheral device;

[0111] In a second resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling the second control element to transmit a corresponding audio data packet with the one target peripheral device on a communication link corresponding to the target peripheral device;

[0112] Wherein, the first control element and the second control element are: two different control elements among the main control element and the at least one auxiliary control element;

[0113] The first resource unit and the second resource unit correspond to different time slots in the time domain. The frequency domain resources occupied by the first resource unit and the second resource unit are allocated according to the frequency hopping information of the communication link corresponding to the target peripheral device.

[0114] In this embodiment, the central device can be set to communicate with the same peripheral device in different time slots by using different controllers, thereby improving the reliability of wireless transmission.

[0115] For example, if in the target sub-event, the target peripheral device A communicates with the central device based on the control component a within the first time slot of the audio transmission period of the target sub-event, and in the event of a communication failure, there is a risk of low channel quality in the frequency channel corresponding to the control component a. At this time, when choosing to allocate the second time slot of the audio transmission period of the target sub-event to the target peripheral device A for retransmission, you can further choose to complete the retransmission work between the target peripheral device A and the central device through the control component b, so as to retransmit the corresponding data packet based on the new frequency channel by replacing the control component on which the transmission depends, that is, by replacing the frequency channel used for communication, so as to avoid the risk of low channel quality that may exist in the original frequency channel and increase the probability of successful transmission.

[0116] In this example, the target peripheral device A can be understood as the aforementioned target peripheral device, the resource unit indicating the first time slot of the audio transmission period of the target sub-event and the frequency channel corresponding to the control component a can be understood as the aforementioned first resource unit, and the resource unit indicating the second time slot of the audio transmission period of the target sub-event and the frequency channel corresponding to the control component b can be understood as the aforementioned second resource unit.

[0117] It should be understood that in the present application, within the audio transmission period of the target sub-event, the same control component can also be enabled based on the resource configuration information to enable the central device and a target peripheral device to transmit corresponding audio data packets on the communication link corresponding to the target peripheral device in two resource units in different time domains.

[0118] In one embodiment, within the audio transmission period of the target secondary event, based on the resource configuration information, enabling the main control component and / or the sub-control component to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit includes:

[0119] In a resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, at least two third control components are enabled to simultaneously receive audio data packets sent by the target peripheral device based on communication links corresponding to the same target peripheral device; wherein the at least two third control components are: at least two different control components among the main control component and the at least one sub-control component.

[0120] Based on the above settings, when the antennas of multiple control components are independent of each other, the central device can enable multiple control components to simultaneously receive audio data packets sent by specific target peripheral devices in the same time slot and the same frequency channel, so as to improve the transmission reliability of audio data packets between the target peripheral devices and the central device through spatial diversity.

[0121] In an application, when the audio output device includes multiple controllers or radio frequency units (such as the audio output device is a wireless multi-channel speaker or headset), the central device can also enable multiple control components to simultaneously send the same audio data packet to the audio output device using different frequency channels in the same time slot, so as to improve the transmission reliability of the audio data packets between the audio output device and the central device through frequency domain diversity. In this case, the audio output device can choose to select a frequency channel with the best channel quality from different frequency channels through the multiple controllers or radio frequency units included therein to receive the audio data packets sent by the central device (or randomly select a frequency channel from different frequency channels to receive the audio data packets sent by the central device), which can also improve the transmission reliability of the audio data packets between the audio output device and the central device.

[0122] Exemplarily, the audio output device may collect statistics on data such as packet loss rate and success rate when transmitting audio data packets based on different frequency channels, and evaluate the channel quality of different frequency channels accordingly.

[0123] In one embodiment, within the audio transmission period of the target secondary event, based on the resource configuration information, enabling the main control component and / or the sub-control component to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit includes:

[0124] In a third resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, a third control element is enabled to send / receive an audio data packet corresponding to the first target peripheral device on a communication link corresponding to the first target peripheral device;

[0125] In a fourth resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a fourth control element to send / receive an audio data packet corresponding to the second target peripheral device on a communication link corresponding to the second target peripheral device;

[0126] Wherein, the third control element and the fourth control element are: two different control elements among the main control element and the at least one auxiliary control element;

[0127] The first target peripheral device and the second target peripheral device are: two different target peripheral devices among the target peripheral devices, and are both audio input devices or audio output devices;

[0128] The third resource unit and the fourth resource unit correspond to the same time slot in the time domain.

[0129] In this embodiment, based on the above settings, different control components can also be enabled based on the resource configuration information within a time slot of the audio transmission period of the target secondary event, so that the central device and different target peripheral devices can simultaneously transmit corresponding audio data packets on the corresponding communication links, thereby doubling the effective bandwidth.

[0130] Specifically, the central device may enable multiple control components to simultaneously send different audio data packets to different audio output devices using different frequency channels in the same time slot to double the effective bandwidth;

[0131] The central device can enable multiple control components to simultaneously receive different audio data packets sent by different audio input devices using different frequency channels in the same time slot to double the effective bandwidth.

[0132] In one embodiment, the central device may also enable multiple control components to simultaneously send the same control data packet to different audio output devices using different frequency channels in the same time slot to obtain frequency diversity gain.

[0133] Further, in one embodiment, enabling the main control component and / or the sub-control component to send the same control data packet to the N peripheral devices within the control transmission period of the target secondary event includes:

[0134] During the control transmission period of the target secondary event, the target control component is enabled to send the same control data packet to the N peripheral devices; wherein the target control component is: the control component with the best channel quality of the supported frequency channel among the main control component and the at least one sub-control component.

[0135] Based on the above settings, the transmission reliability of the control data packet is improved through spatial diversity.

[0136] For example, the central device may collect statistics on packet loss rate, success rate and other data when different control components perform audio data packets, and evaluate the channel quality of different control components accordingly.

[0137] In one embodiment, the time domain included in the hybrid domain is divided into a plurality of continuous equal-time intervals, and a plurality of the sub-events are divided into one equal-time interval.

[0138] The method further comprises:

[0139] enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet within a target equal-time interval advertisement transmission period;

[0140] The target isochronous interval is one of the multiple isochronous intervals, the advertisement transmission period and the control transmission period do not overlap each other, and the advertisement transmission period and the audio transmission period do not overlap each other.

[0141] Specifically, during the target equal-time interval advertising transmission period, the central device can enable at least two different control components in the main control component and the sub-control component to simultaneously send the same advertising data packet using different frequency channels in the same time slot, while the peripheral devices can select the frequency channel with the best channel quality among the different frequency channels to receive the advertising data packet sent by the central device, which can improve the transmission reliability of the advertising data packet through frequency domain diversity.

[0142] In one embodiment, enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet during the target equal-time interval advertisement transmission period includes:

[0143] enabling the target control component to broadcast the same advertisement data packet in a time slot of the target equidistant advertisement transmission period;

[0144] The target control component is: among the main control component and the at least one sub-control component, the control component supporting the frequency channel with the best channel quality.

[0145] During the targeted equally spaced advertising transmission period, the central device sends advertising data packets to multiple peripheral devices using a frequency channel with the best channel quality in the same time slot to improve the transmission reliability of the advertising data packets through selective spatial diversity.

[0146] Exemplarily, the advertising data packet includes at least one of an extended advertisement (ADV_EXT_IND) PDU, an auxiliary advertisement (AUX_ADV_IND) PDU, and a synchronization (AUX_SYNC_IND) PDU.

[0147] In one embodiment, the control data packet includes at least one of the following:

[0148] A first management parameter, used to indicate the total number of control components of a control component set corresponding to the main control component and the at least one secondary control component;

[0149] A second management parameter, used to indicate the number of communication links to which the central device is connected;

[0150] The third management parameter is used to indicate the sequence number of the corresponding secondary event;

[0151] A confirmation mapping table, used to indicate whether each communication link in the communication links to which the central device is connected replies with confirmation information;

[0152] An enable mapping table, used to indicate whether multiple resource units included in a corresponding secondary event are enabled;

[0153] An allocation mapping table is used to indicate the control component serial number, transmission direction, communication link serial number and protocol data unit serial number of each enabled resource unit corresponding to the control component in the control component set in at least one enabled resource unit included in the corresponding secondary event.

[0154] In one embodiment, the audio data packet includes audio data and preset parameters, wherein the preset parameters include at least one of the following:

[0155] A first sub-parameter for indicating a control component sequence number of a control component corresponding to the audio data packet in the control component set;

[0156] A second sub-parameter used to indicate a transmission direction corresponding to the audio data packet;

[0157] A third sub-parameter for indicating a sequence number of a communication link corresponding to the audio data packet;

[0158] A fourth sub-parameter is used to indicate the sequence number of the audio data packet.

[0159] Exemplarily, based on the above method, a Hybrid Domain Agile Isochronous Stream (HD-AIS) link protocol and a Hybrid Domain Agile Isochronous Group (HD-AIG) link protocol consisting of at least two HD-AIS links can be defined between the central device and the peripheral devices.

[0160] The HD-AIS and HD-AIG link protocols define two protocol data units (PDUs) based on the BLE synchronous isochronous channels (Isochronous Channels) protocol, as shown below:

[0161] One is the Hybrid Domain Agile Isochronous Stream Manager (HD-AISM) PDU, which can be understood as the aforementioned control data packet; the other is the Hybrid Domain Agile Isochronous Stream Data (HD-AISD) PDU, which can be understood as the aforementioned audio data packet.

[0162] Based on the above definition, the aforementioned central device can also be called an HD-AIG central device, and the aforementioned peripheral device can also be called an HD-AIG peripheral device.

[0163] The HD-AIG center device uses HD-AISM PDU to send batch resource allocation information or batch confirmation requirement information, and its payload can also carry broadcast audio data.

[0164] The HD-AIG central device and the HD-AIG peripheral device use HD-AISD PDU with audio payload to transmit audio data to each other, and can also use HD-AISD PDU without payload to send and receive confirmation information.

[0165] The HD-AISM PDU has the same structure as the BLE Broadcast Isochronous Stream (BIS) PDU but a different header format, namely, the BIS PDU with an extended header.

[0166] The format of the HD-AISM PDU extension header is as follows Figure 4 As shown, based on the BIS PDU header, the 1-bit reserved field (Reserved for Future Use, RFU) is set to HD-AISM to indicate whether HD-AIS MPDU is enabled. The HD-AISM field is assigned a value of 0 to indicate that HD-AISM PDU is not enabled, and the HD-AISM field is assigned a value of 1 to indicate that HD-AIS MPDU is enabled. When AISM PDU is not enabled, it indicates that it is an ordinary BIS PDU. When AISM PDU is enabled, a certain number of bytes are added to the extended header, including at least one or more fields such as Num_FD, Num_AIS, ACK MT, SE_SN, BRET and BRAT.

[0167] Among them, Num_FD represents the number of frequency domain channels supported, or the number of controllers in the expandable controller used by the HD-AIG central device or the number of radio frequency units in the multi-radio controller. Num_FD can be understood as the aforementioned first management parameter.

[0168] Num_AIS indicates the number of HD-AIS links currently established, and Num_AIS can be understood as the aforementioned second management parameter.

[0169] ACK MT is used to indicate the mapping table (Mapping Table, MT) of the HD-AIS audio output link that is required to reply the confirmation information (Acknowledgement, ACK). Each bit corresponds to an HD-AIS audio output link or a wireless audio output device connected to the HD-AIS link. ACK MT can be understood as the aforementioned confirmation mapping table.

[0170] Without loss of generality, the bits from low to high correspond to the HD-AIS link sequence numbers (SN) from small to large. A bit is set to 1 to indicate that the corresponding HD-AIS link is required to reply with confirmation information, and is set to 0 to indicate that the corresponding HD-AIS link is not required to reply with confirmation information.

[0171] SE_SN represents the sequence number of a sub-event (SE) within an HD-AIG ISO Interval or the sequence number of an HD-AISM PDU within an HD-AIG ISO Interval. SE_SN can be understood as the aforementioned third management parameter.

[0172] BRET stands for Block Resource Enable Table (BRET), where each bit corresponds to a resource unit (RU). Setting it to 1 means enabling a certain resource unit, and setting it to 0 means disabling a certain resource unit. BRET can be understood as the aforementioned enable mapping table.

[0173] The resource units include resource units of all mixed domains including frequency domain and time domain. The total number of resource units is Num_RU, which generally corresponds to the total number N of HD-AIG peripheral devices or HD-AIS links, and may also be greater than N or less than N.

[0174] BRAT stands for Block Resource Allocation Table (BRAT), which contains resource allocation units less than or equal to Num_RU, that is, the number of resource units enabled in BRET. It is used to allocate the corresponding number of resource units in batches to each HD-AIS link. BRAT can be understood as an allocation mapping table.

[0175] The resource allocation unit with sequence number n in BRAT corresponds to the resource unit with sequence number n enabled in BRET, including the frequency domain sequence number (FD SN), transmission direction (Direction), link sequence number HD-AIS SN and protocol data unit sequence number PDU SN.

[0176] The frequency domain sequence number (FD SN) indicates the sequence number of the frequency domain path corresponding to the enabled resource unit with sequence number n, or the sequence number of the controller or radio frequency unit of the HD-AIG central device, where the FD SN of the main controller or main radio frequency unit is 0.

[0177] The transmission direction (Direction) is set to 0 to represent the audio output direction, that is, the direction in which the HD-AIG central device sends the HD-AISD PDU to the wireless audio output device; the transmission direction (Direction) is set to 1 to represent the audio input direction, that is, the direction in which the wireless audio input device sends the HD-AISD PDU to the HD-AIG central device.

[0178] The HD-AIS SN in the resource allocation unit with sequence number n indicates that the enabled time slot resource with sequence number n is used for the HD-AIS link with sequence number HD-AIS SN to receive or send HD-AISD PDU. The PDU SN in the enabled resource allocation unit with sequence number n indicates that the enabled resource unit with sequence number n is used for the HD-AIS link with sequence number HD-AIS SN to send or receive HD-AISD PDU with sequence number PDU SN. The functions and usage of other fields in the HD-AISM PDU extended header are the same as those of the BIS PDU, including the logical link identifier (LLID) used to indicate the HD-AISM PDU payload type, the control subevent sequence number (CSSN), the control subevent transmission flag (CSTF), the length of the AISM PDU payload (Length), and a 1-bit RFU.

[0179] The HD-AISD PDU has the same format as the BLE Connected Isochronous Stream (CIS) PDU but a different header format, namely, the CIS PDU with an extended header.

[0180] The format of the HD-AISD PDU extension header is as follows Figure 5 As shown, based on the CIS PDU header, a 1-bit reserved field is set to HD-AISD to indicate whether the HD-AISD PDU is enabled. When the HD-AISD field is assigned a value of 0, it indicates that the HD-AISD PDU is not enabled. When the HD-AISD field is assigned a value of 1, it indicates that the HD-AISD PDU is enabled. When the HD-AISD PDU is not enabled, it indicates a normal CIS PDU. When the HD-AISD PDU is enabled, a certain number of bytes are added to the extended header, which includes at least one or more fields such as FD SN, Direction, HD-AIS SN or PDU SN.

[0181] FD SN represents the serial number of the frequency domain path, indicating the serial number of the frequency domain path corresponding to the resource unit used by the HD-AISD PDU, or the serial number of the controller or radio frequency unit used by the HD-AIG central device. FD SN can be understood as the aforementioned first sub-parameter.

[0182] Direction represents the audio transmission direction. When Direction is set to 0, it represents the audio output direction, that is, the HD-AIG central device sends HD-AISD PDU to the wireless audio output device; when Direction is set to 1, it represents the audio input direction, that is, the wireless audio input device sends HD-AISD PDU to the HD-AIG central device. Direction can be understood as the second sub-parameter mentioned above.

[0183] HD-AIS SN indicates the serial number of the HD-AIS link corresponding to the current HD-AISD PDU, and HD-AIS SN can be understood as the aforementioned third sub-parameter. PDU SN indicates the PDU sequence number of the HD-AIS link corresponding to the current HD-AISD PDU, and PDU SN can be understood as the aforementioned fourth sub-parameter.

[0184] The meanings of other fields in the HD-AISD PDU header are the same as those of the CIS PDU header. LLID (Logical Link Identifier) ​​is the logical link identifier, which is used to indicate the payload type of the HD-AISD PDU. NESN (Next Expected Sequence Number) is the next expected sequence number, and SN (Sequence Number) is the current sequence number. CIE (Close Isochronous Event) is to close the isochronous event, indicating whether the isochronous event is ended. NPI (Null PDU Indicator) is the Null PDU identifier. In the CIS PDU, it indicates whether the PDU is a CISData PDU (data PDU) or a CISNull PDU (empty PDU). In the HD-AISD PDU, it indicates whether the PDU is an HD-AISD Data PDU or an HD-AISD Null PDU. The HD-AISD Null PDU is used to carry reception confirmation information when there is no data to send. Length indicates the payload length of the HD-AISD PDU.

[0185] For example, the definition of HD-AIG peripheral devices accessing HD-AIG central devices may be:

[0186] The HD-AIG peripheral devices synchronize with the HD-AIG central device and obtain the HD-AIG link information (HD-AIGInfo) through the extended advertisement (ADV_EXT_IND) PDU sent by the HD-AIG central device on the primary advertising (Primary Advertising) channel, the auxiliary advertisement (AUX_ADV_IND) PDU sent on the secondary advertising (Secondary Advertising) channel, and the synchronization control (AUX_SYNC_CTR) PDU sent on the periodic advertising (Periodic Advertising) channel.

[0187] After the HD-AIG peripheral device is synchronized with the HD-AIG central device, it establishes, maintains and cancels the HD-AIS link with the HD-AIG central device through the AUX_SYNC_CTR PDU (synchronization control) and synchronization control response (AUX_SYNC_CTR_RSP) PDU. After the HD-AIS link is established, the HD-AIG peripheral device can receive the HD-AISM PDU sent by the HD-AIG central device, and according to the BRET-enabled hybrid domain resource unit in the HD-AISM PDU and the batch resource allocation information carried by BRAT, use the allocated resource unit to send or receive the HD-AISD PDU, and determine whether to reply to the confirmation information according to the information of the ACK MT.

[0188] The structure of AUX_SYNC_CTR PDU and AUX_SYNC_CTR_RSP PDU is similar to that of AUX_SYNC_IND PDU. Figure 6 The Common Extended Advertising Payload Format shown in FIG. 1 includes a 6-bit Extended Header Length, a 2-bit AdvMode, a 0-63-byte Extended Header, and a maximum of 254 bytes of AdvData. The Extended Header format of the AUX_SYNC_CTR PDU and AUX_SYNC_CTR_RSP PDU is as follows: Figure 7 As shown, it includes a one-byte extended header flag (Extended Header Flags), 1-48 bytes of control commands (ControlCommand), and 16 bytes of HD-AIG link information (HD-AIGInfo).

[0189] HD-AIGInfo format is as follows Figure 8As shown, it includes fields such as HD-AIG_Offset, ISO_Interval, Num_FD, Nun_AIS, Num_RU, NSE, Sub_Interval, Max_PDU1, Max_PDU2, ChM, PHY, and EventCount.

[0190] HD-AIG_Offset is the time between the start point of AUX_SYNC_CTR PDU and the start point of HD-AIG (Anchor Point), in microseconds.

[0191] ISO_Interval is the equal time interval of HD-AIG, that is, the time between the starting points of two HD-AIG events (Event), and the unit is 1.25ms.

[0192] Num_AIS is the maximum number of HD-AIS links that can be connected.

[0193] Num_RU is the maximum number of hybrid domain resources that can be enabled in BRET, or the maximum number of resources that can be allocated in BRAT.

[0194] Num_RU generally corresponds to the total number N of HD-AIG peripheral devices, and may be greater than N or less than N.

[0195] NSE is the number of sub-events in an HD-AIG equal time interval. Sub_Interval is the interval between two sub-events, in microseconds. Max_PDU1 is the maximum number of bytes in the HD-AISM PDU payload. Max_PDU2 is the maximum number of bytes in the HD-AISD PDU payload. ChM contains a channel mapping table, indicating which channels are available (Used) and which channels are not used (Unused). Each channel is represented by a bit. 1 represents Used and 0 represents Unused. The lowest bit represents the lowest channel index number (Channel Index) and the highest bit represents the highest channel index number. PHY represents the PHY format used by HD-AIG. 0 represents BLE 1M PHY, 1 represents BLE 2M PHY, and 2 represents BLE CodedPHY. Other values ​​can represent the next generation of high-speed PHY, such as 3Mbps PHY, 4Mbps PHY, 6Mbps PHY or 7.5Mbps PHY. EventCount represents the number or sequence number of HD-AIG Event.

[0196] According to the BLE protocol, the first 7 bits of the Extended Header Flags are set to 0. The 7th bit is reserved and is defined as the Control field in the AUX_SYNC_CTR PDU and AUX_SYNC_CTR_RSP PDU. If it is set to 1, it means that the Extended Header of the AUX_SYNC_CTR PDU and AUX_SYNC_CTR_RSP PDU contains a Control Command. The format of the Control Command is as follows: Fig. 9 As shown in FIG. 1 , it includes two parts: an operation code (Opcode) and control data (CtrData). The Opcode and CtrData of different control commands are different.

[0197] This example specifically defines three control commands for AUX_SYNC_CTR PDU, including

[0198] HD-AIS Random Access command;

[0199] HD-AIS Access Permit command;

[0200] HD-AIS Terminate command.

[0201] Define a control command for AUX_SYNC_CTR_RSP PDU:

[0202] HD-AIS Access Request command.

[0203] The HD-AIS Terminate command is also applicable to the AUX_SYNC_CTR_RSP PDU.

[0204] The HD-AIS Random Access command is used by the HD-AIG central device to open a random access window, so that the HD-AIG peripheral devices can send the HD-AIS Access Request command to request access. Only in the random access window opened by the HD-AIG central device can the HD-AIG peripheral devices send the HD-AIS Access Request command. At other times, the HD-AIG peripheral devices cannot send the HD-AIS Access Request command.

[0205] The HD-AIS Access Request command is used by the HD-AIG peripheral device to request access or request to establish an HD-AIS link when the HD-AIG central device opens a random access window.

[0206] The HD-AIS Access Permit command is used by the HD-AIG central device to permit HD-AIG peripheral devices to access or establish an HD-AIS link.

[0207] The HD-AIS Terminate command is used by the HD-AIG central device to terminate a certain HD-AIS link or all HD-AIS links. It can also be used by the HD-AIG peripheral device to request the termination of the corresponding HD-AIS link.

[0208] In this example, it is defined that Opcode of HD-AIS Random Access=0x20, Opcode of HD-AIS AccessRequest=0x21, Opcode of HD-AIS Access Permit=0x22, and Opcode of HD-AIS Terminate=0x23.

[0209] Figure 10 (1) is the CtrData of the HD-AIS Random Access command, which includes a 3-byte random access deadline (Deadline), and its lower 18 bits are the same as the definition of EventCount in HD-AIGInfo. When the EventCount value of HD-AIGInfo in the current AUX_SYNC_CTR PDU is less than the Deadline, the HD-AIG peripheral device is allowed to send the HD-AIS Access Request command through the AUX_SYNC_CTR_RSP PDU. After receiving the HD-AIS Random Access command, the HD-AIG peripheral device will randomly delay a certain period of time to receive the HD-AIS Random Access command again and send the HD-AIS Access Request in order to avoid conflicts with the HD-AIS Access Request commands sent by other HD-AIG peripheral devices. The random delay time does not exceed the Deadline. When the Deadline is 0, it means that the deadline is infinite.

[0210] Figure 10 (2) is the CtrData of the HD-AIS Access Request command, which includes a 6-byte device address (DeviceAddress), a 1-bit transmission direction (Direction), a 10-bit PDU size (PDU Size), and a 13-bit Audio ChM. Device Address is the device address of the peripheral device requesting access. Direction represents the audio transmission direction requested for access, 0 represents the audio output direction, and 1 represents the audio input direction. PDU Size is the payload size of the HD-AISD PDU requested for access, in bytes. Audio ChM is a table of supported audio channel mappings (Channel Map, ChM), in which each bit represents a specific channel, and a bit set to 1 represents that the corresponding channel can be supported.

[0211] Figure 10 (3) is the CtrData of the HD-AIS Access Permit command, which includes a 6-byte device address (DeviceAddress), 4 bits of HD-AIS SN, 1 bit of Direction, 10 bits of PDU Size, 13 bits of Audio ChA, 4 bits of RFU, 4 bytes of Access Address, 3 bytes of CRCInit, and 18 bits of Instant.

[0212] Device Address is the device address of the peripheral device that is allowed to access. HD-AIS SN is the serial number of the HD-AIS link that is allowed to access. Direction represents the audio transmission direction that is allowed to access. 0 represents the audio output direction and 1 represents the audio input direction. PDU Size is the payload size of the HD-AISD PDU that is allowed to access, in bytes. AudioChA is the audio channel allocation (ChA: Channel Allocation) of the HD-AIS link that is allowed to access. Each bit represents a specific channel. A bit set to 1 represents an audio channel that is allowed to access. RFU is a reserved field. Access Address represents the access address used by the HD-AIS link that is allowed to access. CRCInit represents the initial value of the cyclic check of the HD-AISD PDU payload of the HD-AIS link that is allowed to access. Instant is the effective time, which is the same as the definition of EventCount in HD-AIGInfo. When EventCount is equal to Instant, the HD-AIS Access Permit command takes effect.

[0213] The HD-AIG peripheral device sends its device address to the HD-AIG central device through the HD-AIS Access Request command. The HD-AIG central device receives the device addresses of multiple peripheral devices during random access and saves them in the device address list. After the random access window is closed, the central device selects a specific peripheral device from the random access device address list and allows it to access and establish an HD-AIS link by sending an HD-AIS Access Permit command to the peripheral device with the corresponding device address. At the same time, the HD-AIS Access Permit command is used to configure the HD-AIS SN, Access Address and CRCInit for the peripheral device that is allowed to access, and confirm the Direction, Audio channel, PDUsize, and effective time of the allowed access. The peripheral device uses the configured HD-AIS SN, Access Address and CRCInit to receive the HD-AISD PDU sent by the HD-AIG central device or send the HD-AISD PDU to the HD-AIG central device on the corresponding HD-AIS link according to the Direction, or reply to the confirmation information according to the ACK MT value of the HD-AISM PDU packet header.

[0214] Figure 10 (4) is the CtrData of the HD-AIS Terminate command, which includes 4 bits of HD-AIS SN, 2 bits of Reason, 6 bytes of Device Address, and 18 bits of Instant. HD-AIS SN is the serial number of the HD-AIS link to be terminated. Device Address is the device address of the peripheral device of the HD-AIS link to be terminated. Reason is the reason for terminating the HD-AIS link. Instant is the time when the HD-AIS Terminate command takes effect, which is the same as the definition of EventCount in HD-AIGInfo. When EventCount is equal to Instant, the HD-AIS Terminate command takes effect. Generally, the HD-AIG central device sends the HD-AIS Terminate command to the peripheral device with a specific device address to disconnect the HD-AIS link of the specified HD-AIS SN. The HD-AIG central device can also configure the HD-AIS SN to 0xFF when sending the HD-AIS Terminate command to disconnect all HD-AIS links. The HD-AIG peripheral device can also send an HD-AIS Terminate command to the HD-AIG central device to request to disconnect its own HD-AIS link. The HD-AIG peripheral device sends the HD-AIS Terminate command within the random access window. After receiving the HD-AIS Terminate command sent by the HD-AIG peripheral device, the device in the HD-AIG center sends the HD-AIS Terminate command via the AUX_SYNC_CTR PDU to confirm the disconnection of the HD-AIS link of the corresponding peripheral device. In a specific embodiment, there are three Reasons for disconnecting the HD-AIS link, 0x01 means that a new device needs to be connected and the inactive device needs to be disconnected, 0x02 means that the AIS link is disconnected due to abnormal reasons such as insufficient power, and 0x03 means that the shutdown is used to disconnect all HD-AIS links.

[0215] In this example, the process of connecting the HD-AIG peripheral device to the HD-AIG central device can be:

[0216] like Fig.11As shown, the HD-AIG peripheral device to be connected first searches for ADV_EXT_IND PDU on the primary advertising channel, and then receives AUX_ADV_IND PDU on the secondary advertising channel according to the indication information of ADV_EXT_IND PDU, and then receives AUX_SYNC_CTR PDU on the periodic advertising channel according to the information provided by AUX_ADV_IND PDU to obtain the synchronization information of the HD-AIG link.

[0217] After synchronization, if the HD-AISRandom Access command is received from the HD-AIG central device through the AUX_SYNC_CTR PDU, the HD-AIS Random Access command is received again after a random delay of a certain equal time interval and the HD-AIS Access Request command is sent through the AUX_SYNC_CTR_RSP PDU. To ensure reliability, the HD-AIS Access Request command can be sent multiple times. After the peripheral device sends the HD-AIS Access Request command, it continues to receive the AUX_SYNC_CTR PDU sent by the HD-AIG central device and determines whether it carries the HD-AIS AccessPermit command. If the HD-AIS Access Permit command is received, and the HD-AIS link information allocated by the HD-AIG central device to this peripheral device is obtained, including HD-AIS SN, Access Address and CRCInit, as well as the Direction, Audio channel, PDU Size and effective time confirmed to be allowed to access, the HD-AIG link is accessed after the HD-AIS Access Permit command takes effect, and the HD-AISD PDU is sent and received according to the HD-AISM PDU to transmit audio data. If the HD-AIS Access Permit command is not received and the timeout has occurred, the AUX_SYNC_CTRPDU sent by the HD-MIMO central device continues to be received and determines whether it is an HD-AIS Random Access command, and a new round of access process begins. If there is no timeout, the AUX_SYNC_CTR PDU sent by the HD-AIG central device continues to be received and determines whether it is an HD-AIS Access Permit command.

[0218] Based on the HD-AIG protocol adopted in this application, fewer time slots are required for peripheral device access, and the efficiency is high.

[0219] The embodiment of the present application also provides a wireless audio data transmission method, which is applied to a peripheral device, wherein the peripheral device wirelessly communicates with a central device in a hybrid domain based on a communication link, wherein the hybrid domain includes at least a time domain and a frequency domain, and the peripheral device is an audio input device or an audio output device;

[0220] The time domain included in the mixed domain is divided into multiple sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes multiple resource units, different resource units correspond to different time slots in the time domain and / or different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with the central device.

[0221] like Fig.12 As shown, the method includes:

[0222] Step 1201: Receive a control data packet sent by the central device within a control transmission period of a target secondary event.

[0223] The control data packet carries resource configuration information, and when the peripheral device is allowed to send / receive corresponding audio data packets based on the communication link within the target sub-event, the resource configuration information is used to indicate: the resource unit allocated to the peripheral device in the target sub-event.

[0224] Step 1202: within the audio transmission period of the target secondary event, based on the resource configuration information, transmit a corresponding audio data packet with the central device in a corresponding resource unit.

[0225] In one embodiment, when the surrounding device is allowed to send / receive the corresponding audio data packet based on the communication link within the target sub-event, the surrounding device is allocated at least one resource unit in the target sub-event;

[0226] Wherein, when the peripheral device is allocated with a plurality of resource units in the target sub-event and the peripheral device is an audio output device, the plurality of resource units allocated to the peripheral device in the target sub-event correspond to different time slots in the time domain.

[0227] The wireless audio data transmission method provided in the embodiment of the present application corresponds to the various processes involving peripheral devices in the aforementioned embodiments and can achieve the same technical effects. To avoid repetition, it will not be described here.

[0228] The present application also provides a wireless audio data transmission system. Fig.13As shown, the wireless audio data transmission system 1300 includes:

[0229] A central device 1301 and N peripheral devices 1302, N is an integer greater than or equal to 2, the central device 1301 includes: an application and a main processor, a main control component, and at least one secondary control component;

[0230] The central device 1301 communicates wirelessly with the N peripheral devices 1302 in a hybrid domain based on N communication links, wherein the N peripheral devices 1302 include audio input devices and / or audio output devices, and the hybrid domain includes at least a time domain and a frequency domain, such as Fig.12 As shown, the N peripheral devices 1302 are specifically composed of N1 audio input devices and N2 audio output devices, where N1 and N2 are greater than or equal to 0;

[0231] The time domain included in the mixed domain is divided into multiple sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes multiple resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used for the central device 1301 to transmit audio data packets with any peripheral device 1302 of the N peripheral devices 1302;

[0232] The central device 1301 is used for:

[0233] During a control transmission period of a target secondary event, the main control component and / or the secondary control component are enabled to send a same control data packet to the N peripheral devices 1302, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices 1302, a resource unit allocated to each target peripheral device in the target secondary event, wherein the target peripheral device is the peripheral device 1302 that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events;

[0234] During the audio transmission period of the target secondary event, based on the resource configuration information, the main control component and / or the sub-control component are enabled to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit.

[0235] Exemplarily, the central device may be a smart phone, a personal computer, a tablet computer, a smart TV, an audio entertainment device, a wireless game console, etc. The audio input device includes a wireless microphone, a wireless audio source device or various musical instruments, etc. The audio output device includes a wireless headset or a wireless speaker.

[0236] For devices that support both wireless audio input and wireless audio output functions, such as headsets, without loss of generality, this application considers such devices that support both wireless audio output and wireless audio input functions as independent audio input devices and audio output devices.

[0237] Among them, the wireless audio data transmission system 1200 described in the present application can also be called a hybrid domain multiple input multiple output (Hybrid Domain Multiple Input Multiple Output, HD-MIMO) wireless audio transmission system, the aforementioned central device 1301 can also be called an HD-MIMO audio gateway device, and the peripheral device 1302 can also be called an HD-MIMO peripheral device.

[0238] A typical application example of the HD-MIMO wireless audio system includes a smartphone or game console as an HD-MIMO audio gateway device, two independent wireless microphones for improving noise cancellation performance, and a TWS headset consisting of two independent wireless mono headphones. The HD-MIMO audio gateway device is connected to each audio input device or audio output device through a hybrid domain flexible isochronous stream link and transmits audio data. The HD-AIS link established between the HD-MIMO audio gateway device and all audio input devices or audio output devices constitutes a hybrid domain flexible isochronous group link. Different HD-AIS links not only support time division multiplexing to share time domain resources, but also support frequency division multiplexing to share frequency domain resources, that is, at least two HD-AIS links support frequency division multiplexing to share frequency domain resources. The HD-MIMO audio gateway device is also called an HD-AIS or HD-AIG central device (Central), and all audio input devices or audio output devices that constitute the HD-MIMO wireless audio system are also called HD-AIS or HD-AIG peripheral devices (Peripheral) or HD-MIMO peripheral devices.

[0239] In one embodiment, the main control element is a main controller, the sub-control element is a sub-controller, the at least one sub-controller is connected to the main controller, and the main controller and the application are connected to a main processor; or,

[0240] The main control component is a main radio frequency unit, the sub-control component is a sub-radio frequency unit, the central device also includes a controller baseband and a protocol processor, the at least one sub-radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application, and the main radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application.

[0241] In one embodiment, when the number of resource units included in the target secondary event is greater than or equal to the number of target peripheral devices, one target peripheral device is allocated at least one resource unit included in the target secondary event, and different target peripheral devices are allocated different resource units.

[0242] In one embodiment, among the multiple resource units included in any one of the secondary events, the resource unit allocated to the audio input device is the target input resource unit, and the resource unit allocated to the audio output device is the target output resource unit;

[0243] The time slot corresponding to any of the target input resource units in the time domain is different from the time slot corresponding to any of the target output resource units in the time domain.

[0244] In one embodiment, the central device 1301 is specifically used for:

[0245] In a first resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a first control component to transmit a corresponding audio data packet with a target peripheral device on a communication link corresponding to the target peripheral device;

[0246] In a second resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling the second control element to transmit a corresponding audio data packet with the one target peripheral device on a communication link corresponding to the target peripheral device;

[0247] Wherein, the first control element and the second control element are: two different control elements among the main control element and the at least one auxiliary control element;

[0248] The first resource unit and the second resource unit correspond to different time slots in the time domain.

[0249] In one embodiment, the central device 1301 is specifically used for:

[0250] In a resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, at least two third control components are enabled to simultaneously receive audio data packets sent by the target peripheral device based on communication links corresponding to the same target peripheral device; wherein the at least two third control components are: at least two different control components among the main control component and the at least one sub-control component.

[0251] In one embodiment, the central device 1301 is specifically used for:

[0252] In a third resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, a third control element is enabled to send / receive an audio data packet corresponding to the first target peripheral device on a communication link corresponding to the first target peripheral device;

[0253] In a fourth resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a fourth control element to send / receive an audio data packet corresponding to the second target peripheral device on a communication link corresponding to the second target peripheral device;

[0254] Wherein, the third control element and the fourth control element are: two different control elements among the main control element and the at least one auxiliary control element;

[0255] The first target peripheral device and the second target peripheral device are: two different target peripheral devices among the target peripheral devices, and are both audio input devices or audio output devices;

[0256] The third resource unit and the fourth resource unit correspond to the same time slot in the time domain.

[0257] In one embodiment, the central device 1301 is specifically used for:

[0258] During the control transmission period of the target secondary event, the target control component is enabled to send the same control data packet to the N peripheral devices; wherein the target control component is: the control component with the best channel quality of the supported frequency channel among the main control component and the at least one sub-control component.

[0259] In one embodiment, the time domain included in the hybrid domain is divided into a plurality of continuous equal-time intervals, and a plurality of the sub-events are divided into one equal-time interval.

[0260] In one embodiment, the central device 1301 is further used for:

[0261] enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet within a target equal-time interval advertisement transmission period;

[0262] The target isochronous interval is one of the multiple isochronous intervals, the advertisement transmission period and the control transmission period do not overlap each other, and the advertisement transmission period and the audio transmission period do not overlap each other.

[0263] The step of enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet during the target equal-time interval advertisement transmission period includes:

[0264] enabling the target control component to broadcast the same advertisement data packet in a time slot of the target equidistant advertisement transmission period;

[0265] The target control component is: among the main control component and the at least one sub-control component, the control component supporting the frequency channel with the best channel quality.

[0266] In one embodiment, the control data packet includes at least one of the following:

[0267] A first management parameter, used to indicate the total number of control components of a control component set corresponding to the main control component and the at least one secondary control component;

[0268] A second management parameter, used to indicate the number of communication links to which the central device is connected;

[0269] The third management parameter is used to indicate the sequence number of the corresponding secondary event;

[0270] A confirmation mapping table, used to indicate whether each communication link in the communication links to which the central device is connected replies with confirmation information;

[0271] An enable mapping table, used to indicate whether multiple resource units included in a corresponding secondary event are enabled;

[0272] An allocation mapping table is used to indicate the control component serial number, transmission direction, communication link serial number and protocol data unit serial number of each enabled resource unit corresponding to the control component in the control component set in at least one enabled resource unit included in the corresponding secondary event.

[0273] In one embodiment, the audio data packet includes audio data and preset parameters, wherein the preset parameters include at least one of the following:

[0274] A first sub-parameter for indicating a control component sequence number of a control component corresponding to the audio data packet in the control component set;

[0275] A second sub-parameter used to indicate a transmission direction corresponding to the audio data packet;

[0276] A third sub-parameter for indicating a sequence number of a communication link corresponding to the audio data packet;

[0277] A fourth sub-parameter is used to indicate the sequence number of the audio data packet.

[0278] The wireless audio data transmission system 1300 provided in the embodiment of the present application corresponds to the various processes involving the central device and the peripheral device in the aforementioned embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0279] In general, the wireless audio data transmission system 1300 described in the present application has at least the following advantages:

[0280] 1. The HD-AIG link protocol can flexibly configure the number of audio input links and audio output links under the constraint of the total number of links. When applied to an HD-MIMO wireless audio system composed of a mixture of wireless multi-microphones and wireless multi-channel playback devices, any number of wireless multi-microphones and any number of wireless multi-channel playback devices can be configured. When all are configured as audio input links, the HD-MIMO wireless audio system degenerates into a wireless multi-microphone audio system. When all are configured as audio output links, the HD-MIMO wireless audio system degenerates into a wireless multi-channel audio system.

[0281] 2. The HD-AIG link protocol supports sharing of mixed domain resources including frequency domain and time domain among all HD-AIS links, overcoming the shortcomings of BLE Audio's BIG and CIG protocols that fixedly allocate time domain resources to each link, thereby improving the ability of multiple audio input links and multiple audio output links to adapt to changes in wireless channels, and improving the link efficiency, effective bandwidth and transmission reliability of the HD-MIMO wireless audio system. In particular, the effective bandwidth increased by the frequency domain enables the HD-MIMO wireless audio system to accommodate more HD-AIS links or HD-AIG peripheral devices.

[0282] 3. For wireless multi-microphone application scenarios, the HD-MIMO central device uses HD-AISM PDU to send batch resource allocation information to multiple wireless microphones, which is equivalent to batch reply confirmation information. This overcomes the shortcoming of the CIG protocol replying confirmation information to each wireless microphone separately and wasting time slot resources, thereby improving link efficiency.

[0283] 4. The HD-AIG link protocol also solves the problem of difficulty in supporting multiple input links and multiple output links through the CIG protocol.

[0284] For ease of understanding, the following examples are provided:

[0285] The wireless game console audio system is taken as a specific embodiment to explain in detail the working principle of the HD-MIMO wireless audio transmission system based on the HD-AIG link.

[0286] and Fig.13 Similarly, the wireless game console audio system includes an HD-MIMO central device and four HD-MIMO peripheral devices. The HD-MIMO central device is a game console, or it can be a smart phone. The four HD-MIMO peripheral devices include two wireless audio input devices and two wireless audio output devices, corresponding to a TWS microphone composed of two mono wireless microphones and a TWS headset composed of two mono headsets. Without loss of generality, the HD-MIMO central devices are:

[0287] Establish an HD-AIS0 link with the left channel headphone, and the corresponding HD-AIS SN is equal to 0;

[0288] Establish an HD-AIS1 link with the right channel headphone, and the corresponding HD-AIS SN is equal to 1;

[0289] Establish an HD-AIS2 link with the left channel wireless microphone, and the corresponding HD-AIS SN is equal to 2;

[0290] Establish an HD-AIS3 link with the right channel wireless microphone, and the corresponding HD-AIS SN is equal to 3.

[0291] The HD-AIS0, HD-AIS1, HD-AIS2 and HD-AIS3 links constitute the HD-AIG.

[0292] like Figure 4 The HD-AISM value of the HD-AISM PDU extended packet header is 1, and the extended packet header increases by 6 bytes, including 2 bits Num_FD, 3 bits Num_AIS, 4 bits ACK MT, 3 bits SE_SN, 4 bits BRET, and 32 bits BRAT. Figure 5 The HD-AISD value of the HD-AISD PDU extended header shown is 1, and the extended header is increased by 1 byte, including 2 bits of FD_SN, 1 bit of Direction, 2 bits of HD-AIS SN, and 3 bits of PDU SN.

[0293] The HD-MIMO central device uses an extensible controller, including a main controller and a sub-controller. The number of frequency domain channels Num_FD supported by the HD-AIG link between the HD-MIMO central device and the HD-MIMO peripheral device is equal to 2.

[0294] Specifically, in the above wireless game console audio system, the sampling rate of the digital audio signal of each channel is 48kHz, and the number of quantization bits of each sampling point is 16. The digital audio signal of each channel is encoded using a Low Complexity Communication Codec (LC3), with a coding frame length of 10ms and a coding rate of 96kbps. After encoding, each frame of audio data is 120 bytes.

[0295] The wireless game console audio system based on the HD-AIG protocol adopts Fig.13 The time slot structure shown in the figure, in which the communication time is divided into 10ms equal time intervals (ISO Interval), and the starting point of each equal time interval is the starting point of sending the first HD-AISM PDU.

[0296] Using the BLE 2Mbps transmission rate, an HD-AISM PDU without a payload occupies 68us in the air, an HD-AISD Data PDU containing 120 bytes of audio data occupies 528us in the air, and an HD-AISD NULL PDU that only carries the reception confirmation information and has no payload occupies 48us in the air. The interval between PDUs (Time of Minimum Slot Space, T_MSS) is 210us, that is, the interval between the last bit of the previous PDU and the first bit of the next PDU is 210us.

[0297] In each equal time interval, four subevents (SE) are included for sending and receiving HD-AISM PDU and HD-AISD PDU between the HD-MIMO central device of the wireless game console audio system and four HD-MIMO peripheral devices.

[0298] Each Subevent includes the time it takes for the HD-MIMO central device to broadcast an HD-AISM PDU, the time it takes for the HD-MIMO central device and the HD-MIMO peripheral devices to allocate two time domain resources, or the time it takes for the HD-MIMO central device and the HD-MIMO peripheral devices to send and receive two HD-AISD DataPDUs to each other, and the time it takes for the HD-MIMO peripheral device to send an HD-AISD Null PDU carrying confirmation information to the HD-MIMO central device.

[0299] Therefore, the interval Sub_Interval between two Subevents is equal to 2.012ms. Four Subevents occupy a total of 8.048ms. Each equal time interval also includes the time for the HD-MIMO master device to send the extended advertisement (ADV_EXT_IND) PDU on the primary advertising (Primary Advertising) channel, the auxiliary advertisement (AUX_ADV_IND) PDU on the secondary advertising (Secondary Advertising) channel, and the synchronization control (AUX_SYNC_CTR) PDU on the periodic advertising (Periodic Advertising) channel.

[0300] Without loss of generality, in order to save time slot resources, these PDUs are sent in time division, that is, they are sent in different equal time intervals, such as the XA time slot shown in Figure 14, where XA represents the above three types of advertising PDUs.

[0301] As shown in Figure 14(a), within an ISO Interval numbered k, the HD-MIMO center device first sends an HD-AISM PDU numbered k in the first Subevent (SE), i.e., HD-AISM PDU k, wherein the payload length (Length) is 0, the HD-AISM field of the extended packet header is set to 1, Num_FD is equal to 2, indicating that two frequency domain paths are supported or the extensible controller of the HD-MIMO center device includes a main controller and a sub-controller, Num_AIS is equal to 4, indicating that four AIS links are connected, SE_SN is equal to 0, indicating that the SE sequence number is 0, the four enable bits of the BRET field are all set to 1, and the BRAT field contains four resource allocation units (composed of two frequency domain paths and two time slot resources in pairs).

[0302] The link numbers HD-AIS SN corresponding to the resource allocation units numbered 0 to 3 are 0, 2, 1, and 3 respectively.

[0303] The number PDU SN of the HD-AISD PDU is k. PDU SN can also be k-1, k-2, k-3, etc., which means that the HD-AISD PDUs numbered k-1, k-2, k-3 are sent at equal time intervals. Without loss of generality, this embodiment takes the number k as an example.

[0304] The values ​​of the Direction field of the resource allocation units numbered 0 to 3 are 0, 1, 0, and 1, respectively, indicating that the AIS links with HD-AISSN 0 and 1 are in the audio output direction, and the HD-AIS links with HD-AIS SN 2 and 3 are in the audio input direction. Bit 0 and bit 1 of ACKMT are set to 1, and the other bits are 0, indicating that the HD-AIS links with HD-AIS SN 0 and 1 in the audio output direction are required to reply with confirmation information.

[0305] The FD SNs of the resource allocation units numbered 0 to 3 are 0, 0, 1, 1 respectively, indicating that the HD-AIS links with HD-AIS SNs 0 and 2 are transmitted and received through the main controller of the HD-MIMO central device scalable controller, and the HD-AIS links with HD-AIS SNs 1 and 3 are transmitted and received through the sub-controller of the HD-MIMO central device scalable controller.

[0306] After the HD-MIMO center device sends the HD-AISM PDU k in the first SE, according to the resource allocation information of BRET and BRATT, the main controller first sends the HD-AISD0 PDU k to the left channel earphone connected to the HD-AIS link with HD-AIS SN of 0, and then receives the HD-AISD2 PDU k sent by the left channel wireless microphone connected to the HD-AIS link with HD-AIS SN of 2. The sub-controller first sends the HD-AISD1 PDU k to the right channel earphone connected to the HD-AIS link with HD-AIS SN of 1, and then receives the HD-AISD3 PDU k sent by the right channel wireless microphone connected to the HD-AIS link with HD-AIS SN of 3.

[0307] Finally, the main controller receives the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel earphone, and the sub-controller receives the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel earphone, wherein:

[0308] The NPI of ACK0 is set to 1, the Length is set to 0, the FD SN is set to 0, the Direction is set to 0, the HD-AIS SN is set to 0, and the PDU SN is set to k;

[0309] The NPI of ACK1 is set to 1, the Length is set to 0, the FD SN is set to 1, the Direction is set to 0, the HD-AIS SN is set to 1, and the PDU SN is set to k.

[0310] It can be seen that within the same time domain resource, the HD-AISD PDU can be sent to two headphones at the same time through the main and sub-controllers, and the HD-AISD PDU sent by two wireless microphones can also be received by the main and sub-controllers at the same time, thereby increasing the effective bandwidth.

[0311] The AISD0 PDU k and AISD1 PDU k sent by the HD-MIMO center device in the first SE are correctly received by the left and right channel headphones, respectively, and the ACK0 and ACK1 replied by the left and right channel headphones are also correctly received by the HD-MIMO center device. The AISD2 PDU k sent by the left channel wireless microphone is not correctly received by the HD-MIMO center device, and the AISD3 PDU k sent by the right channel wireless microphone is not correctly received by the HD-MIMO center device.

[0312] Therefore, the HD-MIMO center device sends the HD-AISM PDU numbered k again in the second SE (note that although the content of the extended packet header of the HD-AISM PDU has changed, in this embodiment, it is still called k), that is, AISMPDU k, in which SE_SN is equal to 1, the 4 bits of BRET are all 1, the link numbers HD-AIS SN corresponding to the resource allocation units numbered 0 to 3 in BRAT are 3, 2, 2, and 3 respectively, and the PDU numbers PDU SN are all k.

[0313] The Direction of resource allocation units numbered 0 to 3 is 1, 1, 1, 1 respectively. The bits of ACK MT are all set to 0, indicating that there is no HD-AIS link to reply to the acknowledgment information. Note that both HD-AISD2 PDU k and HD-AISD3 PDU k are sent twice in the second SE. The FD SN of resource allocation units numbered 0 to 3 is 0, 0, 1, 1 respectively, indicating that the HD-AIS links with HD-AIS SN 2 and 3 are sent and received through the main controller and the sub-controller of the HD-MIMO central device scalable controller respectively.

[0314] After the HD-MIMO center device sends the HD-AISM PDU k in the second SE, according to the resource allocation information of BRET and BRAT, the main controller first receives the HD-AISD3 PDU k sent by the right channel wireless microphone connected to the HD-AIS link with an HD-AIS SN of 3, and then receives the HD-AISD2 PDU k sent by the left channel wireless microphone connected to the HD-AIS link with an HD-AIS SN of 2. The sub-controller first receives the HD-AISD2 PDU k sent by the left channel wireless microphone connected to the HD-AIS link with an HD-AIS SN of 2, and then receives the HD-AISD3 PDU k sent by the right channel wireless microphone connected to the HD-AIS link with an HD-AIS SN of 3. It can be seen that in the same SE, the two wireless microphones can share the time domain and frequency domain resources of the two wireless headphones, obtain more retransmission times, and improve the transmission reliability through frequency domain diversity and spatial diversity.

[0315] In the second SE of the HD-MIMO central device, the AISD2 PDU k sent by the left channel wireless microphone is correctly received by the HD-MIMO central device, and the AISD3 PDU k sent by the right channel wireless microphone is also correctly received by the HD-MIMO central device. Therefore, when the HD-MIMO central device sends the HD-AISM PDU numbered k again in the third SE, SE_SN is equal to 2, the enable bits of BRET are all set to 0, and BRAT is empty. After receiving the HD-AISM PDU in the third SE, the HD-MIMO peripheral device ends the transmission and reception of HD-AISD PDUs in the equal time interval numbered k.

[0316] It can be seen that in the two SEs of the time slot structure shown in Figure 14 (a), the HD-AIS links numbered 0 and 1 use one transmission opportunity respectively, while the HD-AIS links numbered 2 and 3 obtain three transmission opportunities respectively. The HD-AIG link protocol realizes the flexible configuration of hybrid domain resources between different HD-AIS links, improves the overall link efficiency, and especially improves the transmission reliability of the HD-AIS links numbered 2 and 3.

[0317] In the application, the overlapping time domain resources on the two frequency domain paths can be set to prohibit being allocated to an audio input link and an audio output link at the same time, so as to prevent the RF transmission of the HD-MIMO center device output link from interfering with the RF reception of the HD-MIMO center device input link.

[0318] As shown in Figure 14(b), within an equal time interval numbered k+1, the HD-MIMO center device first sends an HD-AISM PDU numbered k+1 in the first SE, that is, HD-AISM PDU k+1, wherein the payload length (Length) is 0, the HD-AISM field of the extended packet header is assigned a value of 1, Num_FD is equal to 2, indicating that the extensible controller supporting two frequency domain channels or the HD-MIMO center device includes a main controller and a sub-controller, Num_AIS is equal to 4, indicating that 4 AIS links are connected, SE_SN is equal to 0, the 4 enable bits of the BRET field are all set to 1, the BRAT field contains 4 resource allocation units, and the link numbers HD-AIS SN corresponding to the resource allocation units numbered 0 to 3 are 0, 2, 1, and 3 respectively, and the PDU numbers PDU SN are all k+1. The Direction of the resource allocation units numbered from 0 to 3 is 0, 1, 0, 1, respectively, indicating that the HD-AIS links with HD-AIS SNs 0 and 1 are in the audio output direction, and the HD-AIS links with HD-AIS SNs 2 and 3 are in the audio input direction. Bit 0 and bit 1 of the ACK MT are set to 1, and the other bits are 0, indicating that the HD-AIS links with HD-AIS SNs 0 and 1 in the audio output direction are required to reply with confirmation information. The FD SN of the resource allocation units numbered from 0 to 3 is 0, 0, 1, 1, respectively, indicating that the HD-AIS links with HD-AIS SNs 0 and 2 are transmitted and received through the main controller of the HD-MIMO central device scalable controller, and the HD-AIS links with HD-AIS SNs 1 and 3 are transmitted and received through the sub-controller of the HD-MIMO central device scalable controller.

[0319] After the HD-MIMO center device sends the HD-AISM PDU k+1 in the first SE, according to the resource allocation information of BRET and BRAT, the main controller first sends AISD0 PDU k+1 to the left channel earphone connected to the HD-AIS link with HD-AIS SN 0, and then receives AISD2 PDU k+1 sent by the left channel wireless microphone connected to the HD-AIS link with HD-AIS SN 2. The sub-controller first sends AISD1 PDU k+1 to the right channel earphone connected to the HD-AIS link with HD-AIS SN 1, and then receives AISD3 PDU k+1 sent by the right channel wireless microphone connected to the HD-AIS link with HD-AIS SN 3. Finally, the main controller receives the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel earphone, and the sub-controller receives the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel earphone. Among them, the NPI of ACK0 is set to 1, the Length is set to 0, the FD SN is set to 0, the Direction is set to 0, the HD-AIS SN is set to 0, and the PDU SN is set to k+1; the NPI of ACK1 is set to 1, the Length is set to 0, the FD SN is set to 1, the Direction is set to 0, the HD-AIS SN is set to 1, and the PDU SN is set to k+1.

[0320] The HD-AISD0 PDU k+1 and HD-AISD1 PDU k+1 sent by the HD-MIMO center device in the first SE are not correctly received by the left channel earphone and the right channel earphone. The HD-AISD2 PDU k+1 sent by the left channel wireless microphone is correctly received by the HD-MIMO center device, but the HD-AISD3 PDU k+1 sent by the right channel wireless microphone is not correctly received by the HD-MIMO center device. Therefore, the HD-MIMO center device sends the HD-AISMPDU numbered k+1 again in the second SE, that is, HD-AISM PDU k+1, in which SE_SN is equal to 1, the 4 bits of BRET are all set to 1, the link numbers HD-AIS SN corresponding to the resource allocation units numbered 0 to 3 in BRAT are 0, 3, 1, 3 respectively, and the PDU numbers PDU SN are all k+1. The Direction of the resource allocation units numbered 0 to 3 are 0, 1, 0, 1 respectively. Bit 0 and bit 1 of the ACK MT are set to 1, and the other bits are set to 0, indicating that the HD-AIS links in the audio output direction with HD-AIS SNs 0 and 1 need to reply with a reception confirmation message. The FD SNs of the resource allocation units numbered 0 to 3 are 0, 0, 1, 1, respectively, indicating that the HD-AIS link with HD-AIS SN 0 is sent and received through the main controller, the HD-AIS link with HD-AIS SN 1 is sent and received through the sub-controller, and the AISD3 PDU k+1 of the HD-AIS link with HD-AIS SN 3 can be received by both the main controller and the sub-controller at the same time. However, the AISD3 PDU k+1 occupies the second time domain resource in the second SE and is only sent once.

[0321] After the HD-MIMO center device sends the HD-AISM PDU k+1 in the second SE, according to the resource allocation information of BRET and BRAT, the main controller first sends the HD-AISD0 PDU k+1 to the left channel earphone connected to the HD-AIS link with HD-AIS SN of 0, and then receives the HD-AISD3 PDU k+1 sent by the right channel wireless microphone connected to the HD-AIS link with HD-AIS SN of 3. The sub-controller first sends the HD-AISD0 PDU k+1 to the right channel earphone connected to the HD-AIS link with HD-AIS SN of 1, and then receives the HD-AISD3 PDU k+1 sent by the right channel wireless microphone connected to the HD-AIS link with HD-AIS SN of 3. Finally, the main controller receives the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel headphone, and the sub-controller receives the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel headphone, where the NPI of ACK0 is set to 1, the Length is set to 0, the FD SN is set to 0, the Direction is set to 0, the HD-AIS SN is set to 0, and the PDU SN is set to k+1. The NPI of ACK1 is set to 1, the Length is set to 0, the FD SN is set to 1, the Direction is set to 0, the HD-AIS SN is set to 1, and the PDU SN is set to k+1.

[0322] It can be seen that the HD-AISD3PDUk+1 sent by the right channel wireless microphone connected to the HD-AIS link with HD-AIS SN 3 can be received by the main controller and the sub-controller at the same time, improving the transmission reliability through spatial diversity.

[0323] The HD-AISD0 PDU k+1 and HD-AISD1 PDU k+1 sent by the HD-MIMO center device in the second SE are not correctly received by the left channel earphone and the right channel earphone, and the HD-AISD3 PDU k+1 sent by the right channel wireless microphone is correctly received by the HD-MIMO center device. Therefore, the HD-MIMO center device sends the HD-AISM PDU numbered k+1 again in the third SE, that is, HD-AISM PDU k+1, in which SE_SN is equal to 2, the 4 bits of BRET are all set to 1, the link numbers HD-AIS SN corresponding to the resource allocation units numbered 0 to 3 in BRAT are 0, 1, 1, 0 respectively, and the PDU numbers PDU SN are all k+1. The Directions of the resource allocation units numbered 0 to 3 are 0, 0, 0, 0 respectively. Bit 0 and bit 1 of ACK MT are set to 1, and the other bit positions are 0, which means that the HD-AIS link reply confirmation information of the audio output direction with HD-AIS SN 0 and 1 is required. The FD SNs of the resource allocation units numbered from 0 to 3 are 0, 0, 1, and 1, respectively, indicating that the main controller sequentially sends HD-AISD0 PDU k+1 of the HD-AIS link with HD-AIS SN being 0 and HD-AISD1 PDU k+1 of the HD-AIS link with HD-AIS SN being 1, and then receives ACK0 replied by the HD-AIS link with HD-AIS SN being 0. The sub-controller sequentially sends HD-AISD1 PDU k+1 of the HD-AIS link with HD-AIS SN being 1 and HD-AISD0 PDU k+1 of the HD-AIS link with HD-AIS SN being 0, and then receives ACK1 replied by the HD-AIS link with HD-AIS SN being 1.

[0324] After the HD-MIMO center device sends the HD-AISM PDU k+1 in the third SE, according to the resource allocation information of BRET and BRAT, the main controller first sends the HD-AISD0 PDU k+1 to the left channel headphone connected to the HD-AIS link with HD-AIS SN of 0, and then sends the HD-AISD1 PDU k+1 to the right channel headphone connected to the HD-AIS link with HD-AIS SN of 1. The sub-controller first sends the HD-AISD1 PDU k+1 to the right channel headphone connected to the HD-AIS link with HD-AIS SN of 1, and then sends the HD-AISD0 PDU k+1 to the left channel headphone connected to the HD-AIS link with HD-AIS SN of 0. Finally, the main controller receives the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel earphone and the sub-controller receives the AISD Null PDU (ACK1) carrying confirmation information sent by the right channel earphone, where the NPI of ACK0 is set to 1, the Length is set to 0, the FD SN is set to 0, the Direction is set to 0, the HD-AIS SN is set to 0, and the PDU SN is set to k+1. The NPI of ACK1 is set to 1, the Length is set to 0, the FD SN is set to 1, the Direction is set to 0, the HD-AIS SN is set to 1, and the PDU SN is set to k+1.

[0325] It can be seen that HD-AISD0 PDU k+1 and HD-AISD1 PDU k+1 are both sent twice in the third SE, through the main controller and the secondary controller respectively. The number of retransmissions is increased by sharing resources in the hybrid domain, and frequency domain and spatial domain diversity are obtained to improve transmission reliability.

[0326] The HD-AISD1 PDU k+1 sent by the HD-MIMO center device in the third SE is correctly received by the right channel headphone, and the ACK1 replied by the right channel headphone is also correctly received by the HD-MIMO center device. However, the HD-AISD0 PDU k+1 is not correctly received by the left channel headphone. Therefore, the HD-MIMO center device sends the HD-AISM PDU numbered k+1 again in the fourth SE, that is, HD-AISM PDU k+1, in which SE_SN is equal to 4, the 0th and 3rd of the 4 bits of BRET are set to 1, and the others are set to 0, the link numbers HD-AIS SN corresponding to the resource allocation units numbered 0 to 1 in BRAT are 0, 0 respectively, and the PDU numbers PDU SN are all k+1. The Direction of the resource allocation units numbered 0 to 1 is 0, 0 respectively. Bit 0 of ACK MT is set to 1, and the other bit positions are 0, which means that the HD-AIS link reply confirmation information of the audio output direction with HD-AIS SN of 0 is required. The FD SNs of the resource allocation units numbered from 0 to 1 are 0 and 1 respectively, indicating that the main controller sends the HD-AISD0 PDU k+1 of the HD-AIS link with the HD-AIS SN being 0 in the first time domain resource of the fourth SE, and then receives the ACK0 replied by the HD-AIS link with the HD-AIS SN being 0; the sub-controller sends the HD-AISD0 PDU k+1 of the HD-AIS link with the HD-AIS SN being 0 in the second time domain resource of the fourth SE, and then receives the ACK0 replied by the HD-AIS link with the HD-AIS SN being 0.

[0327] After the HD-MIMO center device sends the HD-AISM PDU k+1 in the fourth SE, according to the resource allocation information of BRET and BRAT, the main controller first sends the HD-AISD0 PDU k+1 to the left channel earphone connected to the HD-AIS link with HD-AIS SN of 0 in the first time domain resource, and the sub-controller then sends the HD-AISD0 PDU k+1 to the left channel earphone connected to the HD-AIS link with HD-AISSN of 0 in the second time domain resource. Finally, both the main controller and the sub-controller receive the AISD Null PDU (ACK0) carrying confirmation information sent by the left channel earphone, where the NPI of ACK0 is set to 1, the Length is set to 0, the FD SN is set to 0, the Direction is set to 0, the HD-AIS SN is set to 0, and the PDU SN is set to k+1.

[0328] In the fourth SE of the HD-MIMO center device, the HD-AISD0 PDU k+1 sent by the master controller is not correctly received by the left channel earphone, but the HD-AISD0 PDU k+1 sent by the slave controller is correctly received by the left channel earphone, and the ACK0 replied by the left channel earphone is also correctly received by both the master controller and the slave controller. Therefore, the HD-AISD0 PDU k+1 is correctly received by the HD-MIMO center device.

[0329] It can be seen that in the fourth SE, HD-AISD0 PDU k+1 is sent by the main controller and the sub-controller respectively. While increasing the number of retransmissions through hybrid domain shared resources, it also improves transmission reliability through spatial diversity.

[0330] As shown in Figure 14(b), within the four SEs, the HD-AIS link numbered 2 uses one transmission opportunity, the HD-AIS link numbered 3 uses three transmission opportunities, the HD-AIS link numbered 1 obtains four transmission opportunities, and the HD-AIS link numbered 0 obtains six transmission opportunities. This enables flexible configuration of time slot resources between different HD-AIS links and improves overall link efficiency. In addition, the HD-AIS links coded 0, 1, and 3 obtain frequency diversity and spatial diversity provided by multiple controllers, thereby improving transmission reliability.

[0331] It should also be noted that in this example, if any of HD-AISD0 PDU k+1, HD-AISD1 PDU k+1, HD-AISD2 PDU k+1, and HD-AISD3 PDU k+1 is not successfully and correctly transmitted in the equal time interval numbered k+1, it can be repeatedly transmitted in the equal time intervals numbered k+2, K+3, ... until the flush time (FT) times out, where the PDU SN remains unchanged. FT=1 means that it is only sent in the current equal time interval and will not be retransmitted in the next equal time interval; FT=2 means that it can be retransmitted in two consecutive equal time intervals. The larger the FT, the higher the transmission reliability, but the greater the transmission delay. Generally, when low delay is required, FT=1.

[0332] As can be seen from the example provided in FIG. 14, by using the HD-AIG protocol, the hybrid domain resources available to each HD-AIS link in the wireless game console audio system are flexibly configured rather than fixedly configured. The wireless game console audio system can flexibly allocate different hybrid domain resources to different HD-MIMO peripheral devices or their corresponding HD-AIS links according to the channel quality or reception status of each HD-AIS link, thereby improving the link efficiency and transmission reliability of wireless multi-microphones and wireless multi-channel headphones. More importantly, hybrid domain resources including time domain and frequency domain can also be shared between the wireless audio input link and the wireless audio output link.

[0333] The embodiment of the present application also provides a wireless audio data transmission device 1400, which is applied to a central device, wherein the central device includes: an application and a main processor, a main control component, and at least one sub-control component;

[0334] The central device wirelessly communicates with N peripheral devices in a hybrid domain based on N communication links, respectively, wherein the N peripheral devices include an audio input device and / or an audio output device, the hybrid domain includes at least a time domain and a frequency domain, and N is an integer greater than or equal to 2;

[0335] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit an audio data packet with any one of the N peripheral devices;

[0336] like Fig.15 As shown, the device 1500 includes:

[0337] The control packet first transmission module 1501 is used to enable the main control component and / or the sub-control component to send the same control data packet to the N peripheral devices within the control transmission period of the target sub-event, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, the resource unit allocated to each target peripheral device in the target sub-event, and the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target sub-event, wherein the target sub-event is one of the multiple sub-events;

[0338] The audio packet first transmission module 1502 is used to enable the main control component and / or the sub-control component to transmit the corresponding audio data packet with each target peripheral device in the corresponding resource unit based on the resource configuration information during the audio transmission period of the target secondary event.

[0339] In one embodiment, the main control element is a main controller, the sub-control element is a sub-controller, the at least one sub-controller is connected to the main controller, and the main controller and the application are connected to a main processor; or,

[0340] The main control component is a main radio frequency unit, the sub-control component is a sub-radio frequency unit, the central device also includes a controller baseband and a protocol processor, the at least one sub-radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application, and the main radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application.

[0341] In one embodiment, when the number of resource units included in the target secondary event is greater than or equal to the number of target peripheral devices, one target peripheral device is allocated at least one resource unit included in the target secondary event, and different target peripheral devices are allocated different resource units.

[0342] In one embodiment, among the multiple resource units included in any one of the secondary events, the resource unit allocated to the audio input device is the target input resource unit, and the resource unit allocated to the audio output device is the target output resource unit;

[0343] The time slot corresponding to any of the target input resource units in the time domain is different from the time slot corresponding to any of the target output resource units in the time domain.

[0344] In one embodiment, the audio packet first transmission module 1502 includes a first transmission unit, and the first transmission unit is specifically configured to:

[0345] In a first resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a first control component to transmit a corresponding audio data packet with a target peripheral device on a communication link corresponding to the target peripheral device;

[0346] In a second resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling the second control element to transmit a corresponding audio data packet with the one target peripheral device on a communication link corresponding to the target peripheral device;

[0347] Wherein, the first control element and the second control element are: two different control elements among the main control element and the at least one auxiliary control element;

[0348] The first resource unit and the second resource unit correspond to different time slots in the time domain.

[0349] In one embodiment, the audio packet first transmission module 1502 includes a second transmission unit, and the second transmission unit is specifically configured to:

[0350] In a resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, at least two third control components are enabled to simultaneously receive audio data packets sent by the target peripheral device based on communication links corresponding to the same target peripheral device; wherein the at least two third control components are: at least two different control components among the main control component and the at least one sub-control component.

[0351] In one embodiment, the audio packet first transmission module 1502 includes a third transmission unit, and the third transmission unit is specifically used to:

[0352] In a third resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, a third control element is enabled to send / receive an audio data packet corresponding to the first target peripheral device on a communication link corresponding to the first target peripheral device;

[0353] In a fourth resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a fourth control element to send / receive an audio data packet corresponding to the second target peripheral device on a communication link corresponding to the second target peripheral device;

[0354] Wherein, the third control element and the fourth control element are: two different control elements among the main control element and the at least one auxiliary control element;

[0355] The first target peripheral device and the second target peripheral device are: two different target peripheral devices among the target peripheral devices, and are both audio input devices or audio output devices;

[0356] The third resource unit and the fourth resource unit correspond to the same time slot in the time domain.

[0357] In one embodiment, the control packet first transmission module 1501 is specifically used for:

[0358] During the control transmission period of the target secondary event, the target control component is enabled to send the same control data packet to the N peripheral devices; wherein the target control component is: the control component with the best channel quality of the supported frequency channel among the main control component and the at least one sub-control component.

[0359] In one embodiment, the time domain included in the hybrid domain is divided into a plurality of continuous equal-time intervals, and a plurality of the sub-events are divided into one equal-time interval.

[0360] In one embodiment, the apparatus 1500 further includes an advertising packet transmission module, and the advertising packet transmission module is specifically configured to:

[0361] enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet within a target equal-time interval advertisement transmission period;

[0362] The target isochronous interval is one of the multiple isochronous intervals, the advertisement transmission period and the control transmission period do not overlap each other, and the advertisement transmission period and the audio transmission period do not overlap each other.

[0363] In one embodiment, enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet during the target equal-time interval advertisement transmission period includes:

[0364] enabling the target control component to broadcast the same advertisement data packet in a time slot of the target equidistant advertisement transmission period;

[0365] The target control component is: among the main control component and the at least one sub-control component, the control component supporting the frequency channel with the best channel quality.

[0366] In one embodiment, the control data packet includes at least one of the following:

[0367] A first management parameter, used to indicate the total number of control components of a control component set corresponding to the main control component and the at least one secondary control component;

[0368] A second management parameter, used to indicate the number of communication links to which the central device is connected;

[0369] The third management parameter is used to indicate the sequence number of the corresponding secondary event;

[0370] A confirmation mapping table, used to indicate whether each communication link in the communication links to which the central device is connected replies with confirmation information;

[0371] An enable mapping table, used to indicate whether multiple resource units included in a corresponding secondary event are enabled;

[0372] An allocation mapping table is used to indicate the control component serial number, transmission direction, communication link serial number and protocol data unit serial number of each enabled resource unit corresponding to the control component in the control component set in at least one enabled resource unit included in the corresponding secondary event.

[0373] In one embodiment, the audio data packet includes audio data and preset parameters, wherein the preset parameters include at least one of the following:

[0374] A first sub-parameter for indicating a control component sequence number of a control component corresponding to the audio data packet in the control component set;

[0375] A second sub-parameter used to indicate a transmission direction corresponding to the audio data packet;

[0376] A third sub-parameter for indicating a sequence number of a communication link corresponding to the audio data packet;

[0377] A fourth sub-parameter is used to indicate the sequence number of the audio data packet.

[0378] The wireless audio data transmission device 1500 provided in the embodiment of the present application can implement each process in the embodiment of the wireless audio data transmission method on the central device side, and will not be described again here to avoid repetition.

[0379] The embodiment of the present application further provides a wireless audio data transmission device 1600, which is applied to a peripheral device, wherein the peripheral device wirelessly communicates with a central device in a hybrid domain based on a communication link, wherein the hybrid domain includes at least a time domain and a frequency domain, and the peripheral device is an audio input device or an audio output device;

[0380] The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with the central device;

[0381] like Fig.16 As shown, the device 1600 includes:

[0382] The control packet second transmission module 1601 is used to receive a control data packet sent by the central device within the control transmission period of the target secondary event, wherein the control data packet carries resource configuration information, and when the peripheral device is allowed to send / receive the corresponding audio data packet based on the communication link within the target secondary event, the resource configuration information is used to indicate: the resource unit allocated to the peripheral device in the target secondary event;

[0383] The audio packet second transmission module 1602 is used to transmit the corresponding audio data packet in the corresponding resource unit with the central device based on the resource configuration information during the audio transmission period of the target secondary event.

[0384] In one embodiment, when the peripheral device is allowed to send / receive corresponding audio data packets based on the communication link within the target secondary event, the peripheral device is allocated at least one resource unit in the target secondary event;

[0385] Wherein, when the peripheral device is allocated with a plurality of resource units in the target sub-event and the peripheral device is an audio output device, the plurality of resource units allocated to the peripheral device in the target sub-event correspond to different time slots in the time domain.

[0386] The wireless audio data transmission device 1600 provided in the embodiment of the present application can implement each process in the embodiment of the wireless audio data transmission method on the peripheral device side, and will not be described again here to avoid repetition.

[0387] According to an embodiment of the present application, the present application also provides an electronic device and a readable storage medium.

[0388] Fig.17 1 shows a schematic block diagram of an example electronic device 1700 that can be used to implement embodiments of the present application. Fig.17 As shown, the device 1700 includes a computing unit 1701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1702 or a computer program loaded from a storage unit 1708 to a random access memory (RAM) 1703. In RAM 1703, various programs and data required for the operation of the device 1700 can also be stored. The computing unit 1701, ROM 1702, and RAM 1703 are connected to each other via a bus 1704. An input / output (I / O) interface 1705 is also connected to the bus 1704.

[0389] A number of components in the device 1700 are connected to the I / O interface 1705, including: an input unit 1706, such as a keyboard, a mouse, etc.; an output unit 1707, such as various types of displays, speakers, etc.; a storage unit 1708, such as a disk, an optical disk, etc.; and a communication unit 1709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1709 allows the device 1700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0390] The computing unit 1701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 1701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSP), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1701 performs the various methods and processes described above, such as wireless audio data transmission methods. For example, in some embodiments, the wireless audio data transmission method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 1700 via the ROM 1702 and / or the communication unit 1709. When the computer program is loaded into the RAM 1703 and executed by the computing unit 1701, one or more steps of the wireless audio data transmission method described above may be performed. Alternatively, in other embodiments, the computing unit 1701 may be configured to execute the wireless audio data transmission method in any other appropriate manner (eg, by means of firmware).

[0391] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0392] The program code for implementing the method of the present application can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, implements the functions / operations specified in the flow chart and / or block diagram. The program code can be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0393] In the context of the present application, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0394] The present application also provides a computer program product, including computer instructions, which, when executed by a processor, implement the above Figure 1 or Fig.12 The various processes of the method embodiment shown can achieve the same technical effect, and will not be described again here to avoid repetition.

[0395] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the expected results of the technical solution disclosed in this application can be achieved, and this document is not limited here.

[0396] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of this application should be included in the protection scope of this application.

Claims

1. A wireless audio data transmission method, characterized in that: Applied to a central device, the central device comprising: an application and a main processor, a main control component, and at least one secondary control component; The central device wirelessly communicates with N peripheral devices in a hybrid domain based on N communication links, respectively, wherein the N peripheral devices include an audio input device and / or an audio output device, the hybrid domain includes at least a time domain and a frequency domain, and N is an integer greater than or equal to 2; The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit an audio data packet with any one of the N peripheral devices; The method comprises: During a control transmission period of a target secondary event, the main control component and / or the secondary control component are enabled to send a same control data packet to the N peripheral devices, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, a resource unit allocated to each target peripheral device in the target secondary event, wherein the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events; During the audio transmission period of the target secondary event, based on the resource configuration information, the main control component and / or the sub-control component are enabled to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit.

2. The method according to claim 1, characterized in that: The main control element is a main controller, the sub-control element is a sub-controller, the at least one sub-controller is connected to the main controller, and the main controller and the application are connected to a main processor; or, The main control component is a main radio frequency unit, the sub-control component is a sub-radio frequency unit, the central device also includes a controller baseband and a protocol processor, the at least one sub-radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application, and the main radio frequency unit is connected to the main processor through the controller baseband and the protocol processor and the application.

3. The method according to claim 1, characterized in that When the number of resource units included in the target secondary event is greater than or equal to the number of the target peripheral devices, one of the target peripheral devices is allocated at least one resource unit included in the target secondary event, and different target peripheral devices are allocated different resource units.

4. The method according to claim 1, characterized in that: Among the multiple resource units included in any one of the sub-events, the resource unit allocated to the audio input device is the target input resource unit, and the resource unit allocated to the audio output device is the target output resource unit; The time slot corresponding to any of the target input resource units in the time domain is different from the time slot corresponding to any of the target output resource units in the time domain.

5. The method according to claim 1, characterized in that The method of enabling the main control component and / or the sub-control component to transmit a corresponding audio data packet in a corresponding resource unit with each target peripheral device based on the resource configuration information during the audio transmission period of the target secondary event includes: In a first resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a first control component to transmit a corresponding audio data packet with a target peripheral device on a communication link corresponding to the target peripheral device; In a second resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling the second control element to transmit a corresponding audio data packet with the one target peripheral device on a communication link corresponding to the target peripheral device; Wherein, the first control element and the second control element are: two different control elements among the main control element and the at least one auxiliary control element; The first resource unit and the second resource unit correspond to different time slots in the time domain.

6. The method according to claim 1, characterized in that The method of enabling the main control component and / or the sub-control component to transmit a corresponding audio data packet in a corresponding resource unit with each target peripheral device based on the resource configuration information during the audio transmission period of the target secondary event includes: In a resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, at least two third control components are enabled to simultaneously receive audio data packets sent by the target peripheral device based on communication links corresponding to the same target peripheral device; wherein the at least two third control components are: at least two different control components among the main control component and the at least one sub-control component.

7. The method according to claim 1, characterized in that The method of enabling the main control component and / or the sub-control component to transmit a corresponding audio data packet in a corresponding resource unit with each target peripheral device based on the resource configuration information during the audio transmission period of the target secondary event includes: In a third resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, a third control element is enabled to send / receive an audio data packet corresponding to the first target peripheral device on a communication link corresponding to the first target peripheral device; In a fourth resource unit of the audio transmission period of the target secondary event, based on the resource configuration information, enabling a fourth control element to send / receive an audio data packet corresponding to the second target peripheral device on a communication link corresponding to the second target peripheral device; Wherein, the third control element and the fourth control element are: two different control elements among the main control element and the at least one auxiliary control element; The first target peripheral device and the second target peripheral device are: two different target peripheral devices among the target peripheral devices, and are both audio input devices or audio output devices; The third resource unit and the fourth resource unit correspond to the same time slot in the time domain.

8. The method according to claim 1, characterized in that The step of enabling the main control component and / or the sub-control component to send the same control data packet to the N peripheral devices within the control transmission period of the target secondary event includes: During the control transmission period of the target secondary event, the target control component is enabled to send the same control data packet to the N peripheral devices; wherein the target control component is: the control component with the best channel quality of the supported frequency channel among the main control component and the at least one sub-control component.

9. The method according to any one of claims 1 to 8, characterized in that The time domain included in the hybrid domain is divided into a plurality of continuous equal-time intervals, and a plurality of the sub-events are divided into one equal-time interval.

10. The method according to claim 9, characterized in that The method further comprises: enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet within a target equal-time interval advertisement transmission period; The target isochronous interval is one of the multiple isochronous intervals, the advertisement transmission period and the control transmission period do not overlap each other, and the advertisement transmission period and the audio transmission period do not overlap each other.

11. The method according to claim 10, characterized in that The method of enabling the main control component and / or the sub-control component to broadcast the same advertisement data packet during the target equal-time interval advertisement transmission period includes: enabling the target control component to broadcast the same advertisement data packet in a time slot of the target equidistant advertisement transmission period; The target control component is: among the main control component and the at least one sub-control component, the control component supporting the frequency channel with the best channel quality.

12. The method according to any one of claims 1 to 8, characterized in that The control data packet includes at least one of the following: A first management parameter, used to indicate the total number of control components of a control component set corresponding to the main control component and the at least one secondary control component; A second management parameter, used to indicate the number of communication links to which the central device is connected; The third management parameter is used to indicate the sequence number of the corresponding secondary event; A confirmation mapping table, used to indicate whether each communication link in the communication links to which the central device is connected replies with confirmation information; An enable mapping table, used to indicate whether multiple resource units included in a corresponding secondary event are enabled; An allocation mapping table is used to indicate the control component serial number, transmission direction, communication link serial number and protocol data unit serial number of each enabled resource unit corresponding to the control component in the control component set in at least one enabled resource unit included in the corresponding secondary event.

13. The method according to any one of claims 1 to 8, characterized in that The audio data packet includes audio data and preset parameters, wherein the preset parameters include at least one of the following: A first sub-parameter for indicating a control component sequence number of a control component corresponding to the audio data packet in the control component set; A second sub-parameter used to indicate a transmission direction corresponding to the audio data packet; A third sub-parameter for indicating a sequence number of a communication link corresponding to the audio data packet; A fourth sub-parameter is used to indicate the sequence number of the audio data packet.

14. A wireless audio data transmission method, applied to peripheral equipment, characterized in that: The peripheral device wirelessly communicates with the central device in a hybrid domain based on a communication link, the hybrid domain includes at least a time domain and a frequency domain, and the peripheral device is an audio input device or an audio output device; The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with the central device; The method comprises: receiving a control data packet sent by the central device within a control transmission period of a target secondary event, the control data packet carrying resource configuration information, and in the case where the peripheral device is allowed to send / receive a corresponding audio data packet based on the communication link within the target secondary event, the resource configuration information is used to indicate: a resource unit allocated to the peripheral device in the target secondary event; During the audio transmission period of the target secondary event, the corresponding audio data packet is transmitted with the central device in the corresponding resource unit based on the resource configuration information.

15. The method according to claim 14, characterized in that In the case where the peripheral device is allowed to send / receive the corresponding audio data packet based on the communication link within the target secondary event, the peripheral device is allocated at least one resource unit in the target secondary event; Wherein, when the peripheral device is allocated with a plurality of resource units in the target sub-event and the peripheral device is an audio output device, the plurality of resource units allocated to the peripheral device in the target sub-event correspond to different time slots in the time domain.

16. A wireless audio data transmission system, characterized in that: The system comprises: N peripheral devices and one central device, N being an integer greater than or equal to 2, the central device comprising: an application and a main processor, a main control component, and at least one secondary control component; The central device wirelessly communicates with the N peripheral devices in a hybrid domain based on N communication links respectively, the N peripheral devices include an audio input device and / or an audio output device, and the hybrid domain includes at least a time domain and a frequency domain; The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used for the central device to transmit audio data packets with any one of the N peripheral devices; The central device is used for: During a control transmission period of a target secondary event, the main control component and / or the secondary control component are enabled to send a same control data packet to the N peripheral devices, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, a resource unit allocated to each target peripheral device in the target secondary event, wherein the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events; During the audio transmission period of the target secondary event, based on the resource configuration information, the main control component and / or the sub-control component are enabled to transmit a corresponding audio data packet with each target peripheral device in a corresponding resource unit.

17. A wireless audio data transmission device, characterized in that: Applied to a central device, the central device comprising: an application and a main processor, a main control component, and at least one secondary control component; The central device wirelessly communicates with N peripheral devices in a hybrid domain based on N communication links, respectively, wherein the N peripheral devices include an audio input device and / or an audio output device, the hybrid domain includes at least a time domain and a frequency domain, and N is an integer greater than or equal to 2; The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit an audio data packet with any one of the N peripheral devices; The device comprises: a control packet first transmission module, used for enabling the main control component and / or the sub-control component to send the same control data packet to the N peripheral devices within the control transmission period of the target secondary event, wherein the control data packet carries resource configuration information, and the resource configuration information is used to indicate: among the N peripheral devices, the resource unit allocated to each target peripheral device in the target secondary event, the target peripheral device is the peripheral device that is allowed to send an audio data packet to the central device or receive an audio data packet sent by the central device in the target secondary event, wherein the target secondary event is one of the multiple secondary events; The first audio packet transmission module is used to enable the main control component and / or the sub-control component to transmit the corresponding audio data packet with each target peripheral device in the corresponding resource unit based on the resource configuration information during the audio transmission period of the target secondary event.

18. A wireless audio data transmission device, applied to peripheral equipment, characterized in that: The peripheral device wirelessly communicates with the central device in a hybrid domain based on a communication link, the hybrid domain includes at least a time domain and a frequency domain, and the peripheral device is an audio input device or an audio output device; The time domain included in the hybrid domain is divided into a plurality of sub-events, each of the sub-events includes a control transmission period and an audio transmission period, the control transmission period is earlier than the audio transmission period in the same event, the audio transmission period includes a plurality of resource units, different resource units correspond to different time slots in the time domain and / or correspond to different frequency channels in the frequency domain, and any resource unit can be used to transmit audio data packets with the central device; The device comprises: A control packet second transmission module, used for receiving a control data packet sent by the central device within a control transmission period of a target secondary event, wherein the control data packet carries resource configuration information, and when the peripheral device is allowed to send / receive a corresponding audio data packet based on the communication link within the target secondary event, the resource configuration information is used to indicate: a resource unit allocated to the peripheral device in the target secondary event; The second audio packet transmission module is used to transmit the corresponding audio data packet in the corresponding resource unit with the central device based on the resource configuration information during the audio transmission period of the target secondary event.

19. An electronic device, characterized in that: It comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein when the program or instruction is executed by the processor, the steps of the wireless audio data transmission method as described in any one of claims 1 to 13 are implemented, or the steps of the wireless audio data transmission method as described in any one of claims 14 to 15 are implemented.

20. A computer-readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the wireless audio data transmission method as described in any one of claims 1 to 13 are implemented, or the steps of the wireless audio data transmission method as described in any one of claims 14 to 15 are implemented.

Images