Wireless audio transmission method and device

Abstract

The embodiment of the invention discloses a wireless audio transmission method and equipment, central equipment and peripheral equipment communicate in continuous equal time intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used for transmitting a main audio data stream, and the auxiliary transmission link is used for transmitting an auxiliary audio data stream. The auxiliary transmission link is used for transmitting an auxiliary audio data stream, the transmission priority of the main transmission link is higher than that of the auxiliary transmission link, and in an equal time interval, after transmission of a main audio data packet on the main transmission link is completed in one or more first event intervals and under the condition of remaining time slots, the main audio data packet on the main transmission link is transmitted. Transmission of consonant data packets of the auxiliary transmission link is completed in one or more second event intervals, and the one or more first event intervals and the second event intervals are at least partially overlapped in the time domain. Compared with the prior art, the embodiment of the invention can improve the adaptability of wireless audio transmission to a rapidly changing wireless communication environment.

Description

Technical Field

[0001] The present invention relates to the field of wireless communication technology, and in particular to a wireless audio transmission method and device. Background Art

[0002] Wireless audio technology brings people the freedom to talk or enjoy music without any restrictions, and has won wide popularity. In particular, the Bluetooth Low Energy (BLE) audio technology based on the Connected Isochronous Stream (CIS) link and the Connected Isochronous Group (CIG) protocol composed of at least one CIS link and the Low Complexity Communication Codec (LC3) will bring people wireless audio services with lower power consumption, lower cost and higher quality. In addition, the BLE high data throughput (HDT) physical layer (PHY) supported by the new generation of BLE specifications provides higher transmission rates, such as 4Mbps, 6Mbps and 7.5Mbps, which will make it possible for BLE Audio to provide high-resolution audio (HRA: High Resolution Audio) or lossless audio (Lossless Audio) that requires higher bandwidth.

[0003] However, the transmission distance, wireless signal fading and interference in the wireless communication environment in the BLE Audio application scenario may be constantly changing. The fixed coding rate, fixed physical layer (PHY) and fixed link parameters based on the existing CIG link are difficult to adapt to the rapidly changing wireless communication environment. The method of adjusting the coding rate, physical layer (PHY) and CIG link parameters according to the changes in the wireless communication environment is difficult to adapt to the rapidly changing wireless communication environment. In other words, in the process of adjusting the coding rate, physical layer (PHY) and link parameters, communication performance and audio quality instability are likely to occur. Summary of the invention

[0004] The embodiments of the present invention provide a wireless audio transmission method and device to improve the adaptability of wireless audio transmission to a rapidly changing wireless communication environment.

[0005] In a first aspect, an embodiment of the present invention provides a wireless audio transmission method for a central device.

[0006] The central device and the peripheral device communicate with each other in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link. The method comprises: in a current isochronous interval,

[0007] Transmitting a main audio data packet within one or more first event intervals based on the main transmission link;

[0008] When the transmission of the main audio data packet is completed and there are remaining time slots in the current equal time interval, transmitting the auxiliary audio data packet in one or more second event intervals based on the auxiliary transmission link;

[0009] The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream;

[0010] One or more first event intervals overlap at least partially with the second event interval in the time domain

[0011] In a second aspect, an embodiment of the present invention provides a wireless audio transmission method for a peripheral device, wherein the peripheral device and the central device communicate in a continuous isochronous interval based on at least one main transmission link and at least one auxiliary transmission link, wherein the main transmission link is used to transmit a main audio data stream, and the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link, and the method comprises: within the current isochronous interval,

[0012] Receiving a main audio data packet sent by the central device within one or more first event intervals based on the main transmission link;

[0013] When the reception of the main audio data packet is completed and there are remaining time slots in the current isochronous interval, receiving the auxiliary audio data packet sent by the central device within one or more second event intervals based on the auxiliary transmission link;

[0014] The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream;

[0015] One or more first event intervals overlap at least partially with the second event intervals in the time domain.

[0016] In a third aspect, an embodiment of the present invention provides a central device, wherein the central device communicates with peripheral devices in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, wherein the main transmission link is used to transmit a main audio data stream, and the auxiliary transmission link is used to transmit an auxiliary audio data stream, wherein the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link, and the central device includes:

[0017] A first main audio data stream transmission unit, configured to transmit a main audio data packet in one or more first event intervals based on the main transmission link in a current isochronous interval;

[0018] A first auxiliary audio data stream transmission unit is used to transmit auxiliary audio data packets within one or more second event intervals of the current equal time interval based on the auxiliary transmission link when the first main audio data stream transmission unit completes the transmission of the main audio data packet and there are remaining time slots in the current equal time interval; one or more first event intervals at least partially overlap with the second event interval in the time domain.

[0019] In a fourth aspect, an embodiment of the present invention provides a peripheral device, wherein the peripheral device communicates with a central device in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, wherein the main transmission link is used to transmit a main audio data stream, and the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link, and the peripheral device includes:

[0020] A second main audio data stream transmission unit is used to receive the main audio data packet sent by the central device in one or more first event intervals based on the main transmission link in the current isochronous interval;

[0021] A second auxiliary audio data stream transmission unit is used to receive the auxiliary audio data packets sent by the central device within one or more second event intervals of the current isochronous interval based on the auxiliary transmission link when the main audio data stream transmission unit completes the transmission of the main audio data packet and there are remaining time slots in the current isochronous interval;

[0022] The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream;

[0023] One or more first event intervals overlap at least partially with the second event intervals in the time domain.

[0024] In the above technical solution, since the first event interval and the second event interval at least partially overlap in the time domain, that is, the main transmission link and the auxiliary transmission link at least share part of the time slot resources. At the same time, the main transmission link preferentially occupies the time slot resources in the isochronous communication, so that in a rapidly changing wireless communication environment, the time slot resources of the main transmission link can be preferentially guaranteed, and adaptive hierarchical transmission can be realized without adjusting the link parameters, thereby improving the adaptability of wireless audio transmission to the rapidly changing wireless communication environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0026] Figure 1 A schematic diagram of the structure of a wireless audio transmission system provided by an embodiment of the present invention;

[0027] Figure 2 A schematic diagram of a flow chart of a wireless audio transmission method provided by an embodiment of the present invention;

[0028] Figure 3 A schematic diagram of a flow chart of another wireless audio transmission method provided by an embodiment of the present invention;

[0029] Figure 4 A principle block diagram of a central device according to an embodiment of the present invention;

[0030] Figure 5 A principle block diagram of an encoder in a central device provided by an embodiment of the present invention;

[0031] Figure 6 A principle block diagram of a peripheral device provided by an embodiment of the present invention;

[0032] Figure 7 A principle block diagram of a decoder in a peripheral device provided by an embodiment of the present invention;

[0033] Figure 8 A schematic diagram of a time slot structure of a HCIG link provided in an embodiment of the present invention;

[0034] Fig. 9 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0035] In order to make the purpose, technical scheme and advantages of the embodiments of the present invention clearer, the specific implementation methods of the embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention. The parts that can be combined with each other in the following embodiments, or the same or similar concepts or processes may not be repeated in some embodiments.

[0036] In the description of the embodiments of the present application, unless otherwise specified, “plurality” means two or more.

[0037] This embodiment provides a wireless audio transmission method. Figure 1 The figure shows a schematic diagram of the architecture of a wireless audio transmission system including a central device (Central) and a peripheral device (Peripheral) in this embodiment. The wireless audio transmission system adopts the wireless audio transmission method of this embodiment.

[0038] The central device may be any suitable device such as a mobile phone, a media player (such as MP3, MP4, etc.), a tablet computer, a laptop computer, a television, or a smart watch, and the central device may at least provide audio source output.

[0039] The peripheral device may be: a Bluetooth headset, a Bluetooth speaker, wireless glasses, a wireless bracelet, a wireless watch, a wireless car-mounted device, an augmented reality (AR) device, a virtual reality (VR) device, or other applicable devices. The peripheral device may at least receive wireless audio from the central device. In some specific embodiments, the peripheral device may also be used to play an audio stream.

[0040] Figure 2 The figure shows a flow chart of a wireless audio transmission method of the present embodiment, which is used for a central device, wherein the central device communicates with peripheral devices in continuous equal time intervals based on at least one main transmission link and at least one auxiliary transmission link. The main transmission link is used to transmit a main audio data stream, and the auxiliary transmission link is used to transmit an auxiliary audio data stream. The transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link.

[0041] The method comprises: within a current equal time interval,

[0042] S101, transmitting a main audio data packet within one or more first event intervals based on the main transmission link;

[0043] The main audio data packet is an audio data packet in the main audio data stream.

[0044] S102, when the transmission of the main audio data packet is completed and there are remaining time slots in the current equal time interval, transmitting the auxiliary audio data packet in one or more second event intervals based on the auxiliary transmission link;

[0045] The auxiliary audio data packet is an audio data packet in the auxiliary audio data stream.

[0046] It can be understood that the current equal time interval is an equal time interval within the continuous equal time intervals.

[0047] In this embodiment, one or more first event intervals corresponding to the main transmission link are configured in an equal time interval, and one or more second event intervals corresponding to the auxiliary transmission link are also configured, wherein the one or more first event intervals and the second event intervals at least partially overlap in the time domain.

[0048] The first event interval and the second event interval overlap at least partially in the time domain, that is, the main transmission link and the auxiliary transmission link share at least part of the time slot resources. At the same time, the main transmission link preferentially occupies the time slot resources in the isochronous communication, so that in a rapidly changing wireless communication environment, the time slot resources of the main transmission link can be preferentially guaranteed, and adaptive hierarchical transmission can be realized without adjusting the link parameters, thereby improving the adaptability of wireless audio transmission to a rapidly changing wireless communication environment.

[0049] It can be understood that the number of auxiliary transmission links can be configured according to specific application scenarios, for example, Figure 1 The auxiliary transmission link 1 and the auxiliary transmission link 2 shown may also be other numbers of auxiliary transmission links, which is not specifically limited in the present application.

[0050] In some specific embodiments, when there are multiple auxiliary transmission links, the transmission priorities of all auxiliary transmission links can be configured to be the same. For example, the second event interval in an equal time interval can be configured to correspond to each auxiliary transmission link, so that when the transmission of the main audio data packet of the main transmission link is completed and there are remaining time slots in the current equal time interval, based on the corresponding relationship between the second event interval in the remaining time slot and the auxiliary transmission link, the auxiliary audio data packet is transmitted on the corresponding auxiliary transmission link.

[0051] In other specific embodiments, when there are multiple auxiliary transmission links, the transmission priority of each auxiliary transmission link can be configured differently, so that the auxiliary audio data packet transmission of the auxiliary transmission link with a higher transmission priority is completed preferentially in one or more second event intervals within the remaining time slots of the current equal time interval.

[0052] Usually in wireless transmission, such as Bluetooth audio transmission, a link offset value is configured to coordinate the start time between multiple links, help the peripheral devices and central devices of the link to synchronize, and ensure that data packets are accurately sent and received within the predetermined time, thereby optimizing transmission efficiency and accuracy. In this embodiment, the offset value of the auxiliary transmission link is greater than or equal to the sum of the duration of the first event interval and the offset value of the main transmission link.

[0053] The first event interval may include: the first sending time slot, the first receiving time slot, the first inter-frame space (T_IFS: Time of Inter Frame Space), and the first minimum time slot space (T_MSS: Time of Minimum Slot Space) of the central device on the main transmission link. It can be understood that, for the peripheral device, the first sending time slot is equivalent to the third receiving time slot of the peripheral device on the main transmission link, and the first receiving time slot is equivalent to the third sending time slot of the peripheral device on the main transmission link. In some specific embodiments, the central device sends the main audio data packet to the peripheral device through the main transmission link in the first sending time slot of the first event interval based on the offset value of the main transmission link, and the peripheral device receives the main audio data packet in the third receiving time slot accordingly, and sends the main confirmation data packet to the central device in the third sending time slot. The central device receives the main confirmation data packet in the first receiving time slot accordingly, so as to judge whether the peripheral device has correctly received the sent main audio data packet and whether it needs to retransmit the audio data packet on the main transmission link according to the reception status and confirmation information of the main confirmation data packet.

[0054] The second event interval may include: the second sending time slot, the second receiving time slot, the second packet interval T_lFS, and the second minimum time slot interval T_MSS of the central device on the auxiliary transmission link. It can be understood that, for the peripheral device, the second sending time slot is equivalent to the fourth receiving time slot of the peripheral device on the auxiliary transmission link, and the second receiving time slot is equivalent to the fourth sending time slot of the peripheral device on the main transmission link. In some specific embodiments, the central device sends an auxiliary audio data packet to the peripheral device based on the auxiliary transmission link in the second sending time slot of the second event interval based on the offset value of the auxiliary transmission link, and the peripheral device receives the auxiliary audio data packet in the fourth receiving time slot accordingly, and sends an auxiliary confirmation data packet to the central device in the fourth sending time slot. The central device receives the auxiliary confirmation data packet in the second receiving time slot accordingly, so as to judge whether the peripheral device has correctly received the sent auxiliary audio data packet and whether the auxiliary audio data packet needs to be retransmitted on the auxiliary transmission link according to the reception status and confirmation information of the auxiliary confirmation data packet.

[0055] According to the relationship between the offset value of the primary transmission link and the offset value of the secondary transmission link, and the composition of the first event interval and the second event interval, it can be seen that the time slot relationship of each transmission link in this embodiment is neither the interleaved mode in the CIG link nor the sequential mode in the CIG link. It is referred to as the hierarchical mode in this article.

[0056] In some specific embodiments, the duration of a first event interval may be equal to the duration of a second event interval, thereby making the utilization rate of time slot resources higher.

[0057] In this embodiment, since the transmission resources of the primary transmission link are preferentially guaranteed, the primary audio data stream may be an audio data stream of higher importance, and the secondary audio data stream may be an audio data stream of lower importance.

[0058] It is understandable that the auxiliary audio data stream may be related to the main audio data stream, for example, the auxiliary audio data stream is part of the audio data of the main audio data stream; the auxiliary audio data stream may also be unrelated to the main audio data stream, for example, the main audio data stream is an alarm or voice, and the auxiliary audio data stream is background music. Specifically, the main audio data stream for the main transmission link and the auxiliary audio data stream for the auxiliary transmission link can be flexibly selected according to the actual application scenario.

[0059] For example, for the typical application scenario of multi-channel audio transmission, it can be configured that one channel occupies one main transmission link and one auxiliary transmission link. That is, multiple main transmission links correspond to multiple channels respectively, and multiple auxiliary links also correspond to multiple channels respectively. Multiple channels can be divided in the frequency domain, or they can be divided in the time domain through time division multiplexing. During time division multiplexing, a group of main transmission links and auxiliary transmission links of different channels may not share time slots, but the group of main transmission links and auxiliary transmission links share time slots internally. In addition, it can also be configured that one channel occupies one main transmission link and multiple auxiliary transmission links, and the auxiliary transmission links can also be configured with priorities, so that the least important audio and auxiliary transmission links can be adaptively followed by changes in the communication environment during transmission. Obviously, based on the design idea of ​​this embodiment, the main transmission link, auxiliary transmission link and the audio data transmitted on each link can be flexibly configured.

[0060] In some specific embodiments, the wireless audio transmission method can also be used to achieve high-performance wireless lossless audio transmission. The method further includes:

[0061] Get the audio data stream to be transmitted;

[0062] Performing lossy compression encoding on the audio data stream to obtain a main audio data stream containing a main audio data packet;

[0063] The difference data after the audio data stream is subjected to lossy compression encoding is losslessly encoded to obtain an auxiliary audio data stream containing an auxiliary audio data packet.

[0064] Since the audio data after lossy compression is used as the main audio data stream and transmitted on the main transmission link with high priority, and the difference data generated in the lossy compression of the audio data stream to be transmitted is losslessly encoded and transmitted as the auxiliary audio data stream on the auxiliary transmission link with lower priority, high-performance wireless lossless audio transmission can be supported in a wireless communication environment with short distance, less fading and less interference, and in a wireless communication environment with long distance, more fading and more interference, the coding rate can be automatically reduced to maintain smooth audio transmission without the need for channel estimation and channel quality feedback information.

[0065] In some specific embodiments, the obtaining of the audio data stream to be transmitted includes: obtaining lossless audio samples (Audio Sample), and framing the lossless audio samples to form audio sample frames with the same length.

[0066] In some specific embodiments, performing lossy compression encoding on the audio data stream to obtain a main audio data stream including a main audio data packet includes: performing lossy compression encoding on the audio sample frame to obtain the main audio data stream.

[0067] In some specific embodiments, the lossless encoding of the difference data after lossy compression encoding of the audio data stream to obtain a secondary audio data stream containing a secondary audio data packet includes: decoding the main audio data stream to obtain a lossy audio sample, calculating the difference between the lossy audio sample and the lossless audio sample, and losslessly encoding the difference to obtain the secondary audio data stream.

[0068] The lossy compression coding and lossless coding may adopt various existing or future coding methods suitable for this embodiment, such as LC3 coding, WavPack, FLAC, Huffman, etc.

[0069] In some specific embodiments, an asynchronous connection link (ACL: Asynchronous Connection-oriented) is also established between the central device and the peripheral device, and the asynchronous connection link is at least used for maintaining the link or transmitting link management commands, etc. The transmission priority of the asynchronous connection link is lower than the transmission priority of the auxiliary transmission link, wherein, in an equal time interval, when the transmission of the main audio data packet and the auxiliary audio data packet is completed and there are remaining time slots in the equal time interval, communication with the peripheral device is based on the asynchronous connection link.

[0070] In this embodiment, in order to prioritize the time slot resources for audio data transmission, the transmission priority of the asynchronous connection link is configured to be lower than the transmission priority of the auxiliary transmission link, so that the links for audio data transmission (including the main transmission link and the auxiliary transmission link) can share time slot resources with the asynchronous connection link.

[0071] In some specific embodiments, different buffers may be used to store the main audio data stream and the auxiliary audio data stream respectively, for example, the main audio data packet to be transmitted is stored in the main buffer, and the auxiliary audio data packet to be transmitted is stored in the auxiliary buffer. In some specific embodiments, both the main buffer and the auxiliary buffer may adopt a first-in-first-out buffer.

[0072] Assume that N first event intervals are configured in an equal time interval, where N is a positive integer. The transmission of the main audio data packet is completed in the current equal time interval, including:

[0073] A main audio data packet is obtained from the main buffer, and the main audio data packet is sent in the i-th first event interval in the current equal time interval; wherein i is a positive integer, and i is less than or equal to N.

[0074] confirming whether the main audio data packet is correctly received by the peripheral device, and deleting the main audio data packet from the main buffer if it is correctly received;

[0075] Confirm whether there are any remaining main audio data packets in the main buffer, and confirm whether there are any remaining time slots in the current equal time interval;

[0076] When there are remaining main audio data packets in the main buffer and there are remaining first event intervals in the current equal time interval, one of the remaining main audio data packets in the main buffer is sent in the (i+1)th first event interval in the current equal time interval;

[0077] When there is no remaining main audio data packet in the main buffer, or when the i-th first event interval is the N-th first event interval in the current equal time interval, the sending of the main audio data packet in the current equal time interval is stopped.

[0078] For example, if N=6, and there is 1 main audio data packet stored in the main buffer, that is, the number of main audio data packets that need to be transmitted in the current equal time interval is 1. At this time, the main audio data packet is sent in the 1st (i.e., i=1) first event interval of the current equal time interval. If it is confirmed that the peripheral device has correctly received the main audio data packet, the main audio data packet is deleted from the main buffer. At this time, there are no remaining main audio data packets in the main buffer, so the transmission of the main audio data packet in the current equal time interval is completed. If it is confirmed that the peripheral device has not received it correctly, the main audio data packet is retransmitted in the 2nd (i.e., i=2) first event interval of the current equal time interval. Since N=6, the main audio data packet can be sent up to 6 times in the current equal time interval until it is correctly received, or the time slot resources of all 6 first event intervals are used.

[0079] For another example, let N=6, and there are 2 main audio data packets (such as data packet A and data packet B) stored in the main buffer, that is, the number of main audio data packets that need to be transmitted in the current equal time interval is 2. At this time, the first main audio data packet: data packet A is sent in the 1st (i.e., i=1) first event interval of the current equal time interval. If it is confirmed that the peripheral device correctly receives data packet A, data packet A is deleted from the main buffer. At this time, data packet B is left in the main buffer, and data packet B is sent in the 2nd (i.e., i=2) first event interval of the current equal time interval. If data packet B is not correctly received by the peripheral device, data packet B is retransmitted in the subsequent 3rd to 6th first event intervals until data packet B is correctly received or the time slot resources of the first event interval in the current equal time interval are used up. If it is confirmed that the peripheral device does not correctly receive data packet A, then, as in the above example, data packet A is retransmitted in the subsequent 2nd to 6th first event intervals until data packet A is correctly received or the time slot resources of the first event interval in the current equal time interval are used up. If sending data packet A occupies all the time slot resources of the first event interval of the current equal time interval, data packet B will not be sent in the current equal time interval.

[0080] Assume that M second event intervals are configured in an equal time interval, where M is a positive integer. The transmission of the auxiliary audio data packet is completed in the current equal time interval, including:

[0081] Based on the remaining time slots of the current equal time interval after the transmission of the main audio data packet is completed, and the offset value of the auxiliary transmission link, it is determined that the jth second event interval in the current equal time interval can be used to send the auxiliary audio data packet, j is a positive integer, and j is less than or equal to M. It can be understood that the situation of the main transmission link occupying the time slot resources and the offset value of the auxiliary transmission link may affect the time slot resources starting from the second event interval in the current equal time interval that can be used to send the auxiliary audio data packet.

[0082] Acquire a secondary audio data packet from the secondary buffer, and send the secondary audio data packet in the j-th second event interval;

[0083] confirming whether the auxiliary audio data packet is correctly received by the peripheral device, and deleting the auxiliary audio data packet from the auxiliary buffer if it is correctly received;

[0084] Confirm whether there are any remaining auxiliary audio data packets in the auxiliary buffer, and confirm whether there are any remaining time slots in the current equal time interval;

[0085] In the case where there are remaining auxiliary audio data packets in the auxiliary buffer and there are remaining second event intervals in the current equal time interval, sending one of the remaining auxiliary audio data packets in the auxiliary buffer in the j+1th second event interval in the current equal time interval;

[0086] When there are no remaining auxiliary audio data packets in the auxiliary buffer, or when the jth second event interval is the Mth second event interval in the current equal time interval, the auxiliary audio data packets are stopped from being sent in the current equal time interval.

[0087] Based on the above settings, the central device can determine whether the transmission of the audio data packet is completed within the current equal time interval by combining the correct reception of the audio data packet by the peripheral device and the control of the deletion / retention operation of the audio data packet in the buffer.

[0088] It is understandable that other methods can also be used to complete the transmission of the main audio data packet or the auxiliary audio data packet within the current equal time interval. For example, it can be pre-set that only one main audio data packet or auxiliary audio data packet is transmitted within an equal time interval, so as to determine when to end the audio data packet transmission within the current equal time interval only based on the confirmation of peripheral devices.

[0089] Based on the above settings, the central device can adaptively complete the layered transmission of the main transmission link and the auxiliary transmission link with the peripheral devices.

[0090] like Figure 3 As shown, the embodiment of the present invention also provides a wireless audio transmission method for Figure 1 The peripheral devices shown communicate with the central device in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link.

[0091] The method comprises: within a current equal time interval,

[0092] S201, receiving a main audio data packet sent by the central device within one or more first event intervals based on the main transmission link;

[0093] The main audio data packet is an audio data packet in the main audio data stream.

[0094] S202, when the reception of the main audio data packet is completed and there are remaining time slots in the current equal time interval, receiving the auxiliary audio data packet sent by the central device within one or more second event intervals based on the auxiliary transmission link;

[0095] The auxiliary audio data packet is an audio data packet in the auxiliary audio data stream.

[0096] It can be understood that the current equal time interval is an equal time interval within the continuous equal time intervals.

[0097] In this embodiment, one or more first event intervals corresponding to the main transmission link are configured in an equal time interval, and one or more second event intervals corresponding to the auxiliary transmission link are also configured, wherein the one or more first event intervals and the second event intervals at least partially overlap in the time domain.

[0098] Furthermore, one of the first event intervals includes the third receiving time slot, the third sending time slot, the first inter-packet interval T_IFS, and the first minimum time slot interval T_MSS of the peripheral device on the main transmission link. It can be understood that, for the central device, the third receiving time slot is equivalent to the first sending time slot of the central device on the main transmission link, and the third sending time slot is equivalent to the first receiving time slot of the central device on the main transmission link.

[0099] The second event interval includes the fourth receiving time slot, the fourth sending time slot, the second inter-packet interval T_IFS, and the second minimum time slot interval T_MSS of the peripheral device on the auxiliary transmission link. It can be understood that, for the central device, the fourth receiving time slot and the second sending time slot are equivalent to the second sending time slot of the central device on the auxiliary transmission link, and the fourth sending time slot is equivalent to the second receiving time slot of the central device on the main transmission link.

[0100] In this embodiment, the offset value of the auxiliary transmission link is greater than or equal to the sum of the duration of the first event interval and the offset value of the primary transmission link.

[0101] In some specific embodiments, the duration of a first event interval may be equal to the duration of a second event interval, thereby making the utilization rate of time slot resources higher.

[0102] In this embodiment, since the transmission resources of the primary transmission link are preferentially guaranteed, the primary audio data stream may be an audio data stream of higher importance, and the secondary audio data stream may be an audio data stream of lower importance.

[0103] It is understandable that the auxiliary audio data stream may be related to the main audio data stream, for example, the auxiliary audio data stream is part of the audio data of the main audio data stream; in such cases, the peripheral device may process the received audio data based on the correlation between the main audio data stream and the auxiliary audio data stream, and use it for audio playback. The auxiliary audio data stream may also be unrelated to the main audio data stream, for example, the main audio data stream is an alarm or voice, and the auxiliary audio data stream is background music. In such cases, when the peripheral device plays the received audio data, it can at least improve the playback fluency of the main audio data stream.

[0104] In some specific embodiments, the wireless audio transmission method can also be used to achieve high-performance wireless lossless audio transmission, wherein the primary audio data packet carries audio data after lossy compression encoding, and the secondary audio data packet carries difference data corresponding to the primary audio data packet after lossless encoding.

[0105] The method further comprises:

[0106] If all the main audio data packets are correctly received within a predetermined time period, and all the auxiliary audio data packets corresponding to the main audio data packets are also correctly received, the main audio data packets are decoded to obtain main audio samples, the corresponding auxiliary audio data packets are losslessly decoded to obtain auxiliary audio samples, and the main audio samples and the auxiliary audio samples are summed and then lossless audio is output;

[0107] If all the main audio data packets are correctly received within a predetermined time period, but only the auxiliary audio data packets corresponding to some of the main audio data packets are correctly received, then, when the packet loss probability of the auxiliary audio data packets is less than or equal to a predetermined value, the main audio data packets are decoded to obtain main audio samples, auxiliary audio samples corresponding to the main audio data packets are obtained through lossless decoding and packet loss concealment technology, and the main audio samples and the auxiliary audio samples are summed and the restored lossless audio is output;

[0108] If all the main audio data packets are correctly received within a predetermined time period, but only the auxiliary audio data packets corresponding to some of the main audio data packets are correctly received, then, when the packet loss probability of the auxiliary audio data packets is greater than the predetermined value, the main audio data packets are decoded to obtain main audio samples, and the main audio samples are output;

[0109] If only part of the main audio data packets are correctly received within the predetermined time period, the repaired main audio samples are obtained through decoding and packet loss concealment technology, and the repaired main audio samples are output.

[0110] It is understandable that the predetermined duration and the predetermined value of the packet loss probability can be set based on a specific application scenario, and this application does not make any specific limitation on this.

[0111] Based on the above settings, this embodiment can support high-performance wireless lossless audio transmission in a short-distance wireless communication environment with less fading and interference. In a long-distance wireless communication environment with greater fading and interference, the coding rate can be automatically reduced to maintain smooth audio transmission without the need for channel estimation and channel quality feedback information. The lossless audio and the repaired lossless audio obtained by the peripheral device can be used to achieve lossless audio playback, thereby obtaining high-quality audio-visual effects. In a long-distance, fading and interference-intensive wireless communication environment, the main audio samples and the repaired main audio samples obtained by the peripheral device can be used to achieve smooth audio playback to meet the basic needs of users.

[0112] In some specific embodiments, an asynchronous connection link is also established between the peripheral device and the central device, and the transmission priority of the asynchronous connection link is lower than the transmission priority of the auxiliary transmission link. wherein, within the current equal time interval, after the reception of the main audio data packet and the auxiliary audio data packet is completed and there are remaining time slots within the equal time interval, communication with the central device is based on the asynchronous connection link.

[0113] In some specific embodiments, N first event intervals may be configured in an equal time interval, where N is a positive integer. The receiving of the main audio data packet is completed in the current equal time interval, including:

[0114] Receive a main audio data packet sent by the central device in the i-th first event interval in the current equal time interval; wherein i is a positive integer, and i is less than or equal to N.

[0115] Confirm whether there are still main audio data packets to be received within the current equal time interval, and confirm whether there are still remaining time slots within the current equal time interval;

[0116] If there are still main audio data packets to be received within the current equal time interval, and there are still remaining first event intervals within the current equal time interval, receiving the main audio data packets sent by the central device within the (i+1)th first event interval within the current equal time interval;

[0117] When there are no remaining main audio data packets to be received in the current equal time interval, or when the i-th first event interval is the N-th first event interval in the current equal time interval, the main audio data packets are stopped from being received in the current equal time interval.

[0118] In some specific embodiments, M second event intervals may be configured in one equal time interval; and completing the transmission of the auxiliary audio data packet in the current equal time interval includes:

[0119] Based on the remaining time slots of the current equal time interval after the reception of the primary audio data packet is completed, and the offset value of the secondary transmission link, determining that the jth second event interval in the current equal time interval can be used to receive the secondary audio data packet;

[0120] receiving a secondary audio data packet within the j-th second event interval;

[0121] Confirm whether there are any auxiliary audio data packets to be received within the current equal time interval, and confirm whether there are any remaining time slots within the current equal time interval;

[0122] If there are auxiliary audio data packets to be received within the current equal time interval and there are remaining second event intervals within the current equal time interval, receiving the auxiliary audio data packets within the j+1th second event interval within the current equal time interval;

[0123] When no auxiliary audio data packet needs to be received in the current equal time interval, or when the jth second event interval is the Mth second event interval in the current equal time interval, stop receiving auxiliary audio data packets in the current equal time interval;

[0124] Wherein, M and j are both positive integers, and j is less than or equal to M.

[0125] It is understandable that the confirmation of whether there are still main audio data packets or auxiliary audio data packets to be received in the current equal time interval can be carried out in a variety of ways. For example, if the main audio data packet is not received in the i-th first event interval, or an erroneous data packet is received, it can be considered that there are still main audio data packets to be received. Alternatively, if the main audio data packet correctly received in the current equal time interval carries an indication of how many main audio data packets are sent in the current equal time interval, it can also be determined based on the indication information whether there are still main audio data packets to be received. Similarly, a similar method can be used for the auxiliary audio data packet, which will not be repeated here.

[0126] Based on the above settings, the peripheral device can adaptively complete the layered transmission of the main transmission link and the auxiliary transmission link with the central device.

[0127] refer to Figure 4 This embodiment provides a central device, and the central device communicates with peripheral devices in continuous equal time intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, and the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link.

[0128] The central device comprises:

[0129] The first main audio data stream transmission unit 401 is used to transmit the main audio data packet in one or more first event intervals based on the main transmission link in the current isochronous interval;

[0130] The first auxiliary audio data stream transmission unit 402 is configured to transmit the auxiliary audio data packet within one or more second event intervals of the current equal time interval based on the auxiliary transmission link when the first main audio data stream transmission unit completes the transmission of the main audio data packet and there are remaining time slots in the current equal time interval;

[0131] The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream;

[0132] One or more first event intervals overlap at least partially with the second event intervals in the time domain.

[0133] In some specific embodiments, the central device also includes an encoder 403, which is used to receive an audio data stream to be transmitted, perform lossy compression encoding on the audio data stream to obtain a main audio data stream including a main audio data packet, and output it to the first main audio data stream transmission unit 401, and perform lossless encoding on the difference data after the lossy compression encoding of the audio data stream to obtain a secondary audio data stream including a secondary audio data packet, and output it to the first secondary audio data stream transmission unit 402.

[0134] Figure 5 FIG. 5 is a schematic diagram of a specific encoder structure, wherein the encoder includes a framing unit 501, a first lossy encoding unit 502, a first decoding unit 503, a difference calculation unit 504, and a lossless encoding unit 505;

[0135] The framing unit 501 is used to receive lossless audio samples of an audio data stream to be transmitted, and to frame the lossless audio samples to form audio sample frames having the same length;

[0136] The first lossy encoding unit 502 is used to receive the audio sample frames from the frame assembly unit 501, perform lossy compression encoding on the audio sample frames, and output them as the main audio data stream;

[0137] The first decoding unit 503 is configured to receive the main audio data stream from the first lossy encoding unit, decode the main audio data stream and output lossy audio samples.

[0138] The difference calculation unit 504 is used to receive the audio sample frame from the frame assembly unit 501 and the lossy audio sample from the first decoding unit 503, and calculate the difference between the lossy audio sample and the lossless audio sample;

[0139] The lossless encoding unit 505 is used to perform lossless encoding on the difference calculated by the difference calculation unit 504 and output the result as the auxiliary audio data stream.

[0140] It is understandable that the central device can implement the wireless audio transmission of this embodiment based on the various steps and methods in the aforementioned embodiments, and obtain the same technical effect. For the sake of simplicity, this article will not go into details.

[0141] refer to Figure 6This embodiment provides a peripheral device, wherein the peripheral device communicates with a central device in continuous equal time intervals based on at least one main transmission link and at least one auxiliary transmission link, wherein the main transmission link is used to transmit a main audio data stream, and the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link.

[0142] The peripheral equipment includes:

[0143] The second main audio data stream transmission unit 601 is used to receive the main audio data packet sent by the central device in one or more first event intervals based on the main transmission link in the current isochronous interval;

[0144] The second auxiliary audio data stream transmission unit 602 is configured to receive the auxiliary audio data packets sent by the central device within one or more second event intervals of the current isochronous interval based on the auxiliary transmission link when the main audio data stream transmission unit completes the transmission of the main audio data packet and there are remaining time slots in the current isochronous interval;

[0145] The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream;

[0146] One or more first event intervals overlap at least partially with the second event intervals in the time domain.

[0147] In some specific embodiments, the peripheral device further includes a decoder 603 for implementing lossless audio decoding.

[0148] Figure 7 The figure shows a principle block diagram of a peripheral device with a decoder, wherein the main audio data packet received by the second main audio data stream transmission unit 601 carries audio data after lossy compression encoding, and the auxiliary audio data packet received by the second auxiliary audio data stream transmission unit 602 carries difference data corresponding to the main audio data packet after lossless encoding.

[0149] The decoder 603 includes a second decoding unit 6031, a lossless decoding unit 6032 and a sum calculation unit 6033;

[0150] The second decoding unit 6031 is used to decode the received main audio data packet and output the main audio sample;

[0151] The lossless decoding unit 6032 is used to perform lossless decoding on the received auxiliary audio data packet corresponding to the main audio data packet and output auxiliary audio samples.

[0152] The sum calculation unit 6033 is used to calculate the sum of the primary audio sample and the secondary audio sample and output a lossless audio.

[0153] In some specific embodiments, a packet loss compensation module may be provided between the sum value calculation unit 6033 and the second decoding unit 6031, and between the calculation unit 6033 and the lossless decoding unit 6032, respectively, for repairing the main audio data packet and the auxiliary audio data packet respectively in the case of packet loss and a low probability of packet loss, so as to obtain the main audio sample and the auxiliary audio sample. In addition, in the case of packet loss and a high probability of packet loss, the auxiliary audio data packet may not be compensated for packet loss and repaired, and the main audio sample output by the second decoding unit 6031, or the main audio sample repaired by the packet loss compensation module, may be directly input to the sum value calculation unit 6033. At this time, since the auxiliary audio data packet is lost and no signal is input to the sum value calculation unit 6033, the output of the sum value calculation unit 6033 is the main audio sample or the repaired main audio sample.

[0154] It is understandable that the peripheral device can implement the wireless audio transmission of this embodiment based on the various steps and methods in the aforementioned embodiments, and obtain the same technical effect. For the sake of simplicity, this article will not go into details.

[0155] The following will use a typical embodiment of lossless audio transmission to explain in detail how the embodiment of the present invention is used to implement adaptive hierarchical transmission of wireless audio (AHTWA: Adaptively Hierarchical Transmission of Wireless Audio) transmission.

[0156] For ease of description, some definitions in this embodiment are first explained. Among them:

[0157] Will be like Figure 1 The wireless audio data transmission system shown is defined as an AHTWA system. In the AHTWA system, the central device is an audio source device, specifically a smart phone, and the peripheral device is a wireless audio terminal device, specifically a wireless headset.

[0158] The communication link between the central device and the peripheral device for audio transmission is defined as a hierarchical connected isochronous group (HCIG: Hierarchical Connected Isochronous Grcup) link, and the HCIG includes at least two hierarchical connected isochronous stream (HCIS: Hierarchical Connected Isochronous Stream) links, of which at least one main HCIS link (corresponding to Figure 1 The main transmission link shown in FIG. 1 is used to transmit the main audio stream, and at least one auxiliary HCIS link (corresponding to Figure 1 The auxiliary transmission link shown in the figure is used to transmit auxiliary audio streams. When HCIG is used to transmit wireless multi-channel audio, each channel is encoded into a main audio stream and at least one auxiliary audio stream. The multiple main audio streams corresponding to the multiple channels can be transmitted through multiple main HCIS links respectively, or they can be combined in one main HCIS link for transmission. The multiple auxiliary audio streams corresponding to the multiple channels can be transmitted through multiple auxiliary HCIS links respectively, or they can be combined in one auxiliary HCIS link for transmission.

[0159] The coding and decoding method of lossless audio between the central device and the peripheral device is defined as a lossless audio hierarchical coding and decoding (LAHC) method. The audio source device and the wireless audio terminal device use the hierarchical connection isochronous group HCIG: link adaptive transmission uses LAHC hierarchical coded audio data.

[0160] Without loss of generality, this embodiment further illustrates the characteristics of the HCIG link using a HCIG link consisting of a main HCIS link and an auxiliary HCIS link, that is, the HCIG established between the audio source device and the wireless audio terminal device includes two HCIS links, a main HCIS link HCISO and an auxiliary HCIS link HCIS1.

[0161] Figure 8 The figure shows the time slot structure diagram of the HCIG link, where HCISO is the main HCIS link and HCIS1 is the auxiliary HCIS link. The characteristics of the HCIS link are the same as those of the prior art connected isochronous stream (CIS: Connected Isochronous Stream) link. That is, both the main transmission link and the auxiliary transmission link can use CIS links. The difference between the HCIG link and the prior art connected isochronous group (CIG: Connected Isochronous Group) link is that the time slot relationship of each HCIS link in the HCIG is a hierarchical mode, which is neither the interleaved mode in the CIG link nor the sequential mode in the CIG link. The HCIS links share the time slots, and the main HCIS link occupies the time slots first. The difference between the HCIG link and the CIG link is that the physical layer (PHY) used can be different and the sub-event interval (Subinterval) can be different.

[0162] like Figure 8As shown, in each isochronous interval (ISO Interval), the HCISO link occupies at least one subinterval (Subinterval0) to send and receive an HCIS protocol data unit (PDU), as shown in the solid line box. In addition to the solid line box, there are several dotted line boxes representing possible retransmissions of the HCIS PDU. Figure 8 In the above figure, CO represents the HCIS PDU sent by the HCIG central device on the HCISO link, and PO represents the HCISPDU sent by the HCIG peripheral device on the HCISO link. Figure 8 C1 in the figure represents the HCIS PDU sent by the HCIG central device on the HCIS1 link, and P1 represents the HCIS PDU sent by the HCIG peripheral device on the HCIS1 link, both of which are represented by dotted boxes, indicating that when the time slot resources are insufficient, the HCIS1 link may not send or receive HCIS PDUs. That is, the HCIS1 link has a lower priority than the HCISO link.

[0163] An asynchronous connection link (ACL: Asynchronous Connection-oriented) is also established between the audio source device and the wireless audio terminal device. In this embodiment, the asynchronous connection link can adopt a BLE ACL link. Figure 8 The c (lowercase) boxes in FIG. 1 represent various PDUs sent by the HCIG central device on the BLE ACL link. Figure 8 The p (lowercase) boxes in FIG. 1 represent various PDUs sent by the HCIG peripheral device on the BLEBLE ACL link.

[0164] like Figure 8As shown, the offset value (CIS Offset1) of the HCIS1 link is greater than or equal to the sum of the offset value (CIS Offset0) of the HCISO link plus the sub-event interval (Subinterval0) of the HCISO link. Subinterval0 is equal to the sum of the CO time slot, PO time slot, inter-packet interval (T_IFS: Time of Inter Frame Space) (T_IFSO) and minimum time slot interval (T_MSS: Time of Minimum Slot Space) (T_MSSO) on the HCISO link. Subinterval1 of the HCISOHCIS1 link is equal to the sum of the C1 time slot, P1 time slot, T_IFS1 and T_MSS1 on the HCIS1 link. Subinterval0 and Subinterval1 may not be equal. According to the relationship between CIS Offset1 and CIS Offset0, and the composition of Subinterval0 and Subinterval1, the time slot relationship of each HCIS link in HCIG is neither the interleaved mode in the CIG link nor the sequential mode in the CIG link, which is called the hierarchical mode.

[0165] Although CIS Offset1 is greater than or equal to CIS Offset0 and Subinterval0 and Subinterval1 may not be equal, CIS Offset1 being equal to CIS Offset0 and Subinterval0 being equal to Subinterval1 is an optimization solution, which can make the time slot utilization rate of the HCIG link higher.

[0166] The encoder structure of the lossless audio hierarchical codec (LAHC) of this embodiment is as follows: Figure 5 As shown, the first lossy encoding unit 502 may adopt LC3 encoding (or other lossy audio encoding), the first decoding unit 503 may adopt LC3 decoding (or other lossy audio decoding), and the lossless encoding unit 505 may be a WavPack encoder, a FLAC encoder, a Huffman encoder, etc. The workflow of the LAHC encoder is basically the same as that described in the aforementioned embodiment, and will not be repeated here.

[0167] The LAHC decoder structure of this embodiment is as follows Figure 7As shown, since the second decoding unit 6031 included in the wireless audio terminal device corresponds to the audio source device, LC3 decoding (or other lossy audio decoding) is adopted, and the lossless decoding unit 6032 can be a WavPack decoder, a FLAC decoder, a Huffman decoder, etc. Similarly, the workflow of the LAHC decoder is basically the same as that described in the aforementioned embodiment, and will not be repeated here.

[0168] When the audio device is a smart phone and the wireless audio terminal device is a wireless headset, the following parameters can be configured to achieve lossless audio transmission between the smart phone and the wireless headset:

[0169] The sampling rate of stereo lossless audio is 48kHz, and the number of quantization bits of each audio sample is 16. Using the LAHC encoding described in this embodiment, the length of the encoding frame is 10ms, where: Figure 5 The lossless encoder in the LAHC encoder structure shown is a WavPack lossless encoder. Among them, the LC3 mono encoding rate is 124kbps, the stereo encoding rate is 248kbps, the encoded data per frame is 310 bytes, the WavPack stereo encoding rate is 753.6kbps, and the encoded data per frame is 930 bytes. The main audio stream encoding data of the two channels encoded by LC3 are combined and transmitted in the HCISO PDU of the main HCIS link, and the auxiliary audio stream encoding data of the stereo or dual channels encoded by WavPack are combined and transmitted in the HCIS1 PDU of the auxiliary HCIS link. HClSO uses BLE-HDT2 PHY with a transmission rate of 2Mbps, and the air time occupied is 69+1264=1333us, T_IFSO=67us, T_MSSO=67us, and Subinterval0 is equal to 1400us. HCIS1 uses BLE-HDT6 PHY with a transmission rate of 6Mbps. The air time occupied is 69+1264=1333us, T_IFS1=67us, T_MSS1=67us, and Subinterval1 is equal to 1400us.

[0170] The number of subevents (NSE) of the HClSO link in each equal time interval is 5, the number of bursts (BN) is 1, the flush timeout (FT) is 6, and the CIS Offset0 is 1.25ms. The number of subevents (NSE) of the HCISOHCIS1 link in each equal time interval is 4, the number of bursts (BN) is 1, the flush timeout (FT) is 6, and the CIS Offset1 is 2.65ms.

[0171] The process of the audio source device sending LAHC-encoded lossless audio through the HCIG link is as follows: In each equal time interval, a frame of dual-channel LC3 encoded data and a frame of dual-channel WavPack encoded data are generated, respectively combined and encapsulated in HCISOPDU and HCIS1 PDU, and stored in the first-in-first-out send buffer of the HCISO link and the first-in-first-out send buffer of the HCI S1 link. In each equal time interval, the HCISO PDU in the send buffer of the HCISO link is first sent through the HCISO link, and there are remaining time slots, and then the HCIS1PDU in the send buffer of the HCIS1 link is sent through the HCIS1 link until the time slots of the HCIS1 link in the current equal time interval are used up, that is, the time slot corresponding to the maximum value of NSE is reached. If the time slots in the current equal time interval are used up by sending the HCISO PDU, the HCIS1 PDU will not be sent.

[0172] The process of wireless headphones receiving LAHC-encoded lossless audio through the HCIG link is as follows: in each equal time interval, first receive the HCISO PDU through the HCISO link. If the reception is successful and there are remaining time slots, then receive the HCIS1 PDU through the HCIS1 link until the time slots of the HCIS1 link in the current equal time interval are used up, that is, the time slot corresponding to the maximum value of NSE is reached. If the time slots in the current equal time interval are used up by receiving the HCISO PDU through the HCISO link, the HCIS1 PDU will not be received.

[0173] The method for wireless headphones to receive and process the main audio stream and auxiliary audio stream is as follows:

[0174] 1. The HCISO PDU and HCIS1 PDU corresponding to the coded data generated by the primary audio stream and the secondary audio stream in each equal time interval are completely and correctly received through the HCISO link and the HCIS1 link respectively within the FT range, then the following Figure 3 The LAHC decoder shown decodes and plays lossless audio.

[0175] 2. The HCISO PDU corresponding to the coded data generated by the main audio stream in each equal time interval is completely and correctly received through the HCISO link within the FT range. The HCIS1 PDU corresponding to the coded data generated by the auxiliary audio stream in each equal time interval is not completely and correctly received through the HCIS1 link within the FT range, that is, there is a small probability (for example, not less than 2%) that it is not received correctly. In this case, the packet loss concealment (PLC: Packet Loss Concealment) technology is used to restore the audio samples corresponding to the lost coded data of the auxiliary audio stream, and then the lossless audio repaired by PLC is played.

[0176] 3. The HCISO PDU corresponding to the encoded data generated by the main audio stream in each equal time interval is completely and correctly received through the HCISO link within the FT range, and the HCIS1 PDU corresponding to the encoded data generated by the auxiliary audio stream in each equal time interval is not completely and correctly received through the HCIS1 link within the FT range, that is, there is a high probability (for example, greater than 2%) that it is not received correctly, then only the encoded data of the main audio stream is decoded and the decoded audio samples are played.

[0177] 4. If the HCISO PDU corresponding to the coded data generated by the main audio stream in each equal time interval is not completely and correctly received through the HCISO link within the FT range, the PLC technology is used to restore the audio samples corresponding to the lost coded data of the main audio stream, and then the audio samples of the main audio stream repaired by PLC are played.

[0178] It can be seen from the above embodiments that, through LAHC coding and HCIG link, the AHTWA system can improve the adaptability of wireless audio transmission to a rapidly changing wireless communication environment without requiring channel estimation and channel quality feedback information.

[0179] According to an embodiment of the present disclosure, an embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein the memory stores executable code, and when the processor executes the executable code, it can be used to implement the embodiment of the present disclosure.

[0180] Fig. 9 1 shows a schematic block diagram of an example electronic device 900 that can be used to implement an embodiment of the present disclosure. Fig. 9As shown, the device 900 includes a computing unit 901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded from a storage unit 908 to a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the device 900 can also be stored. The computing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0181] A number of components in the device 900 are connected to the I / O interface 905, including: an input unit 906, such as a keyboard, a mouse, etc.; an output unit 907, such as various types of displays, speakers, etc.; a storage unit 908, such as a disk, an optical disk, etc.; and a communication unit 909, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 909 allows the device 900 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0182] The computing unit 901 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSP), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 901 performs the various methods and processes described above. For example, in some embodiments, the wireless audio transmission method may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 908. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 900 via the ROM 902 and / or the communication unit 909. When the computer program is loaded into the RAM 903 and executed by the computing unit 901, one or more steps of the wireless audio transmission method described above may be performed. Alternatively, in other embodiments, the computing unit 901 may be configured to execute the wireless audio transmission method in any other appropriate manner (for example, by means of firmware).

[0183] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0184] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0185] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0186] The embodiment of the present application also provides a computer program product, including computer instructions. When the computer instructions are executed by a processor, the various processes of the above-mentioned embodiment are implemented and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0187] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; the present invention can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present invention more thoroughly and comprehensively understood. It should be noted that in the present invention, similar descriptions such as "in one embodiment" and "in some specific embodiments" do not particularly refer to the same embodiment. They can be the same embodiment or different embodiments. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the process depicted in the drawings does not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0188] The professionals should further realize that the units and steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0189] The steps of the method described in conjunction with the embodiments disclosed herein may be implemented by hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0190] Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent substitutions for some of the technical features therein; and these modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A wireless audio transmission method, used in a central device, characterized in that: The central device and the peripheral device communicate with each other in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link. The method comprises: in a current isochronous interval, Transmitting a main audio data packet within one or more first event intervals based on the main transmission link; When the transmission of the main audio data packet is completed and there are remaining time slots in the current equal time interval, transmitting the auxiliary audio data packet in one or more second event intervals based on the auxiliary transmission link; The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream; One or more first event intervals overlap at least partially with the second event intervals in the time domain.

2. The method according to claim 1, characterized in that The first event interval includes a first sending time slot, a first receiving time slot, a first inter-packet interval, and a first minimum time slot interval of the central device on the main transmission link; The second event interval includes a second sending time slot, a second receiving time slot, a second inter-packet interval, and a second minimum time slot interval between the central device and the peripheral device on the auxiliary transmission link; The offset value of the auxiliary transmission link is greater than or equal to the sum of the duration of the first event interval and the offset value of the primary transmission link.

3. The method according to claim 2, characterized in that The duration of one of the first event intervals is equal to the duration of one of the second event intervals; The main transmission link and the auxiliary transmission link are both CIS links.

4. The method according to claim 1, characterized in that The method further comprises: Get the audio data stream to be transmitted; Performing lossy compression encoding on the audio data stream to obtain a main audio data stream containing a main audio data packet; The difference data after the audio data stream is subjected to lossy compression encoding is losslessly encoded to obtain an auxiliary audio data stream containing an auxiliary audio data packet.

5. The method according to claim 4, characterized in that The obtaining of the audio data stream to be transmitted includes: obtaining lossless audio samples, and framing the lossless audio samples to form audio sample frames having the same length; The step of performing lossy compression encoding on the audio data stream to obtain a main audio data stream containing a main audio data packet comprises: performing lossy compression encoding on the audio sampling frame to obtain the main audio data stream; The method of losslessly encoding the difference data after lossy compression encoding of the audio data stream to obtain a secondary audio data stream containing a secondary audio data packet includes: decoding the main audio data stream to obtain a lossy audio sample, calculating the difference between the lossy audio sample and the lossless audio sample, and losslessly encoding the difference to obtain the secondary audio data stream.

6. The method according to claim 1, characterized in that An asynchronous connection link is also established between the central device and the peripheral devices, and the transmission priority of the asynchronous connection link is lower than the transmission priority of the auxiliary transmission link. In an equal time interval, after the transmission of the main audio data packet and the auxiliary audio data packet is completed and there are remaining time slots in the equal time interval, communication with the peripheral devices is based on the asynchronous connection link.

7. The method according to any one of claims 1 to 6, characterized in that There are N first event intervals configured in one equal time interval; The main audio data packet to be transmitted is stored in the main buffer; The transmission of the main audio data packet is completed in the current equal time interval, including: obtaining a main audio data packet from the main buffer, and sending the main audio data packet in the i-th first event interval in the current equal time interval; confirming whether the main audio data packet is correctly received by the peripheral device, and deleting the main audio data packet from the main buffer if it is correctly received; Confirming whether there are any remaining main audio data packets in the main buffer, and confirming whether there are any remaining time slots in the current equal time interval; When there are remaining main audio data packets in the main buffer and there are remaining first event intervals in the current equal time interval, one of the remaining main audio data packets in the main buffer is sent in the (i+1)th first event interval in the current equal time interval; When there is no remaining main audio data packet in the main buffer, or when the i-th first event interval is the N-th first event interval in the current equal time interval, stop sending the main audio data packet in the current equal time interval; Wherein, N and i are both positive integers, and i is less than or equal to N.

8. The method according to any one of claims 1 to 6, characterized in that M second event intervals are configured in one equal time interval; The auxiliary audio data packets to be transmitted are stored in the auxiliary buffer; The transmission of the auxiliary audio data packet is completed in the current isochronous interval, comprising: determining that the jth second event interval in the current isochronous interval can be used to send the auxiliary audio data packet based on the remaining time slot of the current isochronous interval after the transmission of the main audio data packet is completed and the offset value of the auxiliary transmission link; Acquire a secondary audio data packet from the secondary buffer, and send the secondary audio data packet in the j-th second event interval; confirming whether the auxiliary audio data packet is correctly received by the peripheral device, and deleting the auxiliary audio data packet from the auxiliary buffer if it is correctly received; Confirm whether there are any remaining auxiliary audio data packets in the auxiliary buffer, and confirm whether there are any remaining time slots in the current equal time interval; In the case where there are remaining auxiliary audio data packets in the auxiliary buffer and there are remaining second event intervals in the current equal time interval, sending one of the remaining auxiliary audio data packets in the auxiliary buffer in the j+1th second event interval in the current equal time interval; When there is no remaining auxiliary audio data packet in the auxiliary buffer, or when the jth second event interval is the Mth second event interval in the current equal time interval, stop sending the auxiliary audio data packet in the current equal time interval; Wherein, M and j are both positive integers, and j is less than or equal to M.

9. A wireless audio transmission method for peripheral equipment, characterized in that: The peripheral device and the central device communicate with each other in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, the auxiliary transmission link is used to transmit an auxiliary audio data stream, and the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link. The method comprises: in a current isochronous interval, Receiving a main audio data packet sent by the central device within one or more first event intervals based on the main transmission link; When the reception of the main audio data packet is completed and there are remaining time slots in the current isochronous interval, receiving the auxiliary audio data packet sent by the central device within one or more second event intervals based on the auxiliary transmission link; The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream; One or more first event intervals overlap at least partially with the second event intervals in the time domain.

10. The method according to claim 9, characterized in that The first event interval includes the third receiving time slot, the third sending time slot, the first inter-packet interval, and the first minimum time slot interval of the peripheral device in the main transmission link; The second event interval includes a fourth receiving time slot, a fourth sending time slot, a second inter-packet interval, and a second minimum time slot interval of the peripheral device on the auxiliary transmission link; The offset value of the auxiliary transmission link is greater than or equal to the sum of the duration of the first event interval and the offset value of the primary transmission link.

11. The method according to claim 9, characterized in that The primary audio data packet carries audio data that has been lossy compressed and encoded, and the secondary audio data packet carries difference data corresponding to the primary audio data packet that has been losslessly encoded; The method further comprises: If all the main audio data packets are correctly received within a predetermined time period, and all the auxiliary audio data packets corresponding to the main audio data packets are also correctly received, the main audio data packets are decoded to obtain main audio samples, the corresponding auxiliary audio data packets are losslessly decoded to obtain auxiliary audio samples, and the main audio samples and the auxiliary audio samples are summed and then lossless audio is output; If all the main audio data packets are correctly received within a predetermined time period, but only the auxiliary audio data packets corresponding to some of the main audio data packets are correctly received, then, when the packet loss probability of the auxiliary audio data packets is less than or equal to a predetermined value, the main audio data packets are decoded to obtain main audio samples, auxiliary audio samples corresponding to the main audio data packets are obtained through lossless decoding and packet loss concealment technology, and the main audio samples and the auxiliary audio samples are summed and the restored lossless audio is output; If all the main audio data packets are correctly received within a predetermined time period, but only the auxiliary audio data packets corresponding to some of the main audio data packets are correctly received, then, when the packet loss probability of the auxiliary audio data packets is greater than the predetermined value, the main audio data packets are decoded to obtain main audio samples, and the main audio samples are output; If only part of the main audio data packets are correctly received within the predetermined time period, the repaired main audio samples are obtained through decoding and packet loss concealment technology, and the repaired main audio samples are output.

12. The method according to claim 8, characterized in that An asynchronous connection link is also established between the peripheral device and the central device, and the transmission priority of the asynchronous connection link is lower than the transmission priority of the auxiliary transmission link. In the current equal time interval, after the reception of the main audio data packet and the auxiliary audio data packet is completed and there are remaining time slots in the equal time interval, communication with the central device is based on the asynchronous connection link.

13. The method according to any one of claims 8 to 12, characterized in that There are N first event intervals configured in one equal time interval; Receiving the main audio data packet within the current equal time interval includes: receiving the main audio data packet sent by the central device within the i-th first event interval within the current equal time interval; confirming whether there are still main audio data packets to be received within the current equal time interval, and confirming whether there are still remaining time slots within the current equal time interval, If there are still main audio data packets to be received within the current equal time interval, and there are still remaining first event intervals within the current equal time interval, receiving the main audio data packets sent by the central device within the (i+1)th first event interval within the current equal time interval; When there are no remaining main audio data packets to be received in the current equal time interval, or when the i-th first event interval is the N-th first event interval in the current equal time interval, stop receiving the main audio data packets in the current equal time interval; Wherein, N and i are both positive integers, and i is less than or equal to N.

14. The method according to any one of claims 8 to 12, characterized in that M second event intervals are configured in one equal time interval; The transmission of the auxiliary audio data packet is completed in the current isochronous interval, comprising: determining that the jth second event interval in the current isochronous interval can be used for receiving the auxiliary audio data packet based on the remaining time slot of the current isochronous interval after the reception of the main audio data packet is completed and the offset value of the auxiliary transmission link; receiving a secondary audio data packet within the j-th second event interval; Confirm whether there are any auxiliary audio data packets to be received within the current equal time interval, and confirm whether there are any remaining time slots within the current equal time interval; If there are auxiliary audio data packets to be received within the current equal time interval and there are remaining second event intervals within the current equal time interval, receiving the auxiliary audio data packets within the j+1th second event interval within the current equal time interval; When no auxiliary audio data packet needs to be received in the current equal time interval, or when the jth second event interval is the Mth second event interval in the current equal time interval, stop receiving auxiliary audio data packets in the current equal time interval; Wherein, M and j are both positive integers, and j is less than or equal to M.

15. A central device, characterized in that: The central device communicates with the peripheral devices in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, the auxiliary transmission link is used to transmit an auxiliary audio data stream, the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link, and the central device includes: A first main audio data stream transmission unit, configured to transmit a main audio data packet in one or more first event intervals based on the main transmission link in a current isochronous interval; a first auxiliary audio data stream transmission unit, configured to transmit auxiliary audio data packets within one or more second event intervals of the current equal time interval based on the auxiliary transmission link when the first main audio data stream transmission unit completes the transmission of the main audio data packet and there are remaining time slots in the current equal time interval; The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream; One or more first event intervals overlap at least partially with the second event intervals in the time domain.

16. The central device according to claim 15, characterized in that: The present invention also includes an encoder, which is used to receive an audio data stream to be transmitted, perform lossy compression encoding on the audio data stream to obtain a main audio data stream including a main audio data packet, and output the main audio data stream to the first main audio data stream transmission unit, and perform lossless encoding on difference data after the lossy compression encoding of the audio data stream to obtain a secondary audio data stream including a secondary audio data packet, and output the difference data to the first secondary audio data stream transmission unit.

17. The central device according to claim 16, characterized in that: The encoder comprises a framing unit, a first lossy encoding unit, a first decoding unit, a difference calculation unit, and a lossless encoding unit; The framing unit is used to receive lossless audio samples of the audio data stream to be transmitted, and to frame the lossless audio samples to form audio sample frames with the same length; The first lossy encoding unit is used to receive the audio sample frames from the frame assembly unit, perform lossy compression encoding on the audio sample frames, and output them as the main audio data stream; The first decoding unit is configured to receive the main audio data stream from the first lossy encoding unit, decode the main audio data stream and output lossy audio samples, The difference calculation unit is used to receive the audio sample frame from the frame assembly unit and the lossy audio sample from the first decoding unit, and calculate the difference between the lossy audio sample and the lossless audio sample; The lossless encoding unit is used to losslessly encode the difference calculated by the difference calculation unit and output it as the auxiliary audio data stream.

18. A peripheral device, characterized in that: The peripheral device communicates with the central device in continuous isochronous intervals based on at least one main transmission link and at least one auxiliary transmission link, the main transmission link is used to transmit a main audio data stream, the auxiliary transmission link is used to transmit an auxiliary audio data stream, the transmission priority of the main transmission link is higher than the transmission priority of the auxiliary transmission link, and the peripheral device includes: A second main audio data stream transmission unit is used to receive the main audio data packet sent by the central device in one or more first event intervals based on the main transmission link in the current isochronous interval; A second auxiliary audio data stream transmission unit is used to receive the auxiliary audio data packets sent by the central device within one or more second event intervals of the current isochronous interval based on the auxiliary transmission link when the main audio data stream transmission unit completes the transmission of the main audio data packet and there are remaining time slots in the current isochronous interval; The primary audio data packet is an audio data packet in the primary audio data stream, and the secondary audio data packet is an audio data packet in the secondary audio data stream; One or more first event intervals overlap at least partially with the second event intervals in the time domain.

19. The peripheral device according to claim 16, characterized in that: Also includes decoder, The primary audio data packet carries audio data that has been lossy compressed and encoded, and the secondary audio data packet carries difference data corresponding to the primary audio data packet that has been losslessly encoded; The decoder comprises a second decoding unit, a second lossless decoding unit and a sum calculation unit; The second decoding unit is used to decode the received main audio data packet and output the main audio sample; The lossless decoding unit is used to losslessly decode the received auxiliary audio data packet corresponding to the main audio data packet and output auxiliary audio samples, The sum calculation unit is used to calculate the sum of the primary audio sample and the secondary audio sample and then output lossless audio.

20. An electronic device comprising a memory and a processor, wherein the memory stores executable code, and when the processor executes the executable code, the method according to any one of claims 1 to 8 or any one of claims 9 to 14 is implemented.

Images