A dual-ended collaborative data compensation method and system for wireless audio devices

Abstract

This invention discloses a dual-end collaborative data compensation method and system for wireless audio devices, relating to the field of wireless audio transmission technology. The method involves the transmitting end packetizing the audio stream and embedding a cyclic sequence number and session state flag, constructing an application-layer secondary cache independent of the wireless controller protocol stack, and synchronously backing up the audio data. An asymmetric asynchronous communication link is established, consisting of an unacknowledged push channel and a simplified command channel. The receiving end monitors sequence number gaps in real time and asynchronously sends retransmission requests. The transmitting end utilizes physical channel idle intervals to perform intermittent retransmission. Finally, data reassembly is completed through session boundary closed-loop verification. This system includes a transmitting end module and a receiving end module, capable of solving problems such as low-level retransmission blocking, protocol stack silent overflow packet loss, and head-of-line blocking in BLE transmission. It achieves full audio data recovery while maintaining sub-perceptual low latency, reducing RF interaction power consumption, and improving the integrity and reliability of voice interaction.

Description

Technical Field

[0001] This invention relates to the field of wireless audio transmission technology, specifically to a dual-end collaborative data compensation method and system for wireless audio devices, particularly suitable for real-time voice interaction and audio data transmission in BLE short-range wireless communication scenarios for TWS earphones and smart wearable devices. Background Technology

[0002] In the fields of real-time voice interaction, TWS (True Wireless Stereo) audio transmission, and wearable devices, business requirements demand end-to-end latency to reach the "sub-perceptual" level and ensure the absolute integrity of the audio sequence. With the popularization of intelligent voice assistants and AI interaction, audio data is not only a simple waveform stream, but also needs to maintain strict frame-level atomicity and timing consistency during transmission to support high-precision semantic recognition and acoustic analysis in the backend.

[0003] Currently, wireless audio transmission largely relies on link-layer (such as Bluetooth's underlying layer) retransmission or is based on common streaming media protocols like RTP / RTSP. These protocols address packet loss issues in unreliable links through sequence number verification and synchronous retransmission mechanisms (Stop and Wait or ACK mode). However, existing technologies have the following significant drawbacks: 1. Logical Conflict Between Physical and Application Layer Retransmission Mechanisms: Existing technologies introduce ARQ (Automatic Repeat Request) at the application layer, but this results in a cumulative retransmission effect in a BLE environment. The Bluetooth underlying link layer already possesses strong synchronous ARQ; when the channel deteriorates, the underlying layer enters a blocking transmission mode. Simultaneous triggering of ARQ at the application layer causes retransmission packets to accumulate, exacerbating head-of-line congestion and leading to real-time stream crashes.

[0004] 2. The Lag in Detecting Silent Overflows by Application-Layer ARQ: Traditional RTP or application-layer ARQ considers data transmission complete once it is sent to the protocol stack. However, in the BLE architecture, data packets may be directly discarded by the physical layer due to continuous retransmission failures at the underlying level after entering the controller buffer (silent overflow). Existing solutions lack a secondary backup copy independent of the protocol stack, making it impossible to recover the original data after an overflow, resulting in permanent data loss.

[0005] 3. Beacon collisions and power consumption bottlenecks in feedback channels: Traditional write operations with acknowledgments require waiting for each acknowledgment packet when executing application layer ARQ. Frequent bidirectional handshakes generate a large number of radio frequency beacon collisions, which crowd out audio bandwidth and lead to a significant increase in power consumption of wearable devices.

[0006] In summary, existing wireless audio transmission solutions cannot solve the problems of underlying congestion, buffer overflow packet loss, and high power consumption under low latency constraints, making it difficult to meet the dual requirements of audio integrity and real-time performance in voice interaction. Therefore, there is an urgent need for a low-latency, highly reliable, and low-power dual-end collaborative data compensation method and system. Summary of the Invention

[0007] This invention aims to provide a dual-end collaborative data compensation method and system for wireless audio devices. By using cross-level secondary caching, asymmetric asynchronous feedback, asynchronous interleaving scheduling, and session closed-loop verification, it achieves lossless data backtracking for lost packets, while ensuring real-time transmission without lag, low latency, and low power consumption. This solves the technical problems in existing wireless audio transmission technologies, such as retransmission superposition blocking, silent overflow packet loss, large feedback overhead, high power consumption, and difficulty in ensuring audio data integrity.

[0008] The technical solution adopted by this invention is as follows: This invention provides a dual-end collaborative data compensation method for wireless audio devices, specifically including the following steps: S1: The sending end divides the audio stream into packets, embeds the loop sequence number and session state flag bit in the audio frame header, and completes polymorphic stream encapsulation and serialization; S2: The transmitting end constructs an application layer secondary buffer independent of the wireless controller protocol stack buffer. While pushing audio data into the system protocol stack buffer for transmission, it simultaneously backs it up to the secondary buffer. S3: Establish an asymmetric asynchronous communication link. The main transmission channel uses an unacknowledged push channel to transmit real-time audio frames, and the asynchronous feedback channel uses a simplified instruction channel to transmit retransmission request instructions. S4: The receiving end verifies the audio frame sequence number in real time. When a sequence number gap is detected, the missing sequence number is stored in the asynchronous compensation queue without interrupting the real-time audio decoding thread. S5: The receiving end sends a retransmission request to the sending end through the asynchronous feedback channel; S6: After receiving the retransmission request, the sending end monitors the idle instruction cycle of the underlying protocol stack, sets the compensation packet as a low-priority background task, and uses the physical idle gap of real-time frame transmission to retrieve the missing data from the secondary buffer and perform intermittent retransmission. S7: When the receiving end detects the session end flag, it performs a final queue self-check, completes the reconstruction of damaged data, and realizes session boundary closed-loop verification.

[0009] Furthermore, the session status identifier includes three logical states: session establishment, data transmission, and session termination, which are used to drive asynchronous data flow boundary control and integrity verification.

[0010] Furthermore, the application layer secondary cache is a circular buffer with a storage depth greater than that of the underlying buffer of the wireless controller protocol stack, which is used to retain the original data to achieve backtracking when the underlying buffer silently overflows.

[0011] Furthermore, the main transmission channel is a BLE GATT Notification channel, and the asynchronous feedback channel is a BLE GATT Write Without Response channel, in order to achieve a compensation closed loop with zero handshake overhead.

[0012] Furthermore, the retransmission request is a minimal NACK request packet of less than 20 bytes, sent only when data loss is detected, reducing radio frequency interaction and device power consumption.

[0013] Furthermore, the interstitial retransmission prioritizes ensuring the real-time audio frame transmission timing, and the compensation data is transmitted in the idle time slots of the physical channel, without causing head-of-line congestion.

[0014] The present invention also provides a dual-end collaborative data compensation system for wireless audio devices, the system comprising a transmitting module and a receiving module.

[0015] The transmitting module includes: The polymorphic stream encapsulation unit is used to packetize the audio stream and embed the loop sequence number and session state flag bits; A cross-level secondary cache unit is used to build an application layer backup cache independent of the wireless controller protocol stack, and synchronously store audio data to be sent; The asymmetric transmission unit is used to send real-time audio frames through an unacknowledged push channel and receive retransmission requests through a simplified command channel; the asynchronous slot scheduling unit is used to perform low-priority compensation data retransmission during channel idle intervals. The receiving module includes: The sequence number monitoring unit is used to verify the audio frame sequence number in real time, detect data breaks, and generate an asynchronous queue to be compensated. The asynchronous feedback unit is used to send retransmission requests through the simplified command channel; the session loop verification unit is used to perform integrity self-checks at the end of the session and complete data reassembly.

[0016] Furthermore, the transmitting module is a TWS earphone, and the receiving module is a smartphone, tablet, or smart speaker. The two establish a dual-end collaborative transmission through a BLE link.

[0017] Furthermore, the storage depth of the cross-level secondary cache unit is 500ms–1000ms, which can trace back silent packet loss data caused by underlying ARQ blocking and protocol stack overflow.

[0018] Furthermore, the asynchronous slot scheduling unit enables parallel transmission of real-time audio stream and compensation data stream without blocking real-time stream transmission, ensuring low end-to-end latency and data integrity.

[0019] The beneficial effects achieved by the present invention using the above solution are as follows: 1. The compensation mechanism is decoupled from the real-time stream, ensuring smooth audio playback and no increase in end-to-end latency during channel fluctuations; 2. The secondary cache is independent of the protocol stack, which can recover packet loss caused by underlying blocking and silent overflow, thus improving the accuracy of speech recognition. 3. Based on NACK asynchronous feedback, compensation is triggered only in case of an anomaly, reducing RF handshake and beacon collisions and significantly reducing the power consumption of wearable devices; 4. Session boundary closed-loop verification ensures that all data is reconstructed before the session is closed, meeting the strict requirements of AI voice interaction for timing and integrity. Attached Figure Description

[0020] Figure 1 This is a schematic diagram of the overall process of the dual-end collaborative data compensation method of the present invention in the scenarios of underlying blocking and protocol stack silent overflow. Figure 2 This is a schematic diagram of the system architecture of the cross-level two-level cache architecture and asymmetric asynchronous transmission channel of the present invention; Figure 3 This is a schematic diagram of the method flow of the present invention. Detailed Implementation

[0021] The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0022] Please refer to the instruction manual appendix. Figure 1-3 As shown, the dual-end collaborative data compensation system for wireless audio devices proposed in this invention consists of a transmitter and a receiver connected via a BLE short-range wireless link: The transmitting end is based on TWS earphones and includes a multi-state stream encapsulation unit, a cross-level secondary buffer unit, an asymmetric transmission unit, and an asynchronous slot scheduling unit; the receiving end is based on a smartphone and includes a serial number monitoring unit, an asynchronous feedback unit, a session loop verification unit, and an audio decoding and speech recognition unit.

[0023] The sending and receiving ends adopt an asymmetric asynchronous communication architecture. Uplink real-time audio uses a handshake-free push channel, and downlink retransmission requests use a simplified command channel, thus decoupling timeliness and integrity.

[0024] Specific implementation steps: S1. Polymorphic Stream Encapsulation and Serialization: The sending end collects the audio stream and divides it into packets according to a fixed duration. A cyclic sequence number and a session status flag are embedded in the header of each frame. The flag includes: session establishment, data transmission, and session termination, which are used to define the boundaries of the data stream and verify its integrity.

[0025] S2. Cross-level secondary buffer backup: The transmitting end constructs a secondary circular buffer at the application layer, independent of the Bluetooth controller protocol stack, with a storage depth of 500ms to 1000ms, significantly larger than the underlying protocol stack buffer. Audio data is simultaneously written to the secondary buffer for physical backup while being pushed into the Bluetooth protocol stack's transmission queue, ensuring that the original data can be retrieved after a silent overflow at the underlying layer.

[0026] S3. Establish an asymmetric asynchronous communication link: Main transmission channel: adopts BLE GATT Notification unacknowledged push, without waiting for response and without handshake overhead, ensuring the lowest latency; Asynchronous feedback channel: adopts BLE GATT WriteWithout Response, used to transmit extremely small NACK commands without interfering with real-time transmission.

[0027] S4. Receiver asynchronous monitoring and tomographic recording: The receiver verifies the audio frame sequence number in real time. When a sequence number is discontinuous (Gap), the decoding thread is not suspended. Instead, the missing frame number is recorded in the asynchronous compensation queue to maintain continuous playback of the real-time stream.

[0028] S5. Asynchronous NACK retransmission request: The receiving end sends a simplified NACK request of less than 20 bytes to the sending end through a non-response write channel, which is triggered only when packet loss is detected, reducing RF interaction and power consumption.

[0029] S6. Asynchronous interleaving scheduling and retransmission: After receiving NACK, the sending end marks the compensation task as a low-priority background task, monitors the idle period of the protocol stack, and retrieves the missing frame from the secondary buffer and sends it interleaved during the physical idle time slot of real-time frame transmission, without blocking the real-time stream or causing head-of-line blocking.

[0030] S7. Session boundary closed-loop verification: When the receiver detects the session termination flag, it forces a self-check of the queue to be compensated to ensure that all damaged frames are reassembled before the session is closed, thus guaranteeing the frame-level atomicity and timing integrity required for speech recognition.

[0031] Example: Voice command transmission in TWS earphones Initialize the user to wake up the voice assistant, the earphone collects the voice and packages it into packets, and sends the data to the Bluetooth controller buffer (depth of about tens of milliseconds), while backing it up to the 500ms secondary circular buffer.

[0032] Interference from underlying blocking and silent overflow causes the Bluetooth underlying ARQ to enter blocking retransmission. The subsequent 3-5 frames of audio are directly discarded by the hardware because the protocol stack buffer is full, resulting in silent overflow packet loss.

[0033] After the receiver detects the sequence number break and the link is restored, it finds that the sequence number has jumped from #10 to #16. It then records #11 to #15 into the asynchronous compensation queue and continues to play the real-time audio after #16.

[0034] The asynchronous NACK request receiver sends a NACK instruction with a length of less than 20 bytes through the Write Without Response channel.

[0035] During the idle interval of sending real-time frame #20, the sending end reads #11 to #15 from the secondary buffer and retransmits them with low priority.

[0036] Once the voice command for session closure verification ends, the receiving end detects the session termination flag, completes full data reconstruction, and outputs a complete audio stream to the speech recognition engine, without semantic truncation, stuttering, or additional delay.

[0037] Technical effectiveness verification: This embodiment can achieve the following in scenarios involving channel fluctuations, underlying ARQ blocking, and protocol stack overflow: 100% recovery of lost data; end-to-end latency remains at a sub-perceptual level with smooth audio playback; significantly reduced RF interactions and over 40% reduction in power consumption for wearable devices; speech recognition completeness and accuracy are significantly better than traditional ARQ solutions.

[0038] Extended implementation method: The transmitting end can be expanded to BLE audio wearable devices such as smartwatches and smart glasses; the receiving end can be expanded to tablets, smart speakers, and in-vehicle infotainment systems; the secondary cache depth can be adaptively adjusted according to link quality; and the interstitial scheduling can be compatible with concurrent scenarios of multiple connections and multiple audio streams.

[0039] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, material, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, material, or apparatus.

[0040] Although embodiments of the invention have been shown and described, it will be understood by those skilled in the art that various changes, modifications, substitutions and alterations can be made to these embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the appended claims and their equivalents.

Claims

1. A dual-end collaborative data compensation method for wireless audio devices, characterized in that, Specifically, the following steps are included: S1: The sending end divides the audio stream into packets, embeds the loop sequence number and session state flag bit in the audio frame header, and completes polymorphic stream encapsulation and serialization; S2: The transmitting end constructs an application layer secondary buffer independent of the wireless controller protocol stack buffer. While pushing audio data into the system protocol stack buffer for transmission, it simultaneously backs it up to the secondary buffer. S3: Establish an asymmetric asynchronous communication link. The main transmission channel uses an unacknowledged push channel to transmit real-time audio frames, and the asynchronous feedback channel uses a simplified instruction channel to transmit retransmission request instructions. S4: The receiving end verifies the audio frame sequence number in real time. When a sequence number gap is detected, the missing sequence number is stored in the asynchronous compensation queue without interrupting the real-time audio decoding thread. S5: The receiving end sends a retransmission request to the sending end through the asynchronous feedback channel; S6: After receiving the retransmission request, the sending end monitors the idle instruction cycle of the underlying protocol stack, sets the compensation packet as a low-priority background task, and uses the physical idle gap of real-time frame transmission to retrieve the missing data from the secondary buffer and perform intermittent retransmission. S7: When the receiving end detects the session end flag, it performs a final queue self-check, completes the reconstruction of damaged data, and realizes session boundary closed-loop verification.

2. The dual-end collaborative data compensation method for wireless audio devices according to claim 1, characterized in that: The session state flag in S1 includes three logical states: session establishment, data transmission, and session termination, which are used to drive asynchronous data flow boundary control and integrity verification.

3. The dual-end collaborative data compensation method for wireless audio devices according to claim 1, characterized in that: The application layer secondary cache in S2 is a circular buffer with a storage depth greater than that of the underlying buffer of the wireless controller protocol stack. It is used to retain the original data to achieve backtracking when the underlying buffer silently overflows.

4. The dual-end collaborative data compensation method for wireless audio devices according to claim 1, characterized in that: The main transmission channel in S3 is the BLE GATT Notification channel, and the asynchronous feedback channel is the BLE GATTWrite Without Response channel, in order to achieve a compensation closed loop with zero handshake overhead.

5. A dual-end collaborative data compensation method for wireless audio devices according to claim 1, characterized in that: The retransmission request in S3 is a minimal NACK request packet of less than 20 bytes, which is sent only when data is detected as missing, thereby reducing radio frequency interaction and device power consumption.

6. A dual-end collaborative data compensation method for wireless audio devices according to claim 1, characterized in that: The interstitial retransmission in S6 prioritizes ensuring the real-time audio frame transmission timing, and the compensation data is transmitted in the idle time slot of the physical channel to avoid head-of-line congestion.

7. A dual-end collaborative data compensation system for wireless audio devices, characterized in that: It includes a sending module and a receiving module; the sending module includes a polymorphic stream encapsulation unit, which is used to packetize the audio stream and embed a loop sequence number and a session state identifier bit; A cross-level secondary cache unit is used to build an application layer backup cache independent of the wireless controller protocol stack, and synchronously store audio data to be sent; The asymmetric transmission unit is used to send real-time audio frames through an unacknowledged push channel and receive retransmission requests through a simplified command channel. An asynchronous interleaving scheduling unit is used to perform low-priority compensation data retransmission during channel idle intervals; the receiving module includes a sequence number monitoring unit, used to verify the audio frame sequence number in real time, detect data gaps, and generate an asynchronous compensation queue. The asynchronous feedback unit is used to send retransmission requests through the simplified command channel; the session loop verification unit is used to perform integrity self-checks at the end of the session and complete data reassembly.

8. A dual-end collaborative data compensation system for wireless audio devices according to claim 7, characterized in that: The transmitting module is a TWS earphone, and the receiving module is a smartphone, tablet, or smart speaker. The two establish a dual-end collaborative transmission through a BLE link.

9. A dual-end collaborative data compensation system for wireless audio devices according to claim 7, characterized in that: The storage depth of the cross-level secondary cache unit is 500ms–1000ms, which can trace back silent packet loss data caused by underlying ARQ blocking and protocol stack overflow.

10. A dual-end collaborative data compensation system for wireless audio devices according to claim 7, characterized in that: The asynchronous slot scheduling unit enables parallel transmission of real-time audio stream and compensation data stream without blocking real-time stream transmission, ensuring low end-to-end latency and data integrity.

Images