A multi-band WiFi-based anti-interference low-latency high-fidelity wireless audio transmission method and system

Abstract

This invention relates to the field of wireless audio transmission, providing a method and system for anti-interference, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi. The method includes a transmitter acquiring raw audio signals and preprocessing the raw digital audio stream; a receiver receiving and demodulating the signal, decoding and reconstructing the audio data, converting the digital signal to an analog signal, and outputting the audio signal through an audio output interface. The receiver implements frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching, and active interference avoidance based on a multi-band intelligent collaborative mechanism. This invention leverages the high bandwidth characteristics of WiFi technology to support multi-band lossless high-fidelity audio transmission. In a single-chip integrated architecture, an external professional codec is preferred, significantly improving core audio indicators such as signal-to-noise ratio and dynamic range, reducing distortion, and adapting to the gain configuration requirements of different pickup units.

Description

Technical Field

[0001] This invention relates to the field of wireless audio transmission technology, and in particular to a method and system for anti-interference, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi. Background Technology

[0002] Wireless microphones are core audio devices for stage performances, live broadcasts, conference presentations, education, and other scenarios, and their technological development has evolved from analog to digital.

[0003] Traditional analog wireless microphones, which use analog transmission methods such as FM modulation, have inherent defects: First, the audio quality is poor and they are easily affected by environmental interference, resulting in noise and crosstalk problems; second, they have poor security and the signal is easily eavesdropped on; and third, the available frequency resources are limited, and when multiple devices are used at the same time, they are prone to mutual interference, which cannot meet the application needs of large-scale scenarios.

[0004] With the development of technology, multi-band WiFi chips have emerged. Multi-band WiFi has the advantages of less interference and higher bandwidth. Existing dual-band solutions can no longer be adapted to these new chips and have obvious limitations.

[0005] Therefore, developing a wireless digital microphone solution that combines high sound quality, extremely low latency, strong anti-interference capability, high stability, and compatibility with multi-band WiFi chips has become an urgent technical problem to be solved in this field. Summary of the Invention

[0006] The purpose of this section is to outline some aspects of embodiments of the present invention and to briefly describe some preferred embodiments. Simplifications or omissions may be made in this section, as well as in the abstract and title of this application, to avoid obscuring the purpose of these documents. Such simplifications or omissions are not intended to limit the scope of the invention.

[0007] The purpose of this invention is to overcome the above-mentioned defects in the prior art and provide an anti-interference, low-latency, high-fidelity wireless audio transmission method and system based on multi-band WiFi. It is compatible with 2.4GHz / 5GHz dual-band WiFi chips. By using the collaborative working mechanism of multi-band WiFi, it solves the problem of weak anti-interference capability of existing solutions. At the same time, by optimizing the design of an external professional codec, it solves the problems of insufficient audio performance and poor flexibility of existing integrated solutions. Ultimately, it achieves end-to-end millisecond-level low latency, professional-grade high-fidelity audio transmission, and high stability in complex environments.

[0008] In view of the problems existing in the above and / or existing methods for anti-interference, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi, the present invention is proposed.

[0009] Therefore, the problem that this invention aims to solve is that traditional analog wireless microphones, which use analog transmission methods such as FM modulation, are easily monitored and prone to mutual interference when multiple devices are used simultaneously.

[0010] To solve the above-mentioned technical problems, the present invention provides the following technical solution: a method for anti-interference, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi, comprising: The transmitting end acquires the raw digital audio stream of wireless audio, preprocesses, compresses, encapsulates, and transmits the raw digital audio stream to form audio data packets. Based on the decision results of the multi-band intelligent coordination mechanism, the audio data packets are scheduled to the WiFi radio frequency link of the corresponding frequency band, and the audio data packets are radiated to the receiving end through the transmitting antenna. The intelligent coordination process includes frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching, and active interference avoidance steps. The receiving end receives the audio data packets through the receiving antenna, demodulates the audio data packets, and performs parsing, error correction, decoding and audio data reconstruction on the audio data packets based on a multi-band intelligent collaborative mechanism, completing the conversion from digital signal to analog signal. The receiving end outputs the audio signal through the audio output interface.

[0011] As a preferred embodiment of the anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi described in this invention, the transmitting end processing flow specifically includes the following steps: The transmitter converts the audio signal into an analog electrical signal, and then converts the analog electrical signal at a preset sampling rate and sampling depth to output the original digital audio stream; The transmitting end performs noise reduction, gain control, and delay compensation preprocessing on the original digital audio stream, and then uses a low-latency audio coding algorithm to compress and encode the preprocessed audio data to generate coded audio frames. The transmitter encapsulates the encoded audio frames with protocols, adds timestamps, sequence numbers and error correction verification information, and schedules data packets to multi-band WiFi links of the corresponding frequency bands based on the decision results of the intelligent collaborative process. The transmitter uses a multi-band intelligent collaborative mechanism to perform baseband processing and up-conversion on the encapsulated audio data packets, and then converts them into radio electromagnetic wave signals for transmission via the transmitting antenna.

[0012] As a preferred embodiment of the anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi described in this invention, the receiving end processing flow specifically includes the following steps: The receiver uses a multi-band intelligent collaborative mechanism to receive wireless signals through the receiving antenna, completes down-conversion, demodulation and baseband processing, restores audio data packets, performs protocol parsing on the received data packets, performs out-of-order rearrangement and packet loss compensation based on the sequence number, completes data error correction through verification information, and extracts valid encoded audio frames. The receiving end uses the corresponding low-latency decoding algorithm to decode the encoded audio frame, and combines the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream; The receiving end converts the reconstructed digital audio stream to generate an analog audio signal, which is then amplified by a subsequent amplifier circuit and output to the audio output interface.

[0013] As a preferred embodiment of the anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi described in this invention, the intelligent collaboration process includes the following steps: The default configuration uses the 5GHz band as the primary transmission band, carrying the core audio data stream; Configure the 2.4GHz band as a secondary transmission or control band to carry control signaling, reverse link data, or as a redundant backup transmission link; If the multi-band WiFi supports the 6GHz band, configure the 6GHz band as a high-bandwidth backup or extended band, and enable it when the 5GHz band is severely interfered with or when ultra-high bandwidth transmission is required. The multi-band intelligent collaborative mechanism periodically scans the entire 2.4GHz, 5GHz and scalable 6GHz channels, and collects the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time. Based on real-time monitored channel quality data, combined with current audio transmission latency and packet loss rate threshold requirements, link decisions are made: If the quality of the 5GHz main channel meets the preset high-quality transmission requirements, then the 5GHz band will maintain single-link main transmission, the 2.4GHz band will only transmit control signaling, and the 6GHz band will be in standby monitoring state. If the channel quality of the 5GHz band is lower than the preset threshold, but the channel quality of the 2.4GHz or 6GHz band meets the requirements, then seamlessly switch to the band with the best channel quality to complete the main audio stream transmission; If extremely high reliability is required, activate the multi-band redundant transmission mode, select at least two frequency bands in the 2.4GHz, 5GHz and 6GHz bands to transmit the same audio data packets simultaneously, and the receiving end will select and merge the best ones through the multi-band intelligent collaborative process to minimize the packet loss rate. Within the selected operating frequency band, channel interference is monitored in real time. When continuous interference is detected, the system automatically switches to the least interfered idle channel within the same frequency band. If there is no available idle channel in the same frequency band, the system switches to other frequency bands to complete the dynamic adjustment of frequency points.

[0014] As a preferred embodiment of the anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi described in this invention, wherein: in the noise reduction of the original digital audio stream by the transmitting end, the low-latency audio encoding algorithm adopts any one of the three audio source decoders LC3, LC3plus, and Opus, and the frame length of the encoding algorithm is configured to be 2.5ms-10ms. The sampling rate is not less than 48kHz and the sampling depth is not less than 16bit.

[0015] In view of the problems existing in the above and / or existing methods for anti-interference, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi, the present invention is proposed.

[0016] Therefore, the problem that this invention aims to solve is that most existing mainstream wireless digital microphones use 2.4GHz proprietary protocols or Bluetooth protocols to achieve wireless transmission, which makes it difficult to support high-quality lossless audio transmission of 48kHz / 24bit and above, and thus cannot achieve high-fidelity audio effects.

[0017] To solve the above-mentioned technical problems, the present invention provides the following technical solution: an anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi, comprising; The transmitting device is used to collect the raw digital audio stream of wireless audio, preprocess, compress, encode and encapsulate the raw digital audio stream to form audio data packets, and schedule the audio data packets to the WiFi radio frequency link of the corresponding frequency band according to the decision result of the multi-band intelligent coordination mechanism, and transmit them through the transmitting antenna. The receiving device is used to receive the audio data packets through a receiving antenna, receive and demodulate the audio data packets, and parse, correct, decode and reconstruct the audio data packets based on a multi-band intelligent collaborative mechanism, complete the conversion of digital signals to analog signals, and output audio signals through an audio output interface. The multi-band intelligent coordination module is deployed in the transmitting and receiving devices respectively, and is used to perform intelligent coordination processes such as frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching and active interference avoidance.

[0018] As a preferred embodiment of the multi-band WiFi-based anti-interference, low-latency, high-fidelity wireless audio transmission system of the present invention, the transmitting device specifically includes: The analog-to-digital converter module is used to convert audio signals into analog electrical signals, and converts the analog electrical signals at a preset sampling rate and sampling depth to output the original digital audio stream; The preprocessing and encoding module is used to perform noise reduction, gain control and delay compensation preprocessing on the original digital audio stream, and then use a low-latency audio encoding algorithm to compress and encode the preprocessed audio data to generate encoded audio frames. The protocol encapsulation and scheduling module is used to encapsulate the encoded audio frames, add timestamps, sequence numbers and error correction verification information, and schedule data packets to the corresponding multi-band WiFi links based on the decision results of the multi-band intelligent coordination module. The first radio frequency transmission module is used to perform baseband processing and up-conversion on the encapsulated audio data packets via the multi-band intelligent collaborative module, and then convert them into radio electromagnetic wave signals for transmission through the transmitting antenna.

[0019] As a preferred embodiment of the multi-band WiFi-based anti-interference, low-latency, high-fidelity wireless audio transmission system of the present invention, the receiving device specifically includes: The first radio frequency receiving module is used to receive wireless signals through the receiving antenna using the multi-band intelligent collaborative module, and to complete down-conversion, demodulation and baseband processing to restore the audio data packets. The protocol parsing and error correction module is used to parse the received data packets, perform out-of-order reordering and packet loss compensation based on the sequence number, complete data error correction through verification information, and extract valid encoded audio frames. The decoding and reconstruction module is used to decode the encoded audio frames using the corresponding low-latency decoding algorithm, and combine the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream. The digital-to-analog converter and output module is used to convert the reconstructed digital audio stream into an analog audio signal, which is then amplified by a subsequent amplifier circuit and output to the audio output interface.

[0020] As a preferred embodiment of the anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi described in this invention, the multi-band intelligent coordination is specifically used to perform the following operations: Configure the 5GHz band as the primary transmission band to carry the core audio data stream; configure the 2.4GHz band as the secondary transmission or control band to carry control signaling, reverse link data, or as a redundant backup transmission link; if the 6GHz band is supported, configure the 6GHz band as a high-bandwidth backup or extended band. Periodically scan all channels of 2.4GHz, 5GHz and scalable 6GHz, and collect the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time; Based on real-time monitored channel quality data, combined with current audio transmission latency and packet loss rate threshold requirements, link decisions are made: When the quality of the 5GHz band main channel meets the preset high-quality transmission requirements, maintain single-link main transmission in the 5GHz band. When the channel quality of the 5GHz band is lower than the preset threshold but other bands meet the requirements, seamlessly switch to the band with the best channel quality; When high reliability is required, a multi-band redundant transmission mode is activated, selecting at least two frequency bands to transmit the same audio data packets simultaneously, which are then merged by the receiving end. Within the selected operating frequency band, channel interference is monitored in real time. When continuous interference is detected, the system automatically switches to the least interfered idle channel within the same frequency band. If no idle channel is available, the system switches to another frequency band.

[0021] As a preferred embodiment of the anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi described in this invention, the low-latency audio encoding algorithm used in the preprocessing and encoding includes any one of three audio source decoders: LC3, LC3plus, and Opus, and the frame length of the encoding algorithm is configured to be 2.5ms-10ms. The sampling rate of the analog-to-digital conversion module is not less than 48kHz, and the sampling depth is not less than 16bit.

[0022] The present invention provides the following technical solution: an electronic device, comprising: one or more processors; a storage device storing one or more programs thereon; when the one or more programs are executed by the one or more processors, the one or more processors implement an anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi.

[0023] The present invention provides the following technical solution: an electronic device, comprising: a computer-readable storage medium storing executable instructions thereon, which, when executed by a processor, enable the processor to implement an anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi.

[0024] Compared with the prior art, the present invention has the following significant advantages: 1. Achieves professional-grade, ultra-high-quality audio transmission: Based on the high bandwidth characteristics of WiFi technology, this invention can support lossless / low-loss high-fidelity audio transmission at 48kHz / 24bit or even 96kHz / 24bit, far exceeding the sound quality limits of Bluetooth and 2.4G proprietary protocols, and can significantly improve core audio indicators such as signal-to-noise ratio and dynamic range.

[0025] 2. Achieved millisecond-level ultra-low latency: This invention, through low-latency audio encoding, simplified transmission protocol encapsulation, and low-latency optimization of WiFi 6 and above protocols, combined with high-speed inter-chip interfaces, controls the total end-to-end audio transmission latency to within 20ms, far superior to Bluetooth solutions; when the 6GHz band is enabled, the transmission latency can be further reduced, fully meeting the needs of scenarios that are extremely sensitive to latency, such as real-time singing, earphone monitoring, and live interactive broadcasts. Attached Figure Description

[0026] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Wherein: Figure 1 This is a diagram of the transmitter operation framework for a multi-band WiFi-based anti-interference, low-latency, high-fidelity wireless audio transmission method in Example 1.

[0027] Figure 2 This is a flowchart of the receiver operation of a multi-band WiFi-based anti-interference, low-latency, high-fidelity wireless audio transmission method in Example 1. Detailed Implementation

[0028] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0029] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0030] Secondly, the term "one embodiment" or "example" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the invention. The appearance of an embodiment in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that mutually excludes other embodiments.

[0031] Example 1 Reference Figure 1 and Figure 2 This is the first embodiment of the present invention, which provides an anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi, comprising: The transmitting end processing flow, the receiving end processing flow, and the multi-band intelligent coordination and interference avoidance mechanism; the multi-band WiFi includes at least 2.4GHz and 5GHz bands, and the application scenarios of the tri-band WiFi chip.

[0032] The transmitting end processing flow includes: acquiring the original audio signal through the pickup unit, completing the analog-to-digital A / D conversion through the audio codec module, then completing the preprocessing, compression encoding and transmission encapsulation of the audio data by the main control SoC, and finally transmitting the encapsulated audio data packet through the antenna via the multi-band WiFi radio frequency module.

[0033] The receiving end processing flow includes: receiving wireless audio data packets through an antenna, completing signal reception and demodulation through a multi-band WiFi radio frequency module, then completing data packet parsing, error correction, decoding and audio data reconstruction by the main control SoC, and finally completing the D / A conversion from digital signal to analog signal through the audio codec module to output a high-quality audio signal.

[0034] The multi-band intelligent coordination and interference avoidance mechanism is based on multi-band WiFi and includes steps such as frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching, and active interference avoidance.

[0035] Furthermore, the transmitting end processing flow specifically includes the following steps: S11, Audio Acquisition and Digitization: The pickup unit converts the sound signal into an analog electrical signal, and the audio codec module performs A / D conversion on the analog electrical signal at a preset sampling rate and sampling depth, outputting the original digital audio stream; S12, Audio Preprocessing and Encoding: The main control SoC performs noise reduction, gain control and delay compensation preprocessing on the raw digital audio stream, and then uses a low-latency audio encoding algorithm to compress and encode the preprocessed audio data to generate encoded audio frames. S13, Data Encapsulation and Transmission Scheduling: The main control SoC encapsulates the encoded audio frames using the UDP / RTP protocol, adds timestamps, sequence numbers, and error correction verification information, and schedules the data packets to the corresponding WiFi radio frequency link based on the decision results of the multi-band intelligent coordination mechanism. S14, Radio Frequency Transmission: The multi-band WiFi radio frequency module performs baseband processing and up-conversion on the encapsulated audio data packets, and then converts them into radio electromagnetic wave signals through the antenna for transmission.

[0036] Furthermore, the receiving end processing flow specifically includes the following steps: S21, RF reception and demodulation: The multi-band WiFi RF module receives wireless signals through the antenna, completes down-conversion, demodulation and baseband processing, restores the audio data packets, and transmits them to the main control SoC; S22, Data parsing and error correction: The main control SoC performs protocol parsing on the received data packets, performs out-of-order reordering and packet loss compensation based on the sequence number, completes data error correction through verification information, and extracts valid encoded audio frames; S23, Audio Decoding and Reconstruction: The main control SoC uses the corresponding low-latency decoding algorithm to decode the encoded audio frames, and combines the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream; S24, Audio Output: The audio codec module performs D / A conversion on the reconstructed digital audio stream to generate an analog audio signal, which is then output to the audio playback device after passing through the subsequent amplification circuit.

[0037] Furthermore, the multi-band intelligent coordination and interference avoidance mechanism specifically includes the following steps: S31, Frequency Band Priority Configuration: The default configuration is that the 5GHz band is the primary transmission band, carrying the core audio data stream; the 2.4GHz band is configured as the secondary transmission / control band, carrying control signaling, reverse link data, or serving as a redundant backup transmission link; if the multi-band WiFi supports the 6GHz band, the 6GHz band is configured as a high-bandwidth backup / extended band, which is activated when there is severe interference in the 5GHz band or when ultra-high bandwidth transmission is required; S32, Real-time Channel Quality Monitoring: The main control SoC periodically scans the 2.4GHz, 5GHz and scalable 6GHz full channels through the multi-band WiFi radio frequency module, and collects the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time. S33, Transmission Link Decision: Based on real-time monitored channel quality data, combined with the current audio transmission latency and packet loss rate threshold requirements, a link decision is made. If the quality of the 5GHz main channel meets the preset high-quality transmission requirements, then the 5GHz band will maintain single-link main transmission, the 2.4GHz band will only transmit control signaling, and the 6GHz band will be in standby monitoring state. If the channel quality of the 5GHz band is lower than the preset threshold, but the channel quality of the 2.4GHz or 6GHz band meets the requirements, then seamlessly switch to the band with the best channel quality to complete the main audio stream transmission; If extremely high reliability is required, activate the multi-band redundant transmission mode, select two or more frequency bands in the 2.4GHz, 5GHz and 6GHz bands to transmit the same audio data packets simultaneously, and the receiving end will select the best to merge them to minimize the packet loss rate. S34, Active Interference Avoidance: Within the selected operating frequency band, the channel interference situation is monitored in real time. When continuous interference is detected, the system automatically switches to the idle channel with the least interference within the same frequency band. If there is no available idle channel in the same frequency band, the system switches to other frequency bands to complete the dynamic adjustment of the frequency point.

[0038] Furthermore, in step S12, the low-latency audio encoding algorithm adopts any one of LC3, LC3plus, or Opus low-latency modes. LC3 (Low Complexity Communication Codec) is a low-complexity audio codec specified by the Bluetooth LE Audio standard, LC3plus is a wireless audio codec, and Opus is a completely open-source, highly versatile audio decoder. The frame length of the encoding algorithm is configured to be 2.5ms-10ms, ensuring audio compression efficiency while controlling encoding latency to the millisecond level. The audio codec module has a sampling rate of no less than 48kHz and a sampling depth of no less than 16bit, supporting 96kHz / 24bit high-fidelity audio specifications to meet professional-grade high-quality audio requirements. If the 6GHz band is enabled, its higher bandwidth characteristics can be utilized to support higher-specification audio transmission.

[0039] Furthermore, the main control SoC and the multi-band WiFi radio frequency module adopt a discrete architecture or a single-chip integrated architecture; First segment (nRF7002): In the discrete architecture, the main control SoC uses the nRF54L15 series chip, and the multi-band WiFi radio frequency module uses the nRF7002 series chip or a dual-band chip of the same specification that supports 2.4GHz / 5GHz dual-band. The two communicate through the QSPI / SPI high-speed interface to minimize the data transmission latency between chips. Second paragraph (Espresso): The multi-band WiFi RF module can also use Espressif's ESP32-C5 or ESP32-E22 series chips. The ESP32-C5 supports dual-band 2.4GHz / 5GHz, while the ESP32-E22 supports tri-band 2.4GHz / 5GHz / 6GHz. The ESP32-C5 can communicate with the main control SoC through the QSPI / SPI high-speed interface, while the ESP32-E22 can communicate with the main control SoC through the PCIe 2.1 or SDIO 3.0 high-speed interface.

[0040] The single-chip integrated architecture adopts a single SoC chip that integrates a multi-band WiFi radio frequency unit and a processor core, including supported Espressif ESP32-E22 series and upgraded ESP32 series chips. Under the single-chip integrated architecture, an external professional audio codec module is preferred, which can achieve better audio performance, stronger configuration flexibility and richer audio processing functions. The secondary option is to use the audio codec peripheral integrated on the SoC to complete the A / D and D / A conversion of audio signals, so as to simplify hardware design and reduce device size.

[0041] Furthermore, the transmission of audio data packets adopts WiFi 6 and above protocols, optimizes transmission real-time performance through OFDMA subcarrier scheduling, and optimizes device power consumption through TWT target wake-up time mechanism. The total end-to-end audio transmission latency is controlled within 20ms, which fully meets the low latency requirements of real-time monitoring and stage performance. If the 6GHz band is enabled, its higher bandwidth characteristics can be used to further reduce transmission latency and improve audio transmission quality and stability.

[0042] On the other hand, the present invention also provides an anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi, including a transmitting end device and a receiving end device that communicate wirelessly with each other; the multi-band WiFi includes at least 2.4GHz and 5GHz frequency bands and is compatible with tri-band WiFi chip applications.

[0043] The transmitting device includes a pickup unit, a first audio codec module, a first main control unit, a first multi-band WiFi radio frequency unit, and a transmitting antenna, which are connected in sequence.

[0044] The receiving device includes a receiving antenna, a second multi-band WiFi radio frequency unit, a second main control unit, a second audio codec module, and an audio output interface, which are connected in sequence.

[0045] Both the first and second multi-band WiFi radio frequency units support at least 2.4GHz and 5GHz multi-band WiFi communication and can be extended to support the 6GHz band. The two units complete bidirectional transmission of audio data and control signals through a WiFi wireless link.

[0046] Both the first and second main control units have built-in multi-band intelligent collaborative modules for performing channel monitoring, link decision-making, dynamic switching, and interference avoidance operations in the 2.4GHz / 5GHz and extendable 6GHz frequency bands.

[0047] Furthermore, the first main control unit and the first multi-band WiFi radio frequency unit adopt a discrete architecture. The first multi-band WiFi radio frequency unit is an Espressif ESP32-E22 series chip that supports 2.4GHz / 5GHz / 6GHz tri-band, and the two are interconnected through a QSPI high-speed interface. The second main control unit and the second multi-band WiFi radio frequency unit adopt the same discrete architecture.

[0048] Furthermore, the first main control unit and the first multi-band WiFi radio frequency unit adopt a single-chip integrated architecture, which is the Espressif ESP32-E22 single chip integrating a Cortex-M33 core and multi-band WiFi 6 radio frequency; Under the single-chip integrated architecture, the preferred solution is to use an external professional first audio codec module. The pickup unit is connected to the analog input terminal of the external first audio codec module, and the digital interface of the first audio codec module is interconnected with the Espressif ESP32-E22 single chip through the I2S / PCM audio bus. The alternative solution uses the audio codec peripheral integrated on the Espressif ESP32-E22 single chip, with the pickup unit directly connected to the analog microphone input interface of the single chip; The second main control unit and the second multi-band WiFi radio frequency unit adopt the same single-chip integrated architecture.

[0049] Furthermore, both the first and second audio codec modules support audio encoding and decoding of 48kHz / 24bit and above, and have built-in programmable gain amplifiers, low-noise amplifiers, and digital signal processing units. The transmitting device also has a built-in power management unit and a rechargeable battery to meet the battery life requirements of portable devices. The receiving device also includes an audio amplification circuit connected to the output of the second audio codec module, which can directly drive headphones, power amplifiers, and other downstream devices. Under the single-chip integrated architecture, an external professional audio codec or an audio codec integrated on the SoC chip can be used, where SoC technology is an integrated chip technology.

[0050] Furthermore, the multi-band intelligent collaborative module includes: The channel monitoring submodule is used to periodically scan the channels in the 2.4GHz, 5GHz and extendable 6GHz frequency bands to collect signal-to-noise ratio, bit error rate, channel occupancy rate and interference intensity parameters. The priority scheduling submodule is used to configure the transmission strategy of 5GHz as the primary transmission frequency band, 2.4GHz as the secondary transmission / backup frequency band, and 6GHz as the high-bandwidth extension / backup frequency band; The link decision submodule is used to decide whether to start multi-band redundant transmission and whether to perform channel switching based on channel quality parameters and preset latency and packet loss rate thresholds. The seamless switching control submodule is used to achieve seamless switching of audio streams during frequency band / channel switching by synchronizing data packet sequence numbers and performing multi-link cross-transition, thus avoiding audio disconnection and stuttering during the switching process.

[0051] Example 2 A second embodiment of the present invention provides an anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi, comprising: The transmitting device is used to collect the raw digital audio stream of wireless audio, preprocess, compress, encode and encapsulate the raw digital audio stream to form audio data packets, and schedule the audio data packets to the WiFi radio frequency link of the corresponding frequency band according to the decision result of the multi-band intelligent coordination mechanism, and transmit them through the transmitting antenna. The receiving device is used to receive the audio data packets through a receiving antenna, receive and demodulate the audio data packets, and parse, correct, decode and reconstruct the audio data packets based on a multi-band intelligent collaborative mechanism, complete the conversion of digital signals to analog signals, and output audio signals through an audio output interface. The multi-band intelligent coordination module is deployed in the transmitting and receiving devices respectively, and is used to perform intelligent coordination processes such as frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching and active interference avoidance.

[0052] The transmitting equipment specifically includes: The analog-to-digital converter module is used to convert audio signals into analog electrical signals, and converts the analog electrical signals at a preset sampling rate and sampling depth to output the original digital audio stream; The preprocessing and encoding module is used to perform noise reduction, gain control and delay compensation preprocessing on the original digital audio stream, and then use a low-latency audio encoding algorithm to compress and encode the preprocessed audio data to generate encoded audio frames. The low-latency audio coding algorithms used in preprocessing and encoding include any one of the three audio source decoders: LC3, LC3plus, and Opus. The frame length of the coding algorithm is configured to be 2.5ms-10ms. The sampling rate of the analog-to-digital conversion module is not less than 48kHz, and the sampling depth is not less than 16bit.

[0053] The protocol encapsulation and scheduling module is used to encapsulate the encoded audio frames, add timestamps, sequence numbers and error correction verification information, and schedule data packets to the corresponding multi-band WiFi links based on the decision results of the multi-band intelligent coordination module. The first radio frequency transmission module is used to perform baseband processing and up-conversion on the encapsulated audio data packets via the multi-band intelligent collaborative module, and then convert them into radio electromagnetic wave signals for transmission through the transmitting antenna.

[0054] The receiving end equipment specifically includes: The first radio frequency receiving module is used to receive wireless signals through the receiving antenna using the multi-band intelligent collaborative module, and to complete down-conversion, demodulation and baseband processing to restore the audio data packets. The protocol parsing and error correction module is used to parse the received data packets, perform out-of-order reordering and packet loss compensation based on the sequence number, complete data error correction through verification information, and extract valid encoded audio frames. The decoding and reconstruction module is used to decode the encoded audio frames using the corresponding low-latency decoding algorithm, and combine the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream. The digital-to-analog converter and output module is used to convert the reconstructed digital audio stream into an analog audio signal, which is then amplified by a subsequent amplifier circuit and output to the audio output interface.

[0055] Multi-band intelligent collaboration is specifically used to perform the following operations: Configure the 5GHz band as the primary transmission band to carry the core audio data stream; configure the 2.4GHz band as the secondary transmission or control band to carry control signaling, reverse link data, or as a redundant backup transmission link; if the 6GHz band is supported, configure the 6GHz band as a high-bandwidth backup or extended band. Periodically scan all channels of 2.4GHz, 5GHz and scalable 6GHz, and collect the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time; Based on real-time monitored channel quality data, combined with current audio transmission latency and packet loss rate threshold requirements, link decisions are made: When the quality of the 5GHz band main channel meets the preset high-quality transmission requirements, maintain single-link main transmission in the 5GHz band. When the channel quality of the 5GHz band is lower than the preset threshold but other bands meet the requirements, seamlessly switch to the band with the best channel quality; When high reliability is required, a multi-band redundant transmission mode is activated, selecting at least two frequency bands to transmit the same audio data packets simultaneously, which are then merged by the receiving end. Within the selected operating frequency band, channel interference is monitored in real time. When continuous interference is detected, the system automatically switches to the least interfered idle channel within the same frequency band. If no idle channel is available, the system switches to another frequency band.

[0056] Example 3 A third embodiment of the present invention provides a method for interference-resistant, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi, including... It includes the transmitting end processing flow, the receiving end processing flow, and the multi-band intelligent coordination and interference avoidance mechanism; the multi-band WiFi at least includes applications that support the 2.4GHz / 5GHz / 6GHz frequency bands and are compatible with the application scenarios of the Espressif ESP32-E22 tri-band WiFi chip.

[0057] The transmitting end processing flow includes: acquiring the original audio signal through the pickup unit, completing the analog-to-digital A / D conversion through the audio codec module, then completing the preprocessing, compression encoding and transmission encapsulation of the audio data by the main control SoC, and finally transmitting the encapsulated audio data packet through the antenna radiation via the multi-band WiFi radio frequency module; The receiving end processing flow includes: receiving wireless audio data packets through an antenna, completing signal reception and demodulation through a multi-band WiFi radio frequency module, then completing data packet parsing, error correction, decoding and audio data reconstruction by the main control SoC, and finally completing the D / A conversion from digital signal to analog signal through the audio codec module to output a high-quality audio signal; The multi-band intelligent coordination and interference avoidance mechanism is based on multi-band WiFi and includes steps such as frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching, and active interference avoidance.

[0058] The transmitter processing procedure specifically includes the following steps: S11, Audio Acquisition and Digitization: The pickup unit converts the sound signal into an analog electrical signal, and the audio codec module performs A / D conversion on the analog electrical signal at a preset sampling rate and sampling depth, outputting the original digital audio stream; S12, Audio Preprocessing and Encoding: The main control SoC performs noise reduction, gain control and delay compensation preprocessing on the raw digital audio stream, and then uses a low-latency audio encoding algorithm to compress and encode the preprocessed audio data to generate encoded audio frames. S13, Data Encapsulation and Transmission Scheduling: The main control SoC encapsulates the encoded audio frames using the UDP / RTP protocol, adds timestamps, sequence numbers, and error correction verification information, and schedules the data packets to the corresponding WiFi radio frequency link based on the decision results of the multi-band intelligent coordination mechanism. S14, Radio Frequency Transmission: The multi-band WiFi radio frequency module performs baseband processing and up-conversion on the encapsulated audio data packets, converting them into radio electromagnetic wave signals for transmission via the antenna. The receiving end processing flow specifically includes the following steps: S21, RF reception and demodulation: The multi-band WiFi RF module receives wireless signals through the antenna, completes down-conversion, demodulation and baseband processing, restores the audio data packets, and transmits them to the main control SoC; S22, Data parsing and error correction: The main control SoC performs protocol parsing on the received data packets, performs out-of-order reordering and packet loss compensation based on the sequence number, completes data error correction through verification information, and extracts valid encoded audio frames; S23, Audio Decoding and Reconstruction: The main control SoC uses the corresponding low-latency decoding algorithm to decode the encoded audio frames, and combines the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream; S24, Audio Output: The audio codec module performs D / A conversion on the reconstructed digital audio stream to generate an analog audio signal, which is then output to the audio playback device after passing through the subsequent amplification circuit.

[0059] The multi-band intelligent coordination and interference avoidance mechanism includes the following steps: S31, Frequency Band Priority Configuration: The default configuration is that the 5GHz band is the primary transmission band, carrying the core audio data stream; the 2.4GHz band is configured as the secondary transmission / control band, carrying control signaling, reverse link data, or serving as a redundant backup transmission link; if the multi-band WiFi supports the 6GHz band, the 6GHz band is configured as a high-bandwidth backup / extended band, which is activated when there is severe interference in the 5GHz band or when ultra-high bandwidth transmission is required; S32, Real-time Channel Quality Monitoring: The main control SoC periodically scans the 2.4GHz, 5GHz and scalable 6GHz full channels through the multi-band WiFi radio frequency module, and collects the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time. S33, Transmission Link Decision: Based on real-time monitored channel quality data, combined with the current audio transmission latency and packet loss rate threshold requirements, a link decision is made. If the quality of the 5GHz main channel meets the preset high-quality transmission requirements, then the 5GHz band will maintain single-link main transmission, the 2.4GHz band will only transmit control signaling, and the 6GHz band will be in standby monitoring state. If the channel quality of the 5GHz band is lower than the preset threshold, but the channel quality of the 2.4GHz or 6GHz band meets the requirements, then seamlessly switch to the band with the best channel quality to complete the main audio stream transmission; If extremely high reliability is required, activate the multi-band redundant transmission mode, select two or more frequency bands in the 2.4GHz, 5GHz and 6GHz bands to transmit the same audio data packets simultaneously, and the receiving end will select the best to merge them to minimize the packet loss rate. S34, Active Interference Avoidance: Within the selected operating frequency band, the channel interference situation is monitored in real time. When continuous interference is detected, the system automatically switches to the idle channel with the least interference within the same frequency band. If there is no available idle channel in the same frequency band, the system switches to other frequency bands to complete the dynamic adjustment of the frequency point.

[0060] In step S12, the low-latency audio encoding algorithm adopts any one of LC3, LC3plus, and Opus low-latency modes, and the frame length of the encoding algorithm is configured to be 2.5ms-10ms; the sampling rate of the audio codec module is not less than 48kHz, and the sampling depth is not less than 16bit.

[0061] The main control SoC and the multi-band WiFi RF module adopt a discrete architecture or a single-chip integrated architecture; In the discrete architecture, the multi-band WiFi radio frequency module uses Espressif ESP32-E22 series chips or chips of the same specifications that support 2.4GHz / 5GHz / 6GHz tri-band, and communicates through the QSPI / SPI high-speed interface; The single-chip integrated architecture adopts a single SoC chip that integrates a multi-band WiFi radio frequency unit and a processor core, including the Espressif ESP32-E22 series and upgraded versions of the ESP32 series chips that support tri-band operation. Under the single-chip integrated architecture, an external professional audio codec module is preferred to achieve better audio performance, greater configuration flexibility, and richer audio processing functions. The secondary option is to use the audio codec peripheral integrated on the SoC to complete the A / D and D / A conversion of audio signals, thereby simplifying hardware design and reducing device size.

[0062] The transmission of audio data packets adopts WiFi 6 and above protocols. Through OFDMA subcarrier scheduling and TWT target wake-up time mechanism, the transmission latency and power consumption are optimized, and the total end-to-end audio transmission latency is controlled within 20ms. If the 6GHz band is enabled, its higher bandwidth characteristics can be used to further reduce transmission latency and improve audio transmission quality.

[0063] Example 4 The fourth embodiment of the present invention provides an anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi, including... Transmitting and receiving devices for mutual wireless communication; the multi-band WiFi includes at least 2.4GHz, 5GHz and 6GHz frequency bands, and is compatible with the tri-band Espressif ESP32-E22 WiFi chip.

[0064] The transmitting device includes a pickup unit, a first audio codec module, a first main control unit, a first multi-band WiFi radio frequency unit, and a transmitting antenna, which are connected in sequence. The receiving device includes a receiving antenna, a second multi-band WiFi radio frequency unit, a second main control unit, a second audio codec module, and an audio output interface, which are connected in sequence. Both the first and second multi-band WiFi radio frequency units support at least 2.4GHz and 5GHz multi-band WiFi communication and can be extended to support the 6GHz band. The two units complete bidirectional transmission of audio data and control signals through a WiFi wireless link. Both the first and second main control units have built-in multi-band intelligent collaborative modules for performing channel monitoring, link decision-making, dynamic switching, and interference avoidance operations in the 2.4GHz / 5GHz and extendable 6GHz frequency bands.

[0065] The first main control unit and the first multi-band WiFi RF unit adopt a discrete architecture. The first main control unit is an nRF54L15 chip, and the first multi-band WiFi RF unit is an Espressif ESP32-E22 series chip that supports 2.4GHz / 5GHz / 6GHz tri-band. The two are interconnected through a QSPI high-speed interface. The second main control unit and the second multi-band WiFi RF unit adopt the same discrete architecture.

[0066] The first main control unit and the first multi-band WiFi RF unit adopt a single-chip integrated architecture, which is the Espressif ESP32-E22 single chip that integrates a Cortex-M33 core and multi-band WiFi 6 RF. Under the single-chip integrated architecture, the preferred solution is to use an external professional first audio codec module. The pickup unit is connected to the analog input terminal of the external first audio codec module, and the digital interface of the first audio codec module is interconnected with the Espressif ESP32-E22 single chip through the I2S / PCM audio bus. The alternative solution uses the audio codec peripheral integrated on the Espressif ESP32-E22 single chip, with the pickup unit directly connected to the analog microphone input interface of the single chip; The second main control unit and the second multi-band WiFi radio frequency unit adopt the same single-chip integrated architecture.

[0067] Both the first and second audio codec modules support audio encoding and decoding of 48kHz / 24bit and above, and have built-in programmable gain amplifiers, low-noise amplifiers, and digital signal processing units. The transmitting device also has a built-in power management unit and a rechargeable battery, and the receiving device also includes an audio amplification circuit connected to the output of the second audio codec module. Under the single-chip integrated architecture, an external professional audio codec or an audio codec integrated on the SoC can be used.

[0068] The wireless digital microphone system, wherein the multi-band intelligent collaborative module includes: The channel monitoring submodule is used to periodically scan the channels in the 2.4GHz, 5GHz and extendable 6GHz frequency bands to collect signal-to-noise ratio, bit error rate, channel occupancy rate and interference intensity parameters. The priority scheduling submodule is used to configure the transmission strategy of 5GHz as the primary transmission frequency band, 2.4GHz as the secondary transmission / backup frequency band, and 6GHz as the high-bandwidth extension / backup frequency band; The link decision submodule is used to decide whether to start multi-band redundant transmission and whether to perform channel switching based on channel quality parameters and preset latency and packet loss rate thresholds. The merging algorithm for multi-band redundant transmission includes hierarchical error correction and scenario-adaptive merging strategies: The receiving end restores redundant audio data packets received from multiple frequency bands into a complete audio stream through error correction preprocessing and a layered merging strategy. The specific process is as follows: (1) Error correction preprocessing stage For each data packet received in each frequency band, FEC (Forward Error Correction) or ARQ (Automatic Repeat Request) error correction processing is first performed: If FEC is used: Based on the preset coding rate, the data packets are corrected and decoded, and the set of error-corrected data packets is output; If ARQ is used: when the receiver detects that the CRC check of the data packet has failed or the SNR is lower than the retransmission threshold, it sends a retransmission request to the transmitter until it successfully receives the data or reaches the maximum number of retransmissions.

[0069] (2) Layered merging stage For data packets that have undergone error correction preprocessing, they are merged in layers according to sequence number priority and frequency band quality weight: Serial number selection logic: Data packets carry globally unique sequence numbers. During merging, data packets with consecutive sequence numbers and no errors are selected first. If there is sequence number overlap, the channel quality score (QoSScore) of each frequency band is compared, and the data packet with higher QoS is selected as the benchmark. Data packets of other frequency bands are only used for supplementary error correction.

[0070] Frequency band quality weighting fusion: For valid data packets in different frequency bands, a frequency band quality weight is assigned. The weight is calculated as the QoSScore of that frequency band / the sum of the QoSScores of all received frequency bands. The data is then fused using a weighted average or voting mechanism. Weighted average: The audio sampling points of the data packet are summed in a weighted manner according to the frequency band quality weight.

[0071] Voting mechanism: For multiple valid data packets with the same sequence number, if the difference in the sampled values ​​is less than the threshold, the average value is taken directly; if the difference is greater than the threshold, secondary error correction is triggered.

[0072] (3) Seamless switching and adaptation During frequency band switching, the receiver's multi-band intelligent coordination module caches the sequence number of the last complete data packet before the switch and prioritizes receiving the sequence number and subsequent data packets after the switch. At the same time, it completes the data packets lost during the switch through forward and backward error correction to ensure the continuity of the audio stream.

[0073] Typical values ​​and parameters FEC coding rate: 2 / 3 for low interference scenarios, 1 / 2 for high interference scenarios; Retransmission thresholds: 2.4GHz < 18dB, 5GHz < 23dB, 6GHz < 28dB; Serial number window size: 64 by default, dynamically expandable to 128; Sampling value difference threshold: ±1 LSB; Merged weight update cycle: synchronized with channel quality monitoring cycle.

[0074] The seamless switching control submodule is used to achieve seamless switching of audio streams during frequency band / channel switching by synchronizing data packet sequence numbers and performing multi-link cross-transition, thus avoiding audio disconnection and stuttering during the switching process.

[0075] Example 5 The fifth embodiment of the present invention provides an anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi. It adopts a discrete hardware architecture and is suitable for scenarios with extremely high requirements for performance, reliability, and audio indicators, such as professional stages, large conferences, and professional recording. Its overall architecture includes a transmitting end device and a receiving end device that communicate wirelessly with each other.

[0076] The transmitting device 100 includes a pickup unit, a first audio codec module, a first main control unit, a first multi-band WiFi radio frequency unit, and a transmitting antenna 105 connected in sequence. It also has a built-in power management unit and a rechargeable battery to power the whole device.

[0077] The pickup unit uses an electret microphone or MEMS microphone, paired with a low-noise preamplifier circuit, which is responsible for converting the sound signal into a high-fidelity analog electrical signal to meet professional-grade sound pickup needs. The first audio codec module uses the TI PCM1862 or Cirrus Logic CS42L52 professional audio codec chip, which supports A / D conversion of 48kHz / 24bit or even 96kHz / 32bit. It has a built-in programmable gain amplifier, automatic gain control and digital noise reduction module to complete the high-precision conversion of analog audio to digital audio stream, achieving a dynamic range of more than 105dB and extremely low distortion. The first main control unit uses the Nordic nRF54L15 chip, which has a built-in Arm Cortex-M33 core and a main frequency of up to 128MHz. It has rich audio peripherals and DSP processing capabilities and is responsible for performing audio preprocessing, low-latency audio encoding, data encapsulation, and multi-band intelligent collaborative algorithms. The first multi-band WiFi radio frequency unit: adopts Espressif ESP32-E22 chip supporting 2.4GHz / 5GHz / 6GHz tri-band WiFi 6, compatible with IEEE802.11a / b / g / n / ac / ax standards, interconnects with nRF54L15 chip through QSPI high-speed interface, and the inter-chip transmission latency can be as low as sub-millisecond level, responsible for completing WiFi baseband processing and radio frequency transceiver; Transmitting antenna: A tri-band onboard antenna is used, covering both 2.4GHz and 5GHz frequency bands, with a VSWR ≤1.5, ensuring the efficiency of multi-band signal transmission and reception.

[0078] The receiving device includes a receiving antenna, a second multi-band WiFi radio frequency unit, a second main control unit, a second audio codec module, and an audio output interface, which are connected in sequence, and is also equipped with a power management unit.

[0079] Receiving antenna: The receiving antenna uses the same three-band antenna as the transmitting antenna to ensure the symmetry of the transmitting and receiving links; The second multi-band WiFi radio frequency unit also uses the Espressif ESP32-E22 tri-band chip to establish a point-to-point WiFi 6 wireless link with the WiFi chip at the transmitting end, and completes the reception, demodulation and baseband processing of wireless signals. The second main control unit uses an nRF54L15 chip and is responsible for packet parsing, packet loss compensation, audio decoding, and jitter buffering to ensure continuous and stable output of the audio stream. The second audio codec module uses the same professional audio codec chip as the transmitter, supports 48kHz / 24bit D / A conversion, completes high-precision conversion from digital audio to analog audio, and outputs high-fidelity audio signals; Audio output interfaces include XLR connectors, 6.35mm audio jacks, and 3.5mm headphone jacks, compatible with various professional power amplifiers such as mixing consoles, power amplifiers, and monitoring headphones.

[0080] In this embodiment, both the transmitting and receiving nRF54L15 chips have a built-in multi-band intelligent coordination module. This module includes a channel monitoring submodule, a priority scheduling submodule, a link decision submodule, and a seamless handover control submodule, with the following specific functions: 1. Channel monitoring submodule: Configured to perform a full channel scan every 100ms, collect signal-to-noise ratio, bit error rate, channel occupancy rate, and co-channel interference intensity data for 13 channels in the 2.4GHz band, 20 channels in the 5GHz band, and 16 channels in the 6GHz band, and update the channel quality table; 2. Priority Scheduling Submodule: By default, channels 36 / 40 / 44 / 48 of the 5GHz band are configured as the main transmission channels, carrying the core audio data stream; the 2.4GHz band only transmits reverse control signaling and also serves as a backup link; the 6GHz band is configured as a high-bandwidth backup band and is in standby monitoring mode, automatically activating when interference in the 5GHz band is severe. 3. Link Decision Submodule: The preset transmission thresholds are: end-to-end latency ≤ 15ms, packet loss rate ≤ 0.1%; when the signal-to-noise ratio of the 5GHz main channel is ≥ 30dB and the bit error rate is ≤ 0.01%, single-link transmission at 5GHz is maintained; when the signal-to-noise ratio of the 5GHz main channel is < 20dB and the packet loss rate is > 0.5% due to interference, obstruction, etc., a frequency band switching decision is triggered. If there is a channel in the 2.4GHz or 6GHz band that meets the threshold requirements, seamless switching to the optimal frequency band is initiated; in scenarios with ultra-high reliability requirements such as stage performances, multi-band redundant transmission mode can be manually enabled to transmit the same audio data packets simultaneously in the 5GHz and 6GHz bands. The receiving end selects and merges the packets based on the sequence number and verification information to reduce the packet loss rate to near 0. 4. Seamless switching control submodule: When switching frequency bands, a link is first established on the target frequency band (2.4GHz or 6GHz) and the data packet sequence number is synchronized. After a 20ms multi-link cross transition, the main transmission link of the original frequency band is shut down. The entire switching process is completely transparent to the audio stream and there will be no stuttering or audio dropout.

[0081] 1. Implementation details of the seamless switching control submodule During frequency band / channel switching, a three-layer mechanism of timestamp synchronization, dynamic buffering, and hybrid error correction is used to achieve seamless switching of audio streams, as detailed below: (1) Data packet sequence number synchronization mechanism Transmitter: Assign a globally incrementing sequence number to each audio data packet and embed a transmission timestamp in the packet header; Receiver: Maintains a multi-band sequence number window. During switching, after the link of the target frequency band is established, it first synchronizes the reference sequence number and timestamp offset to ensure that the data packet sequence number of the target frequency band is logically continuous with the sequence number of the source frequency band.

[0082] (2) Multi-link cross-transition mechanism During the handover process, audio data packets are transmitted in parallel on the source and target frequency bands for a duration of 20ms. Source band: Continue transmitting incomplete data packets until the handover completion command is triggered; Target frequency band: Send data packets with sequence numbers consecutive to the source frequency band and timestamp aligned, and carry a switching flag bit; Receiver: Enables dynamic buffer pool, sorts by sequence number + timestamp dual index, prioritizes outputting error-free data packets, and triggers FEC / ARQ error correction for residual erroneous data packets.

[0083] (3) FEC forward error correction assisted transition During the handover, hybrid error correction is performed on packets in the buffer pool: If the data packet comes from the source frequency band and contains errors, perform XOR verification using data packets with the same sequence number in the target frequency band; If the error density is high, FEC decoding is triggered; After error correction is completed, the data packet is sent to the audio output queue to ensure the continuity of the audio stream during the switching process.

[0084] (4) The link is shut down after the handover is completed. When the data packet sequence numbers in the dynamic buffer pool are consecutive and there are no uncorrected data packets, a shutdown transmission command is sent to the source frequency band. The source frequency band stops transmitting, and the target frequency band becomes the sole primary transmission link. The entire process is completely transparent to upper-layer audio applications.

[0085] Example 6 The sixth embodiment of the present invention provides an anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi. It adopts a single-chip integrated architecture, with the core using Espressif ESP32-E22 supporting 2.4GHz / 5GHz / 6GHz tri-band chips. It also provides a preferred solution, namely an external professional codec, and a secondary solution, namely an on-chip codec, which are respectively adapted to mid-to-high-end consumer-grade live streaming lavalier microphones, portable conference microphones, and ultra-lightweight entry-level portable microphones. The overall architecture conforms to the system framework.

[0086] Preferred solution: Single-chip integrated architecture + external professional codec.

[0087] This solution is a preferred implementation under a single-chip integrated architecture, which takes into account the advantages of low power consumption and small size of single-chip solutions. At the same time, it achieves audio performance comparable to discrete professional solutions through an external professional codec, making it suitable for scenarios with high requirements for sound quality, size, and power consumption, such as mid-to-high-end live streaming lavalier microphones and portable professional recording microphones.

[0088] Transmitter equipment design: The transmitter core uses the Espressif ESP32-E22 chip, which integrates a 256MHz Arm Cortex-M33 core, a 2.4GHz / 5GHz / 6GHz tri-band WiFi 6E RF unit, and a wealth of audio interfaces and peripherals. It eliminates the need for an external main controller and WiFi chip, greatly simplifying the hardware circuit design and reducing the size of the device.

[0089] The pickup unit uses a high signal-to-noise ratio MEMS microphone, paired with a low-noise preamplifier circuit, to output analog audio signals to an external professional codec module; The external professional audio codec module uses the Cirrus Logic CS42L51 or TI TLV320ADC3101 low-power professional codec chip, supports 48kHz / 24bit A / D conversion, and has built-in programmable gain amplifier, low-noise amplifier and hardware digital noise reduction module, which can achieve audio performance far exceeding that of the on-chip codec. At the same time, the gain and filtering parameters can be flexibly configured to adapt to the characteristics of different pickup units. The external codec module is interconnected with Espressif ESP32-E22 via the I2S high-speed audio interface, transmitting the converted high-precision digital audio stream to the main control core; The core of the Espressif ESP32-E22 is responsible for audio preprocessing, low-latency encoding, data encapsulation, and multi-band intelligent collaborative algorithms. The integrated tri-band WiFi radio frequency unit on the chip completes the modulation and transmission of wireless signals and is directly connected to the tri-band onboard antenna. The power management unit uses an integrated PMU chip to power the codec, single-chip SoC, and microphone unit, and is equipped with a 1000mAh rechargeable lithium battery to achieve ultra-long battery life.

[0090] Receiver equipment design: The receiver also uses the Espressif ESP32-E22 single-chip SoC, paired with an external professional audio codec module, to achieve high-fidelity audio output. The Espressif ESP32-E22 single chip receives and demodulates wireless signals through a receiving antenna, reconstructs audio data packets, and the core performs data packet parsing, error correction, and decoding to output a digital audio stream. The digital audio stream is transmitted to an external professional codec module via the I2S interface, where the codec performs high-precision D / A conversion and outputs an analog audio signal. After being amplified by the analog audio circuit, the signal is output through the 3.5mm headphone jack and the Type-C audio interface, which can directly drive devices such as monitoring headphones, live streaming sound cards, and cameras.

[0091] The advantages of this preferred solution are: it utilizes the Espressif ESP32-E22 single chip to achieve low power consumption, small size, and minimalist hardware design; it also breaks through the performance bottleneck of the on-chip codec by using an external professional codec, achieving professional-grade audio acquisition and playback effects; at the same time, it retains complete multi-band intelligent collaboration and anti-interference capabilities, and the end-to-end latency can be controlled within 15ms, perfectly adapting to mainstream scenarios such as live streaming, Vlog recording, and portable recording.

[0092] Alternative option: Single-chip integrated architecture + on-chip codec.

[0093] This solution is a simplified implementation under a single-chip integrated architecture, which greatly simplifies hardware design, reduces device size and hardware cost, and is suitable for ultra-lightweight entry-level portable lavalier microphones, conference microphones and other scenarios that are sensitive to size and cost and have moderate requirements for audio performance. The hardware structure of the transmitter is shown in the figure.

[0094] In this solution, the core of the transmitter device adopts Espressif ESP32-E22 single-chip SoC. In addition to integrating the main control core and tri-band WiFi RF unit, this chip also has a built-in audio codec peripheral that supports 48kHz / 16bit, eliminating the need for an external codec chip and making the hardware circuit extremely simple.

[0095] The pickup unit is directly connected to the analog microphone input interface of the Espressif ESP32-E22, and the A / D conversion is completed by the integrated codec on the chip, outputting the digital audio stream to the core; The on-chip processor core performs audio preprocessing, low-latency encoding, data encapsulation, and multi-band collaborative algorithms. The on-chip tri-band WiFi radio frequency unit completes the transmission and reception of wireless signals, directly connects to the tri-band antenna, and supports 2.4GHz / 5GHz tri-band switching and collaborative operation.

[0096] The receiver also uses the Espressif ESP32-E22 single-chip solution, which completes the D / A conversion through the on-chip codec and directly outputs the analog audio signal to the 3.5mm headphone jack or Type-C digital audio interface, further simplifying the receiver hardware design.

[0097] The advantages of this chosen solution are: minimal number of hardware components, extremely compact PCB area, significantly reduced device size, lower BOM cost, and simpler production and assembly; combined with the ultra-low power consumption of the Espressif ESP32-E22 chip, it can achieve ultra-long battery life with a small capacity battery, meeting the product needs of entry-level consumer portable wireless microphones.

[0098] In this embodiment, both the preferred and secondary options fully inherit the multi-band intelligent coordination and interference avoidance mechanism, which can realize automatic monitoring, dynamic switching and interference avoidance of 2.4GHz, 5GHz and 6GHz frequency bands, ensuring the stability of audio transmission in complex environments. At the same time, based on the low latency optimization of WiFi6 protocol, it achieves millisecond-level end-to-end transmission latency, meeting the needs of real-time monitoring and live interactive broadcasts.

Claims

1. A method for interference-resistant, low-latency, high-fidelity wireless audio transmission based on multi-band WiFi, characterized in that, Include: The transmitting end acquires the raw digital audio stream of wireless audio, preprocesses, compresses, encapsulates, and transmits the raw digital audio stream to form audio data packets. Based on the decision results of the multi-band intelligent coordination mechanism, the audio data packets are scheduled to the WiFi radio frequency link of the corresponding frequency band, and the audio data packets are radiated to the receiving end through the transmitting antenna. The intelligent coordination process includes frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching, and active interference avoidance steps. The receiving end receives the audio data packets through the receiving antenna, demodulates the audio data packets, and performs parsing, error correction, decoding and audio data reconstruction on the audio data packets based on a multi-band intelligent collaborative mechanism, completing the conversion from digital signal to analog signal. The receiving end outputs the audio signal through the audio output interface.

2. The anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi as described in claim 1, characterized in that, The transmitting end processing procedure specifically includes the following steps: The transmitter converts the audio signal into an analog electrical signal, and then converts the analog electrical signal at a preset sampling rate and sampling depth to output the original digital audio stream; The transmitting end performs noise reduction, gain control, and delay compensation preprocessing on the original digital audio stream, and then uses a low-latency audio coding algorithm to compress and encode the preprocessed audio data to generate coded audio frames. The transmitter encapsulates the encoded audio frames with protocols, adds timestamps, sequence numbers and error correction verification information, and schedules data packets to multi-band WiFi links of the corresponding frequency bands based on the decision results of the intelligent collaborative process. The transmitter uses a multi-band intelligent collaborative mechanism to perform baseband processing and up-conversion on the encapsulated audio data packets, and then converts them into radio electromagnetic wave signals for transmission via the transmitting antenna.

3. The anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi as described in claim 1, characterized in that: The receiving end processing flow specifically includes the following steps: The receiver uses a multi-band intelligent collaborative mechanism to receive wireless signals through the receiving antenna, completes down-conversion, demodulation and baseband processing, restores audio data packets, performs protocol parsing on the received data packets, performs out-of-order rearrangement and packet loss compensation based on the sequence number, completes data error correction through verification information, and extracts valid encoded audio frames. The receiving end uses the corresponding low-latency decoding algorithm to decode the encoded audio frame, and combines the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream; The receiving end converts the reconstructed digital audio stream to generate an analog audio signal, which is then amplified by a subsequent amplifier circuit and output to the audio output interface.

4. The anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi as described in claim 1, characterized in that: The intelligent collaboration process includes the following steps: The default configuration uses the 5GHz band as the primary transmission band, carrying the core audio data stream; Configure the 2.4GHz band as a secondary transmission or control band to carry control signaling, reverse link data, or as a redundant backup transmission link; If the multi-band WiFi supports the 6GHz band, configure the 6GHz band as a high-bandwidth backup or extended band, and enable it when the 5GHz band is severely interfered with or when ultra-high bandwidth transmission is required. The multi-band intelligent collaborative mechanism periodically scans the entire 2.4GHz, 5GHz and scalable 6GHz channels, and collects the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time. Based on real-time monitored channel quality data, combined with current audio transmission latency and packet loss rate threshold requirements, link decisions are made: If the quality of the 5GHz main channel meets the preset high-quality transmission requirements, then the 5GHz band will maintain single-link main transmission, the 2.4GHz band will only transmit control signaling, and the 6GHz band will be in standby monitoring state. If the channel quality of the 5GHz band is lower than the preset threshold, but the channel quality of the 2.4GHz or 6GHz band meets the requirements, then seamlessly switch to the band with the best channel quality to complete the main audio stream transmission; If extremely high reliability is required, activate the multi-band redundant transmission mode, select at least two frequency bands in the 2.4GHz, 5GHz and 6GHz bands to transmit the same audio data packets simultaneously, and the receiving end will select and merge the best ones through the multi-band intelligent collaborative process to minimize the packet loss rate. Within the selected operating frequency band, channel interference is monitored in real time. When continuous interference is detected, the system automatically switches to the least interfered idle channel within the same frequency band. If there is no available idle channel in the same frequency band, the system switches to other frequency bands to complete the dynamic adjustment of frequency points.

5. The anti-interference, low-latency, high-fidelity wireless audio transmission method based on multi-band WiFi as described in claim 2, characterized in that, In the noise reduction of the original digital audio stream at the transmitting end, the low-latency audio encoding algorithm adopts any one of the three audio source decoders: LC3, LC3plus, and Opus, and the frame length of the encoding algorithm is configured to be 2.5ms-10ms. The sampling rate is not less than 48kHz and the sampling depth is not less than 16bit.

6. A multi-band WiFi-based anti-interference, low-latency, high-fidelity wireless audio transmission system, characterized in that, include: The transmitting device is used to collect the raw digital audio stream of wireless audio, preprocess, compress, encode and encapsulate the raw digital audio stream to form audio data packets, and schedule the audio data packets to the WiFi radio frequency link of the corresponding frequency band according to the decision result of the multi-band intelligent coordination mechanism, and transmit them through the transmitting antenna. The receiving device is used to receive the audio data packets through a receiving antenna, receive and demodulate the audio data packets, and parse, correct, decode and reconstruct the audio data packets based on a multi-band intelligent collaborative mechanism, complete the conversion of digital signals to analog signals, and output audio signals through an audio output interface. The multi-band intelligent coordination module is deployed in the transmitting and receiving devices respectively, and is used to perform intelligent coordination processes such as frequency band priority scheduling, real-time channel quality monitoring, dynamic frequency band switching and active interference avoidance.

7. The anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi as described in claim 6, characterized in that: The transmitting device specifically includes: The analog-to-digital converter module is used to convert audio signals into analog electrical signals, and converts the analog electrical signals at a preset sampling rate and sampling depth to output the original digital audio stream; The preprocessing and encoding module is used to perform noise reduction, gain control and delay compensation preprocessing on the original digital audio stream, and then use a low-latency audio encoding algorithm to compress and encode the preprocessed audio data to generate encoded audio frames. The protocol encapsulation and scheduling module is used to encapsulate the encoded audio frames, add timestamps, sequence numbers and error correction verification information, and schedule data packets to the corresponding multi-band WiFi links based on the decision results of the multi-band intelligent coordination module. The first radio frequency transmission module is used to perform baseband processing and up-conversion on the encapsulated audio data packets via the multi-band intelligent collaborative module, and then convert them into radio electromagnetic wave signals for transmission through the transmitting antenna.

8. The anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi as described in claim 6, characterized in that, The receiving device specifically includes: The first radio frequency receiving module is used to receive wireless signals through the receiving antenna using the multi-band intelligent collaborative module, and to complete down-conversion, demodulation and baseband processing to restore the audio data packets. The protocol parsing and error correction module is used to parse the received data packets, perform out-of-order reordering and packet loss compensation based on the sequence number, complete data error correction through verification information, and extract valid encoded audio frames. The decoding and reconstruction module is used to decode the encoded audio frames using the corresponding low-latency decoding algorithm, and combine the timestamp to complete audio and video synchronization and jitter buffering to reconstruct a continuous digital audio stream. The digital-to-analog converter and output module is used to convert the reconstructed digital audio stream into an analog audio signal, which is then amplified by a subsequent amplifier circuit and output to the audio output interface.

9. A multi-band WiFi-based anti-interference, low-latency, high-fidelity wireless audio transmission system as described in claim 6, characterized in that, The multi-band intelligent collaboration is specifically used to perform the following operations: Configure the 5GHz band as the primary transmission band to carry the core audio data stream; configure the 2.4GHz band as the secondary transmission or control band to carry control signaling, reverse link data, or as a redundant backup transmission link; if the 6GHz band is supported, configure the 6GHz band as a high-bandwidth backup or extended band. Periodically scan all channels of 2.4GHz, 5GHz and scalable 6GHz, and collect the signal-to-noise ratio, bit error rate, channel occupancy rate and co-channel interference intensity of each channel in real time; Based on real-time monitored channel quality data, combined with current audio transmission latency and packet loss rate threshold requirements, link decisions are made: When the quality of the 5GHz band main channel meets the preset high-quality transmission requirements, maintain single-link main transmission in the 5GHz band. When the channel quality of the 5GHz band is lower than the preset threshold but other bands meet the requirements, seamlessly switch to the band with the best channel quality; When high reliability is required, a multi-band redundant transmission mode is activated, selecting at least two frequency bands to transmit the same audio data packets simultaneously, which are then merged by the receiving end. Within the selected operating frequency band, channel interference is monitored in real time. When continuous interference is detected, the system automatically switches to the least interfered idle channel within the same frequency band. If no idle channel is available, the system switches to another frequency band.

10. The anti-interference, low-latency, high-fidelity wireless audio transmission system based on multi-band WiFi as described in claim 7, characterized in that, The low-latency audio coding algorithm used in the preprocessing and encoding includes any one of the three audio source decoders: LC3, LC3plus, and Opus. The frame length of the coding algorithm is configured to be 2.5ms-10ms. The sampling rate of the analog-to-digital conversion module is not less than 48kHz, and the sampling depth is not less than 16bit.

Images