Audio processing method, device, equipment and storage medium combining WiFi and BLE technology

Abstract

The present invention relates to the field of audio processing technology, and discloses an audio processing method, device, equipment and storage medium combining WiFi and BLE technology, which is used to achieve high-quality, low-latency multi-room multi-channel synchronous playback. The audio processing method combining WiFi and BLE technology includes: obtaining target audio data containing multi-channel information, establishing a multi-room audio device connection through WiFi and BLE Auracast™ protocol, dynamically configuring the distribution path according to intelligent distance detection, obtaining the configured audio distribution network, adjusting the target audio data timing using the BLE Auracast™ synchronization algorithm, obtaining synchronized audio data, and sending the synchronized audio data to each device for playback through WiFi or BLE Auracast™ according to the configured audio distribution network.

Description

Technical Field

[0001] The present invention relates to the field of audio processing technology, and in particular to an audio processing method, device, equipment and storage medium combining WiFi and BLE technologies. Background Art

[0002] The multi-room audio systems currently on the market either rely entirely on WiFi networks or use only BLE technology. This single transmission mode has obvious limitations. Specifically, due to the transmission characteristics of WiFi networks, especially in complex network environments, audio data between different rooms may have delay differences during transmission, causing users to feel asynchrony between channels when listening, affecting the overall coherence and immersion of the sound effect. BLE's transmission distance and wall penetration capabilities are relatively weak, which is particularly evident in large residences or environments with complex room layouts. When users try to play audio in a room far away from the BLE signal source, they may encounter problems with unstable signals or disconnected connections, which limits the widespread application of BLE technology in multi-room audio systems.

[0003] Therefore, both the WiFi network solution and the BLE technology have their own limitations. The WiFi solution has a large delay when synchronizing multiple channels, while the BLE solution is limited by distance. Summary of the invention

[0004] The present invention provides an audio processing method, device, equipment and storage medium combining WiFi and BLE technologies to solve the problem in the prior art that a single transmission mode of the same system leads to large delay or distance limitation during multi-channel synchronization.

[0005] A first aspect of the present invention provides an audio processing method combining WiFi and BLE technologies, including: obtaining target audio data containing multi-channel information; using WiFi technology and combining with the BLE Auracast™ protocol to establish an intelligent hybrid transmission architecture connection between audio devices corresponding to multiple rooms; dynamically configuring the distribution path of the target audio data according to the intelligent distance detection result to obtain a configured audio distribution network; using the synchronization algorithm in the BLE Auracast™ protocol to adjust the timing of the target audio data to obtain synchronized audio data; according to the configured audio distribution network, sending the synchronized audio data to the corresponding channels of each audio device via WiFi or the BLE Auracast™ protocol for playback.

[0006] In a feasible implementation, the obtaining of target audio data containing multi-channel information includes: receiving original audio data, the original audio data containing information of at least two channels; parsing the original audio data, identifying and separating data of each channel; and pre-processing the separated channel data according to preset audio processing rules to obtain target audio data containing multi-channel information.

[0007] In a feasible implementation, the use of WiFi technology, combined with the BLE Auracast™ protocol, to establish an intelligent hybrid transmission architecture connection between audio devices corresponding to multiple rooms, includes: using WiFi technology to cache target audio data containing multi-channel information; using the BLE Auracast™ protocol to start the BLE broadcast function and set corresponding broadcast parameters; applying BLE technology to scan audio devices in each room, identifying the BLE identifier of each audio device and establishing a communication connection, thereby forming an intelligent hybrid transmission architecture connection.

[0008] In a feasible implementation, the distribution path of the target audio data is dynamically configured according to the intelligent distance detection result to obtain a configured audio distribution network, including: real-time monitoring of the relative distance between each audio device and the WiFi access point to obtain distance information; grouping all audio devices according to the distance information; and configuring a corresponding transmission mode for each audio device based on the grouping result to determine the distribution path of the target audio data to obtain a configured audio distribution network.

[0009] In a feasible implementation, grouping all audio devices according to the distance information includes: for each audio device, comparing its relative distance to the WiFi access point with a preset grouping threshold; and dividing all audio devices into WiFi transmission groups and BLE Auracast™ protocol transmission groups according to the comparison results.

[0010] In a feasible implementation, the corresponding transmission mode is configured for each audio device based on the grouping result to determine the distribution path of the target audio data to obtain a configured audio distribution network, including: configuring the corresponding transmission mode for each audio device based on the grouping result; designing the distribution path of the target audio data according to the transmission mode configuration result, in combination with the layout of each room, the performance of each audio device and the number of channels of the target audio data; setting the role of each audio device in the audio distribution network according to the designed distribution path, and verifying whether the configuration is successful, to obtain the configured audio distribution network.

[0011] In a feasible implementation, the use of the synchronization algorithm in the BLE Auracast™ protocol to adjust the timing of the target audio data to obtain synchronized audio data includes: identifying and acquiring the clock deviation and network delay between each audio device; applying the synchronization algorithm in the BLE Auracast™ protocol to calculate the time compensation value required by each audio device based on the clock deviation and the network delay information to obtain time compensation information; and performing time compensation on each channel data of the target audio data based on the time compensation information to obtain synchronized audio data.

[0012] In a feasible implementation, the identifying and obtaining of the clock deviation and network delay between the audio devices includes: starting a clock synchronization mechanism, sending and receiving clock synchronization signals through a BLE connection, measuring the signal round-trip time to calculate the network delay between the audio devices; using a timestamp to record the time when each audio device receives the synchronization signal, and calculating the clock deviation between the audio devices.

[0013] In a feasible implementation, the synchronization algorithm in the applied audio broadcasting technology protocol calculates the time compensation value required by each audio device according to the clock deviation and the network delay information to obtain the time compensation information, including: selecting an audio device as a master device and the remaining audio devices as slave devices; calculating the time offset of each slave device relative to the master device based on the clock deviation and network delay collected by the master device to obtain the time offset information; calculating the time compensation value required by each slave device according to the time offset information and the playback rate of the audio data stream corresponding to each audio device to obtain the time compensation value information.

[0014] In a feasible implementation manner, according to the configured audio distribution network, the synchronized audio data is sent to the corresponding channel of each audio device through WiFi or BLE Auracast™ protocol for playback, including: for the first audio device belonging to the WiFi transmission group, according to the configured audio distribution network, the synchronized audio data is sent to each first audio device through the WiFi network, so that each first audio device receives and extracts the audio data belonging to its own channel and plays it; for the second audio device belonging to the BLE Auracast™ protocol transmission group, the synchronized audio data is packaged into a BLE data packet suitable for BLE transmission; according to the configured audio distribution network, the BLE data packet is sent to each second audio device sequentially or in parallel through the BLE technology, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it.

[0015] In a feasible implementation, packaging the synchronized audio data into a BLE data packet suitable for BLE transmission includes: segmenting the synchronized audio data, each segment containing audio information of a fixed time length; adding header information to each data segment, encoding and compressing each data segment and the corresponding header information to comply with the data format and bandwidth limitation of BLE transmission, and encapsulating them into a BLE data packet.

[0016] In a feasible implementation, the BLE data packet is sent to each second audio device sequentially or in parallel through the BLE technology according to the configured audio distribution network, including: reading the topological structure of the configured audio distribution network; determining the connection relationship and transmission order between each audio device according to the topological structure, and obtaining the target configuration of the audio distribution network; selecting the target BLE transmission strategy according to the target configuration of the audio distribution network, and sending the BLE data packet to each second audio device sequentially or in parallel.

[0017] The second aspect of the present invention provides an audio processing device that combines WiFi and BLE technologies, including: an acquisition module for acquiring target audio data containing multi-channel information; an establishment module for using WiFi technology and combining the BLE Auracast™ protocol to establish an intelligent hybrid transmission architecture connection between audio devices corresponding to multiple rooms; a configuration module for dynamically configuring the distribution path of the target audio data according to the intelligent distance detection result to obtain a configured audio distribution network; an adjustment module for using the synchronization algorithm in the BLE Auracast™ protocol to adjust the timing of the target audio data to obtain synchronized audio data; a playback module for sending the synchronized audio data to the corresponding channels of each audio device through WiFi or the BLE Auracast™ protocol for playback according to the configured audio distribution network.

[0018] In a feasible implementation, the acquisition module is specifically used to: receive original audio data, the original audio data containing information of at least two channels; parse the original audio data, identify and separate the data of each channel; and pre-process the separated channel data according to preset audio processing rules to obtain target audio data containing multi-channel information.

[0019] In a feasible implementation, the establishment module is specifically used to: use WiFi technology to cache target audio data containing multi-channel information; use the BLE Auracast™ protocol to start the BLE broadcast function and set corresponding broadcast parameters; use BLE technology to scan audio devices in each room, identify the BLE identifier of each audio device and establish a communication connection to form an intelligent hybrid transmission architecture connection.

[0020] In a feasible implementation, the configuration module includes: a monitoring unit, used to monitor the relative distance between each audio device and the WiFi access point in real time to obtain distance information; a grouping unit, used to group all audio devices according to the distance information; and a distribution unit, used to configure a corresponding transmission mode for each audio device based on the grouping result to determine the distribution path of the target audio data and obtain a configured audio distribution network.

[0021] In a feasible implementation, the grouping unit is specifically used to: for each audio device, compare its relative distance to the WiFi access point with a preset grouping threshold; and based on the comparison result, divide all audio devices into a WiFi transmission group and a BLE Auracast™ protocol transmission group.

[0022] In a feasible implementation, the distribution unit is specifically used to: configure a corresponding transmission mode for each audio device based on the grouping result; design a distribution path for the target audio data according to the transmission mode configuration result, in combination with the layout of each room, the performance of each audio device and the number of channels of the target audio data; set the role of each audio device in the audio distribution network according to the designed distribution path, and verify whether the configuration is successful, so as to obtain the configured audio distribution network.

[0023] In a feasible implementation, the adjustment module includes: an acquisition unit, used to identify and acquire the clock deviation and network delay between each audio device; a calculation unit, used to apply the synchronization algorithm in the BLE Auracast™ protocol, calculate the time compensation value required by each audio device according to the clock deviation and the network delay information, and obtain time compensation information; a compensation unit, used to perform time compensation on each channel data of the target audio data based on the time compensation information to obtain synchronized audio data.

[0024] In a feasible implementation, the acquisition unit is specifically used to: start the clock synchronization mechanism, send and receive clock synchronization signals through the BLE connection, measure the signal round-trip time to calculate the network delay between each audio device; use the timestamp to record the time when each audio device receives the synchronization signal, and calculate the clock deviation between each audio device.

[0025] In a feasible implementation, the calculation unit is specifically used to: select one audio device as a master device and the remaining audio devices as slave devices; calculate the time offset of each slave device relative to the master device based on the clock deviation and network delay collected by the master device to obtain time offset information; calculate the time compensation value required for each slave device according to the time offset information and the playback rate of the audio data stream corresponding to each audio device to obtain time compensation value information.

[0026] In a feasible implementation, the playback module includes: a first playback unit, for sending the synchronized audio data to each first audio device through the WiFi network according to the configured audio distribution network for the first audio device belonging to the WiFi transmission group, so that each first audio device receives and extracts the audio data belonging to its own channel and plays it; a packaging unit, for packaging the synchronized audio data into a BLE data packet suitable for BLE transmission for the second audio device belonging to the BLE Auracast™ protocol transmission group; a second playback unit, for sending the BLE data packet to each second audio device sequentially or in parallel through the BLE technology according to the configured audio distribution network, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it.

[0027] In a feasible implementation, the packaging unit is specifically used to: segment the synchronized audio data, each segment of data contains audio information of a fixed time length; add header information to each data segment, encode and compress each data segment and the corresponding header information to comply with the data format and bandwidth limitation of BLE transmission, and encapsulate them into BLE data packets.

[0028] In a feasible implementation, the second playback unit is specifically used to: read the topological structure of the configured audio distribution network; determine the connection relationship and transmission order between the second audio devices according to the topological structure to obtain the target configuration of the audio distribution network; select the target BLE transmission strategy according to the target configuration of the audio distribution network, and send the BLE data packet to each second audio device sequentially or in parallel, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it.

[0029] A third aspect of the present invention provides an audio processing device combining WiFi and BLE technologies, comprising: a memory and at least one processor, wherein instructions are stored in the memory; the at least one processor calls the instructions in the memory so that the audio processing device combining WiFi and BLE technologies executes the above-mentioned audio processing method combining WiFi and BLE technologies.

[0030] A fourth aspect of the present invention provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer executes the above-mentioned audio processing method combining WiFi and BLE technologies.

[0031] In the technical solution provided by the present invention, target audio data containing multi-channel information is obtained; WiFi technology is used in combination with the BLE Auracast™ protocol to establish an intelligent hybrid transmission architecture connection between audio devices corresponding to multiple rooms; according to the intelligent distance detection result, the distribution path of the target audio data is dynamically configured to obtain the configured audio distribution network; the synchronization algorithm in the BLE Auracast™ protocol is used to adjust the timing of the target audio data to obtain synchronized audio data; according to the configured audio distribution network, the synchronized audio data is sent to the corresponding channels of each audio device through WiFi or BLE Auracast™ protocol for playback. In the embodiment of the present invention, the efficient data transmission capability of WiFi technology is utilized to avoid the limitation of BLE technology in transmission distance. At the same time, with the help of the synchronization algorithm of the BLE Auracast™ protocol, the delay in the synchronization of multi-channel audio is effectively reduced, thereby realizing high-quality, low-latency synchronous transmission of audio data between multi-room audio devices, significantly improving the coordination of audio playback and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 A schematic diagram of an embodiment of an audio processing method combining WiFi and BLE technologies in an embodiment of the present invention;

[0033] Figure 2 It is a schematic diagram of another embodiment of the audio processing method combining WiFi and BLE technologies in an embodiment of the present invention;

[0034] Figure 3 It is a schematic diagram of another embodiment of the audio processing method combining WiFi and BLE technologies in an embodiment of the present invention;

[0035] Figure 4 This is a schematic diagram of an embodiment of an audio processing device combining WiFi and BLE technologies in an embodiment of the present invention;

[0036] Figure 5 It is a schematic diagram of another embodiment of an audio processing device combining WiFi and BLE technologies in an embodiment of the present invention;

[0037] Figure 6 Schematic diagram of an embodiment of an audio processing device combining WiFi and BLE technologies in an embodiment of the present invention. DETAILED DESCRIPTION

[0038] The embodiments of the present invention provide an audio processing method, apparatus, device and storage medium combining WiFi and BLE technologies to achieve high-quality, low-latency multi-room multi-channel synchronous playback.

[0039] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" or "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0040] It is understandable that the execution subject of the present invention may be an audio processing device combining WiFi and BLE technology, or may be a terminal or a server, which is not specifically limited here. The embodiment of the present invention is described by taking a server as the execution subject as an example.

[0041] For ease of understanding, the specific process of the embodiment of the present invention is described below. Figure 1 , an embodiment of the audio processing method combining WiFi and BLE technology in an embodiment of the present invention includes:

[0042] 101. Acquire target audio data including multi-channel information;

[0043] Capture audio data containing multi-channel information from source devices such as home theater systems, smartphones or computers. This data may cover advanced multi-channel audio formats such as Dolby AC-3, DTS-HD, Dolby TrueHD or Atmos. The connection with the source device is established through the core controller, which can be a WiiM module with integrated efficient audio decoding and processing capabilities. The core controller has the ability to identify and parse multiple audio formats. Once the connection is established, the core controller is responsible for receiving these audio data streams, decoding the audio data using the built-in decoder, and converting it into digital audio signals that can be recognized by the audio device. These signals are then prepared for further processing and distribution to ensure that the multi-channel audio data can be accurately transmitted to each audio device.

[0044] 102. Using WiFi technology and combining it with the BLE Auracast™ protocol, an intelligent hybrid transmission architecture connection is established between audio devices corresponding to multiple rooms;

[0045] First, initialize and configure via WiFi network. This process includes connecting to an available WiFi network, obtaining network settings such as the IP address, subnet mask, gateway, etc. of each audio device from the server or configuration file in the network, as well as the unique identification code of each audio device, user account information, etc. These configuration information are crucial for the stable operation of the device in the network, and they ensure that the device can correctly identify and join the network. Then, a unique identifier is assigned to each audio device using the BLE Auracast™ protocol to ensure accurate identification and management in a complex network environment; then, based on the specific needs of the multi-channel audio configuration, a BLE connection is dynamically established with each device, and connection management and optimization algorithms are applied to reduce latency and improve the stability of data transmission. The audio device is initialized and configured via WiFi, a unique identifier is assigned using the BLE Auracast™ protocol, and a BLE connection and optimization are dynamically established, realizing an intelligent hybrid transmission architecture connection between multi-room audio devices.

[0046] 103. Dynamically configure the distribution path of the target audio data according to the intelligent distance detection result to obtain the configured audio distribution network;

[0047] By integrating distance sensors in the audio device or environment or using intelligent algorithms, the distance between the audio device and the audio source or central control node is detected in real time. These sensors or algorithms can capture tiny distance changes and update the distance data in real time. Distance sensors include but are not limited to laser rangefinders and ultrasonic rangefinders, and intelligent algorithms include but are not limited to location service algorithms.

[0048] Based on the distance between each audio device and the audio source or central control node, the corresponding transmission path is configured for each audio device to obtain the configured audio distribution network. For example, when the distance between the audio receiving device and the central control node is close, the low-power, high-efficiency BLE Auracast™ protocol is selected for transmission to reduce the energy consumption of the device and extend the battery life; when the distance is far or a large amount of audio data needs to be transmitted, a high-speed, large-bandwidth WiFi network is selected to ensure that the audio data can be stably and quickly transmitted to the target device.

[0049] In the process of dynamically configuring the transmission path, various factors can also be considered, such as network congestion, signal interference, device compatibility, etc. In order to ensure that audio data can be transmitted in the most efficient and stable manner, various technical means may be used to optimize the transmission path. For example, by dynamically adjusting the network configuration and transmission parameters to reduce network congestion and signal interference, the transmission parameters include but are not limited to channel selection, power control and data encoding methods; by intelligently identifying the compatibility of devices, it is ensured that audio data can flow seamlessly on audio devices of different brands and models.

[0050] 104. Use the synchronization algorithm in the BLE Auracast™ protocol to adjust the timing of the target audio data to obtain synchronized audio data;

[0051] The BLE Auracast™ protocol is adopted and a synchronization algorithm is integrated to make precise timing adjustments to the target audio data. In this process, the timestamp mechanism is first used to time-tag each audio data packet to ensure that their timing relationship is preserved during transmission; then, by implementing an efficient buffering strategy and clock synchronization mechanism, the delay differences that may occur in network transmission are effectively compensated; in addition, the playback speed can be dynamically adjusted to fine-tune the audio data stream according to actual conditions, thereby further ensuring that audio devices in multiple rooms can receive fully synchronized audio data streams. This method ensures the consistency and coherence of audio playback, bringing users an immersive multi-room audio experience.

[0052] 105. According to the configured audio distribution network, the synchronized audio data is sent to the corresponding channels of each audio device via WiFi or BLEAuracast™ protocol for playback.

[0053] After the configuration of the audio distribution network is completed, first, check the connection status of each audio device to ensure that they have successfully connected to the network and are in standby status; then, according to the preset audio configuration plan, split and package the synchronized audio data. Each data packet will contain key information such as the corresponding audio data, timestamp information, and the identifier of the target device. The timestamp is used to ensure that the timing relationship of the audio data is maintained during the transmission process, and the target device identifier is used to guide the data packet to be correctly routed to the corresponding audio device;

[0054] After the data packet is prepared, the transmission method is intelligently selected according to the network environment and the distance of the device. For devices within the WiFi coverage area and requiring high-speed transmission, WiFi technology will be used for data transmission; while for devices with shorter distances and lower power consumption requirements, BLE Auracast™ protocol is preferred for broadcasting. Both transmission methods support low-latency, high-stability data transmission, and have intelligent routing and error correction functions, which can cope with complex network environments and ensure that audio data is accurately delivered to the target device.

[0055] Once the data packet arrives at the audio device, it will immediately unpack and parse it. The unpacking process includes extracting audio data, timestamp information, and device identifiers from the data packet, while the parsing process further processes and converts this information so that the audio device can correctly understand and play the audio data.

[0056] After the audio data is successfully parsed, the audio device will sort and play the audio data according to the timestamp information to ensure that audio devices in multiple rooms can receive synchronized audio data streams and maintain the consistency and coherence of audio playback.

[0057] In addition, the transmission and playback status of audio data and changes in the network environment can be monitored in real time. Once any abnormal situation is found, such as network delay, equipment failure, etc., the system will immediately take corresponding remedial measures, such as adjusting transmission strategies, reallocating data packets, etc., to ensure the stability and reliability of audio distribution.

[0058] Furthermore, it also provides a wealth of user control interfaces, such as smartphone apps, which allow users to make fine-grained adjustments and control of audio playback according to their preferences and needs. These control interfaces not only provide an intuitive graphical interface and convenient interaction methods, but also support a variety of custom settings and scene modes, bringing users a more flexible and personalized audio experience.

[0059] In an embodiment of the present invention, target audio data containing multi-channel information is obtained, and a smart hybrid transmission architecture connection is established between audio devices corresponding to multiple rooms by using WiFi technology and combining the BLE Auracast™ protocol. According to the intelligent distance detection result, the distribution path of the target audio data is dynamically configured to obtain the configured audio distribution network, and the synchronization algorithm in the BLE Auracast™ protocol is used to adjust the timing of the target audio data to obtain the synchronized audio data. According to the configured audio distribution network, the synchronized audio data is sent to the corresponding channels of each audio device through WiFi or BLE Auracast™ protocol for playback. This embodiment utilizes the efficient data transmission capability of WiFi technology to avoid the limitation of BLE technology in transmission distance. At the same time, with the help of the synchronization algorithm of the BLE Auracast™ protocol, the delay in the synchronization of multi-channel audio is effectively reduced, thereby realizing high-quality, low-latency synchronous transmission of audio data between multi-room audio devices, significantly improving the coordination of audio playback and user experience.

[0060] See also Figure 2 Another embodiment of the audio processing method combining WiFi and BLE technologies in the embodiment of the present invention includes:

[0061] 201. Acquire target audio data including multi-channel information;

[0062] Receive original audio data, the original audio data containing information of at least two channels; parse the original audio data, identify and separate the data of each channel; pre-process the separated data of each channel according to a preset audio processing rule to obtain target audio data containing multi-channel information.

[0063] Receive raw audio data, which can be stored in a variety of formats, including but not limited to WAV, FLAC and MP3, and carry key information such as sampling rate, bit depth and channel configuration. Through a series of interfaces, such as USB, Bluetooth, Wi-Fi or Ethernet, audio data can be captured from these interface sources in real time or on demand. For streaming audio, audio frames can also be efficiently read from the network buffer to ensure data continuity and real-time performance.

[0064] According to the metadata of the audio file or the audio database, the data of each channel corresponding to the original audio data is identified and separated. For compressed audio, such as MP3, decoding operations are required to convert it into uncompressed PCM format or other uncompressed formats for subsequent processing. During the parsing process, the header information of the audio file, such as the header of the WAV file, is analyzed to determine key parameters such as the number of channels and sampling rate.

[0065] According to preset audio processing rules, the data of each channel separated from the original audio data is independently preprocessed, and the preset audio processing rules include at least one or more of volume adjustment rules, equalization rules, noise reduction processing rules and spatial effect processing rules, wherein the volume adjustment rule is used to adjust the volume level of each channel to ensure the volume balance between the channels; the equalization rule is used to adjust the audio frequency response of each channel to improve the timbre and sound quality of the audio; the noise reduction processing rule is used to reduce the noise component in each channel to improve the clarity of the audio; the spatial effect processing rule is used to add spatial effects, such as reverberation or delay, to each channel to simulate a specific acoustic environment or enhance the stereoscopic sense of the audio; the data of each channel that has been independently preprocessed is recombined to generate target audio data containing multi-channel information.

[0066] By receiving and parsing the original audio data, identifying and separating the information of each channel, and then pre-processing according to preset rules, multi-channel audio data is effectively integrated, the flexibility and accuracy of audio processing are improved, and the high fidelity of the target audio data and multi-channel playback effects are ensured.

[0067] 202. Using WiFi technology and combining it with the BLE Auracast™ protocol, an intelligent hybrid transmission architecture connection is established between audio devices corresponding to multiple rooms;

[0068] Use WiFi technology to cache target audio data containing multi-channel information; use the BLE Auracast™ protocol to enable the BLE broadcast function and set the corresponding broadcast parameters; use BLE technology to scan audio devices in each room, identify the BLE identifier of each audio device and establish a communication connection to form an intelligent hybrid transmission architecture connection.

[0069] 203. Monitor the relative distance between each audio device and the WiFi access point in real time to obtain distance information;

[0070] WiFi signals gradually weaken as the distance increases during propagation. Therefore, the relative distance between them can be estimated by measuring the signal strength (RSSI, Received Signal Strength Indicator) received by the audio device from the WiFi access point. Specifically, a mapping relationship between signal strength and distance can be established. Then, in the real-time monitoring process, this mapping relationship is used to estimate the distance based on the received signal strength, thereby obtaining distance information.

[0071] In another implementation, since a single WiFi access point may not provide sufficient accuracy to accurately measure the distance in a complex environment, a positioning network may be constructed using multiple WiFi access points; the audio device communicates with these access points and measures the relative distance to each access point; then, using the principle of triangulation positioning and combining this distance information, the precise position of the audio device in space may be calculated, thereby obtaining the relative distance to each access point to obtain the corresponding distance information.

[0072] 204. Group all audio devices according to distance information;

[0073] For each audio device, the relative distance between the audio device and the WiFi access point is compared with a preset grouping threshold; based on the comparison result, all audio devices are divided into a WiFi transmission group and a BLE Auracast™ protocol transmission group.

[0074] A grouping threshold is pre-set according to the layout, transmission requirements and signal coverage of the audio distribution network. The grouping threshold is used as a basis for judgment to divide audio devices into WiFi transmission groups and BLE Auracast™ protocol transmission groups. Specifically, when the relative distance between the audio device and the WiFi access point is less than the preset threshold, it is considered to be within the strong range of WiFi signal coverage, and it is more suitable for audio data transmission through high-speed and stable WiFi; when the distance is greater than the threshold, the BLE Auracast™ protocol is considered to be used, with its low power consumption and wide coverage characteristics, to ensure that audio data can be stably transmitted even in areas with weak signals.

[0075] 205. Based on the grouping result, configure a corresponding transmission mode for each audio device to determine a distribution path for the target audio data, and obtain a configured audio distribution network;

[0076] Based on the grouping results, the corresponding transmission mode is configured for each audio device; according to the transmission mode configuration result, combined with the layout of each room, the performance of each audio device and the number of channels of the target audio data, the distribution path of the target audio data is designed; according to the designed distribution path, the role of each audio device in the audio distribution network is set, and it is verified whether the configuration is successful to obtain the configured audio distribution network.

[0077] Among them, configuring the corresponding transmission mode for each audio device based on the grouping result includes: allocating WiFi as the transmission mode of audio data for audio devices belonging to the WiFi transmission group, and configuring the audio devices belonging to the BLE Auracast™ protocol transmission group to use the BLE Auracast™ protocol to send and receive audio data.

[0078] Among them, according to the transmission mode configuration result, combined with the layout of each room, the performance of each audio device and the number of channels of the target audio data, the distribution path of the target audio data is designed, including: obtaining the layout information of each room and analyzing the performance parameters of each audio device; determining the number of channels and channel content of the target audio data; according to the layout information of each room, the performance parameters of each audio device, the number of channels, the channel content and the transmission mode configuration result, the distribution path of the target audio data is designed.

[0079] Collect detailed layout information of each room, including but not limited to the size, shape, wall and floor materials, and furniture placement of the room; analyze the performance parameters of each audio device, including but not limited to frequency response, sensitivity, and maximum output power.

[0080] The execution steps for determining the number of channels and channel content of the target audio data may be: parsing the file format of the target audio data, extracting and identifying channel configuration information in the audio metadata, the channel configuration information including the number of channels and the identification or role of each channel, such as left channel, right channel, center channel, surround channel, etc.; based on the channel configuration information obtained by the analysis, verifying and confirming the actual number of channels of the target audio data and the specific content of each channel, to ensure the accuracy and completeness of the channel configuration information.

[0081] Based on the layout information of each room, acoustic simulation software or algorithm is used to predict the propagation characteristics of the audio signal in the corresponding room. The propagation characteristics include but are not limited to reflection, diffraction and attenuation, so as to determine the best audio signal transmission path; combined with the performance parameters of each audio device, such as receiving sensitivity, frequency response and maximum output power, as well as the number of channels and channel content of the target audio data, the distribution path is optimized to ensure that the data of each channel can be transmitted to the corresponding audio device with the best quality, while considering the physical location of the equipment and the feasibility of connection.

[0082] Acoustic simulation relies on the prediction results of software or algorithms, and can also be combined with actual acoustic measurement data to verify and adjust simulation parameters. For example, using equipment such as sound level meters and spectrum analyzers to measure the actual acoustic environment in the room, including background noise, reverberation time, standing waves and other parameters, to ensure the accuracy of acoustic simulation.

[0083] For audio equipment performance parameters, in addition to focusing on the static performance indicators of audio equipment, dynamic performance tests are also conducted. For example, by playing different types of audio signals, the response characteristics and distortion of audio equipment under different signals are observed to comprehensively evaluate the performance of the equipment.

[0084] Taking into account the transmission mode configuration results (WiFi transmission or BLE Auracast™ protocol transmission), the physical location and connection feasibility of the audio device, and the number of channels and channel content of the target audio data, the distribution path is optimized and adjusted to ensure that the data of each channel can be transmitted to the corresponding audio device in the most suitable way and with the best quality.

[0085] Among them, the role of each audio device in the audio distribution network is set according to the designed distribution path, and whether the configuration is successful is verified to obtain the configured audio distribution network, including: assigning a specific role to each audio device according to the designed distribution path; constructing a configuration instruction, the configuration instruction includes a device ID, role information and connection parameters; sending the corresponding configuration instruction to each audio device through a WiFi or BLE connection, and waiting for a confirmation response from each audio device; checking whether each audio device has correctly received and applied the configuration instruction. If the verification fails, resend the configuration instruction or adjust the distribution path until the configuration is successful, and obtain the configured audio distribution network.

[0086] According to the designed distribution path, a specific role is assigned to each audio device, which is determined based on the function of the audio device in the audio distribution network and its physical location in the room; according to the assigned role, a configuration instruction containing the device ID, role information and connection parameters is constructed. The device ID is used to uniquely identify each audio device. The role information clearly defines the responsibilities of the audio device in the audio distribution network. The connection parameters include the channel, address and other necessary communication parameters for BLE or WiFi communication to ensure that the audio devices can connect and transmit data in the predetermined manner; through the WiFi or BLE connection, according to the designed distribution path, the corresponding configuration instructions are sent to each audio device.

[0087] After sending the configuration instructions, listen for confirmation responses from each audio device. The confirmation response includes the device ID and status code. The status code is used to indicate whether the device has successfully received and applied the configuration instructions. Checking whether each audio device has correctly received and applied the configuration instructions can be achieved by parsing the status code in the confirmation response. A status code of "success" indicates successful configuration, otherwise it indicates configuration failure. If the verification fails, the configuration instructions can be resent to the failed audio device. Before resending, the stability of the WiFi or BLE connection can be checked and reconnected if necessary. If the verification still fails after resending the configuration instructions, the distribution path is adjusted according to the preset strategy, such as changing the connection order between devices, adjusting device roles, or optimizing communication parameters, and trying to configure again until all audio devices are successfully configured to form a configured audio distribution network.

[0088] By assigning specific roles to audio devices and constructing configuration instructions, and using WiFi or BLE connections to send and verify configurations, it ensures that each device in the audio distribution network is correctly configured according to the predetermined path and parameters, effectively improving the accuracy and flexibility of network configuration and reducing the risk of configuration errors and repeated configurations.

[0089] 206. Use a synchronization algorithm of the audio broadcasting technology protocol to adjust the timing of the target audio data to obtain synchronized audio data;

[0090] 207. According to the configured audio distribution network, the synchronized audio data is sent to the corresponding channels of each audio device via WiFi or BLEAuracast™ protocol for playback.

[0091] In an embodiment of the present invention, target audio data containing multi-channel information is obtained, and a smart hybrid transmission architecture connection between audio devices corresponding to multiple rooms is established by using WiFi technology and combining the BLE Auracast™ protocol. The relative distance between each audio device and the WiFi access point is monitored in real time to obtain distance information. According to the distance information, all audio devices are grouped, and the corresponding transmission mode is configured for each audio device based on the grouping result to determine the distribution path of the target audio data, and the configured audio distribution network is obtained. The timing of the target audio data is adjusted by using the synchronization algorithm in the BLE Auracast™ protocol to obtain the synchronized audio data. According to the configured audio distribution network, the synchronized audio data is sent to the corresponding channel of each audio device through WiFi or the BLE Auracast™ protocol for playback. This embodiment constructs a hybrid transmission architecture by integrating WiFi and the BLE Auracast™ protocol, overcomes the delay of WiFi in multi-channel synchronization and the problem of BLE distance limitation, realizes efficient and synchronous distribution of audio data, and provides users with a more stable, flexible and high-quality multi-room audio playback experience.

[0092] See also Figure 3 Another embodiment of the audio processing method combining WiFi and BLE technologies in the embodiment of the present invention includes:

[0093] 301. Acquire target audio data including multi-channel information;

[0094] 302. Using WiFi technology and combining with BLE Auracast™ protocol, an intelligent hybrid transmission architecture connection is established between audio devices corresponding to multiple rooms;

[0095] 303. Dynamically configure the distribution path of the target audio data according to the intelligent distance detection result to obtain the configured audio distribution network;

[0096] 304. Identify and obtain clock deviation and network delay between audio devices;

[0097] Start the clock synchronization mechanism, send and receive clock synchronization signals through the BLE connection, measure the signal round-trip time to calculate the network delay between the audio devices; use the timestamp to record the time when each audio device receives the synchronization signal, and calculate the clock deviation between the audio devices.

[0098] Select an audio device as the clock reference device, which can be the main speaker or other key devices in the network. The clock reference device is responsible for sending clock synchronization signals. The clock reference device sends clock synchronization signals to other audio devices through the BLE connection. The clock synchronization signal contains the timestamp of the sending time. After receiving the synchronization signal, other audio devices immediately record the receiving timestamp and send a confirmation response to the clock reference device through the BLE connection. The response contains the receiving timestamp and the unique identifier of the device.

[0099] After receiving the confirmation response from each audio device, the clock reference device calculates the signal round-trip time based on the sending timestamp and the receiving timestamp in the received confirmation response. Due to the bidirectional nature of BLE communication, half of the signal round-trip time is regarded as the one-way network delay from the clock reference device to the audio device. The above steps are repeated for all audio devices to calculate the network delay between each audio device and the clock reference device.

[0100] In one implementation, the network delay of each audio device can also be calculated using historical data. Historical data is obtained, and the historical delay average value of each audio device is calculated based on the historical data, and the variance between the current measured value and the historical average value of the delay of each audio device is calculated. The dynamic weight coefficient is calculated based on the target variance and the preset variance threshold, and the network delay of each audio device is calculated based on the historical delay average value, the current measured value, and the dynamic weight coefficient. Furthermore, the variance can be adjusted to convert the original variance value into a relative quantity that is more suitable for calculating the dynamic weight coefficient. This relative quantity can more accurately reflect the degree of difference between the current measured value and the historical average value, and adjust the weight of the current measured value in subsequent calculations accordingly, thereby improving the stability and accuracy of the algorithm's estimation of network delay.

[0101] For example, if the historical average delay value DH = 5ms, the current measured value DC = 8ms, and the preset variance threshold V0 = 3; then the variance ΔV1 = (DC − DH) 2 =(8−5) 2 =9; determine the scaling ratio, which can be set according to the distribution of historical data, application requirements, and the desired stability level. For example, if you want the algorithm to be more sensitive to larger differences, you can choose a smaller scaling ratio; conversely, if you want the algorithm to be smoother, you can choose a larger scaling ratio; adjust the variance based on the scaling ratio. If the scaling ratio is 0.25, the adjusted variance ΔV2=9×0.25=2.25; by the formula α1=min(e −ΔV / V0 ,0.8) to calculate, we get α1=e −2.25 / 3≈0.47, where α1 is the dynamic weight coefficient of the current measurement value, then α2=1-α1=0.53, where α2 is the dynamic weight coefficient of the historical delay average value, through the formula DN=DC×α1+DH×α2=0.47×8+0.53×5=6.41ms, where DN is the final calculated network delay of the audio device.

[0102] By using historical data to calculate the network delay of audio devices and combining dynamic weight coefficients to adjust the difference between the current measurement value and the historical average, the stability and accuracy of network delay estimation are improved, thereby more accurately reflecting the delay of the device.

[0103] The timestamp is used to record the time when each audio device receives the synchronization signal. At the same time, the clock reference device also records the time when the synchronization signal is sent. By comparing the time when each audio device receives the synchronization signal with the time when the clock reference device sends the synchronization signal, the clock deviation of each audio device relative to the clock reference device is calculated, and the clock deviation of each audio device is obtained based on the calculation.

[0104] In one implementation, the final network delay can also be calculated based on the configured audio distribution network, the actually measured network delay, the distance between devices, and the network load. Specifically, the transmission type of the audio device is determined based on the configured audio distribution network, the corresponding reference delay value is determined based on the transmission type of the audio device, the reference delay value is compared with the actually measured network delay to obtain the delay deviation, the distance weight is calculated based on the distance between devices, the network load adjustment factor is calculated based on the network load, and the final network delay is calculated using the reference delay value, delay deviation, distance weight, and network load adjustment factor.

[0105] Distance weight W(d)=1 / (1+β*d 2 ), where β is the distance attenuation coefficient and d is the distance between devices.

[0106] The network load adjustment factor F(n) = log(1 +γ*n) / log(1 +γ), where γ is the load sensitivity, ranging from [5,20], and n is the current network load rate.

[0107] For example, there is a device whose transmission type is WiFi network transmission, the distance between devices is 10 meters, and the network load rate is 60%; the benchmark delay value DB corresponding to WiFi network transmission is 50ms, and the measured delay deviation ΔT is 10ms; the corresponding weight and adjustment factor are calculated based on the distance weight W(d) and the network load adjustment factor F(n).

[0108] When calculating the distance weight, set the distance attenuation coefficient β to 0.01, substitute the distance between devices d = 10 meters, and get W(10) = 1 / (1+0.01*10 2 )=0.5; when calculating the network load adjustment factor, set the load sensitivity γ to 10, substitute the network load rate n=0.6, and get F(0.6)=log(1+6) / log(1+10)=0.72.

[0109] The final network delay is calculated using the baseline delay value, measured delay deviation, distance weight, and network load adjustment factor.

[0110] The final network delay is: D = DB + ΔT * W(d) * F(n) = 50 + 10*0.5*0.72 = 53.6ms.

[0111] It automatically adapts to the delay characteristics of different distances through the distance weight function, and dynamically responds to changes in network conditions with the help of the network load adjustment factor. The multi-parameter linkage improves the compensation accuracy and adaptability, thereby ensuring a stable delay compensation effect in different network environments.

[0112] By starting the clock synchronization mechanism, using the BLE connection to send and receive synchronization signals, and measuring the signal round-trip time to accurately calculate the network delay, and using the timestamp to record the receiving time to calculate the clock deviation, accurate clock synchronization between devices in the audio distribution network is effectively achieved, which significantly reduces audio playback problems caused by clock asynchrony and network delays, improves the accuracy and stability of audio synchronization playback, and provides users with a smoother and higher-quality audio experience.

[0113] 305. Apply the synchronization algorithm in the BLE Auracast™ protocol to calculate the time compensation value required by each audio device according to the clock deviation and the network delay information to obtain the time compensation information;

[0114] An audio device is selected as a master device and the remaining audio devices are selected as slave devices; based on the clock deviation and network delay collected by the master device, the time offset of each slave device relative to the master device is calculated to obtain time offset information; according to the time offset information and the playback rate of the audio data stream corresponding to each audio device, the time compensation value required by each slave device is calculated to obtain time compensation value information.

[0115] The master device may be the audio device used as the clock reference device mentioned in step 303, or may be other audio devices in the network, which is not limited here.

[0116] Among all audio devices, select an audio device with stable performance, strong communication capability and high clock accuracy as the master device. The master device will be responsible for collecting and processing the clock deviation and network delay information of other audio devices. The remaining audio devices are set as slave devices. They will receive the synchronization signal of the master device and make corresponding adjustments according to the instructions of the master device. The master device and the slave device communicate through the BLE connection to ensure the real-time transmission and reliability of data.

[0117] Clock deviation indicates how fast the local clock of the slave device is relative to the master device clock. In order to obtain an accurate time offset, it is necessary to consider the effect of network delay on clock deviation. Specifically, half of the network delay is subtracted from the original clock deviation for correction. Because network delay causes the slave device to receive the synchronization signal later than the master device sends the synchronization signal. By subtracting half of the network delay, the corrected clock deviation can be obtained, which is the time offset of the slave device relative to the master device.

[0118] By selecting the master device and calculating the time offset of each slave device, and then determining the time compensation value, the clock synchronization between devices in the audio distribution network is effectively achieved, ensuring the consistent playback rate of the audio data stream, reducing audio delay and distortion caused by clock asynchrony, and improving the overall audio playback synchronization and sound quality experience.

[0119] 306. Perform time compensation on each channel data of the target audio data based on the time compensation information to obtain synchronized audio data;

[0120] Based on the time compensation information, precise time adjustment is performed on each independent channel of the target audio data corresponding to each audio device in the network, including moving the starting playback point of each channel data forward or backward, to ensure that all channels of all audio devices can maintain time consistency during playback, thereby generating a synchronized audio data.

[0121] 307. For the first audio devices belonging to the WiFi transmission group, the synchronized audio data is sent to each first audio device through the WiFi network according to the configured audio distribution network, so that each first audio device receives and extracts the audio data belonging to its own channel and plays it;

[0122] After the configuration of the audio distribution network is completed, for the first audio devices classified as the WiFi transmission group, the synchronized audio data will be transmitted to each first audio device in real time through the WiFi network in accordance with the set distribution path and configuration information. In this process, the integrity and synchronization of the audio data will be ensured, so that each first audio device can receive audio data that matches its channel configuration. After the first audio devices receive the audio data, they will use their own decoding and processing capabilities to extract the audio content belonging to their respective channels, and play the audio according to the preset playback parameters.

[0123] 308. For a second audio device belonging to the BLE Auracast™ protocol transmission group, packaging the synchronized audio data into BLE data suitable for BLE transmission;

[0124] The synchronized audio data is segmented, and each segment contains audio information of a fixed time length. Header information is added to each data segment, and each data segment and the corresponding header information are encoded and compressed to comply with the data format and bandwidth limitation of BLE transmission, and then encapsulated into a BLE data packet.

[0125] The synchronized audio data stream is segmented, and each data segment contains audio information of a preset and fixed time length. A header information is generated for each data segment, and the header information contains key metadata, such as the start timestamp of the audio segment, the device to which it belongs, the channel number to which it belongs, the format description of the audio data, etc. The addition of the header information ensures the identifiability and accuracy of the data segment during the BLE transmission process; in order to comply with the data transmission format of BLE and be limited by its limited bandwidth, each data segment and its header information are encoded and compressed. The encoding process usually involves converting audio data from one format to another format that is more suitable for wireless transmission, while the compression process aims to reduce the size of the data, thereby improving transmission efficiency and reducing latency; the encoded and compressed data segment and its header information will be encapsulated into a BLE data packet, which has a specific structure and format, including data length, type identification, and actual data content.

[0126] By segmenting the synchronized audio data and adding header information, and then encoding, compressing and encapsulating it into BLE data packets, the transmission efficiency and compatibility of audio data are effectively improved, ensuring the stable transmission of data in the BLE network, reducing bandwidth occupancy, and optimizing the fluency and quality of audio playback.

[0127] 309. According to the configured audio distribution network, the BLE data packets are sent to each second audio device sequentially or in parallel through the BLE technology, so that the audio devices decode and extract the audio data belonging to the respective channels based on the received BLE data packets and play them.

[0128] Read the topological structure of the configured audio distribution network; determine the connection relationship and transmission order between the second audio devices according to the topological structure, and obtain the target configuration of the audio distribution network; select the target BLE transmission strategy according to the target configuration of the audio distribution network, and send the BLE data packet to each second audio device sequentially or in parallel.

[0129] The topology of an audio distribution network defines the connection and layout between audio devices. Possible topologies include point-to-point, star, ring, or tree, and each has its own specific application scenarios. For example, a point-to-point structure is suitable for scenarios with a small number of devices, while a star structure facilitates centralized management and control.

[0130] According to the topology structure, the physical or logical connection between audio devices is clarified, and the specific transmission path and sequence of the target audio data from the source device to each terminal device are planned to ensure that each audio device can receive and process its own target audio data in a predetermined manner, thereby obtaining an audio distribution network target configuration that is both efficient and accurate.

[0131] Based on the target configuration, select the appropriate target BLE transmission strategy for the distribution of BLE data packets. When selecting the target BLE transmission strategy, consider the type, quantity and transmission requirements of the device. For example, for a network with a large number of audio devices, a parallel transmission strategy can be used to improve transmission efficiency; for devices with a long transmission distance, an enhanced BLE transmission strategy may be required to ensure stable data transmission.

[0132] By reading the topological structure of the audio distribution network, clarifying the connection and transmission order between audio devices, forming an efficient and accurate target configuration, and then flexibly selecting the BLE transmission strategy, the orderly or parallel sending of data packets is achieved, which significantly improves the efficiency and stability of audio data distribution and ensures that each second audio device can receive the required audio information in a timely and accurate manner.

[0133] In an embodiment of the present invention, target audio data containing multi-channel information is obtained, and an intelligent hybrid transmission architecture connection is established between audio devices corresponding to multiple rooms by using WiFi technology and combining with the BLE Auracast™ protocol. According to the intelligent distance detection result, the distribution path of the target audio data is dynamically configured to obtain a configured audio distribution network, the clock deviation and network delay between the audio devices are identified and obtained, and the synchronization algorithm in the BLE Auracast™ protocol is applied to calculate the time compensation value required by each audio device according to the clock deviation and network delay information to obtain the time compensation information. Time compensation is performed on each channel data of the target audio data based on the time compensation information to obtain synchronized audio data. For the first audio device belonging to the WiFi transmission group, the synchronized audio data is sent to each first audio device through the WiFi network according to the configured audio distribution network, so that each first audio device receives and extracts the audio data belonging to its own channel and plays it. For the first audio device belonging to the BLE The second audio device of the Auracast™ protocol transmission group packages the synchronized audio data into a BLE data packet suitable for BLE transmission, and sends the BLE data packet to each second audio device sequentially or in parallel through the BLE technology according to the configured audio distribution network, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it. This embodiment integrates WiFi and the BLE Auracast™ protocol, dynamically configures the audio distribution path according to the distance of the audio device, and uses the BLE synchronization algorithm to accurately compensate for clock deviation and network delay, thereby realizing efficient and synchronous audio data transmission of the multi-room audio system. Regardless of whether it is transmitted through WiFi or BLE, each audio device can accurately receive and play the audio data of its corresponding channel, greatly improving the synchronization and quality of multi-room audio playback.

[0134] The above describes the audio processing method combining WiFi and BLE technology in the embodiment of the present invention. The following describes the audio processing device combining WiFi and BLE technology in the embodiment of the present invention. Figure 4 In one embodiment of the present invention, an audio processing device combining WiFi and BLE technology includes:

[0135] An acquisition module 401 is used to acquire target audio data containing multi-channel information;

[0136] Establishing module 402 for establishing a smart hybrid transmission architecture connection between audio devices corresponding to multiple rooms by using WiFi technology and combining with BLE Auracast™ protocol;

[0137] Configuration module 403, used to dynamically configure the distribution path of the target audio data according to the intelligent distance detection result to obtain the configured audio distribution network;

[0138] An adjustment module 404 is used to adjust the timing of the target audio data using a synchronization algorithm in the BLE Auracast™ protocol to obtain synchronized audio data;

[0139] The playback module 405 is used to send the synchronized audio data to the corresponding channels of each audio device for playback via WiFi or BLE Auracast™ protocol according to the configured audio distribution network.

[0140] In the embodiments of the present invention, the limitation of BLE technology on transmission distance is avoided by utilizing the efficient data transmission capability of WiFi technology. At the same time, with the help of the synchronization algorithm of the BLE Auracast™ protocol, the delay in multi-channel audio synchronization is effectively reduced, thereby achieving efficient, stable and synchronous transmission of audio data between multi-room audio devices, significantly improving the coordination of audio playback and user experience.

[0141] See also Figure 5 Another embodiment of the audio processing device combining WiFi and BLE technologies in the embodiment of the present invention includes:

[0142] An acquisition module 401 is used to acquire target audio data containing multi-channel information;

[0143] Establishing module 402 for establishing a smart hybrid transmission architecture connection between audio devices corresponding to multiple rooms by using WiFi technology and combining with BLE Auracast™ protocol;

[0144] Configuration module 403, used to dynamically configure the distribution path of the target audio data according to the intelligent distance detection result to obtain the configured audio distribution network;

[0145] An adjustment module 404 is used to adjust the timing of the target audio data using a synchronization algorithm in the BLE Auracast™ protocol to obtain synchronized audio data;

[0146] The playback module 405 is used to send the synchronized audio data to the corresponding channels of each audio device for playback via WiFi or BLE Auracast™ protocol according to the configured audio distribution network.

[0147] Optionally, the acquisition module 401 may be specifically used for:

[0148] Receive original audio data, the original audio data containing information of at least two channels; parse the original audio data, identify and separate the data of each channel; pre-process the separated data of each channel according to a preset audio processing rule to obtain target audio data containing multi-channel information.

[0149] Optionally, the establishing module 402 may be specifically used for:

[0150] Use WiFi technology to cache target audio data containing multi-channel information; use the BLE Auracast™ protocol to enable the BLE broadcast function and set the corresponding broadcast parameters; use BLE technology to scan audio devices in each room, identify the BLE identifier of each audio device and establish a communication connection to form an intelligent hybrid transmission architecture connection.

[0151] Optionally, the configuration module 403 includes:

[0152] The monitoring unit 4031 is used to monitor the relative distance between each audio device and the WiFi access point in real time to obtain distance information;

[0153] The grouping unit 4032 is used to group all audio devices according to the distance information;

[0154] The distribution unit 4033 is used to configure the corresponding transmission mode for each audio device based on the grouping result to determine the distribution path of the target audio data and obtain the configured audio distribution network.

[0155] Optionally, the grouping unit 4032 may be specifically used for:

[0156] For each audio device, the relative distance between the audio device and the WiFi access point is compared with a preset grouping threshold; based on the comparison result, all audio devices are divided into a WiFi transmission group and a BLE Auracast™ protocol transmission group.

[0157] Optionally, the distribution unit 4033 may be specifically used for:

[0158] Based on the grouping results, the corresponding transmission mode is configured for each audio device; according to the transmission mode configuration result, combined with the layout of each room, the performance of each audio device and the number of channels of the target audio data, the distribution path of the target audio data is designed; according to the designed distribution path, the role of each audio device in the audio distribution network is set, and it is verified whether the configuration is successful to obtain the configured audio distribution network.

[0159] Optionally, the adjustment module 404 includes:

[0160] An acquisition unit 4041 is used to identify and acquire clock deviations and network delays between audio devices;

[0161] The calculation unit 4042 is used to apply the synchronization algorithm in the BLE Auracast™ protocol to calculate the time compensation value required by each audio device according to the clock deviation and the network delay information to obtain the time compensation information;

[0162] The compensation unit 4043 is used to perform time compensation on each channel data of the target audio data based on the time compensation information to obtain synchronized audio data.

[0163] Optionally, the acquiring unit 4041 may be specifically used for:

[0164] Start the clock synchronization mechanism, send and receive clock synchronization signals through the BLE connection, measure the signal round-trip time to calculate the network delay between the audio devices; use the timestamp to record the time when each audio device receives the synchronization signal, and calculate the clock deviation between the audio devices.

[0165] Optionally, the calculation unit 4042 may be specifically configured to:

[0166] An audio device is selected as a master device and the remaining audio devices are selected as slave devices; based on the clock deviation and network delay collected by the master device, the time offset of each slave device relative to the master device is calculated to obtain time offset information; according to the time offset information and the playback rate of the audio data stream corresponding to each audio device, the time compensation value required by each slave device is calculated to obtain time compensation value information.

[0167] Optionally, the playing module 405 includes:

[0168] The first playing unit 4051 is used to send the synchronized audio data to each first audio device belonging to the WiFi transmission group through the WiFi network according to the configured audio distribution network, so that each first audio device receives and extracts the audio data belonging to its own channel and plays it;

[0169] The packaging unit 4052 is used to package the synchronized audio data into a BLE data packet suitable for BLE transmission for a second audio device belonging to the BLE Auracast™ protocol transmission group;

[0170] The second playback unit 4053 is used to send BLE data packets to each second audio device sequentially or in parallel through BLE technology according to the configured audio distribution network, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it.

[0171] Optionally, the packaging unit 4052 may be specifically used for:

[0172] The synchronized audio data is segmented, and each segment contains audio information of a fixed time length. Header information is added to each data segment, and each data segment and the corresponding header information are encoded and compressed to comply with the data format and bandwidth limitation of BLE transmission, and then encapsulated into a BLE data packet.

[0173] Optionally, the second playback unit 4053 may be specifically used for:

[0174] Read the topological structure of the configured audio distribution network; determine the connection relationship and transmission order between the second audio devices according to the topological structure, and obtain the target configuration of the audio distribution network; select the target BLE transmission strategy according to the target configuration of the audio distribution network, and send the BLE data packet to each second audio device sequentially or in parallel.

[0175] In the embodiment of the present invention, by integrating WiFi and BLE Auracast™ protocols, a hybrid transmission architecture is constructed, which overcomes the delay of WiFi in multi-channel synchronization and the limited distance of BLE, realizes efficient and synchronous distribution of audio data, and provides users with a more stable, flexible and high-quality multi-room audio playback experience.

[0176] above Figure 4 and Figure 5 The audio processing device combining WiFi and BLE technologies in the embodiment of the present invention is described in detail from the perspective of modular functional entities. The audio processing device combining WiFi and BLE technologies in the embodiment of the present invention is described in detail from the perspective of hardware processing.

[0177] See also Figure 6 As shown, the audio processing device combining WiFi and BLE technologies includes a processor 600 and a memory 601. The memory 601 stores machine executable instructions that can be executed by the processor 600. The processor 600 executes the machine executable instructions to implement the above-mentioned audio processing method combining WiFi and BLE technologies.

[0178] Further, Figure 6 The audio processing device combining WiFi and BLE technologies shown further includes a bus 602 and a communication interface 603 , and the processor 600 , the communication interface 603 and the memory 601 are connected via the bus 602 .

[0179] Among them, the memory 601 may include a high-speed random access memory (Random Access Memory, RAM), and may also include a non-volatile memory (non-volatile memory), for example, at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 603 (which can be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. can be used. The bus 602 can be an ISA bus, a PCI bus or an EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0180] The processor 600 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 600. The above processor 600 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The disclosed methods, steps and logic block diagrams in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as a hardware decoding processor to be executed, or a combination of hardware and software modules in the decoding processor can be executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 601 , and the processor 600 reads the information in the memory 601 and completes the method steps of the above-mentioned embodiment in combination with its hardware.

[0181] The present invention also provides an audio processing device combining WiFi and BLE technologies, wherein the computer device includes a memory and a processor, wherein the memory stores computer-readable instructions, and when the computer-readable instructions are executed by the processor, the processor executes the steps of the audio processing method combining WiFi and BLE technologies in the above-mentioned embodiments.

[0182] The present invention also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are executed on a computer, the computer executes the steps of the audio processing method combining WiFi and BLE technologies.

[0183] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0184] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or the whole or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0185] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. An audio processing method combining WiFi and BLE technology, characterized in that: The audio processing method combining WiFi and BLE technology includes: Obtain target audio data containing multi-channel information; Using WiFi technology and combining it with the BLE Auracast™ protocol, an intelligent hybrid transmission architecture connection is established between audio devices corresponding to multiple rooms; According to the intelligent distance detection result, dynamically configure the distribution path of the target audio data to obtain a configured audio distribution network; Using a synchronization algorithm in the BLE Auracast™ protocol to adjust the timing of the target audio data to obtain synchronized audio data; According to the configured audio distribution network, the synchronized audio data is sent to the corresponding channels of each audio device via WiFi or BLEAuracast™ protocol for playback; The use of WiFi technology and the BLE Auracast™ protocol to establish an intelligent hybrid transmission architecture connection between audio devices corresponding to multiple rooms includes: using WiFi technology to cache target audio data containing multi-channel information; using the BLE Auracast™ protocol to start the BLE broadcast function and set corresponding broadcast parameters; using BLE technology to scan audio devices in each room, identify the BLE identifier of each audio device and establish a communication connection to form an intelligent hybrid transmission architecture connection; The method dynamically configures the distribution path of the target audio data according to the intelligent distance detection result to obtain the configured audio distribution network, including: real-time monitoring of the relative distance between each audio device and the WiFi access point to obtain distance information; for each audio device, comparing its relative distance to the WiFi access point with a preset grouping threshold; according to the comparison result, dividing all audio devices into a WiFi transmission group and a BLE Auracast™ protocol transmission group; and configuring a corresponding transmission mode for each audio device based on the grouping result to determine the distribution path of the target audio data to obtain the configured audio distribution network; The method of using the synchronization algorithm in the BLE Auracast™ protocol to adjust the timing of the target audio data to obtain synchronized audio data includes: identifying and obtaining clock deviations and network delays between audio devices; selecting one audio device as a master device and the remaining audio devices as slave devices; Based on the clock deviation and network delay collected by the master device, the time offset of each slave device relative to the master device is calculated to obtain time offset information; according to the time offset information and the playback rate of the audio data stream corresponding to each audio device, the time compensation value required by each slave device is calculated to obtain time compensation information; based on the time compensation information, each channel data of the target audio data is time compensated to obtain synchronized audio data.

2. The audio processing method combining WiFi and BLE technology according to claim 1, characterized in that: The step of obtaining target audio data containing multi-channel information includes: Receiving original audio data, wherein the original audio data includes information of at least two channels; Parsing the original audio data, identifying and separating the data of each channel; According to the preset audio processing rules, the separated channel data are preprocessed to obtain target audio data containing multi-channel information.

3. The audio processing method combining WiFi and BLE technology according to claim 1, characterized in that: The configuring a corresponding transmission mode for each audio device based on the grouping result to determine a distribution path for the target audio data and obtain a configured audio distribution network includes: Based on the grouping result, each audio device is configured with a corresponding transmission mode; According to the transmission mode configuration result, combined with the layout of each room, the performance of each audio device and the number of channels of the target audio data, a distribution path of the target audio data is designed; Set the role of each audio device in the audio distribution network according to the designed distribution path, and verify whether the configuration is successful to obtain the configured audio distribution network.

4. The audio processing method combining WiFi and BLE technology according to claim 1, characterized in that: The identifying and obtaining the clock deviation and network delay between the audio devices includes: Start the clock synchronization mechanism, send and receive clock synchronization signals through the BLE connection, and measure the signal round-trip time to calculate the network delay between each audio device; The time when each audio device receives the synchronization signal is recorded by using the timestamp, and the clock deviation between the audio devices is calculated.

5. The audio processing method combining WiFi and BLE technology according to claim 1, characterized in that: The step of sending the synchronized audio data to the corresponding channels of each audio device for playback via WiFi or BLE Auracast™ protocol according to the configured audio distribution network includes: For the first audio devices belonging to the WiFi transmission group, according to the configured audio distribution network, the synchronized audio data is sent to each first audio device through the WiFi network, so that each first audio device receives and extracts the audio data belonging to its own channel and plays it; For a second audio device belonging to the BLE Auracast™ protocol transmission group, packaging the synchronized audio data into a BLE data packet suitable for BLE transmission; According to the configured audio distribution network, the BLE data packet is sent to each second audio device sequentially or in parallel through the BLE technology, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it.

6. The audio processing method combining WiFi and BLE technology according to claim 5, characterized in that: Packaging the synchronized audio data into a BLE data packet suitable for BLE transmission includes: The synchronized audio data is processed in segments, each segment of the data contains audio information of a fixed time length; Header information is added to each data segment, and each data segment and the corresponding header information are encoded and compressed to comply with the data format and bandwidth limitation of BLE transmission, and then encapsulated into a BLE data packet.

7. The audio processing method combining WiFi and BLE technology according to claim 5, characterized in that: The configured audio distribution network sends the BLE data packet to each second audio device sequentially or in parallel through the BLE technology, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it, including: Reading the topology of the configured audio distribution network; Determine the connection relationship and transmission order between the audio devices according to the topological structure, and obtain the target configuration of the audio distribution network; According to the target configuration of the audio distribution network, a target BLE transmission strategy is selected, and the BLE data packet is sent to each second audio device sequentially or in parallel, so that each second audio device decodes and extracts the audio data belonging to its own channel based on the received BLE data packet and plays it.

8. An audio processing device combining WiFi and BLE technology, characterized in that: The audio processing device combining WiFi and BLE technology includes: An acquisition module, used to acquire target audio data containing multi-channel information; Establish a module for utilizing WiFi technology and combining it with the BLE Auracast™ protocol to establish an intelligent hybrid transmission architecture connection between audio devices corresponding to multiple rooms; A configuration module, used to dynamically configure the distribution path of the target audio data according to the intelligent distance detection result to obtain a configured audio distribution network; An adjustment module, configured to adjust the timing of the target audio data by using a synchronization algorithm in the BLE Auracast™ protocol to obtain synchronized audio data; A playback module, configured to send the synchronized audio data to the corresponding channels of each audio device for playback via WiFi or BLE Auracast™ protocol according to the configured audio distribution network; The establishment module is specifically used to: use WiFi technology to cache target audio data containing multi-channel information; start the BLE broadcast function and set corresponding broadcast parameters through the BLEAuracast™ protocol; use BLE technology to scan audio devices in each room, identify the BLE identifier of each audio device and establish a communication connection to form an intelligent hybrid transmission architecture connection; The configuration module is specifically used to: monitor the relative distance between each audio device and the WiFi access point in real time to obtain distance information; for each audio device, compare its relative distance to the WiFi access point with a preset grouping threshold; according to the comparison result, divide all audio devices into a WiFi transmission group and a BLE Auracast™ protocol transmission group; configure a corresponding transmission mode for each audio device based on the grouping result to determine the distribution path of the target audio data, and obtain a configured audio distribution network; The adjustment module is specifically used to: identify and obtain the clock deviation and network delay between each audio device; select one audio device as the master device and the other audio devices as slave devices; calculate the time offset of each slave device relative to the master device based on the clock deviation and network delay collected by the master device to obtain time offset information; calculate the time compensation value required by each slave device according to the time offset information and the playback rate of the audio data stream corresponding to each audio device to obtain time compensation information; perform time compensation on each channel data of the target audio data based on the time compensation information to obtain synchronized audio data.

9. An audio processing device combining WiFi and BLE technology, characterized in that: The audio processing device combining WiFi and BLE technology includes: a memory and at least one processor, wherein the memory stores instructions; The at least one processor calls the instruction in the memory so that the audio processing device combining WiFi and BLE technologies executes the audio processing method combining WiFi and BLE technologies as described in any one of claims 1-7.

10. A computer-readable storage medium having instructions stored thereon, characterized in that: When the instructions are executed by the processor, the audio processing method combining WiFi and BLE technologies as described in any one of claims 1 to 7 is implemented.

Images