A real-time audio interaction method based on LE Audio multi-Bluetooth audio devices

Abstract

The application discloses a kind of real-time audio interaction methods based on LE Audio multi Bluetooth audio device, it is related to real-time audio interaction technical field, this kind of real-time audio interaction methods based on LE Audio multi Bluetooth audio device includes S1 establishment Bluetooth connection, S2 determines master-slave role, S3 real-time audio stream synchronization, S4 audio data encoding and decoding, S5 equipment control and instruction transmission, S6 interactive audio, S7 real-time audio transmission, S8 error handling and fault-tolerant mechanism, LE Audio introduces new audio coding standard and extension packet, so that audio quality is higher than traditional based on SCO Bluetooth audio connection, it means that user can enjoy clearer, more realistic auditory experience while maintaining high-quality audio, LE Audio supports multi-channel audio transmission, can realize stereo, surround sound and other richer audio effects;Meanwhile, LE Audio also allows multiple audio devices to be connected to the same host device simultaneously.

Description

Technical Field

[0001] This invention relates to the field of real-time audio interaction technology, and in particular to a real-time audio interaction method based on LE Audio multiple Bluetooth audio devices. Background Technology

[0002] LE Audio is based on Bluetooth Low Energy (LE) technology, which has lower power consumption compared to traditional Bluetooth audio connections. This is especially important for devices that are not easy to charge, such as mobile devices and wireless headphones, as it can extend battery life and provide longer use. In addition, LE Audio also has lower audio transmission latency and supports real-time audio interaction, such as latency control between wireless headphones and TVs.

[0003] LE Audio's real-time interaction method with multiple Bluetooth audio devices is suitable for various application scenarios, including music playback, phone calls, voice assistants, games, and virtual reality. Whether for individual consumers or businesses, LE Audio offers greater flexibility and functionality to meet the needs of different users. LE Audio provides better audio quality and multi-channel audio transmission, delivering a more realistic and richer audio experience. This is especially important for users in fields such as music lovers, gamers, and film and television entertainment. Users can enjoy higher quality music, more immersive game sound, and more realistic virtual reality or augmented reality experiences. LE Audio allows multiple audio devices to connect to a host device simultaneously, such as a mobile phone or computer. This means that users can connect multiple headphones, speakers, or other audio devices at the same time to achieve multi-person shared audio experience or multi-room audio playback. At the same time, multi-device connection also facilitates audio sharing and collaboration in home entertainment and business environments.

[0004] Based on its advantages, the real-time audio interaction method based on LE Audio multiple Bluetooth audio devices has broad application prospects and high feasibility. Therefore, a real-time audio interaction method based on LE Audio multiple Bluetooth audio devices is proposed. Summary of the Invention

[0005] (a) Technical problems to be solved

[0006] To address the shortcomings of existing technologies, this invention provides a real-time audio interaction method based on LE Audio multiple Bluetooth audio devices, achieving better audio quality and higher audio transmission bandwidth, providing higher fidelity audio, and enabling the transmission of multiple independent audio channels between multiple audio devices, thereby achieving richer and more realistic audio effects.

[0007] (II) Technical Solution

[0008] To achieve the above objectives, the present invention provides the following technical solution:

[0009] A real-time audio interaction method based on LE Audio multiple Bluetooth audio devices includes the following steps:

[0010] S1: Establish Bluetooth connection using three new technologies: LE Isochronous Channels, Enhanced Attribute Protocol, and the new LC3 audio encoder;

[0011] S2: Determine the master / slave roles;

[0012] S3: Real-time audio stream synchronization;

[0013] S4: Audio data encoding and decoding;

[0014] S5: Equipment control and command transmission;

[0015] S6: Interactive Audio; S6 interactive audio sends commands or instructions to the audio device to trigger specific interactive operations using features and services of the GATT protocol. The audio device receives control signals by reading the values ​​of GATT features and performs corresponding operations based on the signals. The audio device integrates a sound effects engine, and the sound effects in interactive audio are achieved through real-time processing of audio signals. The audio device can use speech recognition technology to convert the user's voice commands into text or control commands. Then, the audio device can perform corresponding operations based on the interpreted commands to interact with the user. If the audio device integrates touchpad, touch button, or gesture recognition technology, the user can interact with the device through touch or gesture operations. The audio device can interpret the user's touch or gesture operations and map them to corresponding control commands. Then, the audio device can perform corresponding operations to achieve interactive audio.

[0016] S7: Real-time audio transmission;

[0017] S8: Error handling and fault tolerance mechanisms.

[0018] Preferred: S1 establishes a Bluetooth connection by including the following steps:

[0019] S11: Scanning equipment;

[0020] S12: Device pairing and binding;

[0021] S13: Establish a physical connection. In LE Audio, physical connections are typically established through broadcasting and scanning, without the need for the transmission connection found in traditional Bluetooth.

[0022] S14: Service discovery is accomplished by querying the general attribute configuration file to obtain the audio configurations and functions supported by the device;

[0023] S15: Establish audio transmission connection;

[0024] S16: Start audio transmission.

[0025] Preferred: S2 determines the master-slave roles by including the following steps:

[0026] S21: Broadcast LE Connectable; The master device announces its connectable status by broadcasting the LE Connectable advertising packet;

[0027] S22: Scan and connect; The device scans for nearby connectable Bluetooth devices and selects a master device to connect to;

[0028] S23: Initiate a connection request; the slave device initiates a connection request to the master device through the connection request.

[0029] S24: Respond to connection request; After receiving the connection request, the master device can choose to accept or reject the connection;

[0030] S25: Establish connection; Once the connection response is received by the slave device, a connection is established between the master device and the slave device. In LEAudio, the connection is established through the physical layer and the data link layer.

[0031] S26: Determine master / slave roles; After the connection is established, the master and slave devices will negotiate and confirm the master / slave roles;

[0032] S26: Configure audio channel; Once the master / slave roles are confirmed, the device can configure the audio channel, including negotiating audio parameters and the transmission method of the audio stream.

[0033] Preferred: S3 real-time audio stream synchronization includes the following steps:

[0034] S31: Determine the master / slave roles;

[0035] S32: The master device generates a master clock signal and inserts a clock synchronization marker into the audio stream;

[0036] S33: Receive the master clock signal from the device and synchronize its own clock according to the signal;

[0037] S34: Establish an audio buffer; the size and filling method of the buffer should be adjusted according to application requirements and device capabilities;

[0038] S35: Data transmission and synchronization; The master device transmits audio data to the slave device, which receives and buffers this data. Based on the master device's master clock signal, the slave device reads and plays the audio data at regular intervals. By reading and playing data according to the same clock signal, audio stream synchronization can be achieved.

[0039] S36: Control delay and compensation; adjust by controlling data transmission delay or applying audio compensation technology to achieve better synchronization.

[0040] Preferred method: S4 audio data encoding and decoding includes the following steps:

[0041] S41: Audio encoding;

[0042] S42: Audio transmission;

[0043] S43: Audio decoding.

[0044] Preferred: S41 audio encoding includes the following steps:

[0045] Step 1: Raw audio acquisition. The audio data is first acquired by the acquisition device to obtain the raw audio signal;

[0046] Step 2: Digital audio signal processing: The raw audio signal undergoes preprocessing and signal processing, such as noise reduction and gain control, to improve audio quality and adapt to different application requirements;

[0047] Step 3: Audio compression encoding: The audio signal is compressed and encoded using an algorithm to convert it into digital audio data with a higher compression ratio. The encoding algorithm used is the Opus encoding algorithm.

[0048] The Opus encoding algorithm includes the following steps:

[0049] Step 1: Preprocessing;

[0050] Step 2: Frame segmentation;

[0051] Step 3: Enhanced CELP coding; using the adaptive multi-vector linear prediction algorithm as its core coding method;

[0052] Step 4: Arithmetic encoding;

[0053] Step 5: Frame control and bit rate adjustment;

[0054] The adaptive multi-vector linear prediction algorithm, as its core coding method, includes six steps: frame decomposition, preprocessing, vector quantization, linear predictive coding, synthesis filter, and bit rate control.

[0055] Preferably, S42 audio transmission includes the following steps:

[0056] Step 1: Providing encoded audio data: For the master device, it provides encoded audio data, which is sent to the slave device for decoding and playback;

[0057] Step 2: Audio data transmission: The master device transmits the encoded audio data to the slave device via Bluetooth wireless connection.

[0058] Preferred: S43 audio decoding includes the following steps:

[0059] Step 1: Receive audio data; the device receives encoded audio data from the host device.

[0060] The second step is to decode the audio data. The device uses the corresponding decoding algorithm to decode the audio data and convert it into the original audio signal.

[0061] The third step is digital audio signal processing. The decoded audio signal can undergo further signal processing and enhancement, such as equalization and reverb, to improve audio quality and effect.

[0062] Step 4: Audio Output: The decoded audio signal is played through an audio output device.

[0063] Preferred: S5 device control and command transmission includes the following steps:

[0064] S51: Connection established;

[0065] S52: GATT service discovery;

[0066] S53: Feature reading and writing;

[0067] S54: Instruction parsing and execution;

[0068] S55: Status feedback;

[0069] S56: Event Response.

[0070] Preferred: The S8 error handling and fault tolerance mechanism includes the following steps:

[0071] S81: Error detection;

[0072] S82: Error Reporting;

[0073] S83: Error handling;

[0074] S84: Fault Tolerance Mechanisms; LE Audio introduces several fault tolerance mechanisms to deal with errors and interference in communication. One of these mechanisms is forward error correction, which adds redundant information to the data so that the receiver can recover the original data when some data packets are lost or damaged. Another mechanism is adaptive transmission, which can dynamically adjust transmission parameters according to the current channel conditions to ensure better audio transmission quality in unstable environments.

[0075] S85: Retry and timeout handling;

[0076] S86: User feedback.

[0077] (III) Beneficial Effects

[0078] 1. LE Audio introduces a new audio coding standard (LC3) and an enhanced data packet, resulting in higher audio quality than traditional SCO-based Bluetooth audio connections. This means users can enjoy a clearer and more realistic listening experience while maintaining high-quality audio.

[0079] 2. LE Audio supports multi-channel audio transmission, enabling richer audio effects such as stereo and surround sound. LE Audio also allows multiple audio devices to connect to the same host device simultaneously. For example, you can connect headphones, speakers, and other audio devices to your phone at the same time for a more flexible and diverse audio experience.

[0080] 3. LE Audio uses LE (Low Power) Bluetooth technology for audio transmission. Compared to traditional Bluetooth audio connections, LE Audio consumes less power and has lower audio transmission latency. This means that the device's battery life can be longer, and users can get lower latency audio transmission, providing a better real-time audio interaction experience.

[0081] 4. LE Audio's real-time audio interaction method is suitable for multiple application scenarios, including music playback, telephone calls, voice assistants, games, etc. Whether in personal entertainment or in a business environment, LE Audio provides more powerful and flexible audio interaction functions.

[0082] 5. LE Audio introduces fault-tolerant mechanisms such as forward error correction (FEC) and adaptive transmission, which can provide better fault tolerance in unstable wireless environments. This means that even in the event of interference or packet loss, the audio connection can be maintained and restored more reliably to ensure that users have a more stable audio experience. Attached Figure Description

[0083] The above description is merely an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention and to implement it in accordance with the contents of the specification, the preferred embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0084] Figure 1 This is a system structure diagram of the present invention. Detailed Implementation

[0085] This application provides a real-time audio interaction method based on LE Audio multiple Bluetooth audio devices, which effectively achieves the technical effect of providing better audio quality and higher audio transmission bandwidth, providing higher fidelity audio, and transmitting multiple independent audio channels between multiple audio devices, thereby realizing richer and more realistic audio effects.

[0086] Example

[0087] like Figure 1 As shown, the overall technical solution in this application embodiment is as follows:

[0088] To address the problems existing in the prior art, this invention provides a real-time audio interaction method based on LE Audio multiple Bluetooth audio devices, comprising the following steps:

[0089] S1: Establish Bluetooth connection. First, multiple Bluetooth audio devices need to establish a Bluetooth connection, which can be done through the Bluetooth pairing and connection process to ensure that all devices can communicate with each other and exchange audio data.

[0090] The Bluetooth connection establishment utilizes three new technologies: LE Isochronous Channels (LE Isoc), Enhanced Attribute Protocol (EATT), and the new LC3 audio encoder. LE Isoc is a new Bluetooth technology designed to support real-time audio transmission, providing low-latency and high-bandwidth data transmission suitable for audio streaming. By using the LE Isoc channel, audio devices can achieve real-time, stable audio transmission for a better user experience. EATT is an improved GATT protocol designed to provide more efficient data transmission and lower latency. It optimizes packet transmission and processing, reducing latency during data transmission and thus improving the real-time performance of audio transmission. LE Audio introduces a new audio encoder, LC3, which provides higher-quality audio encoding and lower power consumption. The LC3 encoder supports a wider audio frequency response range and higher bit rates for better sound quality; it also optimizes the audio data compression algorithm, enabling audio data transmission at lower bit rates. By using these new technologies and improvements, multiple Bluetooth audio devices based on LE Audio can achieve faster, more stable, and higher-quality audio transmission, providing a better real-time audio interaction experience. The introduction of these technologies provides more options and improvements for connection establishment and data transmission between audio devices and control devices.

[0091] S2: Determine the master and slave roles. In the interaction of multiple Bluetooth devices, one device acts as the master device, responsible for managing audio transmission and synchronization, while other devices act as slave devices, receiving instructions from the master device and synchronizing the audio stream.

[0092] S3: Real-time audio stream synchronization. The master device is responsible for controlling the synchronization of the audio stream, ensuring that all audio data received from the devices can be played in the correct time order. This requires a precise time synchronization mechanism and synchronization protocol to coordinate audio playback between multiple devices.

[0093] S4: Audio data encoding and decoding. In real-time audio interaction, audio data needs to be encoded and decoded. The master device encodes the source audio and then transmits it to the slave device. After receiving the audio data, the slave device decodes it and plays the decoded audio data.

[0094] S5: Device control and command transmission. The master device can send control commands to the slave device, such as volume adjustment, play / pause, etc. This requires the establishment of a communication mechanism to ensure accurate transmission of commands and correct execution by the slave device.

[0095] S6: Interactive Audio; S6 interactive audio sends commands or instructions to audio devices to trigger specific interactive actions by using features and services of the GATT protocol.

[0096] S7: Real-time audio transmission. In real-time audio interaction, audio data needs to be transmitted in real time. This requires low latency and stable data transmission to ensure real-time audio transmission and synchronized playback.

[0097] S8: Error handling and fault tolerance mechanism. In multi-Bluetooth audio interaction, problems such as data loss, transmission errors or communication interruption may occur. In order to ensure the quality and continuity of audio, it is necessary to establish an error handling and fault tolerance mechanism to minimize the impact of data loss and transmission errors.

[0098] Audio devices receive control signals by reading the values ​​of GATT features and perform corresponding operations based on the signals. The audio device integrates a sound effects engine, and sound effects in interactive audio are achieved through real-time processing of audio signals. The audio device can use speech recognition technology to convert user voice commands into text or control commands. Then, the audio device can perform corresponding operations based on the interpreted commands to interact with the user. If the audio device integrates touchpad, touch buttons, or gesture recognition technology, the user can interact with the device through touch or gesture operations. The audio device can interpret the user's touch or gesture operations and map them to corresponding control commands. Then, the audio device can perform the corresponding operations to achieve interactive audio.

[0099] Establishing a Bluetooth connection with S1 involves the following steps:

[0100] S11: Scanning Devices. The device will first perform a scan to search for nearby Bluetooth devices. The scan can be initiated through the device's Bluetooth module, and the search results can be filtered based on some criteria (such as device name, service UUID, etc.).

[0101] S12: Device pairing and binding. Once the target device is found, the devices need to be paired and bound. This usually involves security to ensure that the connected devices are trusted and authorized.

[0102] S13: Establish a physical connection. Once pairing and binding are complete, a physical connection will be established between the devices. In LE Audio, physical connections are usually established through broadcasting and scanning, without the need for the transmission connection in traditional Bluetooth.

[0103] S14: Service discovery. After a connection is established, the device can perform service discovery to learn about the various services and features provided by the connected device. This can be done by querying the GATT (General Attribute Profile) to obtain the audio configurations and functions supported by the device.

[0104] S15: Establish an audio transmission connection. Once the device's audio configuration and functions are understood, the device can choose to establish an audio transmission connection. This involves negotiating audio transmission parameters, such as audio codec, sampling rate, number of channels, etc.

[0105] S16: Start audio transmission. Once an audio transmission connection is established, the device can begin sending and receiving audio data to enable real-time audio interaction.

[0106] S2 determines the master-slave roles by following these steps:

[0107] S21: Broadcast LE Connectable; The master device announces its connectable state by broadcasting the LE Connectable advertising packet, so that other devices can scan and initiate connection requests.

[0108] S22: Scan and connect; The slave device scans for nearby connectable Bluetooth devices and selects a master device to connect to. The slave device can select a master device based on the broadcast packets it scans or the device information in the scan request.

[0109] S23: Initiate a connection request; The slave device initiates a connection request to the master device through a connection request, which includes information such as the slave device's device address, device type, and capabilities;

[0110] S24: Respond to connection request; After receiving the connection request, the master device can choose to accept or reject the connection. If the master device accepts the connection, it returns a connection response to the slave device.

[0111] S25: Establish connection; Once the connection response is received by the slave device, a connection is established between the master device and the slave device. In LEAudio, the connection is established through the physical layer and the data link layer.

[0112] S26: Determine master and slave roles; After the connection is established, the master device and the slave device will negotiate and confirm the master and slave roles. This includes the exchange of role-related information between the master device and the slave device, such as audio roles, audio sources and audio terminals.

[0113] S27: Configure audio channels; Once the master and slave roles are confirmed, the device can configure audio channels, including negotiating audio parameters (such as audio codec, sampling rate, number of channels, etc.) and the transmission method of the audio stream.

[0114] S3 real-time audio stream synchronization includes the following steps:

[0115] S31: Determine master and slave roles. Before the connection is established, the master and slave devices need to determine each other's master and slave roles. Typically, the master device is responsible for controlling the master clock of the audio stream, while the slave device synchronizes according to the master clock.

[0116] S32: The master device generates a master clock signal; the master device generates a master clock signal and inserts a clock synchronization marker into the audio stream. This master clock signal provides the reference clock for audio transmission.

[0117] S33: Receive master clock signal from slave device; Receive master clock signal from master device and synchronize its own clock according to the signal;

[0118] S34: Establish an audio buffer; Both the master and slave devices will establish an audio buffer to store received or transmitted audio data. The size and filling method of the buffer may be adjusted according to application requirements and device capabilities.

[0119] S35: Data transmission and synchronization; The master device transmits audio data to the slave device, which receives and buffers this data. Based on the master device's master clock signal, the slave device reads and plays the audio data at regular intervals. By reading and playing data according to the same clock signal, audio stream synchronization can be achieved.

[0120] S36: Controlling delay and compensation; In actual audio transmission, due to differences in the processing capabilities and transmission delays of different devices, audio stream deviations may occur. To solve this problem, adjustments can be made by controlling data transmission delay or applying audio compensation technology to achieve better synchronization.

[0121] S4 audio data encoding and decoding includes the following steps:

[0122] S41: Audio encoding;

[0123] S42: Audio transmission;

[0124] S43: Audio decoding.

[0125] S41 audio encoding includes the following steps:

[0126] Step 1: Raw audio acquisition. The audio data is first acquired by the acquisition device to obtain the raw audio signal;

[0127] Step 2: Digital audio signal processing: The raw audio signal undergoes preprocessing and signal processing, such as noise reduction and gain control, to improve audio quality and adapt to different application requirements;

[0128] Step 3: Audio compression encoding: The audio signal is compressed and encoded using an algorithm to convert it into digital audio data with a higher compression ratio. The encoding algorithm used is the Opus encoding algorithm.

[0129] The Opus encoding algorithm includes the following steps:

[0130] Step 1: Preprocessing;

[0131] Step 2: Frame segmentation;

[0132] Step 3: Enhanced CELP coding; using the adaptive multi-vector linear prediction algorithm as its core coding method;

[0133] Step 4: Arithmetic encoding;

[0134] Step 5: Frame control and bit rate adjustment;

[0135] The adaptive multi-vector linear prediction algorithm, as its core coding method, includes six steps: frame decomposition, preprocessing, vector quantization, linear predictive coding, synthesis filter, and bit rate control.

[0136] S42 audio transmission includes the following steps:

[0137] Step 1: Providing encoded audio data: For the master device, it provides encoded audio data, which is sent to the slave device for decoding and playback;

[0138] Step 2: Audio data transmission: The master device transmits the encoded audio data to the slave device via Bluetooth wireless connection;

[0139] S43 audio decoding includes the following steps:

[0140] Step 1: Receive audio data; the device receives encoded audio data from the host device.

[0141] The second step is to decode the audio data. The device uses the corresponding decoding algorithm to decode the audio data and convert it into the original audio signal.

[0142] The third step is digital audio signal processing. The decoded audio signal can undergo further signal processing and enhancement, such as equalization and reverb, to improve audio quality and effect.

[0143] Step 4: Audio Output: The decoded audio signal is played through an audio output device.

[0144] S5 device control and command transmission include the following steps:

[0145] S51: Connection established. A Bluetooth connection is established between the master device and the slave device. The master device is responsible for controlling and sending commands, while the slave device is responsible for executing commands, such as headphones or speakers.

[0146] S52: GATT service discovery, where the master device discovers the GATT (Generic Attribute Profile) service in the slave device by sending a request. The GATT service defines the attributes and characteristics required for communication and interaction between devices;

[0147] S53: Feature Reading and Writing. The master device sends control commands to the slave device by reading and writing GATT features. Features are data items in the GATT service and can be used to transmit commands and other necessary data.

[0148] S54: Command parsing and execution. After receiving commands from the master device, the device parses and executes them, and performs corresponding operations based on the content of the commands, such as playing audio, adjusting volume, and switching playback modes.

[0149] S55: Status feedback. The slave device can return the execution result or status information to the master device through specific GATT features. The master device can read these features to obtain the status of the device or confirm the execution status of the command.

[0150] S56: Event Response. The slave device can send event notifications to the master device so that the master device can be notified in a timely manner when the device status changes or a specific event occurs, such as when the device battery is low or playback is complete.

[0151] S8 error handling and fault tolerance mechanisms include the following steps:

[0152] S81: Error detection. During audio interaction, the master and slave devices monitor for errors and anomalies, which may involve verifying the integrity of the data through checksums, CRC (cyclic redundancy check), or other error detection mechanisms.

[0153] S82: Error Reporting. When an error is detected, the device can generate an error report and send it to the other device. The error report can include an error code, an error description, and other relevant information to help diagnose and handle the problem.

[0154] S83: Error handling. Upon receiving an error report, the device needs to perform appropriate error handling steps, which may include retransmitting data, requesting the device to retransmit lost data packets, adjusting transmission parameters, etc., to correct the error and ensure the correct transmission of data.

[0155] S84: Fault Tolerance Mechanisms; LE Audio introduces several fault tolerance mechanisms to deal with errors and interference in communication. One of these mechanisms is forward error correction, which adds redundant information to the data so that the receiver can recover the original data when some data packets are lost or damaged. Another mechanism is adaptive transmission, which can dynamically adjust transmission parameters according to the current channel conditions to ensure better audio transmission quality in unstable environments.

[0156] S85: Retry and timeout handling. When an error or data loss occurs, the device can attempt to recover by retransmitting the data or triggering a retransmission mechanism. If no response or recovered data is received within a certain time (timeout period), the device can take appropriate measures, such as terminating the connection, reconnecting, or displaying an error message to the user.

[0157] S86: User feedback. The device can display error information or status to the user through an appropriate user interface or audio prompt, so that the user can be aware of the error and take the necessary actions or adjustments.

[0158] LE Audio introduces a new audio coding standard (LC3) and an Enhanced DataPacket, resulting in higher audio quality than traditional SCO-based Bluetooth audio connections. This means users can enjoy a clearer and more realistic listening experience while maintaining high-quality audio. LE Audio supports multi-channel audio transmission, enabling richer audio effects such as stereo and surround sound. Meanwhile, LE Audio allows multiple audio devices to connect to the same host device simultaneously. For example, you can connect headphones, speakers, and other audio devices to your phone at the same time for a more flexible and diverse audio experience. LE Audio uses LE (Low Power) Bluetooth technology for audio transmission. Compared to traditional Bluetooth audio connections, LE Audio consumes less power and has lower audio transmission latency, which means longer device battery life. Users can enjoy lower latency audio transmission and a better real-time audio interaction experience. LE Audio's real-time audio interaction method is suitable for multiple application scenarios, including music playback, phone calls, voice assistants, and games. Whether in personal entertainment or business environments, LE Audio provides more powerful and flexible audio interaction capabilities. LE Audio introduces fault-tolerant mechanisms such as Forward Error Correction (FEC) and Adaptive Transmission, which can provide better fault tolerance in unstable wireless environments. This means that even in the event of interference or packet loss, the audio connection can be maintained and restored more reliably, ensuring a more stable audio experience for users.

[0159] Finally, it should be noted that the above embodiments are merely examples for clearly illustrating the present invention, and are not intended to limit the implementation. For those skilled in the art, other variations or modifications can be made based on the above description. It is neither necessary nor possible to exhaustively list all implementation methods here, and any obvious variations or modifications derived therefrom are still within the protection scope of the present invention.

Claims

1. A real-time audio interaction method based on LE Audio multiple Bluetooth audio devices, characterized in that, This real-time audio interaction method based on LEAudio multiple Bluetooth audio devices includes the following steps: S1: Establish Bluetooth connection using three new technologies: LE Isochronous Channels, Enhanced Attribute Protocol, and the new LC3 audio encoder; S2: Determine the master / slave roles; S3: Real-time audio stream synchronization; S4: Audio data encoding and decoding; S5: Equipment control and command transmission; S6: Interactive Audio; S7: Real-time audio transmission; S8: Error handling and fault tolerance mechanisms; S6 interactive audio is implemented using features and services of the GATT protocol.

2. The real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 1, characterized in that: Establishing a Bluetooth connection with S1 involves the following steps: S11: Scanning equipment; S12: Device pairing and binding; S13: Establish a physical connection. In LE Audio, physical connections are typically established through broadcasting and scanning, without the need for the transmission connection found in traditional Bluetooth. S14: Service discovery is accomplished by querying the general attribute configuration file to obtain the audio configurations and functions supported by the device; S15: Establish audio transmission connection; S16: Start audio transmission.

3. The real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 1, characterized in that: S2 determines the master-slave roles by following these steps: S21: Broadcast LE Connectable; The master device announces its connectable status by broadcasting the LE Connectable advertising packet; S22: Scan and connect; The device scans for nearby connectable Bluetooth devices and selects a master device to connect to; S23: Initiate a connection request; the slave device initiates a connection request to the master device through the connection request. S24: Respond to connection request; After receiving the connection request, the master device can choose to accept or reject the connection; S25: Establish connection; Once the connection response is received by the slave device, a connection is established between the master device and the slave device. In LEAudio, the connection is established through the physical layer and the data link layer. S26: Determine master / slave roles; After the connection is established, the master and slave devices will negotiate and confirm the master / slave roles; S27: Configure audio channel; Once the master / slave roles are confirmed, the device can configure the audio channel, including negotiating audio parameters and the audio stream transmission method.

4. The real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 1, characterized in that: S3 real-time audio stream synchronization includes the following steps: S31: Determine the master / slave roles; S32: The master device generates a master clock signal and inserts a clock synchronization marker into the audio stream; S33: Receive the master clock signal from the device and synchronize its own clock according to the signal; S34: Establish an audio buffer; the size and filling method of the buffer should be adjusted according to application requirements and device capabilities; S35: Data transmission and synchronization; The master device transmits audio data to the slave device, which receives and buffers this data. Based on the master device's master clock signal, the slave device reads and plays the audio data at regular intervals. By reading and playing data according to the same clock signal, audio stream synchronization can be achieved. S36: Control delay and compensation; adjust by controlling data transmission delay or applying audio compensation technology to achieve better synchronization.

5. The real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 1, characterized in that: S4 audio data encoding and decoding includes the following steps: S41: Audio encoding; S42: Audio transmission; S43: Audio decoding.

6. The real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 5, characterized in that: S41 audio encoding Includes the following steps: Step 1: Raw audio acquisition. The audio data is first acquired by the acquisition device to obtain the raw audio signal; Step 2: Digital audio signal processing: The raw audio signal undergoes preprocessing and signal processing, such as noise reduction and gain control, to improve audio quality and adapt to different application requirements; Step 3: Audio compression encoding: The audio signal is compressed and encoded using an algorithm to convert it into digital audio data with a higher compression ratio. The encoding algorithm used is the Opus encoding algorithm. The Opus encoding algorithm includes the following steps: Step 1: Preprocessing; Step 2: Frame segmentation; Step 3: Enhanced CELP coding; using the adaptive multi-vector linear prediction algorithm as its core coding method; Step 4: Arithmetic encoding; Step 5: Frame control and bit rate adjustment; The adaptive multi-vector linear prediction algorithm, as its core coding method, includes six steps: frame decomposition, preprocessing, vector quantization, linear predictive coding, synthesis filter, and bit rate control.

7. The real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 5, characterized in that: S42 audio transmission includes the following steps: Step 1: Providing encoded audio data: For the master device, it provides encoded audio data, which is sent to the slave device for decoding and playback; Step 2: Audio data transmission: The master device transmits the encoded audio data to the slave device via Bluetooth wireless connection.

8. A real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 5, characterized in that: S43 audio decoding includes the following steps: Step 1: Receive audio data; the device receives encoded audio data from the host device. The second step is to decode the audio data. The device uses the corresponding decoding algorithm to decode the audio data and convert it into the original audio signal. The third step is digital audio signal processing. The decoded audio signal can undergo further signal processing and enhancement, such as equalization and reverb, to improve audio quality and effect. Step 4: Audio Output: The decoded audio signal is played through an audio output device.

9. A real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 1, characterized in that: S5 device control and command transmission include the following steps: S51: Connection established; S52: GATT service discovery; S53: Feature reading and writing; S54: Instruction parsing and execution; S55: Status feedback; S56: Event Response.

10. A real-time audio interaction method based on LE Audio multiple Bluetooth audio devices as described in claim 1, characterized in that: S8 error handling and fault tolerance mechanisms include the following steps: S81: Error detection; S82: Error Reporting; S83: Error handling; S84: Fault Tolerance Mechanisms; LE Audio introduces several fault tolerance mechanisms to deal with errors and interference in communication. One of these mechanisms is forward error correction, which adds redundant information to the data so that the receiver can recover the original data when some data packets are lost or damaged. Another mechanism is adaptive transmission, which can dynamically adjust transmission parameters according to the current channel conditions to ensure better audio transmission quality in unstable environments. S85: Retry and timeout handling; S86: User feedback.

Images