Electronic device, audio receiving device, and audio processing method
By using Bluetooth scanning and device identification configuration, interference issues during Bluetooth device connection are resolved, resulting in more efficient audio data transmission and an improved user experience.
Patent Information
- Application Number
- PCT/CN2024/083104
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-30
- Filing Date
- 2024-03-21
- Publication Date
- 2024-12-19
AI Technical Summary
When establishing access control list connections, existing Bluetooth devices are prone to scanning a large number of irrelevant Bluetooth devices, making it difficult for users to quickly and accurately find and connect to the Bluetooth speaker they need, thus affecting the user experience.
By scanning with Bluetooth to obtain broadcast packets from audio receiving devices, devices that support Bluetooth Low Energy service are identified, and device identifiers are displayed in the device selection interface. After the user selects a device, an access control list connection is established, and broadcast and other time stream identifiers are configured for the device to enable audio data transmission.
It improves the accuracy and speed for users when selecting Bluetooth speakers, enhances the user experience, reduces interference from irrelevant devices, and achieves more efficient audio data transmission.
Smart Images

Figure CN2024083104_19122024_PF_FP_ABST
Abstract
Description
Electronic device, audio receiving device and audio processing method
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims priority to Chinese patent applications filed on March 30, 2023, with application number 202310331670.0; filed on July 14, 2023, with application number 202310871094.9; and filed on August 30, 2023, with application number 202311107851.1, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The present application relates to the field of Bluetooth technology, and in particular to an electronic device, an audio receiving device, and an audio processing method. Background Art
[0004] Currently, when playing music or videos, electronic devices such as televisions establish an Access Control List (ACL) connection with Bluetooth speakers to ensure optimal audio playback. The Bluetooth speakers then play the audio. However, electronic products using the Bluetooth protocol are not limited to Bluetooth speakers. Before establishing an ACL connection, televisions scan for a large number of unrelated Bluetooth devices, such as Bluetooth mice and other Bluetooth devices that do not support audio output. This large number of unrelated Bluetooth devices interferes with users' ability to select the desired Bluetooth speakers, making it difficult for users to quickly and accurately find and connect to Bluetooth speakers, resulting in a poor user experience.
[0005] Summary of the Invention
[0006] According to some embodiments of the present application, an electronic device may include: at least one processor, and a Bluetooth module and a memory connected to the at least one processor; the memory may be configured to store computer instructions and / or data associated with the electronic device; the at least one processor may be configured to execute the computer instructions to enable the display device to execute: controlling the Bluetooth module to obtain broadcast packets sent by several audio receiving devices to be connected through Bluetooth scanning; determining, from the several audio receiving devices, multiple audio receiving devices carrying target information in the broadcast packets, wherein the target information is used to indicate support for low-power Bluetooth services; displaying a device selection interface, wherein the device selection interface may include a device identifier of each audio receiving device among the multiple audio receiving devices; in response to a user's selection operation for at least one device identifier, controlling the Bluetooth module to establish an access control list (ACL) connection with at least one audio receiving device indicated by the at least one device identifier, configuring a broadcast isochronous stream (BIS) identifier for each audio receiving device among the at least one audio receiving device, and sending the configured BIS identifier to the at least one audio receiving device through the ACL connection.
[0007] According to some embodiments of the present application, an audio receiving device may include: at least one processor, and a Bluetooth module, an audio output interface and a memory connected to the at least one processor; the memory may be configured to store computer instructions and / or data associated with the audio receiving device; at least one processor may be configured to execute the computer instructions to enable the audio receiving device to execute: controlling the Bluetooth module to send a broadcast packet, the broadcast packet carrying target information, wherein the target information is used to indicate support for low-power Bluetooth services; controlling the Bluetooth module to establish an ACL connection with the electronic device; and receiving a BIS identifier configured by the electronic device through the ACL connection.
[0008] According to some embodiments of the present application, an audio processing method for an electronic device may include: controlling a Bluetooth module to obtain broadcast packets sent by several audio receiving devices to be connected through Bluetooth scanning; determining, from the several audio receiving devices, multiple audio receiving devices carrying target information in the broadcast packets, wherein the target information is used to indicate support for low-power Bluetooth services; displaying a device selection interface, wherein the device selection interface may include a device identifier of each of the multiple audio receiving devices; in response to a user's selection operation for at least one device identifier, controlling the Bluetooth module to establish an ACL connection with at least one audio receiving device indicated by the at least one device identifier, configuring a BIS identifier for each of the at least one audio receiving device, and sending the configured BIS identifier to the at least one audio receiving device through the ACL connection.
[0009] According to some embodiments of the present application, an audio processing method for an audio receiving device may include: controlling a Bluetooth module to send a broadcast packet, the broadcast packet carrying target information, the target information being used to indicate support for low-power Bluetooth services; controlling the Bluetooth module to establish an ACL connection with an electronic device; and receiving a BIS identifier configured by the electronic device through the ACL connection. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] FIG1 is a schematic diagram of a one-to-one audio transmission of unicast media audio in the related art;
[0011] FIG2 is a schematic diagram of a one-to-two audio transmission of unicast media audio in the related art;
[0012] FIG3A is a first schematic diagram showing the relationship between extended broadcast, periodic broadcast, and BIS;
[0013] FIG3B is a second schematic diagram showing the relationship between extended broadcast, periodic broadcast, and BIS;
[0014] FIG3C is a third diagram showing the relationship between extended broadcast, periodic broadcast, and BIS;
[0015] FIG3D is a schematic diagram of a broadcast message structure;
[0016] FIG3E is a schematic diagram of the structure of a header;
[0017] FIG4 is a schematic diagram of a method for continuously sending BIG in the related art;
[0018] FIG5 is a first schematic diagram of a configuration method for broadcasting BIS audio according to some embodiments of the present application;
[0019] FIG6 is a second schematic diagram of a configuration method for broadcasting BIS audio according to some embodiments of the present application;
[0020] FIG7 is a third schematic diagram of a configuration method for broadcasting BIS audio according to some embodiments of the present application;
[0021] FIG8 is a first schematic diagram of a scenario of an audio processing method according to some embodiments of the present application;
[0022] FIG9 is a second schematic diagram of a scenario of an audio processing method according to some embodiments of the present application;
[0023] FIG10 is a third schematic diagram of a scenario of an audio processing method according to some embodiments of the present application;
[0024] FIG11A is a block diagram of a hardware configuration of a display device according to some embodiments of the present application;
[0025] FIG11B is a schematic diagram of a software system architecture of a display device according to some embodiments of the present application;
[0026] FIG12 is a block diagram of a hardware configuration of an audio receiving device according to some embodiments of the present application;
[0027] FIG13 is a block diagram of a hardware configuration of a control device according to some embodiments of the present application;
[0028] FIG14 is a flowchart diagram 1 of an audio processing method according to some embodiments of the present application;
[0029] FIG15 is a schematic diagram of an interface for displaying an application identifier of a Bluetooth speaker application on a display device according to some embodiments of the present application;
[0030] FIG16A is a schematic diagram of an interface for selecting a channel combination according to some embodiments of the present application;
[0031] FIG16B is a schematic diagram of an audio output mode selection interface according to some embodiments of the present application;
[0032] FIG17 is a first schematic diagram of a setting interface for configuring a speaker combination according to some embodiments of the present application;
[0033] FIG18A is a schematic diagram of an interface for scanning audio receiving devices according to some embodiments of the present application;
[0034] FIG18B is a schematic diagram of a pairing interface according to some embodiments of the present application;
[0035] FIG19 is a schematic diagram of an interface of configuration information after speaker configuration according to some embodiments of the present application;
[0036] FIG20 is a schematic diagram of an audio media playback interface according to some embodiments of the present application;
[0037] FIG21A is a schematic diagram of a channel combination selection interface according to some embodiments of the present application;
[0038] FIG21B is a schematic diagram of another channel combination selection interface according to some embodiments of the present application;
[0039] FIG22 is a schematic diagram of a volume adjustment interface according to some embodiments of the present application;
[0040] FIG23 is a second schematic diagram of a setting interface for configuring a speaker combination according to some embodiments of the present application;
[0041] FIG24 is a schematic diagram of an interface for outputting prompt information according to some embodiments of the present application;
[0042] FIG25 is a schematic diagram of a setting success interface according to some embodiments of the present application;
[0043] FIG26 is a schematic diagram of a channel and volume configuration interface according to some embodiments of the present application;
[0044] FIG27 is a schematic diagram of a configured interface according to some embodiments of the present application;
[0045] FIG28 is a schematic diagram of a volume adjustment interface according to some embodiments of the present application;
[0046] FIG29 is a second flow chart of an audio processing method according to some embodiments of the present application;
[0047] FIG30 is a schematic diagram of an interface for triggering the launch of a broadcast assistant application according to some embodiments of the present application;
[0048] FIG31 is a schematic diagram of a control device scanning for available Bluetooth speakers according to some embodiments of the present application;
[0049] FIG32 is a schematic diagram of configuring channels for a connected Bluetooth speaker according to some embodiments of the present application;
[0050] FIG33 is a schematic diagram of an interface for adjusting volume through a control device according to some embodiments of the present application;
[0051] FIG34 is a schematic diagram of a channel selection interface according to some embodiments of the present application;
[0052] FIG35 is a schematic diagram of an interface for setting a left front speaker according to some embodiments of the present application;
[0053] FIG36 is a third flow chart of an audio processing method according to some embodiments of the present application;
[0054] FIG37 is a fourth flow chart of an audio processing method according to some embodiments of the present application;
[0055] FIG38 is a schematic diagram of a data structure of a broadcast packet according to some embodiments of the present application;
[0056] FIG39 is a schematic diagram of a device selection interface according to some embodiments of the present application;
[0057] FIG40 is a schematic diagram of a BIS configuration according to some embodiments of the present application;
[0058] FIG41 is a fifth flow chart of an audio processing method according to some embodiments of the present application;
[0059] FIG42 is a first schematic diagram of a process for screening multiple audio receiving devices according to some embodiments of the present application;
[0060] FIG43 is a second schematic diagram of a process for screening multiple audio receiving devices according to some embodiments of the present application;
[0061] FIG44 is a third schematic diagram of a process for screening multiple audio receiving devices according to some embodiments of the present application;
[0062] FIG45 is a schematic diagram of a device selection interface according to some embodiments of the present application;
[0063] Figure 46 is a schematic diagram of BIS configuration according to some embodiments of the present application. DETAILED DESCRIPTION
[0064] In order to more clearly understand the above-mentioned objectives, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that, in the absence of conflict, the embodiments of the present application and the features therein can be combined with each other.
[0065] In the following description, many specific details are set forth to facilitate a full understanding of the present application, but the present application can also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present application, not all of the embodiments.
[0066] The display device and audio receiving device provided in this application can both support Bluetooth-based low-energy audio (LE Audio) technology, wherein the display device serves as an audio playback device or a device for configuring an audio receiving device. In some embodiments, the display device can be a television, mobile phone, projector, etc., and the audio receiving device can be a Bluetooth speaker, Bluetooth headset, etc.
[0067] Compared with classic Bluetooth (Bluetooth Rate / Enhanced Data Rate, BR / EDR), LE Audio has the following advantages:
[0068] 1. One audio playback device can be connected to multiple audio receiving devices at the same time;
[0069] 2. A broadcast audio device can send broadcast audio to an unlimited number of audio receiving devices, supporting encrypted broadcasting;
[0070] 3. Adopt the latest Low Complexity Communication Codec (LC3) audio format, and the sound quality is improved;
[0071] 4. Support Internet phone and HD calls;
[0072] 5. Support hearing aid / assisted listening applications.
[0073] The LE Audio application layer specification Telephony and Media Audio Profile (TMAP) defines two media audio applications: unicast media audio and broadcast media audio.
[0074] Unicast media audio
[0075] Compared to the current Bluetooth Classic Advanced Audio Distribution Profile (A2DP), unicast media audio in TMAP utilizes a more advanced audio codec to provide better sound quality and offers richer control features than the current Bluetooth Classic Audio / Video Remote Control Profile (AVRCP). TMAP defines two roles for unicast media audio: the Unicast Media Sender (UMS) and the Unicast Media Receiver (UMR). Unicast media audio is transmitted between the UMS and UMR using a Connected Isochronous Stream (CIS).
[0076] It should be noted that the unicast media audio defined in TMAP is not limited to one-to-one audio transmission, but also supports a unicast media sender transmitting unicast media audio to two unicast media receivers.
[0077] Figure 1 is a schematic diagram of a one-to-one audio transmission of unicast media audio in the related art. As shown in Figure 1 , UMS 11 sends unicast media audio to UMR 12 .
[0078] Figure 2 is a schematic diagram of a one-to-two audio transmission of unicast media audio in the related art. As shown in Figure 2, UMS 21 sends unicast media audio to UMR 22 and UMR 23 respectively.
[0079] The aforementioned unicast media audio applications require a Bluetooth connection between the media player and the media receiver to transmit unicast media audio, similar to the audio transmission method in classic Bluetooth. Therefore, when the media player's Bluetooth link is limited, the number of media receivers that can be connected is limited. For example, due to the current limitations of the TV's Bluetooth link, the TV can only send unicast media audio to one or two Bluetooth speakers, which makes stereo playback impossible.
[0080] Broadcast Media Audio
[0081] Broadcast media audio in TMAP is transmitted synchronously over multiple connectionless broadcast isochronous streams (BIS). The biggest advantage of broadcast media audio is that it can transmit audio data synchronously to multiple audio receiving devices.
[0082] The broadcast synchronization channel for broadcast media audio in TMAP uses two concepts: the Boardcast Isochronous Stream (BIG) and the BIS. An audio transmitter can simultaneously transmit multiple BIGs. Each BIG can consist of multiple BISs, and a BIG can contain up to 31 BISs. Each BIS has a unique access address, generated using a unified algorithm based on the seed access address of the BIG to which it belongs.
[0083] Broadcast media audio may include multiple broadcasts with different access addresses, which in some embodiments may include:
[0084] Extended Advertising: This is an extended advertisement on the main advertising channel. It uses the ADV_EXT_IND packet and uses time and frequency information to point to the subsidiary advertisement. Its access address uses the main advertising access address specified in the Bluetooth core specification: 0x8E89BED6.
[0085] Periodic Advertising: Ancillary advertising uses AUX_ADV_IND packets and points to the periodic advertising through time, frequency hopping map, and access address. The periodic advertising uses AUX_SYNC_IND packets and contains BIG information (BIGInfo).
[0086] Broadcast Isochronous Stream (BIS): A broadcast isochronous stream that periodically broadcasts digital audio using a time, frequency hopping map, access address, and BIGInfo pointing to the BIS. The BIS is encapsulated in BIS Protocol Data Unit (PDU).
[0087] Figure 3A shows the relationship between extended broadcast, periodic broadcast, and BIS. It should be noted that Bluetooth operates in the 2.4 GHz band, which has a frequency range of 2402 MHz to 2480 MHz. There is a channel every 2 MHz, for a total of 40 channels. These channels are divided into three primary broadcast channels: channel 37, channel 38, and channel 39. The remaining 37 channels are secondary broadcast channels, which are channels 0 through 36. As shown in Figure 3A, the primary broadcast channels may include channels 37, 38, and 39; the secondary broadcast channels may include channels 0 through 36. The extended broadcast on the main broadcast channel can use the ADV_EXT_IND packet and point to the subsidiary broadcast on the secondary broadcast channel through the time and frequency information. The subsidiary broadcast then uses the AUX_ADV_IND packet to point to the periodic broadcast through the time, frequency hopping map and access address. Furthermore, the periodic broadcast uses the AUX_SYNC_IND packet to point to the BIS through the time, frequency hopping map, access address and BIG information (BIGInfo). The BIS uses the BIS PDU packet to broadcast digital audio.
[0088] In actual applications, when broadcasting digital audio through BIS, it is achieved by continuously sending BIG. Each time a BIG is sent, it can be called a BIG event, and each BIG event can include multiple BIS.
[0089] FIG3B is a second diagram illustrating the relationship between extended broadcasts, periodic broadcasts, and BIS. Extended broadcasts on the primary advertising channel utilize ADV_EXT_IND packets, which direct to auxiliary broadcasts on the general purpose channel utilizing AUX_ADV_IND packets. A fixed interval exists between each extended broadcast on the secondary advertising channel.
[0090] FIG3C is a third diagram showing the relationship between extended broadcast, periodic broadcast and BIS. Based on FIG3B , the additional broadcast data BIG information (ACAD BIGinfo) contained in the auxiliary broadcast of the AUX_ADV_IND packet points to the BIS data packet (BISData Packet).
[0091] Figure 3D is a schematic diagram of the broadcast message structure. As shown in Figure 3D, a Bluetooth Low Energy (BLE) message may include a preamble, access address, header, length, data, and checksum. The preamble is an 8-bit alternating sequence. Depending on whether the first bit of the access address is 0 or 1, it is divided into two types: 01010101 and 10101010. There are two types of access addresses: broadcast access address and data access address. Broadcast access address: fixed to 0x8E89BED6, used when broadcasting, scanning, and initiating a connection. Data access address: random value, different connections have different values. Used between two devices after the connection is established. The length field of the broadcast message contains 6 bits, and the length field of the data message contains 5 bits.
[0092] As shown in Figure 3E, Figure 3E is a schematic diagram of the structure of the header. The header may include broadcast message type, reserved, sending address type and receiving address type. Among them, the broadcast message type may include the 7 types shown in Table 1 below:
[0093] Table 1
[0094] The sending address type and receiving address type indicate whether the device uses a public address (Public Address) or a random address (Random Address).
[0095] Figure 4 is a schematic diagram of a continuous BIG transmission in the related art. As shown in Figure 4, in the process of continuously transmitting BIG, BIG events are executed periodically and continuously. The BIG anchor point shown in Figure 4 indicates the start time of each BIG event, and the time interval between the two anchor points is a cycle of executing the BIG event. It should be noted that Figure 4 is illustrated by taking 3 BIG events, each of which may include 2 BISs as an example. Figure 4 shows the continuous execution of BIG event X, BIG event (X+1) and BIG event (X+2), wherein each BIG event may include 2 BIS streams, namely BIS1 and BIS2 shown in Figure 4. Among them, the BIS stream will be broadcast during the execution of the BIG time, and in the process of broadcasting the BIS stream, the BIS stream will be broadcast once after a fixed time interval.
[0096] There are usually multiple configurations for broadcasting BIS audio. The following examples are provided:
[0097] Figure 5 is a schematic diagram of a configuration for broadcasting BIS audio (which may be a BIS stream) according to some embodiments of the present application. As shown in Figure 5 , three audio receiving devices, namely Bluetooth headset 51, Bluetooth headset 52, and Bluetooth headset 53, are used as an example. In this configuration, one audio transmitting device broadcasts one BIS audio 54, which may include audio from one channel 55. Nearby Bluetooth headsets 51, 52, and 53 can receive this BIS audio 54 and obtain the audio from this channel 55.
[0098] FIG6 is a second schematic diagram of a configuration method for broadcasting BIS audio according to some embodiments of the present application. As shown in FIG6 , taking three audio receiving devices, namely Bluetooth headset 61, Bluetooth headset 62, and Bluetooth headset 63 in FIG6 , as an example, in this configuration, one audio sending device broadcasts two BIS audios, namely BIS audio 64 and BIS audio 66 shown in FIG6 . BIS audio 64 may include audio from a channel 65, and BIS audio 66 may include audio from a channel 67. Channel 65 and channel 67 may be the same channel or different channels. Bluetooth headset 61, Bluetooth headset 62, and Bluetooth headset 63 may all receive BIS audio 64 and BIS audio 66, and obtain audio from channel 65 from BIS audio 64 and audio from channel 67 from BIS audio 66.
[0099] FIG7 is a third schematic diagram of a configuration method for broadcasting BIS audio according to some embodiments of the present application. As shown in FIG7 , three audio receiving devices, namely Bluetooth headset 71, Bluetooth headset 72, and Bluetooth headset 73 in FIG7 , are used as an example for illustration. In this configuration, one audio transmitting device broadcasts a BIS audio 74, which may include two channels of audio: channel 75 and channel 76 shown in FIG7 . Nearby Bluetooth headsets 71, 72, and 73 can receive BIS audio 74 and obtain audio from channels 75 and 76. In FIG7 , the multiple audio receiving devices are Bluetooth headset 71, 72, and 73. Channels 75 and 76 in FIG7 can be different channels, for example, channel 75 is the left front channel and channel 76 is the right front channel.
[0100] According to the audio processing methods of some embodiments of the present application, an audio transmitting device can transmit multiple channels of BIS audio to one or more audio receiving devices by broadcasting BIS audio. In this application, BIS audio can be broadcast using a configuration similar to any of the BIS audio broadcasting configurations shown in Figures 5, 6, or 7.
[0101] According to the audio processing method of the embodiment of the present application, it can be implemented by a display device and multiple audio receiving devices, and the display device can be a mobile phone, a television, a computer, etc. The audio receiving device can be a speaker, a headset, etc. The audio processing method in the embodiment of the present application may include a configuration stage and an audio processing stage. Among them, the configuration stage mainly involves the configuration of the BIS audio of the channel matched by the audio receiving device (i.e., configuring the BIS identifier), as well as the configuration of the volume for the display device and the audio receiving device. The configuration stage is mainly implemented by the display device and / or the control device, while the audio processing stage is mainly implemented by broadcasting the BIS audio from the display device to the audio receiving device. Among them, the control device can be a mobile terminal, such as a mobile phone, a tablet computer, a remote control, a wearable device, etc., which can be used to implement a device that configures the BIS identifier and volume and other functions of the audio receiving device, wherein the wearable device can be a smart watch, a smart bracelet, etc.
[0102] Figure 8 is a scene diagram 1 of an audio processing method according to some embodiments of the present application. As shown in Figure 8, Figure 8 takes the display device as a TV and the audio receiving device as N speakers as an example for explanation. This scene may include a TV and N speakers. The TV can configure channel-matched BIS audio for different speakers in advance, and then broadcast N BIS audios. Correspondingly, each speaker can receive N BIS audios and select channel-matched BIS audios from these N BIS audios for playback. Among them, the channels corresponding to different BIS streams may be different. In the embodiment of the present application, N is greater than or equal to 1.
[0103] FIG9 is a second schematic diagram of a scenario illustrating an audio processing method according to some embodiments of the present application. As shown in FIG9 , the display device 100 can configure multiple audio receiving devices 200 for speaker configuration via ACL connections. After configuration is complete, the display device 100 transmits multi-channel audio to the multiple audio receiving devices 200 via broadcast BIS audio. In FIG9 , the multiple audio receiving devices 200 are N speakers, represented as speaker 91, speaker 92, ..., speaker 9N.
[0104] The audio processing method according to the embodiment of the present application can also be implemented by a display device, a control device and multiple audio receiving devices. Among them, the control device can be a mobile phone, a tablet computer, etc., and the control device is mainly used to configure the audio receiving device.
[0105] FIG10 is a schematic diagram of a scenario of an audio processing method according to some embodiments of the present application. As shown in FIG10 , the display device 100 can establish a wireless connection with a control device 300 (such as a mobile phone), and the display device 100 can send the channel information to be configured to the control device 300. The control device 300 can then configure multiple audio receiving devices 200 based on the channel information through an ACL connection. The display device 100 can send multiple channels of audio to the multiple audio receiving devices 200 by broadcasting BIS audio. In FIG10 , the multiple audio receiving devices 200 are N speakers, respectively represented as speakers 91, 92...speakers 9N. Optionally, the above-mentioned control device 300 can notify the display device 100 through a configuration completion message after the configuration is completed. After the display device 100 receives the configuration completion message, the display device 100 can send multiple channels of audio to the multiple audio receiving devices 200 by broadcasting BIS audio.
[0106] Figure 11A is a hardware configuration block diagram of a display device according to some embodiments of the present application. As shown in Figure 11A, the display device 100 may include: a tuner and demodulator 110, a communication device 120, a detector 130, an external device interface 140, at least one processor 150, a display 160, an audio output interface 170, a memory, a power supply, etc. Among them, the at least one processor may include a central processing unit, a video processor, an audio processor, a graphics processor, a random access memory (RAM), a read-only memory (ROM), and a first interface to an nth interface for input / output. The display 160 may be at least one of a liquid crystal display, an organic light-emitting diode (OLED) display, a touch display, and a projection display, and may also be a projection device and a projection screen. The tuner and demodulator 110 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as electronic program guide (EPG) data signals. The detector 130 is used to collect signals from the external environment or external interactions. The controller 150 and the tuner 110 can be located in different separate devices, that is, the tuner 110 can also be located in an external device of the main device where the controller 150 is located, such as an external set-top box.
[0107] For the scenario shown in FIG9 , when implementing the audio processing method of some embodiments of the present application, each component in the display device can implement the following functions:
[0108] In some embodiments, at least one processor may be configured to execute computer instructions to enable the display device to: obtain channel information to be configured; control the Bluetooth module in the communication device to determine a number of audio receiving devices to be connected through Bluetooth scanning;
[0109] At least one processor can also be configured to execute the computer instructions to enable the display device to execute: controlling the Bluetooth module to establish an ACL connection with multiple audio receiving devices; configuring a BIS identifier for each of the multiple audio receiving devices based on the channel information to be configured, and sending the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection, wherein the multiple audio receiving devices are some or all of the several audio receiving devices; controlling the Bluetooth module in the communication device to broadcast multiple BIS streams, wherein each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that the multiple audio receiving devices can obtain target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0110] In some embodiments, the at least one processor may be further configured to execute the computer instructions to enable the display device to send a configuration volume parameter to each of the plurality of audio receiving devices through the ACL connection.
[0111] In some embodiments, the at least one processor may also be configured to execute the computer instructions to cause the display device to perform: after determining the plurality of audio receiving devices to be connected through Bluetooth scanning, and before controlling the Bluetooth module to establish an ACL connection with the plurality of audio receiving devices, determining the plurality of audio receiving devices that support low-power Bluetooth from the plurality of audio receiving devices.
[0112] In some embodiments, when determining the multiple audio receiving devices that support low-power Bluetooth from the multiple audio receiving devices, the at least one processor may be further configured to execute the computer instructions to enable the display device to execute: obtaining the UUID corresponding to each audio receiving device among the multiple audio receiving devices; and selecting, from the multiple audio receiving devices, the multiple audio receiving devices whose device type indicated by the UUID supports low-power Bluetooth.
[0113] In some embodiments, when executing the acquisition of the channel information to be configured, the at least one processor may be further configured to execute the computer instructions to cause the display device to execute: obtaining the channel information of the currently played audio media; and determining, from the channel information supported by the display device, the channel information to be configured that matches the channel information of the audio media.
[0114] In some embodiments, when performing the step of obtaining the channel information to be configured, the at least one processor may be further configured to execute the computer instructions to cause the display device to: receive a channel combination selection instruction; and obtain the channel information to be configured in response to the channel combination selection instruction.
[0115] For the scenario shown in FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the display device can implement the following functions:
[0116] In some embodiments, at least one processor may be configured to execute the computer instructions to cause the display device to: determine channel information to be configured; and control a communication device to transmit the channel information to a control device, so that the control device configures a speaker for each channel of the display device based on the channel information. After the control device configures a speaker for each channel of the display device (i.e., configures a different audio receiving device), the control device broadcasts multiple BIS streams so that the speakers configured for each channel of the display device can receive and play the BIS audio for their corresponding channel.
[0117] In some embodiments of the present application, the display device can transmit BIS audio of multiple channels to multiple audio receiving devices by broadcasting BIS streams, so that the audio receiving devices can play the BIS audio of their corresponding channels, thereby achieving a stereo playback effect without occupying the Bluetooth link in the current display device.
[0118] Figure 11B is a schematic diagram of the software system architecture of a display device according to some embodiments of the present application. As shown in Figure 11B, the software system may include: an application layer, a system framework layer (referred to as the "framework layer"), a system hardware abstraction layer (HAL), and a Bluetooth protocol stack.
[0119] The application layer may include an Android application package (APK) corresponding to the settings application or a home speaker APK corresponding to the home speaker application. Both the settings APK and the home speaker APK can be used to configure audio receiving devices, broadcast BIS streams, configure corresponding BIS identifiers for each audio receiving device, and synchronize BIS streams in the embodiments of this application.
[0120] The system framework layer may include: LE Audio TMAP application specifications and audio services (Audio Service). Among them, LE Audio TMAP is a technical specification for devices that support LE Audio to implement various types of calls and media applications that are universally used worldwide. In the embodiment of this application, the technical specifications of the media application in LE Audio TMAP are mainly used to configure the audio receiving device, broadcast the BIS stream, and call the broadcast assistant function (Broadcast Audio Scan Service, BASS, also known as broadcast audio scanning service). The Audio Service is mainly responsible for receiving the channel information configured by the application. After the audio decoder (Decoder) decodes the audio data, it is sent to the Bluetooth module according to the configured channel information. The Bluetooth module then broadcasts the audio data, that is, broadcasts the BIS stream.
[0121] The system HAL layer may include LC-3 audio codec, which is a low-complexity communication encoder. In an embodiment of the present application, the audio data passed into the Bluetooth protocol stack needs to be encoded and encoded by the LC-3 audio codec. The system HAL layer may also include a general audio framework (GAF); GAF may also include a common audio specification (Common Audio Profile, CAP), a common audio service (Common Audio Service, CAS), audio stream transmission management and volume control, wherein audio stream transmission management may include a basic audio profile (BAP), an audio capability display service (PACS), an audio stream control service (ASCS) and a broadcast audio scanning service (Broadcast Audio Scan Service, BASS). BASS is required for broadcast synchronization in some embodiments of the present application. Volume control may include: Volume Control Profile (VCP), Volume Control Service (VCS), Voice Offset Control Service (VOCS), and Audio Input Control Service (AICS). In an embodiment of the present application, when a display device controls its own volume and controls the volume of multiple audio receiving devices, it can be achieved through the services involved in volume control.
[0122] The Bluetooth protocol stack is responsible for scanning, connecting, and configuring audio receiving devices, as well as configuring broadcasts and encoding audio.
[0123] Figure 12 is a hardware configuration block diagram of an audio receiving device according to some embodiments of the present application. As shown in Figure 12, the audio receiving device 200 may include: at least one processor 210, a communication device 220, a user input / output interface 230, a memory 240, and a power supply 250. The communication device 220 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or an alternative module. The user input / output interface 230 includes at least one of a speaker, a microphone, a touchpad, a sensor, a button, or an alternative module.
[0124] For the scenario shown in FIG9 , when implementing the audio processing method of some embodiments of the present application, each component in the audio receiving device may further implement the following functions:
[0125] In some embodiments, at least one processor may be configured to execute computer instructions stored in the memory of the audio receiving device to enable the audio receiving device to perform: controlling the Bluetooth module in the communication device to receive a scanning signal sent by the display device; controlling the Bluetooth module to establish an ACL connection with the display device in response to the scanning signal sent by the display device; receiving the BIS identifier configured by the display device through the ACL connection; controlling the Bluetooth module in the communication device to receive multiple BIS streams, each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio; obtaining a target BIS audio from the multiple BIS audios, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0126] For the scenario shown in FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the audio receiving device can implement the following functions:
[0127] In some embodiments, the Bluetooth module in the communication device may be configured to execute the computer instructions to cause the audio receiving device to: receive a scanning signal sent by the control device;
[0128] At least one processor may be configured to execute the computer instructions to cause the audio receiving device to: control the Bluetooth module to establish an ACL connection with the control device in response to a scan signal sent by the control device; and receive a BIS identifier configured by the control device through the ACL connection;
[0129] The Bluetooth module in the communication device may be configured to execute the computer instructions to enable the audio receiving device to: receive a plurality of BIS streams, wherein each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio;
[0130] Obtain a target BIS audio from the multiple BIS audios, wherein a BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0131] FIG13 is a block diagram of a hardware configuration of a control device according to some embodiments of the present application. It should be understood that the control device 300 shown in FIG13 is merely an example, and that the control device 300 may have more or fewer components than shown in FIG13 , may combine two or more components, or may have a different component configuration. The various components shown in FIG13 may be implemented in hardware, software, or a combination of hardware and software, which may include one or more signal processing and / or application-specific integrated circuits.
[0132] As shown in Figure 13, the control device 300 may include: a radio frequency (RF) circuit 310, a memory 320, a display unit 330, a camera 340, a sensor 350, an audio circuit 360, a wireless fidelity (Wireless Fidelity, Wi-Fi) module 370, at least one processor 380, a Bluetooth module 381, and a power supply 390 and other components.
[0133] RF circuit 310 is used to receive and transmit signals during information transmission or calls. It receives downlink data from the base station and passes it to controller 380 for processing; it can also send uplink data to the base station. Typically, the RF circuit includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and other components.
[0134] The memory 320 can be used to store software programs and data. The controller 380 executes various functions and data processing of the control device 300 by running the software programs or data stored in the memory 320. The memory 320 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state memory device. The memory 320 stores the operating system that enables the control device 300 to operate. In the present application, the memory 320 can store the operating system and various application programs, and may also store program code for executing the audio processing method implemented by the control device in some embodiments of the present application.
[0135] The display unit 330 may be used to receive input digital or character information and generate signal input related to user settings and function control of the control device 300. In some embodiments, the display unit 330 may include a touch screen 331 disposed on the front of the control device 300, which may collect user touch operations on or near it, such as clicking a button.
[0136] The display unit 330 can also be used to display information input by the user or information provided to the user, as well as a graphical user interface (GUI) for various menus of the control device 300. In some embodiments, the display unit 330 may include a display screen 332 disposed on the front of the control device 300. The display screen 332 can be configured in the form of a liquid crystal display, a light-emitting diode, etc. The display unit 330 can be used to display the screen display area of the control device 300 in this application.
[0137] The touch screen 331 can be covered on the display screen 332, or the touch screen 331 and the display screen 332 can be integrated to realize the input and output functions of the control device 300. The integrated display screen can be simply called a touch screen display. In this application, the display unit 330 can display applications and corresponding operation steps.
[0138] Camera 340 can be used to capture still images or video. The lens generates an optical image of an object and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transmitted to at least one processor 380 for conversion into a digital image signal.
[0139] The control device 300 may further include at least one sensor 350, such as an acceleration sensor 351, a distance sensor 352, a fingerprint sensor 353, and a temperature sensor 354. The control device 300 may also be equipped with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, and a motion sensor.
[0140] The audio circuit 360, speaker 361, and microphone 362 provide an audio interface between the user and the control device 300. The audio circuit 360 can convert the received audio data into an electrical signal and transmit it to the speaker 361, which converts it into a sound signal for output. The control device 300 can also be equipped with a volume button for adjusting the volume of the sound signal, and can also be combined with other buttons to adjust the enclosed area. On the other hand, the microphone 362 converts the collected sound signal into an electrical signal, which is received by the audio circuit 360 and converted into audio data. The audio data is then output to the RF circuit 310 for transmission to another device, for example, or the audio data is output to the memory 320 for further processing.
[0141] Wi-Fi is a short-range wireless transmission technology. The control device 300 can help users send and receive emails, browse web pages, and access streaming media through the Wi-Fi module 370, providing users with wireless broadband Internet access.
[0142] At least one processor 380 is the control center of the control device 300, which uses various interfaces and lines to connect the various parts of the entire control device, and performs various functions of the control device 300 and processes data by running or executing software programs (such as computer instructions) stored in the memory 320, and calling data stored in the memory 320.
[0143] In some embodiments, the at least one processor 380 may include one or more processing units; the at least one processor 380 may also integrate an application processor and a baseband processor, wherein the application processor primarily processes the operating system, user interface, and application programs, and the baseband processor primarily processes wireless communications. It is understood that the baseband processor may not be integrated into the at least one processor 380. In the present application, the at least one processor 380 may run the operating system, application programs, user interface display and touch response, as well as the audio processing methods executed by the control device in some embodiments of the present application. In addition, the at least one processor 380 is coupled to the display unit 330.
[0144] The Bluetooth module 381 is used to exchange information with other Bluetooth devices that have a Bluetooth module through the Bluetooth protocol. For example, the control device 300 can establish a Bluetooth connection with a display device that also has a Bluetooth module through the Bluetooth module 381 to exchange data. In an embodiment of the present application, the control device 300 can establish a Bluetooth connection (i.e., an ACL connection) with a display device that also has a Bluetooth module through the Bluetooth module 381 to receive channel information or a BIS identifier sent by the display device.
[0145] The control device 300 may also include a power supply 390 (e.g., a battery) to power the various components. The power supply may be logically connected to at least one processor 380 via a power management system, thereby enabling the power management system to manage functions such as charging, discharging, and power consumption. The control device 300 may also be equipped with a power button to control device power on and off, as well as lock the screen.
[0146] In some embodiments, the at least one processor may be configured to execute computer instructions stored in a memory of the control device to enable the control device to: control the communication device to receive the channel information to be configured sent by the display device, control the Bluetooth module in the communication device to determine a plurality of audio receiving devices to be connected through Bluetooth scanning, and enable the control device to establish ACL connections with the plurality of audio receiving devices;
[0147] At least one processor can also be configured to execute the computer instructions to enable the control device to execute: based on the channel information to be configured, send the configured BIS identifier to each audio receiving device in the multiple audio receiving devices through the ACL connection, and configure the volume of the multiple audio receiving devices through the ACL connection.
[0148] In some embodiments of the present application, the audio receiving device can be configured through the display device to configure speakers corresponding to different channels for the display device. The audio receiving device can also be configured through the control device to configure speakers corresponding to different channels for the display device. Therefore, the audio processing method of some embodiments of the present application is flexible in configuration.
[0149] Corresponding to the scenario diagram shown in FIG9 , an audio processing method according to some embodiments of the present application is shown in FIG14 below.
[0150] FIG14 is a flow chart illustrating a method for audio processing according to some embodiments of the present application. As shown in FIG14 , the method is implemented through interaction between a display device and N audio receiving devices. FIG14 only shows audio receiving device 1 and audio receiving device N. The audio receiving device involved in the following steps may refer to any one of the N audio receiving devices. The method may include, but is not limited to, the following steps:
[0151] S1400: The display device determines the channel information to be configured.
[0152] The channel information to be configured may be information about a channel combination of one or more channels. For example, a 2.0 channel combination for two channels may include a left front channel and a right front channel; a channel combination for three channels may include a 2.1 channel combination and a 3.0 channel combination. The 2.1 channel combination may include a left front channel, a right front channel, and a subwoofer channel, and the 3.0 channel combination may include a left front channel, a right front channel, and a center channel; a 3.1 channel combination, a 2.2 channel combination, and a 4.0 channel combination may include a left front channel, a right front channel, a center channel, and a subwoofer channel; the 2.2 channel combination may include a left front channel, a right front channel, and two subwoofer channels; and the 4.0 channel combination may include a left front channel, a right front channel, a left rear ambient channel, and a right rear ambient channel.
[0153] S1401: The display device determines several audio receiving devices to be connected through Bluetooth scanning.
[0154] In some embodiments of the present application, the display device may select some devices from the aforementioned multiple audio receiving devices as speakers for each channel for the display device based on the channel information to be configured.
[0155] In some embodiments of the present application, before the display device broadcasts multiple BIS audios, it can first scan several audio receiving devices to be connected, and configure the multiple audio receiving devices according to the channel combination information to be configured. During the configuration process, it is necessary to scan the audio receiving devices via Bluetooth and configure them through ACL connection.
[0156] In some embodiments of the present application, the audio receiving device may be scanned and configured when the display device is currently playing audio media, or may be scanned and configured when the audio receiving device is not playing audio media.
[0157] In some embodiments, a home speaker application can be installed on a display device. The home speaker application can be a third-party application or a system application, and the application identifier of the home speaker application can be displayed in the interface of the display device. For example, Figure 15 is a schematic diagram of an interface for displaying the application identifier of a Bluetooth speaker application on a display device according to some embodiments of the present application. As shown in Figure 15, the display device is a television, and the application identifier 151 of the Bluetooth speaker application is displayed on the screen of the television.
[0158] As shown in Figure 15 , in response to a user's activation of the home speaker application, the display device displays a channel combination selection interface. Figure 16A is a schematic diagram of a channel combination selection interface according to some embodiments of the present application. The activation of the home speaker application may be a click operation on the application identifier of the home speaker application. As shown in Figure 16A, the channel combination selection interface may include identifications of six combination methods: a 2.0 channel combination for two channels may include a left front channel and a right front channel; a channel combination for three channels may include a 2.1 channel combination and a 3.0 channel combination, the 2.1 channel combination may include a left front channel, a right front channel and a bass channel, and the 3.0 channel combination may include a left front channel, a right front channel and a center channel; a 3.1 channel combination, a 2.2 channel combination and a 4.0 channel combination for four channels, the 3.1 channel combination may include a left front channel, a right front channel, a center channel and a bass channel, the 2.2 channel combination may include a left front channel, a right front channel and two bass channels, and the 4.0 channel combination may include a left front channel, a right front channel, a left rear ambient channel and a right rear ambient channel.
[0159] In some embodiments, the channel combination selection interface shown in FIG. 16A may be an interface in a home speaker application, and the display of the channel combination selection interface may be triggered by an operation on the home speaker application.
[0160] In other embodiments, the channel combination selection interface shown in FIG. 16A may also be an interface in a setting interface (also referred to as a setting interface) of a display device.
[0161] For the channel combinations displayed in the channel combination selection interface shown in FIG16A , if the display device is not currently playing audio media, a channel combination can be selected in response to a user instruction received by the display device. The user instruction can be a user touch operation on a channel combination icon in the channel combination selection interface; or the user instruction can be a selection instruction for a channel combination sent by the user via the display device's remote control or other associated device.
[0162] For the channel combination displayed in the channel combination selection interface shown in Figure 16A, when the display device is currently playing audio media, the channel information to be configured (channel combination to be configured) can be determined based on the channel information of the audio media currently played by the display device, that is, the corresponding channel combination can be selected from the channel combinations displayed in the channel combination selection interface.
[0163] In some embodiments, based on the channel information of the audio media currently played by the display device, determining the channel combination to be configured can be selecting a channel combination from the channel combinations displayed in the channel combination selection interface that matches the channel information of the audio media currently played by the display device.
[0164] In some embodiments, if a first channel combination with the same channel information as the audio media asset exists among the channel combinations displayed in the channel combination selection interface, the first channel combination can be selected for subsequent configuration. In other embodiments, if a first channel combination with the same channel information as the audio media asset does not exist among the channel combinations displayed in the channel combination selection interface, a second channel combination with the highest similarity to the audio media asset can be selected for subsequent configuration. The channel combinations displayed in the channel combination selection interface are the channel combinations supported by the current display device.
[0165] The second channel combination having the highest similarity to the channel information of the audio media asset may be: the channel combination having the most channels identical to the channel information of the audio media asset among the channel combinations supported by the current display device.
[0166] In some embodiments, determining the channel combination to be configured based on the channel information of the audio media currently played by the display device may further include, if no channel combination supported by the current display device matches the channel information of the audio media currently played by the display device, determining the channel combination with the highest configuration among the channel combinations supported by the current display device as the channel information to be configured. The channel combination with the highest configuration may be the one that can include the largest number of channels.
[0167] For example, assuming the audio media currently being played by the display device has a 5.1-channel combination, the 5.1-channel combination may include a center channel, a left front channel, a right front channel, a left rear ambient channel, a right rear ambient channel, and a subwoofer channel. The channel combinations shown in FIG16A may include: a 2.0-channel combination, a 2.1-channel combination, a 3.0-channel combination, a 3.1-channel combination, a 2.2-channel combination, and a 4.0-channel combination. The 4.0-channel combination may include a left front channel, a right front channel, a center channel, and a subwoofer channel. The 4.0-channel combination has the highest similarity to the 5.1-channel combination. Therefore, if the audio media has a 5.1-channel combination, the 4.0-channel combination may be selected for subsequent settings.
[0168] For another example, assuming the audio media currently being played by the display device has a 3.1 channel combination, the channel combinations to be selected shown in FIG16A may include: 2.0 channel combination, 2.1 channel combination, 3.0 channel combination, 3.1 channel combination, 2.2 channel combination, and 4.0 channel combination. The 3.1 channel combination shown in FIG17 is the same as the channel information of the audio media, so the 3.1 channel combination can be selected for subsequent settings.
[0169] In some embodiments, in response to the user's opening operation for the home speaker application, the audio output mode selection interface shown in Figure 16B is first displayed. After receiving the selection instruction for the audio output mode "Bluetooth Home Theater" in the audio output mode selection interface, the channel combination selection interface shown in Figure 16A is displayed. In the "Bluetooth Home Theater" audio output mode, multiple audio receiving devices can be configured for the display device to output audio of different channels. Figure 16B is a schematic diagram of an audio output mode selection interface according to some embodiments of the present application.
[0170] In some embodiments, after a certain channel combination is selected, speakers of different channels in the selected channel combination may be configured as different audio receiving devices, as shown in FIG. 16A and FIG. 17 described below.
[0171] Figure 17 is a schematic diagram of a setup interface for configuring a speaker combination according to some embodiments of the present application. After selecting a 3.1-channel combination in the channel combination selection interface shown in Figure 16A, an interface 1701 as shown in (a) of Figure 17 may be displayed. This interface 1701 is a setup interface for the 3.1-channel speaker combination, which shows the speaker combination to be configured corresponding to the 3.1-channel combination, which may include a left front speaker, a right front speaker, a center speaker, and a subwoofer. The left front speaker in the speaker combination corresponds to the left front channel in the 3.1-channel combination, the right front speaker corresponds to the right front channel in the 3.1-channel combination, the center speaker corresponds to the center channel in the 3.1-channel combination, and the subwoofer corresponds to the bass channel in the 3.1-channel combination. As shown in (a) in Figure 17, after the TV receives the user's trigger operation for the setting control 1702 for the left front speaker, it can trigger the TV to determine one or more audio receiving devices to be connected through Bluetooth scanning (i.e., execute the above step S1401), and display the setting interface 1703 of the left front speaker as shown in (b) in Figure 17. In the setting interface 1703 of the left front speaker, the identification of the audio receiving device to be connected can be displayed: "Bluetooth Speaker 1", "Bluetooth Speaker 2" and "Bluetooth Speaker 3".
[0172] In some embodiments, after selecting a certain channel combination, the display device can first determine the audio receiving devices that can be discovered through the Bluetooth scanning function, and then the display device can select different audio receiving devices from these audio receiving devices to be configured as speakers of different channels, as shown in Figures 18A, 18B and 19.
[0173] Figure 18A is a schematic diagram of an interface for scanning audio receiving devices according to some embodiments of the present application. After selecting a 3.1 channel combination in the channel combination selection interface shown in Figure 16A, the display device can be triggered to perform a Bluetooth scan, pair with nearby Bluetooth devices, and identify the scanned Bluetooth devices as available Bluetooth speakers. The interface shown in Figure 18A can be displayed, in which the device identifiers corresponding to the available Bluetooth speakers are displayed, namely: "Bluetooth Speaker 1", "Bluetooth Speaker 2", and "Bluetooth Speaker 3".
[0174] After selecting the device identifier corresponding to the Bluetooth speaker "Bluetooth Speaker 1" in Figure 18A, the audio receiving device and display device indicated by "Bluetooth Speaker 1" can be paired and connected, and an interface as shown in Figure 18B can be displayed. Figure 18B is a schematic diagram of a pairing interface according to some embodiments of the present application.
[0175] It should be noted that, in response to the user's opening operation for the home speaker application, the display device may first determine whether it is the first time to configure the speaker (i.e., the first time to configure the speaker for the display device). If it is the first time to configure the speaker, it may trigger the display of the channel combination selection interface shown in FIG16A to perform subsequent configuration operations. If it is not the first time to configure the speaker, the configuration information after the previous configuration can be displayed to facilitate the user to determine whether to reconfigure.
[0176] For example, FIG19 is a schematic diagram of an interface showing configuration information after a speaker configuration has been performed according to some embodiments of the present application. In response to a user's opening operation for the home speaker application, if this is not the first time the speaker configuration is being performed, an interface as shown in FIG19 may be triggered to be displayed. It can be seen that the interface shown in FIG19 shows the identifiers of the Bluetooth speakers currently configured for the speakers corresponding to each channel of the display device. For example, the left front speaker corresponding to the left front channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 1"; the right front speaker corresponding to the right front channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 2"; the center speaker corresponding to the center channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 3"; and the subwoofer corresponding to the bass channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 4". Furthermore, the interface may also include a "Reset" control for triggering the modification of the speaker configuration, and a "Confirm" control for triggering the confirmation of the currently saved speaker configuration.
[0177] In some embodiments, in the process of determining several audio receiving devices to be connected through Bluetooth scanning, the display device can first turn on the Bluetooth scanning function to scan the Bluetooth devices near the display device. After the display device receives the broadcast information sent by the Bluetooth device, the Bluetooth device that sends the broadcast information can be determined as the audio receiving device to be connected, wherein the broadcast information may include the identification of the Bluetooth device.
[0178] In the above embodiment, all Bluetooth devices that can receive broadcast information from the display device are determined as audio receiving devices to be connected, and can be displayed in the speaker settings interface. For example, the Bluetooth speakers 1, 2, and 3 displayed in the interface 1703 shown in FIG17(b) indicate that the display device can receive broadcast information. Since BIS audio needs to be sent based on LE Audio technology in the future, if any of the Bluetooth speakers 1, 2, and 3 do not support LE Audio technology, the subsequent audio transmission process will be affected and the BIS identifier cannot be configured. Therefore, after receiving the user's instruction to select a Bluetooth speaker (such as Bluetooth speaker 1) in the interface 1703, an ACL connection can be established with the Bluetooth speaker 1 first, and the type information of the Bluetooth speaker 1 sent by the Bluetooth speaker 1 can be obtained through the ACL connection. If the Bluetooth speaker 1 is determined to be a device that supports LE Audio technology, the Bluetooth speaker 1 can be determined as the audio receiving device to be connected. The type information of the Bluetooth speaker 1 can be the universally unique identifier (UUID) of the Bluetooth speaker 1.
[0179] In some embodiments, in the process of determining several audio receiving devices to be connected through Bluetooth scanning, the display device can first turn on the Bluetooth scanning function to scan Bluetooth devices near the display device. After the display device receives the broadcast information sent by the Bluetooth device, it can first obtain the type of the Bluetooth device from the broadcast information. When it is determined that the device is a device that supports LE Audio technology, the Bluetooth device of the broadcast information can be determined as the audio receiving device to be connected, wherein the broadcast information may include the identification of the Bluetooth device and the type information of the Bluetooth device.
[0180] The Bluetooth device type information may be the UUID of the Bluetooth device. Since the UUIDs for Classic Bluetooth and LE Audio are different, the UUID can be used to identify whether the Bluetooth device's UUID supports LE Audio. If the UUID is determined to be a type that supports LE Audio, the Bluetooth device is considered to support LE Audio.
[0181] The following describes an example of triggering the execution of step S1401 in the case where the display device is currently playing audio media.
[0182] Figure 20 is a schematic diagram of an audio media playback interface according to some embodiments of the present application. As shown in Figure 20, when a display device plays audio media, an audio playback interface 2001 shown in Figure 20 (a) may be displayed. After the display device receives a sound configuration instruction, a sound configuration interface 2002 shown in Figure 20 (b) may be invoked on top of the audio playback interface. A "Set Bluetooth Surround Sound" control 2003 may be configured in the sound configuration interface 2002. After the display device receives a selection instruction for control 2003, the display device may obtain channel information of the currently playing audio media and select subsequent channel combinations based on the channel information of the audio media.
[0183] Figure 21A is a schematic diagram of a channel combination selection interface according to some embodiments of the present application. For example, Figure 21A (a) shows a channel combination selection interface 2101, which displays that the currently playing audio media is 5.1, i.e., the channel combination is 5.1, and displays four channel combinations for the user to select and configure: a 3.1 channel combination, a 2.1 channel combination, a 3.0 channel combination, and a 2.0 channel combination.
[0184] In some embodiments, FIG. 21A (a) shows a channel combination selection interface 2101, where the user can learn the channel combination of the currently playing audio media and the available channel combinations, thereby facilitating user selection. The display device can then select a channel combination from the currently selected channel combinations in response to user instructions.
[0185] In some embodiments, the display device may automatically select, from the channel combinations to be selected, a 3.1 channel combination that is most similar to the 5.1 channel combination of the currently played audio media asset for configuration.
[0186] After selecting a channel combination in the channel combination selection interface 2101 shown in (a) of Figure 21A and receiving a selection instruction for the "Configure Speaker" control 2102, the display device can be triggered to perform Bluetooth scanning, pair with nearby Bluetooth devices, and determine the scanned Bluetooth devices as available Bluetooth speakers, and display the interface shown in (b) of Figure 21A, in which the device identifiers corresponding to the available Bluetooth speakers can be displayed, namely: "Bluetooth Speaker 1", "Bluetooth Speaker 2" and "Bluetooth Speaker 3". Among them, Bluetooth Speaker 1, Bluetooth Speaker 2 and Bluetooth Speaker 3 are Bluetooth devices scanned by the display device through the Bluetooth scanning function. Further, after the display device receives the selection instruction for the device identifier "Bluetooth Speaker 1" in the interface shown in (b) of Figure 21A, the display device can establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1", and further configure the BIS identifier of the corresponding channel for the audio receiving device, as well as the volume of the audio receiving device, etc. through the ACL connection.
[0187] In some embodiments, in the sound configuration interface 2002 shown in Figure 20, if a selection instruction for the control 2003 of "Set Bluetooth Surround Sound" is received, the display device can first determine whether the audio output mode of the currently played audio media has been configured as Bluetooth Surround Sound mode, that is, whether different speakers have been configured for different channels for output, and display the interface shown in Figure 21B when it is determined that it has been configured as Bluetooth Surround Sound mode. Figure 21B is a schematic diagram of another channel combination selection interface according to some embodiments of the present application. As shown in Figure 21B, the interface can display that the currently configured channel combination is a 3.1 channel combination, and a control of "Turn Off Bluetooth Surround Sound" is provided. After receiving the selection operation for the control of "Turn Off Bluetooth Surround Sound", the audio output mode can be switched to normal output mode, that is, the speaker output of the display device itself.
[0188] S1402: The display device establishes an ACL connection with multiple audio receiving devices.
[0189] S1403: The display device sends the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection based on the channel information to be configured.
[0190] Among them, different audio receiving devices correspond to different BIS identifiers, and different BIS identifiers are used to represent BIS audio corresponding to different channels.
[0191] The display device sends the configured BIS identifier to the audio receiving device through the ACL connection so that when multiple BIS audios are subsequently broadcast, the audio receiving device can select the BIS audio corresponding to the channel it wants to play based on the configured BIS identifier after receiving multiple BIS audios.
[0192] In some embodiments, the display device sends a configured BIS identifier to each of the multiple audio receiving devices through an ACL connection based on the channel information to be configured, which may include: the display device configures the BIS identifier based on the channel information to be configured, and sends the configured BIS identifier to each of the multiple audio receiving devices through an ACL connection.
[0193] In some embodiments, after configuring the BIS identifier based on the channel information to be configured, the display device may directly send the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection.
[0194] In other embodiments, after configuring the BIS identifier based on the channel information to be configured, the display device can first start the built-in broadcast assistant function (i.e., the above-mentioned BASS) to scan the broadcast sound source. After scanning the BIS broadcast stream that matches the configured BIS identifier, the display device can send the configured BIS identifier to each audio receiving device in the multiple audio receiving devices through the ACL connection.
[0195] Among them, the display device can broadcast preset audio, and during the broadcast process, the above-mentioned startup built-in broadcast assistant function is executed to scan the preset audio source of the display device's own broadcast to determine whether there is a BIS broadcast stream that matches the configured BIS identifier.
[0196] S1404: The display device configures the volume of multiple audio receiving devices through ACL connections.
[0197] The display device may send the volume parameters configured for each audio receiving device to the corresponding audio receiving device through the ACL connection, so that each audio receiving device may adjust its own volume after receiving the volume parameters.
[0198] The above volume parameters may be default configuration parameters or user-configured parameters.
[0199] In some embodiments, the display device can sequentially establish an ACL connection with each of the multiple audio receiving devices. After the display device establishes an ACL connection with an audio receiving device, the volume of the audio receiving device is configured while the ACL connection is maintained, and the configured BIS identifier is sent to the audio receiving device. After the configuration of the audio receiving device is completed, the ACL connection is disconnected, and the ACL connection is established with the next audio receiving device to configure the volume and BIS identifier.
[0200] In some embodiments of the present application, before configuring the volume and BIS identifier by sequentially establishing an ACL connection between a display device and each of a plurality of audio receiving devices, consideration may be given to whether to configure the ACL connection sequentially based on the occupancy of the Bluetooth link of the display device and / or the number of ACL connections supported by the Bluetooth protocol stack. In the embodiments of the present application, the ACL connections established for volume configuration and BIS identifier configuration may be based on LE Audio.
[0201] In some embodiments, when the occupancy status of the Bluetooth link of the display device indicates that there is only one idle Bluetooth link, the configuration can be performed by establishing ACL connections in sequence; in other embodiments, when the occupancy status of the Bluetooth link of the display device indicates that there are two or more idle Bluetooth links, the configuration can be performed by establishing ACL connections between the display device and multiple audio receiving devices at the same time.
[0202] In some embodiments, if the occupancy of the Bluetooth link of the display device indicates that the current Bluetooth link is occupied by other ACL connections established based on classic Bluetooth, then it is possible to consider disconnecting the ACL connection established based on classic Bluetooth, give priority to configuring the Bluetooth link to the ACL connection established based on LE Audio, and perform volume configuration and BIS identifier configuration. Among them, if there is only one idle Bluetooth link after disconnecting the ACL connection established based on classic Bluetooth, then the method of establishing ACL connections in sequence can be used for configuration; in other embodiments, if there are two or more idle Bluetooth links after disconnecting the ACL connection established based on classic Bluetooth, the display device can be configured by simultaneously connecting the ACL to multiple audio receiving devices.
[0203] In some embodiments, when the number of ACL connections that the Bluetooth protocol stack supports to be established simultaneously is one, the configuration can be performed by establishing ACL connections in sequence; in other embodiments, when the number of ACL connections that the Bluetooth protocol stack supports to be established simultaneously is greater than one, the configuration can be performed by establishing ACL connections between the display device and multiple audio receiving devices at the same time.
[0204] In some embodiments, when the Bluetooth protocol stack supports multiple ACL connections to be established simultaneously, the number of ACL connections supported by the Bluetooth protocol stack to be established simultaneously can be compared with the number of ACL connections that have been currently established to determine the current number of remaining ACL connections that can be established. When the current number of remaining ACL connections that can be established is 1, the method of establishing ACL connections in sequence can be used for configuration; in other embodiments, when the current number of remaining ACL connections that can be established is greater than 1, the display device can be configured with simultaneous ACL connections to multiple audio receiving devices.
[0205] For example, after the display device receives the selection instruction for "Bluetooth Speaker 1" in the setting interface 1703 for the left front speaker shown in (b) of Figure 17, the display device can establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1", and establish an ACL with the audio receiving device indicated by "Bluetooth Speaker 1". Furthermore, since the setting interface 1703 for the left front speaker shown in (b) of Figure 17 is for setting the speaker for the left front channel, after receiving the selection instruction for "Bluetooth Speaker 1", the audio receiving device indicated by "Bluetooth Speaker 1" can be configured as the speaker corresponding to the left front channel. After the display device establishes an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1", the display device will send the BIS identifier indicating the left front channel to the audio receiving device indicated by "Bluetooth Speaker 1" through the ACL connection.
[0206] Figure 22 is a schematic diagram of a volume adjustment interface according to some embodiments of the present application. After the display device receives the selection instruction for "Bluetooth Speaker 1" in the setting interface 1703 for the left front speaker shown in Figure 17 (b), it can trigger the display of a volume adjustment interface 2201 as shown in Figure 22. The volume adjustment interface may include a volume adjustment control 2202 for the audio receiving device indicated by "Bluetooth Speaker 1" and a volume adjustment control 2203 for TV volume adjustment (the display device is a TV). The display device can control the volume adjustment control 2202 based on the received volume adjustment instruction and obtain the corresponding volume parameter to be sent to the audio receiving device indicated by "Bluetooth Speaker 1" through the ACL connection. The display device can also control the volume adjustment control 2203 based on the received volume adjustment instruction and obtain its own volume parameter to adjust the volume of the display device itself.
[0207] The above-mentioned volume adjustment commands can all be input by the user. When controlling the volume adjustment control 2202 and the volume adjustment control 2203 using the received volume adjustment command, a preset audio can be played so that the user can understand the volume effect of the adjustment based on the audio heard during the volume adjustment process, facilitating the adjustment of the volume to the appropriate parameters. Furthermore, after the volume adjustment is completed, the settings for the left front speaker of the left front channel can be saved. The user can then enter the next speaker setting interface and continue to set the speaker for the next channel.
[0208] FIG23 is a second schematic diagram of a setting interface for configuring a speaker combination according to some embodiments of the present application. After the configuration of the left front speaker is completed, an interface 2301 as shown in (a) of Figure 23 can be displayed. In the interface 2301, the current configuration status information 2303 of the left front speaker can be displayed as "Bluetooth Speaker 1", identifying the left front speaker as the audio receiving device indicated by "Bluetooth Speaker 1". As shown in (a) of Figure 23, after the display device receives the trigger operation of the setting control 2302 for the right front speaker in the interface 2301, the TV can be triggered to determine one or more audio receiving devices to be connected through Bluetooth scanning (i.e., execute the above step S1401), and display the setting interface 2304 of the right front speaker as shown in (b) of Figure 23. In the setting interface 2304 of the right front speaker, the identification of the audio receiving device to be connected can be displayed: "Bluetooth Speaker 1", "Bluetooth Speaker 2" and "Bluetooth Speaker 3", and for the "Bluetooth Speaker 1" that has been configured as the left front speaker, the identification information 2305 can be displayed: "Left Front" to indicate that "Bluetooth Speaker 1" has been configured as the left front speaker.
[0209] In some embodiments, if an audio receiving device that has been configured for other channels is selected when configuring speakers for a certain channel, the display device can output a prompt message to indicate that the audio receiving device has been configured for other channels and ask the user whether to change it, which can improve human-computer interaction performance.
[0210] Figure 24 is a schematic diagram of an interface for outputting prompt information according to some embodiments of the present application. In the setting interface 2304 of the right front speaker shown in (b) of Figure 23 above, if the display device receives a selection operation for "Bluetooth Speaker 1", since the audio receiving device indicated by "Bluetooth Speaker 1" has been previously configured as the left front speaker and is now to be configured as the right front speaker, the display device can display an interface as shown in Figure 24, prompting the user through the prompt information in the interface "The Bluetooth speaker 1 has been set as the left front speaker, confirm whether to reset the location information of the device?", and further confirm whether to configure the audio receiving device indicated by "Bluetooth Speaker 1" as the right front speaker by the user's selection of "Cancel" or "Reset" for the control.
[0211] In some embodiments, when a selection instruction for the "Reset" control is received, the audio receiving device indicated by the "Bluetooth Speaker 1" is configured as the right front speaker. When a selection instruction for the "Cancel" control is received, the system can return to the setting interface 2304 of the right front speaker shown in (b) of Figure 23 above, and reselect the audio receiving device to be configured as the right front speaker.
[0212] After the speakers for each channel are set up, a successful setting interface as shown in Figure 25 can be displayed. Figure 25 is a schematic diagram of a successful setting interface according to some embodiments of the present application. A prompt message is displayed in the successful setting interface shown in Figure 25 to remind the user that the speakers for each channel have been set up. After the display device receives the selection operation for the "Done" control, it can save the current configuration, trigger the Bluetooth home theater function, and start broadcasting multiple BIS streams.
[0213] In some embodiments, in the interface shown in (b) in Figure 21A above, when a selection instruction for "Bluetooth Speaker 1" is received, the display device can establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1" and further configure the channel and volume.
[0214] Figure 26 is a schematic diagram of a channel and volume configuration interface according to some embodiments of the present application. As shown in Figure 26, for the connected Bluetooth speaker "Bluetooth Speaker 1", a channel can be selected from "Left Front Channel", "Right Front Channel", "Center Channel", and "Bass Channel" for configuration, and the volume of the connected Bluetooth speaker "Bluetooth Speaker 1" can be adjusted using the volume adjustment control 2601 for "Bluetooth Speaker 1" shown in Figure 26. The adjusted volume parameter is sent to the audio receiving device indicated by "Bluetooth Speaker 1" for volume configuration.
[0215] After configuring the volume and channels of "Bluetooth Speaker 1" in the configuration interface shown in Figure 26, you can also trigger the configuration of the next connected Bluetooth speaker by receiving a selection instruction for the "Continue Configuration" control in the matching interface. After configuring the speakers of all channels, you can complete all configurations by receiving a selection instruction for the "Finish" control in the matching interface. After completing all configurations, an interface as shown in Figure 27 can be displayed. Figure 27 is a schematic diagram of a configuration completed interface according to some embodiments of the present application. In Figure 27, "Switched to Bluetooth Surround Sound 3.1" can be displayed to prompt the user that the current mode of playing audio media is channel combination 3.1.
[0216] In the above implementation, the display device establishes an ACL connection with an audio receiving device in sequence, and configures the audio receiving device by establishing the ACL connection device. After the configuration is completed, the display device disconnects the ACL connection with the audio receiving device and continues to establish an ACL connection with the next audio receiving device to continue configuration until all the speakers of all channels are configured. This method of establishing ACL connections in sequence for configuration, considering that the Bluetooth links that support ACL connections in the current display devices are limited, only establishes one ACL connection for configuration each time. This can save the Bluetooth links that support ACL connections during the configuration process and avoid the Bluetooth links that support ACL connections in the display device being occupied by one audio receiving device for a long time.
[0217] In some embodiments, the display device may also establish ACL connections with multiple audio receiving devices at the same time, and simultaneously configure BIS identifiers corresponding to different channels and perform volume configuration on the multiple audio receiving devices.
[0218] For example, taking the example of configuring the left front speaker as the audio receiving device indicated by "Bluetooth Speaker 1", the right front speaker as the audio receiving device indicated by "Bluetooth Speaker 2", the center speaker as the audio receiving device indicated by "Bluetooth Speaker 3", and the subwoofer as the audio receiving device indicated by "Bluetooth Speaker 4", when configuring the volume, the display device can obtain the current volume parameters of the four audio receiving devices and display them in the same interface, so that the display device can adjust the volume of the display device and the four audio receiving devices in the interface by receiving the user's volume adjustment instructions for the interface.
[0219] Figure 28 is a schematic diagram of a volume adjustment interface according to some embodiments of the present application. As shown in Figure 28, the volume adjustment interface can simultaneously display: a volume adjustment control 2801 for the audio receiving device indicated by "Bluetooth speaker 1", a volume adjustment control 2802 for the audio receiving device indicated by "Bluetooth speaker 2", a volume adjustment control 2803 for the audio receiving device indicated by "Bluetooth speaker 3", a volume adjustment control 2804 for the audio receiving device indicated by "Bluetooth speaker 4", and a volume adjustment control 2805 for TV volume adjustment (the display device is a TV). In this way, the volume of each audio receiving device and / or display device can be adjusted separately by control instructions for different volume adjustment controls.
[0220] S1405: The audio receiving device saves the BIS identifier.
[0221] In some embodiments of the present application, each audio receiving device will receive a BIS identifier corresponding to a certain channel sent by the display device through the ACL connection, and can save the BIS identifier.
[0222] For example, taking the display device configuring four audio receiving devices as four-channel speakers as an example, assume that the four audio receiving devices are identified as: Bluetooth speaker 1, Bluetooth speaker 2, Bluetooth speaker 3 and Bluetooth speaker 4, among which Bluetooth speaker 1 is configured as the left front speaker, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 1 is BIS-A, and Bluetooth speaker 1 saves the BIS-A; Bluetooth speaker 2 is configured as the right front speaker, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 2 is BIS-B, and Bluetooth speaker 2 saves the BIS-B; Bluetooth speaker 3 is configured as the center speaker, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 3 is BIS-C, and Bluetooth speaker 3 saves the BIS-C; Bluetooth speaker 4 is configured as a subwoofer, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 3 is BIS-D, and Bluetooth speaker 4 saves the BIS-D.
[0223] S1406: The display device broadcasts multiple BIS streams.
[0224] Each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio.
[0225] In an embodiment of the present application, FIG14 shows a solution in which the display device first configures the audio receiving device and then broadcasts multiple BIS streams. It should be noted that multiple BIS streams can also be broadcast before the display device configures the audio receiving device.
[0226] In some embodiments, the BIS audio in each BIS stream may include a single channel of audio or multiple channels of audio.
[0227] S1407: The audio receiving device receives multiple BIS streams.
[0228] Among them, after the display device sends the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection, it can broadcast multiple BIS streams, each BIS stream may include BIS audio data and the BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain the target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0229] In some embodiments of the present application, when broadcasting multiple BIS streams, public broadcasting or encrypted broadcasting can be used. Using encrypted broadcasting when broadcasting multiple BIS streams means that the multiple BIS streams are encrypted. Authorized devices can obtain the decryption key to correctly decrypt the broadcast information, while unauthorized devices cannot obtain the decryption key and cannot obtain the correct information even if they intercept the broadcast data. This ensures information security.
[0230] S1408. The audio receiving device obtains the target BIS audio from the multiple BIS audios.
[0231] The BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0232] For example, a display device broadcasts audio data, which may include four channels of BIS audio, namely: BIS audio for the left front channel, with a corresponding BIS identifier BIS-A; BIS audio for the right front channel, with a corresponding BIS identifier BIS-B; BIS audio for the center channel, with a corresponding BIS identifier BIS-C; and BIS audio for the bass channel, with a corresponding BIS identifier BIS-D. Accordingly, after Bluetooth speaker 1, Bluetooth speaker 2, Bluetooth speaker 3, and Bluetooth speaker 4 receive the audio data, they can choose to match it with their own stored BIS identifiers and select the target BIS audio.
[0233] For another example, taking Bluetooth speaker 1 saving BIS-A, Bluetooth speaker 2 saving BIS-B, Bluetooth speaker 3 saving BIS-C, and Bluetooth speaker 4 saving BIS-D as an example, Bluetooth speaker 1 will determine the BIS audio of the left front channel as the target BIS audio; Bluetooth speaker 2 will determine the BIS audio of the right front channel as the target BIS audio; Bluetooth speaker 3 will determine the BIS audio of the center channel as the target BIS audio; Bluetooth speaker 2 will determine the BIS audio of the bass channel as the target BIS audio.
[0234] S1409: The audio receiving device plays the target BIS audio.
[0235] In the embodiment of the present application, each audio receiving device can play the BIS audio of its corresponding channel, thereby achieving a stereo playback effect, that is, a Bluetooth home theater playback effect.
[0236] In some embodiments of the present application, the display device, audio receiving device and audio processing method, the display device can obtain the channel information to be configured, and can determine several audio receiving devices to be connected through Bluetooth scanning, and establish an ACL connection with multiple audio receiving devices therein. After the ACL connection is established, a BIS identifier can be configured for each of the multiple audio receiving devices based on the channel information to be configured, and the configured BIS identifier can be sent to each of the multiple audio receiving devices through the ACL connection. The multiple audio receiving devices are part or all of the several audio receiving devices. After the configuration is completed, the display device can broadcast multiple BIS streams, each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain target BIS audio from multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier. Through this solution, the display device configures different channel speakers (i.e., audio receiving devices corresponding to different channels) based on ACL connection, and can simultaneously send multiple channel broadcast isochronous streams (BIS) of the display device to multiple audio receiving devices based on broadcast mode. In this way, without occupying the Bluetooth link of the display device, multiple channels of audio can be played simultaneously through multiple audio receiving devices, thereby achieving a stereo playback effect.
[0237] Corresponding to the scenario diagram shown in Figure 9, an audio processing method according to some embodiments of the present application is shown in Figure 29 below.
[0238] FIG29 is a second flow chart of an audio processing method according to some embodiments of the present application. As shown in FIG29 , the method is implemented through interaction between a display device, a control device, and N audio receiving devices. FIG29 only shows audio receiving device 1 and audio receiving device N. The audio receiving device involved in the following steps may refer to any one of the N audio receiving devices. The method may include but is not limited to the following steps:
[0239] S2901: The display device determines the channel information to be configured.
[0240] The description of step S2901 can refer to the above description of step S1400 and will not be repeated here.
[0241] S2902: The display device sends the channel information to be configured to the control device.
[0242] In some embodiments of the present application, the display device may send the channel information to be configured to the control device, so that after the control device learns the channel information to be configured, it configures the corresponding audio receiving device as the speaker of each channel for the display device based on the channel information to be configured.
[0243] The display device and the control device may establish a communication connection via wireless communication, and send the channel information to be configured.
[0244] For example, a Wi-Fi connection can be established between the display device and the control device through a Wireless Fidelity (Wi-Fi) network, and the display device sends the channel information to be configured to the control device through the Wi-Fi connection; or, an ACL connection can be established between the display device and the control device through a Bluetooth network, and the display device sends the channel information to be configured to the control device through the ACL connection.
[0245] For example, in the interface shown in Figure 16A above, after receiving the selection instruction for the 3.1 channel combination, the display device determines the channel information to be configured. At this time, the display device can be triggered to send the channel information to be configured to the control device, that is, to send the information of the 3.1 channel combination to the control device.
[0246] For example, in the interface 2101 shown in (a) in the above Figure 21A, after receiving the selection instruction for the control 2103 "Configure the speaker through the mobile phone", the display device determines the channel information to be configured. At this time, the display device can be triggered to send the channel information to be configured to the control device, that is, to send the information of the 3.1 channel combination to the control device.
[0247] S2903: The control device determines several audio receiving devices to be connected through Bluetooth scanning.
[0248] For example, after the display device sends the channel information to be configured to the control device, the control device can configure the corresponding audio receiving device as the speaker of each channel for the display device based on the channel information to be configured, that is, configure the BIS identifier, and further configure the volume.
[0249] In some embodiments, a broadcast assistant application may be provided in the control device, and the broadcast assistant application may be used to implement a function of configuring a corresponding audio receiving device for the display device as a speaker for each channel.
[0250] Figure 30 is a schematic diagram of an interface for triggering the launch of a broadcast assistant application according to some embodiments of the present application. As shown in Figure 30, the application identifier 3001 of the broadcast assistant application can be displayed on the display screen of the control device. After receiving a user's selection instruction for the application identifier of the broadcast assistant application, the broadcast assistant function can be enabled in response to the selection instruction and subsequent configuration can be performed. After the broadcast assistant function is enabled and the control device receives the channel information to be configured sent by the display device, the control device can determine a number of audio receiving devices to be connected based on the broadcast assistant application through Bluetooth scanning.
[0251] Figure 31 is a schematic diagram of a control device scanning for available Bluetooth speakers according to some embodiments of the present application. As shown in Figure 31, the interface displays the device identifiers corresponding to the available Bluetooth speakers, namely: "Bluetooth Speaker 1", "Bluetooth Speaker 2", and "Bluetooth Speaker 3". Bluetooth Speaker 1, Bluetooth Speaker 2, and Bluetooth Speaker 3 are Bluetooth devices scanned by the control device using the Bluetooth scanning function. Furthermore, after the control device receives a selection instruction for "Bluetooth Speaker 1", the display device can establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1".
[0252] S2904: The control device establishes an ACL connection with multiple audio receiving devices.
[0253] S2905: The control device configures a BIS identifier based on the channel information to be configured, and sends the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection.
[0254] In some embodiments, after configuring the BIS identifier based on the channel information to be configured, the control device may directly send the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection.
[0255] In other embodiments, after configuring the BIS identifier based on the channel information to be configured, the control device can first start the built-in broadcast assistant function (i.e., the above-mentioned BASS) to scan the broadcast sound source. After scanning the BIS broadcast stream that matches the configured BIS identifier, the control device can send the configured BIS identifier to each audio receiving device in the multiple audio receiving devices through the ACL connection.
[0256] Among them, after the display device sends the channel information to be configured to the control device, it can broadcast the preset audio. During the broadcast process, the above-mentioned built-in broadcast assistant function is started to scan the preset audio broadcasted by the display device to determine whether there is a BIS broadcast stream that matches the configured BIS identifier.
[0257] S2906: The control device configures the volume of multiple audio receiving devices through ACL connections.
[0258] It should be noted that the above step S2906 is an optional step, that is, the control device may configure the volume of multiple audio receiving devices through the ACL connection, or may not configure the volume of multiple audio receiving devices.
[0259] The controlling device configuring the volume of the plurality of audio receiving devices through the ACL connection may include: the controlling device sending the volume parameter configured for each of the plurality of audio receiving devices to the corresponding audio receiving device through the ACL connection.
[0260] In some embodiments, the control device may sequentially establish an ACL connection with each of the multiple audio receiving devices. After establishing the ACL connection with an audio receiving device, the control device may configure the volume of the audio receiving device while the ACL connection is maintained, and may send the configured BIS identifier to the audio receiving device. After the configuration of the audio receiving device is complete, the control device may disconnect the ACL connection, establish an ACL connection with the next audio receiving device, and configure the volume and BIS identifier.
[0261] The control device establishes an ACL connection with each audio receiving device in turn, and configures the audio receiving device in the ACL connection establishment device. After the configuration is complete, the control device disconnects the ACL connection with the audio receiving device and continues to establish an ACL connection with the next audio receiving device to continue configuration until all channels of speakers are configured. This method of establishing ACL connections in sequence for configuration, considering that the current control device has limited Bluetooth links that support ACL connections, only establishes one ACL connection for configuration at a time. This saves Bluetooth links that support ACL connections during the configuration process and prevents the Bluetooth link that supports ACL connections in the control device from being occupied by a single audio receiving device for a long time.
[0262] In some embodiments, the control device may also establish ACL connections with multiple audio receiving devices at the same time, and simultaneously configure BIS identifiers corresponding to different channels and perform volume configuration on the multiple audio receiving devices.
[0263] Among them, different audio receiving devices correspond to different BIS identifiers, and different BIS identifiers are used to represent BIS audio corresponding to different channels.
[0264] The above-mentioned control device can first determine the BIS identifier corresponding to each channel according to the channel information to be configured, and send the configured BIS identifier to the audio receiving device through the ACL connection. This is so that when multiple BIS audios are broadcast subsequently, the audio receiving device can select the BIS audio corresponding to the channel it wants to play according to the configured BIS identifier after receiving multiple BIS audios.
[0265] For example, assuming the channel information to be configured is for a 3.1-channel combination, which may include a left front channel, a right front channel, a center channel, and a subwoofer, BIS-A can be configured as the BIS identifier for the left front channel; BIS-B can be configured as the BIS identifier for the right front channel; BIS-C can be configured as the BIS identifier for the center channel; and BIS-D can be configured as the BIS identifier for the subwoofer.
[0266] In some embodiments, the control device may first connect to the Bluetooth speaker and then configure the channels.
[0267] Figure 32 is a schematic diagram of configuring channels for a connected Bluetooth speaker according to some embodiments of the present application. After the control device has connected to the audio receiving device indicated by "Bluetooth Speaker 1", the channel to be played can be further selected for the audio receiving device. When the left front channel is selected as shown in Figure 32, the audio receiving device indicated by "Bluetooth Speaker 1" is configured as the speaker for the left front channel of the display device. At this time, the BIS identifier corresponding to the left front channel can be sent to the audio receiving device indicated by "Bluetooth Speaker 1".
[0268] In some embodiments, in the interface shown in Figure 32, after the audio receiving device indicated by "Bluetooth Speaker 1" is configured as the speaker of the left front channel of the display device, the "Continue Configuration" control can be used to trigger the return to the interface for connecting other Bluetooth speakers, such as the interface shown in Figure 31, and further connect other Bluetooth speakers and configure channels until all channels are configured with speakers. The configuration can be saved by triggering the "Done" control in the interface shown in Figure 32.
[0269] In some embodiments, when the left front channel is selected as shown in Figure 32, the interface shown in Figure 33 can be further triggered. Figure 33 is a schematic diagram of an interface for adjusting volume by controlling a device according to some embodiments of the present application. As shown in Figure 33, the interface displays a volume adjustment control 3301 corresponding to the audio receiving device indicated by the Bluetooth speaker 1, and a TV volume adjustment control 3302 corresponding to the display device (the display device is a TV). By controlling the volume adjustment control 3301, the volume of the audio receiving device indicated by the Bluetooth speaker 1 is adjusted, and by controlling the TV volume adjustment control 3302, the volume of the display device is adjusted.
[0270] It should be noted that the interface diagram for adjusting the volume through the control device shown in Figure 33 above is set based on the situation where the control device establishes ACL connections with multiple audio receiving devices in sequence. For the situation where the control device also establishes ACL connections with multiple audio receiving devices at the same time and configures volume to multiple audio receiving devices at the same time, the interface for adjusting the volume on the control device can be similar to Figure 26 above.
[0271] When the control device establishes an ACL connection with multiple audio receiving devices, it can send the corresponding volume parameters to the multiple audio receiving devices through the ACL connection. At the same time, when the control device is connected to a display device via wireless communication, the control device can also send the configured volume parameters to the display device, thereby enabling the control device to adjust the volume of multiple audio receiving devices and display devices. In addition, a volume setting interface similar to that shown in Figure 26 can also be set in the control device to facilitate the use of the control device to adjust the volume of multiple audio receiving devices and display devices through the operation of the visual interface.
[0272] In other embodiments, the control device may first configure the audio channel and then select a Bluetooth speaker to connect to the corresponding audio channel.
[0273] Figure 34 is a schematic diagram of a channel selection interface according to some embodiments of the present application. Before the control device performs a Bluetooth scan, the control device may first display a schematic diagram of the channel selection interface shown in Figure 34, in which the channels currently to be played may include: left front channel, right front channel, center channel, and subwoofer channel.
[0274] In some embodiments, after the control device receives a selection instruction for the "left front channel" shown in Figure 34, it can trigger the display of an interface as shown in Figure 35. Figure 35 is a schematic diagram of an interface for setting a left front speaker according to some embodiments of the present application. Figure 35 shows the identifiers of available Bluetooth speakers scanned by the control device through the Bluetooth scanning function, which may include: "Bluetooth Speaker 1", "Bluetooth Speaker 2" and "Bluetooth Speaker 3" respectively. After receiving the selection instruction for "Bluetooth Speaker 1" shown in Figure 35, the control device can establish an ACL connection with the audio receiving device indicated by Bluetooth speaker 1, and send the BIS identifier corresponding to the left front channel to the audio receiving device indicated by Bluetooth speaker 1 through the ACL connection.
[0275] S2907: The audio receiving device saves the BIS identifier.
[0276] S2908. The display device broadcasts multiple BIS streams.
[0277] Each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio.
[0278] After the display device sends the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection, multiple BIS streams can be broadcast, each of which may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that the multiple audio receiving devices can obtain the target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0279] S2909: The audio receiving device receives multiple BIS streams.
[0280] S2910. The audio receiving device obtains target BIS audio from multiple BIS audios.
[0281] The BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0282] S2911. The audio receiving device plays the target BIS audio.
[0283] For the description of steps S2907 to S2911 above, reference can be made to the description of steps S1405 to S1409 above, which will not be repeated here.
[0284] According to the audio processing method of some embodiments of the present application, the display device can obtain the channel information to be configured and send the channel information to be configured to the control device. The control device can then configure speakers of different channels (i.e., audio receiving devices corresponding to different channels) for the display device based on the channel information to be configured. Specifically: a number of audio receiving devices to be connected can be determined through Bluetooth scanning, and an ACL connection can be established with multiple audio receiving devices therein. After the ACL connection is established, a BIS identifier can be configured for each of the multiple audio receiving devices based on the channel information to be configured, and the configured BIS identifier can be sent to each of the multiple audio receiving devices through the ACL connection. The multiple audio receiving devices are part or all of the several audio receiving devices. After the control device completes the configuration, the display device can broadcast multiple BIS streams, each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain target BIS audio from multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier. Through this solution, the control device can be used to configure speakers with different channels for the display device, and the display device can simultaneously send multiple-channel broadcast isochronous streams (BIS) to multiple audio receiving devices based on the broadcast method. In this way, without occupying the Bluetooth link of the display device, multiple-channel audio can be played simultaneously through multiple audio receiving devices, thereby achieving a stereo playback effect.
[0285] In some embodiments, the BIS identifier may be configured by the display device based on the channel information to be configured and sent to the control device. The control device, as a relay device, forwards the BIS identifier to multiple audio receiving devices.
[0286] For example, FIG36 is a flowchart diagram of an audio processing method according to some embodiments of the present application. FIG36 may be based on FIG29 above, with step S2902 in FIG29 replaced by the following steps S2902a and S2902b:
[0287] S2902a: The display device configures a BIS identifier based on the channel information to be configured.
[0288] The manner in which the display device configures the BIS identifier based on the channel information to be configured is similar to the manner in which the control device configures the BIS identifier based on the channel information to be configured, and will not be repeated here.
[0289] S2902b. The display device sends the configured BIS identifier to the control device.
[0290] Among them, a Wi-Fi connection can be established between the display device and the control device through a Wireless Fidelity (Wi-Fi) network, and the display device sends the configured BIS identifier to the control device through the Wi-Fi connection, or an ACL connection can be established between the display device and the control device through a Bluetooth network, and the display device sends the configured BIS identifier to the control device through the ACL connection.
[0291] Accordingly, in FIG36 , step S2905 in FIG29 may be replaced by the following step S2905a:
[0292] S2905a: The control device sends a BIS identifier to each of the multiple audio receiving devices through the ACL connection.
[0293] The control device may receive the BIS identifiers sent by the display device, and send these BIS identifiers to different audio receiving devices respectively.
[0294] The above-mentioned control device acts as a relay device to forward the BIS identifier sent by the display device, and can also be used to configure speakers of different channels for the display device through the control device. The display device can also be based on a broadcast method to realize the display device sending multiple-channel broadcast isochronous streams (BIS) to multiple audio receiving devices at the same time, so that without occupying the Bluetooth link of the display device, multiple-channel audio can be played simultaneously through multiple audio receiving devices, thereby achieving a stereo playback effect.
[0295] For the scenario shown in FIG9 or FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the display device may further implement the following functions:
[0296] At least one processor can be configured to execute the computer instructions to enable the display device to perform: controlling the Bluetooth module to obtain broadcast packets sent by several audio receiving devices to be connected through Bluetooth scanning; determining, from the several audio receiving devices, multiple audio receiving devices carrying target information in the broadcast packets, wherein the target information is used to indicate support for low-power Bluetooth services; displaying a device selection interface, wherein the device selection interface may include a device identifier of each of the multiple audio receiving devices; in response to a user's selection operation for at least one device identifier, controlling the Bluetooth module to establish an ACL connection with at least one audio receiving device indicated by the at least one device identifier, configuring a BIS identifier for each of the at least one audio receiving device, and sending the configured BIS identifier to the at least one audio receiving device through the ACL connection.
[0297] In some embodiments, at least one processor can also be configured to execute the computer instructions to enable the display device to perform: configuring a BIS identifier for each audio receiving device in at least one audio receiving device, and after sending the configured BIS identifier to at least one audio receiving device through an ACL connection, controlling the Bluetooth module to broadcast at least one BIS stream, wherein each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that at least one audio receiving device can obtain target BIS audio from at least one BIS stream, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0298] In some embodiments, the at least one processor may be further configured to execute the computer instructions to cause the display device to perform: obtaining channel information to be configured before configuring a BIS identifier for each audio receiving device in the at least one audio receiving device;
[0299] When executing the configuration of the BIS identifier for each audio receiving device in at least one audio receiving device, at least one processor can be further configured to execute the computer instructions to enable the display device to execute: configuring the BIS identifier for each audio receiving device in at least one audio receiving device based on the channel information to be configured.
[0300] In some embodiments, when executing the acquisition of the channel information to be configured, at least one processor can be further configured as at least one processor, and can also be configured to execute the computer instructions to cause the display device to execute: obtaining the channel information of the currently playing audio media; and determining, from the channel information supported by the display device, the channel information to be configured that matches the channel information of the audio media.
[0301] For the scenario shown in FIG9 , when implementing the audio processing method of some embodiments of the present application, each component in the audio receiving device may further implement the following functions:
[0302] In some embodiments, at least one processor may be configured to execute computer instructions stored in the memory of the audio receiving device to enable the audio receiving device to perform: controlling the Bluetooth module to send a broadcast packet, wherein the broadcast packet carries target information, and the target information is used to indicate support for low-power Bluetooth services; controlling the Bluetooth module to establish an ACL connection with the display device; and receiving the BIS identifier configured by the display device through the ACL connection.
[0303] For the scenario shown in FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the audio receiving device can implement the following functions:
[0304] In some embodiments, the Bluetooth module in the communication device may be configured to execute computer instructions stored in a memory of the audio receiving device to cause the audio receiving device to: receive a scanning signal sent by the control device;
[0305] At least one processor may be configured to execute the computer instructions to cause the audio receiving device to: control the Bluetooth module to establish an ACL connection with the control device in response to a scan signal sent by the control device; and receive a BIS identifier configured by the control device through the ACL connection;
[0306] The Bluetooth module in the communication device may be configured to execute the computer instructions to cause the audio receiving device to: receive a plurality of BIS streams, each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio;
[0307] Get the target BIS audio from multiple BIS audios. The BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0308] For the scenario shown in FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the control device may further implement the following functions:
[0309] In some embodiments, at least one processor may be configured to execute computer instructions stored in a memory of a control device to cause the control device to: control a communication device to receive channel information to be configured sent by a display device, control a Bluetooth module in the communication device to determine, through Bluetooth scanning, a plurality of audio receiving devices to be connected, and cause the control device to establish an ACL connection with at least one audio receiving device;
[0310] The at least one processor may be further configured to execute the computer instructions to enable the control device to execute: sending a configured BIS identifier to each audio receiving device of the at least one audio receiving device through an ACL connection based on the channel information to be configured.
[0311] Corresponding to the scenario diagram shown in FIG9 , an audio processing method according to some embodiments of the present application is shown in FIG37 below.
[0312] FIG37 is a fourth flow chart of an audio processing method according to some embodiments of the present application. As shown in FIG37 , the method is implemented through interaction between an electronic device and N audio receiving devices. The electronic device can be a display device or a control device. FIG37 only shows audio receiving device 1 and audio receiving device N. The audio receiving device involved in the following steps can refer to any one of the N audio receiving devices. The method may include but is not limited to the following steps:
[0313] S3701: The audio receiving device controls the Bluetooth module to send a broadcast packet.
[0314] The broadcast packet carries target information, which is used to indicate support for low-power Bluetooth services.
[0315] As shown in Figure 38, Figure 38 is a schematic diagram of the data structure of a broadcast packet according to some embodiments of the present application. The broadcast packet may include a valid data part (Significant part) and an invalid data part (Non-significant part), wherein the valid data part may include several broadcast data units (AD Structure), each broadcast data unit may include a length (Length) and data (Data), wherein the data may include broadcast packet type information (AD Type) and broadcast data (AD Data), and the broadcast packet type information indicates the meaning of the broadcast data.
[0316] As shown in Table 2, Table 2 shows part of the broadcast packet type information.
[0317] Table 2
[0318] It should be emphasized that the above table is only for example, and this application does not specifically limit the broadcast packet type information. Flags in the above table is valid when there is a connectable broadcast packet. Flags may include: LE Limited Discoverable Mode, LE General Discoverable Mode, BR / EDR Not Supported, Simultaneous LE, BR / EDR to Same Device Capable, Simultaneous LE and BR / EDR to Same Device Capable.
[0319] S3702: The electronic device controls the Bluetooth module to obtain broadcast packets sent by several audio receiving devices to be connected through Bluetooth scanning.
[0320] In some embodiments, the broadcast packet is a periodic broadcast packet. When the electronic device obtains an extended broadcast packet through Bluetooth scanning, it waits for the periodic broadcast packet on the channel indicated by the extended broadcast packet. After obtaining the periodic broadcast packet, it parses the periodic broadcast packet to obtain the target information carried therein to determine whether the audio receiving device sending the periodic broadcast packet supports Bluetooth low energy services.
[0321] S3703: The electronic device determines, from among a plurality of audio receiving devices, a plurality of audio receiving devices carrying target information in the broadcast packet.
[0322] The target information is used to indicate support for Bluetooth Low Energy services. The target information may include any of the following: (1) the advertising packet type information is a universal unique identifier (UUID) service, and the UUID indicates a receiver role device that supports Bluetooth Low Energy services; (2) the advertising packet type information is a Bluetooth feature service, and the Bluetooth feature is a dual-mode device that supports the BR / EDR protocol and the BLE protocol; (3) the advertising packet type information is a Bluetooth feature service (Flags), and the Bluetooth feature is a device that supports Bluetooth Low Energy services; (4) the advertising packet type information is a device type service (Appearance), and the device type is a speaker-type device.
[0323] It is understandable that, based on the target information carried in the broadcast packet, multiple audio receiving devices can be screened from a number of audio receiving devices, wherein the target information needs to meet any of the above conditions.
[0324] The above situation (1) indicates that AD Type is Service UUIDs, and UUID indicates that the audio receiving device sending this broadcast packet supports LE audio; situation (2) indicates that AD Type is Flags, and Flags indicates that the audio receiving device sending this broadcast packet is a dual-mode device supporting BR / EDR protocol and BLE protocol; situation (3) indicates that AD Type is Flags, and Flags indicates that the audio receiving device sending this broadcast packet supports LE audio; situation (4) indicates that AD Type is Appearance, and Appearance indicates that the audio receiving device sending this broadcast packet is a speaker-type device.
[0325] It should be noted that dual-mode devices that support both the BR / EDR and BLE protocols, as well as speakers, also support Bluetooth Low Energy services. Audio receivers that meet any of the above conditions can be effectively used for stereo playback.
[0326] For example, there are several audio receiving devices to be connected: audio receiving device 1, audio receiving device 2, audio receiving device 3, audio receiving device 4, and other audio receiving devices. The advertising packet sent by audio receiving device 1 carries Service UUIDs, and the Service UUIDs indicate that audio receiving device 1 supports LE audio; the advertising packet sent by audio receiving device 2 carries Flags, and the Flags indicate that audio receiving device 2 supports LE audio; the advertising packet sent by audio receiving device 3 carries Flags, and the Flags indicate that audio receiving device 3 supports BR / EDR protocol and BLE protocol; the advertising packet sent by audio receiving device 4 may include Appearance, and Appearance indicates that audio receiving device 4 is a speaker-type device. Therefore, audio receiving device 1, audio receiving device 2, audio receiving device 3, and audio receiving device 4 that support low-power Bluetooth services are selected from the several audio receiving devices to be connected and can be used as output devices for stereo playback.
[0327] S3704. The electronic device displays a device selection interface.
[0328] The device selection interface may include a device identification of each of the multiple audio receiving devices, and the device identification may be obtained from a broadcast packet sent by the audio receiving device.
[0329] As shown in Figure 39, Figure 39 is a schematic diagram of a device selection interface according to some embodiments of the present application, showing the device identification of each audio receiving device in multiple audio receiving devices to show the user the audio receiving devices scanned by the electronic device that can be used for stereo settings. Continuing with the above example, multiple audio receiving devices are shown in device selection interface 391: audio receiving device 1, audio receiving device 2, audio receiving device 3, and audio receiving device 4.
[0330] S3705. The electronic device controls the Bluetooth module to establish an ACL connection with at least one audio receiving device indicated by the at least one device identifier in response to the user's selection operation for at least one device identifier, configures a BIS identifier for each audio receiving device in the at least one audio receiving device, and sends the configured BIS identifier to the at least one audio receiving device through the ACL connection.
[0331] S3706: The audio receiving device controls the Bluetooth module to establish an ACL connection with the electronic device; and receives the BIS identifier configured by the electronic device through the ACL connection.
[0332] In this embodiment, the device selection interface displays the device identifiers of the audio receiving devices, from which the user can select the desired device identifier to achieve a stereo audio receiving device. The user's selection operation for at least one device identifier can be a touch operation for a specific device identifier, or a selection instruction for a specific device identifier sent by the user through a control device (such as a remote control for a display device) or other associated device.
[0333] In some embodiments of the present application, before configuring the volume and BIS identifier by sequentially establishing an ACL connection between a display device and each of a plurality of audio receiving devices, consideration may be given to whether to configure the ACL connection sequentially based on the occupancy of the Bluetooth link of the display device and / or the number of ACL connections supported by the Bluetooth protocol stack. For details, see the description of the aforementioned step S1404, which will not be repeated here. In the embodiments of the present application, the ACL connections established for volume configuration and BIS identifier configuration can all be ACL connections established based on LE Audio.
[0334] In the above implementation, if the electronic device implementing this method can be a display device, an ACL connection can be established with one audio receiving device in turn through the display device, and the ACL connection device can be used to configure the audio receiving device. After the configuration is completed, the display device disconnects the ACL connection with the audio receiving device and continues to establish an ACL connection with the next audio receiving device to continue configuration until the speakers of all channels are configured.
[0335] In some embodiments, the display device may also establish ACL connections with multiple audio receiving devices at the same time, and configure BIS identifiers corresponding to different channels for the multiple audio receiving devices at the same time.
[0336] In some embodiments, before configuring a BIS identifier for each audio receiving device in at least one audio receiving device, the channel information to be configured is obtained, and then during the process of configuring the BIS identifier, the BIS identifier is configured for each audio receiving device in at least one audio receiving device based on the channel information to be configured.
[0337] Optionally, the channel information to be configured may include but is not limited to at least one of the following: channel information that is the same as the channel information of audio media assets; channel information with the most channels that are the same as the channel information of audio media assets; channel information with the most channels; and channel information with the highest frequency of historical user selection.
[0338] In some embodiments, if the electronic device implementing this method is a display device, then during the process of obtaining the channel information to be configured, the display device first obtains the channel information of the currently playing audio media asset, and then determines the channel information to be configured that matches the channel information of the audio media asset from the channel information supported by the display device. The channel information may be information about a combination of one or more channels. For example, still for a 2.0 channel combination of two channels, it may include: a left front channel and a right front channel; for a channel combination of three channels, it may include a 2.1 channel combination and a 3.0 channel combination, the 2.1 channel combination may include: a left front channel, a right front channel and a bass channel, and the 3.0 channel combination may include: a left front channel, a right front channel and a center channel; for a 3.1 channel combination, a 2.2 channel combination and a 4.0 channel combination of four channels, the 3.1 channel combination may include: a left front channel, a right front channel, a center channel and a bass channel, the 2.2 channel combination may include: a left front channel, a right front channel and two bass channels, and the 4.0 channel combination may include: a left front channel, a right front channel, a left rear ambient channel and a right rear ambient channel.
[0339] It should be noted that the above is only an example, and the present application does not impose any specific limitation on the channel information of the currently played audio media and the number of channel information supported by the display device.
[0340] In some embodiments, the mapping relationship between the pre-configured channel information of the audio media asset and the channel information to be configured is shown in Table 3:
[0341] Table 3
[0342] According to the mapping relationship shown in Table 3, this application determines the channel information to be configured that matches the channel information of the audio media asset from the channel information supported by the display device.
[0343] The channel information to be configured can indicate the channel information supported by the currently playing audio media and the display device. Still as shown in FIG16A , the channel information to be configured can include identifiers for six combinations: a 2.0 channel combination for two channels can include a left front channel and a right front channel; a channel combination for three channels can include a 2.1 channel combination and a 3.0 channel combination. The 2.1 channel combination can include a left front channel, a right front channel, and a subwoofer channel, and the 3.0 channel combination can include a left front channel, a right front channel, and a center channel; a 3.1 channel combination, a 2.2 channel combination, and a 4.0 channel combination for four channels can include a 3.1 channel combination, a 2.2 channel combination, and a 4.0 channel combination. The 3.1 channel combination can include a left front channel, a right front channel, a center channel, and a subwoofer channel; the 2.2 channel combination can include a left front channel, a right front channel, and two subwoofer channels; and the 4.0 channel combination can include a left front channel, a right front channel, a left rear ambient channel, and a right rear ambient channel.
[0344] In some embodiments, the channel information supported by the display device is matched with the channel information of the audio media asset. Optionally, the channel combination corresponding to the display device is matched with the channel combination corresponding to the audio media asset. For ease of explanation, the channel combination corresponding to the display device is defined as the first channel combination, and the channel combination of the currently played audio media asset is defined as the second channel combination. The first channel combination is matched with the second channel combination, and at least one channel in the first channel combination is compared with at least one channel in the second channel combination.
[0345] (1) Channel information that is the same as the channel information of audio media assets
[0346] If the first channel combination contains the same channel combination as the second channel combination, it indicates that the channel information supported by the display device is the same as the channel information of the currently played audio media asset. In this case, the channel information supported by the display device is determined as the channel information to be configured.
[0347] For example, the first channel combination may include a 2.0 channel combination (which may include a left front channel and a right front channel) and a 2.1 channel combination (a left front channel, a right front channel, and a subwoofer channel); the second channel combination may be a 2.0 channel combination (which may include a left front channel and a right front channel). If the 2.0 channel combination in the first channel combination is the same as the second channel combination, the 2.0 channel combination is determined to be the channel information to be configured, and may include a left front channel and a right front channel.
[0348] (2) Channel information with the most channels that are the same as the channel information of audio media assets
[0349] If at least one channel in the first channel combination has N channels that are identical to at least one channel in the second channel combination, and N is the largest, it can be understood that the first channel combination that has the most channels in common with the second channel combination is selected from the first channel combination, indicating that the channel information supported by the display device that is most similar to the channel information of the currently playing audio media asset is selected as the channel information to be configured.
[0350] For example, the first channel combination may include: a 2.1 channel combination (left front channel, right front channel and bass channel) and a 3.0 channel combination (may include left front channel, right front channel and center channel), and the second channel combination is a 2.0 channel combination (may include left front channel and right front channel). After matching, it can be determined that the second channel combination has 2 identical channels with the 2.1 channel combination, and 2 identical channels with the 3.0 channel combination, and the maximum number of identical channels is 2. Then, the 2.1 channel combination and the 3.0 channel combination are determined from the first channel combination as the channel information to be configured.
[0351] For another example, the first channel combination may include: a 2.0 channel combination (which may include a left front channel and a right front channel) and a 2.1 channel combination (a left front channel, a right front channel, and a bass channel), and the second channel combination is a 3.1 channel combination (which may include a left front channel, a right front channel, a center channel, and a bass channel). After matching, it can be determined that the second channel combination has 2 identical channels with the 2.0 channel combination, and 3 identical channels with the 2.1 channel combination, which is the largest number. Therefore, the 2.1 channel combination is determined from the first channel combination as the channel information to be configured.
[0352] (3) Channel information with the most channels
[0353] The channel information with the most channels and the largest number of channels is determined from the channel information supported by the display device, and used as the channel information to be configured to match the channel information of the currently playing audio media. This maximizes the use of the channels supported by the display device for audio playback, enriches the channels, and improves the user's listening experience.
[0354] For example, the first channel combination may include: a 2.0 channel combination (which may include a left front channel and a right front channel), a 2.1 channel combination (a left front channel, a right front channel, and a bass channel), a 3.0 channel combination (which may include a left front channel, a right front channel, and a center channel), a 3.1 channel combination (which may include a left front channel, a right front channel, a center channel, and a bass channel), a 2.2 channel combination (which may include a left front channel, a right front channel, and two bass channels), a 4.0 channel combination (which may include a left front channel, a right front channel, a left rear ambient channel, and a right rear ambient channel). The 3.1 channel combination, the 2.2 channel combination, and the 4.0 channel combination with the largest number of channels may be used as channel information to be configured.
[0355] (4) The channel information with the highest frequency of user selection
[0356] In some embodiments, the display device stores the channel information selected by the user each time and records the frequency with which each channel information has been selected by the user. When making channel recommendations, the channel information with the highest historical selection frequency is considered to be the user's preference, and is used as the channel information to be configured for subsequent display and recommendation to the user.
[0357] In other embodiments, if the electronic device implementing this method is a control device, then during the process of obtaining the channel information to be configured, the control device receives the channel information to be configured sent by the display device. Specifically, the display device may determine the channel information to be configured that matches the channel information of the audio media asset from the channel information it supports, and send the channel information to the control device.
[0358] In a process of configuring a BIS identifier for each of at least one audio receiving device based on channel information to be configured, in response to a user selecting target channel information, a BIS identifier is configured for the target audio receiving device based on the target channel information, wherein the target channel information is any one of the channel information to be configured. Different audio receiving devices correspond to different BIS identifiers.
[0359] It can be understood that the user selects one as the target channel information from the channel information selection interface to be configured (also known as the channel combination selection interface) as shown in Figure 16A. The target channel information may include multiple channels, and when the electronic device has established an ACL connection with at least one audio receiving device, the corresponding BIS identifier is sent to the at least one audio receiving device respectively.
[0360] As shown in Figure 40, Figure 40 is a schematic diagram of BIS configuration according to some embodiments of the present application. In the interface 401 shown in (a) of Figure 40, assuming that the target channel information is a 3.1 channel combination, it may include four channels: left channel, right channel, center channel, and bass channel. In the interface 402 shown in (b) of Figure 40, the electronic device has established an ACL connection with four audio receiving devices. The device identifiers of these four audio receiving devices are: audio receiving device 1, audio receiving device 2, audio receiving device 3, and audio receiving device 4. In response to the user's selection operation for the device identifier of audio receiving device 1, the interface 403 shown in (c) of Figure 40 is displayed, allowing the user to configure the channel for audio receiving device 1 and also configure the volume for audio receiving device 1.
[0361] Similarly, if the user clicks the "Continue Configuration" control in interface 403, BIS configuration can be performed on audio receiving devices 2, 3, and 4. If audio receiving device 1 is configured as a left speaker, the corresponding electronic device sends BIS-A to audio receiving device 1 via the ACL connection; if audio receiving device 2 is configured as a right speaker, the corresponding electronic device sends BIS-B to audio receiving device 2 via the ACL connection; if audio receiving device 3 is configured as a center speaker, the corresponding electronic device sends BIS-C to audio receiving device 3 via the ACL connection; if audio receiving device 4 is configured as a subwoofer, the corresponding electronic device sends BIS-D to audio receiving device 4 via the ACL connection.
[0362] In this application, the electronic device sends a configured BIS identifier to the audio receiving device through the ACL connection, so that after the audio receiving device receives multiple broadcast BIS audios, it can select the BIS audio corresponding to the channel it wants to play according to the configured BIS identifier, thereby realizing multi-channel output audio and achieving the effect of stereo playback.
[0363] In some embodiments, the display device can first start the built-in broadcast assistant function (i.e., the above-mentioned BASS) to scan the broadcast audio source. After scanning the BIS broadcast stream that matches the configured BIS identifier, the configured BIS identifier is sent to each audio receiving device in at least one audio receiving device through the ACL connection.
[0364] Among them, the display device can broadcast preset audio, and during the broadcast process, the above-mentioned startup built-in broadcast assistant function is executed to scan the preset audio source of the display device's own broadcast to determine whether there is a BIS broadcast stream that matches the configured BIS identifier.
[0365] In some embodiments, a BIS identifier is configured for each audio receiving device in at least one audio receiving device, and after the configured BIS identifier is sent to at least one audio receiving device through an ACL connection, the Bluetooth module is controlled to broadcast at least one BIS stream, wherein each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain target BIS audio from multiple BIS streams, play the BIS audio of their respective corresponding channels, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0366] The BIS audio in each BIS stream may include a single channel of audio or multiple channels of audio. In the embodiment of the present application, when broadcasting at least one BIS stream, public broadcasting or encrypted broadcasting may be used for broadcasting.
[0367] For example, when the electronic device can be a display device, the display device broadcasts audio data, which may include four channels of BIS audio, namely: BIS audio for the left channel, and the corresponding BIS identifier is BIS-A; BIS audio for the right channel, and the corresponding BIS identifier is BIS-B; BIS audio for the center channel, and the corresponding BIS identifier is BIS-C; BIS audio for the bass channel, and the corresponding BIS identifier is BIS-D. Accordingly, after audio receiving device 1, audio receiving device 2, audio receiving device 3, and audio receiving device 4 receive the audio data, they can choose to match it with their own stored BIS identifiers and select the target BIS audio from them. For another example, taking the audio receiving device 1 saving BIS-A, the audio receiving device 2 saving BIS-B, the audio receiving device 3 saving BIS-C, and the audio receiving device 4 saving BIS-D as an example, the audio receiving device 1 will determine the BIS audio of the left front channel as the target BIS audio; the audio receiving device 2 will determine the BIS audio of the right front channel as the target BIS audio; the audio receiving device 3 will determine the BIS audio of the center channel as the target BIS audio; and the audio receiving device 2 will determine the BIS audio of the bass channel as the target BIS audio.
[0368] According to the audio processing method of some embodiments of the present application, the Bluetooth module is first controlled to obtain broadcast packets sent by several audio receiving devices to be connected through Bluetooth scanning, and then multiple audio receiving devices carrying target information in the broadcast packets are determined from the multiple audio receiving devices, where the target information indicates that the audio receiving devices support low-power Bluetooth services, and then a device selection interface that may include the device identification of each of the multiple audio receiving devices is displayed. In response to the user's selection operation for at least one device identification, the Bluetooth module is controlled to establish an ACL connection with at least one audio receiving device indicated by the at least one device identification, and a BIS identification is configured for each of the at least one audio receiving devices, and the configured BIS identification is sent to the at least one audio receiving device through the ACL connection. Through this solution, at least one audio receiving device that supports low-power Bluetooth services can be screened from the audio receiving devices to be connected using the target information carried in the broadcast packet, and the device identification of at least one audio receiving device can be displayed, so that the user can quickly and accurately select the audio receiving device for achieving a stereo effect for BIS configuration, thereby improving the user experience.
[0369] For the scenario shown in FIG9 or FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the electronic device may further implement the following functions:
[0370] At least one processor can be configured to execute computer instructions to enable the display device to perform the following: control the Bluetooth module to establish an ACL connection with multiple audio receiving devices; obtain type information sent by the multiple audio receiving devices through the ACL connection, and filter out multiple audio receiving devices from the multiple audio receiving devices based on the type information, wherein the type information of the multiple audio receiving devices indicates support for low-power Bluetooth services; display a device selection interface, wherein the device selection interface may include a device identifier of each of the multiple audio receiving devices; in response to a user's selection operation for at least one device identifier, configure a BIS identifier for each of the at least one audio receiving device indicated by the at least one device identifier, and send the configured BIS identifier to the at least one audio receiving device.
[0371] In some embodiments, the type information of multiple audio receiving devices may include at least one of the following situations: the type information of multiple audio receiving devices is device type service, and the device type is a Bluetooth speaker class or a Bluetooth headset class; the type information of multiple audio receiving devices is device attribute service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset; the type information of multiple audio receiving devices is UUID service, and the UUID indicates support for low-power audio service.
[0372] In some embodiments, the type information of the plurality of audio receiving devices is a device type service, and the device type is a Bluetooth speaker class or a Bluetooth headset class; and the type information of the plurality of audio receiving devices is a UUID service, and the UUID indicates support for low power audio service;
[0373] At least one processor, when executing the method of filtering out multiple audio receiving devices from a plurality of audio receiving devices according to type information, can be further configured to execute the computer instructions to enable the display device to execute: for each audio receiving device among the plurality of audio receiving devices, perform the following operations: based on the device type service of any audio receiving device among the plurality of audio receiving devices, determine whether the type of the any audio receiving device is a Bluetooth speaker type or a Bluetooth headset type; if so, query whether the UUID of the any audio receiving device is saved in the local storage space; if the UUID service of the any audio receiving device is not stored in the local storage space, query whether the UUID of the any audio receiving device indicates support for low-power audio service through a service discovery protocol or a common attribute protocol; if the UUID of the any audio receiving device indicates support for low-power audio service, determine that the any audio receiving device is one of the multiple audio receiving devices.
[0374] In some embodiments, the type information of the plurality of audio receiving devices is a device attribute service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset; and the type information of the plurality of audio receiving devices is a UUID service, and the UUID indicates support for a low-power audio service;
[0375] At least one processor, when executing the method of filtering out multiple audio receiving devices from a plurality of audio receiving devices according to type information, can be further configured to execute the computer instructions to enable the display device to execute: for each audio receiving device among the plurality of audio receiving devices, perform the following operations: based on the device attribute service of any audio receiving device among the plurality of audio receiving devices, determine whether the any audio receiving device is a low-power Bluetooth speaker or a low-power Bluetooth headset; if so, query whether the UUID service of the any audio receiving device is saved in the local storage space; if the UUID service of the any audio receiving device is stored in the local storage space and the UUID of the any audio receiving device indicates support for low-power audio service, determine that the any audio receiving device is one of the multiple audio receiving devices.
[0376] In some embodiments, at least one processor, when executing the control of the Bluetooth module to establish an ACL connection with several audio receiving devices, can be further configured to execute the computer instructions to enable the display device to execute: obtaining the Bluetooth link occupancy ratio of the Bluetooth module, and / or the number of ACL connections supported by the Bluetooth protocol stack to be established simultaneously; when the Bluetooth link occupancy ratio of the Bluetooth module is less than a preset ratio, and / or the number of ACL connections supported by the Bluetooth protocol stack to be established simultaneously is multiple, scanning several audio receiving devices to be connected; controlling the Bluetooth module to broadcast a periodic broadcast packet, the periodic broadcast packet is used to request the establishment of an ACL connection; and establishing an ACL connection with several audio receiving devices when a response packet corresponding to the periodic broadcast packet is received.
[0377] In some embodiments, the electronic device may be a display device, and the at least one processor may be further configured to execute the computer instructions to cause the display device to execute: controlling the Bluetooth module to broadcast at least one BIS stream, wherein each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that at least one audio receiving device can obtain target BIS audio from at least one BIS stream, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0378] In some embodiments, after displaying the device selection interface, in response to a user's selection operation for at least one device identifier, at least one processor may further be configured to configure a BIS identifier for each of at least one audio receiving device indicated by the at least one device identifier, and before sending the configured BIS identifier to the at least one audio receiving device, the at least one processor may be further configured to execute the computer instructions to cause the display device to: obtain channel information to be configured;
[0379] At least one processor, when executing the configuration of the BIS identifier for each audio receiving device in at least one audio receiving device indicated by at least one device identifier, can be further configured to execute the computer instructions to cause the display device to execute: configuring the BIS identifier for each audio receiving device in at least one audio receiving device based on the channel information to be configured.
[0380] In some embodiments, the electronic device may be a display device, and the at least one processor, when executing the method of obtaining the channel information to be configured, may be further configured to execute the computer instructions to cause the display device to execute: obtaining the channel information of the currently played audio media asset; determining the channel information to be configured that matches the channel information of the audio media asset from the channel information supported by the display device; or
[0381] The electronic device may be a control device, and the at least one processor, when executing the acquisition of the channel information to be configured, may be further configured to execute the computer instructions to cause the display device to execute: receiving the channel information to be configured sent by the display device.
[0382] For the scenario shown in FIG9 or FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the audio receiving device may further implement the following functions:
[0383] At least one processor can also be configured to execute computer instructions stored in the memory of the audio receiving device to enable the audio receiving device to perform: controlling the Bluetooth module to establish an ACL connection with the electronic device; sending type information to the electronic device through the ACL connection, wherein the type information is used to indicate support for low-power Bluetooth services; and receiving a BIS identifier configured for the electronic device through the ACL connection.
[0384] For the scenario shown in FIG10 , when implementing the audio processing method of some embodiments of the present application, each component in the control device may further implement the following functions:
[0385] At least one processor can be configured to execute computer instructions stored in the memory of the control device to enable the control device to perform the following: control the Bluetooth module in the communication device, determine several audio receiving devices to be connected through Bluetooth scanning, and enable the control device to establish an ACL connection with the several audio receiving devices; obtain type information sent by the several audio receiving devices through the ACL connection, and filter out multiple audio receiving devices from the several audio receiving devices based on the type information, wherein the type information of the multiple audio receiving devices indicates support for low-power Bluetooth services; display a device selection interface, which may include a device identifier of each audio receiving device in the multiple audio receiving devices; in response to a user's selection operation for at least one device identifier, configure a BIS identifier for each audio receiving device in at least one audio receiving device indicated by the at least one device identifier, and send the configured BIS identifier to the at least one audio receiving device.
[0386] In some embodiments, the at least one processor may be configured to execute the computer instructions to enable the control device to: control the communication device to receive the channel information to be configured sent by the display device;
[0387] The at least one processor may be further configured to execute the computer instructions to enable the control device to send a configured BIS identifier to each audio receiving device of the at least one audio receiving device through the ACL connection based on the channel information to be configured.
[0388] Corresponding to the scenario diagram shown in Figure 9 or Figure 10, some embodiments of the present application provide an audio processing method as shown in Figure 41 below.
[0389] FIG41 is a flowchart diagram 5 of an audio processing method according to some embodiments of the present application. As shown in FIG41 , the method is implemented through interaction between an electronic device and N audio receiving devices. FIG41 only shows audio receiving device 1 and audio receiving device N. The audio receiving device involved in the following steps may refer to any one of the N audio receiving devices. The method may include but is not limited to the following steps:
[0390] S4101: Control the Bluetooth module to establish ACL connections with several audio receiving devices.
[0391] Among them, several audio receiving devices are Bluetooth devices that have the Bluetooth function enabled and support ACL connection, but do not necessarily have the function of playing audio, such as Bluetooth mice.
[0392] In some embodiments, there are several audio receiving devices to be connected in the surrounding environment of the electronic device. The electronic device considers whether to simultaneously establish ACL connections for configuration based on the occupancy of the Bluetooth link and / or the number of ACL connections supported by the Bluetooth protocol stack. Specifically, when controlling the Bluetooth module to establish ACL connections with the several audio receiving devices, the electronic device may first obtain the Bluetooth link occupancy ratio of the Bluetooth module and / or the number of ACL connections supported by the Bluetooth protocol stack. It is determined whether the Bluetooth link occupancy ratio is less than a preset ratio and / or whether the number of ACL connections supported by the Bluetooth protocol stack is multiple.
[0393] When the Bluetooth link occupancy ratio of the Bluetooth module is less than the preset ratio, and / or the Bluetooth protocol stack supports the establishment of multiple ACL connections at the same time, it means that the electronic device can support the establishment of multiple ACL connections at the same time, scan several audio receiving devices to be connected, and then receive periodic broadcast packets broadcast by several audio receiving devices, which are used to request the establishment of an ACL connection. On the audio receiving device side, after receiving the periodic broadcast packet, feedback is given and a response packet of the periodic broadcast packet is sent to the electronic device. When the electronic device receives the response packet corresponding to the periodic broadcast packet, it controls the Bluetooth module to cooperate with the Bluetooth modules of several audio receiving devices to establish an ACL connection.
[0394] In the above embodiment, by judging the Bluetooth link occupancy ratio and / or the number of ACL connections supported for simultaneous establishment, when the Bluetooth link occupancy ratio is less than a preset ratio and / or the number of ACL connections supported for simultaneous establishment is multiple, the electronic device meets the conditions for simultaneous establishment of multiple ACL connections and establishes ACL connections with multiple audio receiving devices to implement audio processing.
[0395] S4102: The audio receiving device sends type information to the electronic device through the ACL connection.
[0396] The type information is used to indicate support for low-power Bluetooth services.
[0397] The audio receiving device supporting the low-power Bluetooth service may include at least one of the following: (1) the type information is the device type (Class Of Device, COD) service, and the device type is the audio receiving device of the Bluetooth speaker class or the Bluetooth headset class; (2) the type information is the device attribute service, and the device attribute is the audio receiving device of the low-power Bluetooth speaker or the low-power Bluetooth headset; (3) the type information is the universal unique identifier (UUID) service, and the UUID indicates the audio receiving device supporting the low-power audio (LE Audio) service.
[0398] The device attribute service makes a judgment by reading the Appearance field of the audio receiving device. Appearance represents the device attribute service of the audio receiving device, indicating whether the audio receiving device is a low-power Bluetooth speaker or a low-power Bluetooth headset.
[0399] In the above embodiment, an ACL connection has been established between the electronic device and the audio receiving device. The audio receiving device sends type information to the electronic device through the ACL connection to indicate whether it supports low-power Bluetooth services and whether it can be used as an audio receiving end for audio output to achieve stereo playback.
[0400] S4103: The electronic device obtains type information sent by the plurality of audio receiving devices through the ACL connection, and selects a plurality of audio receiving devices from the plurality of audio receiving devices according to the type information.
[0401] The type information of the multiple audio receiving devices indicates support for low-power Bluetooth services.
[0402] It should be noted that the electronic device has established ACL connections with several audio receiving devices, some of which may be Bluetooth devices that do not have audio playback capabilities. In some embodiments of the present application, it is necessary to select multiple audio receiving devices that support low-power Bluetooth services from these multiple audio receiving devices to achieve audio output and playback. For example, the electronic device has established ACL connections with N audio receiving devices and needs to select M audio receiving devices that support low-power Bluetooth services from the N audio receiving devices.
[0403] In some embodiments, the type information of multiple audio receiving devices may include at least one of the following situations: (1) the type information of multiple audio receiving devices is device type service, and COD is a Bluetooth speaker class or a Bluetooth headset class; (2) the type information of multiple audio receiving devices is device attribute service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset; (3) the type information of multiple audio receiving devices is UUID service, and the UUID indicates support for low-power audio service.
[0404] FIG42 is a flowchart illustrating a process of screening multiple audio receiving devices according to some embodiments of the present application. As shown in FIG42 , in some embodiments, after obtaining type information sent by multiple audio receiving devices via an ACL connection, which may include device type service and UUID service, the following steps S4201 to S4205 are performed for each of the multiple audio receiving devices until the multiple audio receiving devices are traversed and multiple audio receiving devices that support Bluetooth low energy services are screened:
[0405] S4201: Determine, based on the device type service of the audio receiving device, whether the type of the audio receiving device is a Bluetooth speaker or a Bluetooth headset.
[0406] Assume that N audio receiving devices have established ACL connections with the electronic device, and the i-th audio receiving device (where 1≤i≤N is an integer) among the N audio receiving devices is marked as audio receiving device s(i).
[0407] Execute step S4103 to obtain the device type service of the audio receiving device (S4103a). Based on the device type service of the audio receiving device s(i), determine whether the type of the audio receiving device s(i) is a Bluetooth speaker or a Bluetooth headset. Execute step S4201. If the type of the audio receiving device s(i) is a Bluetooth speaker, it indicates that the audio receiving device s(i) is a Bluetooth speaker device; or, if the type of the audio receiving device s(i) is a Bluetooth headset, it indicates that the audio receiving device s(i) is a Bluetooth headset device, then continue to execute S4202. If the type of the audio receiving device s(i) is not a Bluetooth speaker or a Bluetooth headset, it indicates that the audio receiving device s(i) does not support the low-power Bluetooth service. Accordingly, the audio receiving device s(i) cannot be used for audio output. Then, obtain the device type service of the next audio receiving device s(i+1) for judgment.
[0408] S4202: Query whether the UUID of the audio receiving device is saved in the local storage space.
[0409] Continuing with the previous example, execute step 4202 to query the local storage space for the UUID of audio receiving device s(i). If so, execute step S4204 based on the UUID of audio receiving device s(i) stored in the local storage space to determine whether the UUID indicates support for low-power audio services. If not, execute step S4203.
[0410] S4203: Query the UUID of the audio receiving device through the service discovery protocol or the general attribute protocol.
[0411] The Session Description Protocol (SDP) is a session description protocol used to describe the parameters of a multimedia session. In streaming media communications, it is responsible for carrying media information so that both communicating parties can negotiate their media capabilities.
[0412] The Generic Attribute Profile (GATT) is a general specification for sending and receiving very short data segments over a Bluetooth connection. These short data segments are called attributes.
[0413] S4204: Determine whether the UUID indicates support for low-power audio services.
[0414] Continuing with the above example, execute step S4204. If yes, the UUID indicates support for low-power audio service, the audio receiving device s(i) supports low-power Bluetooth service and can be used for audio output, then execute step S4205. If no, the UUID indicates that low-power audio service is not supported, then return to step S4201 to determine the device type service of the next audio receiving device s(i+1).
[0415] S4205: Determine whether the audio receiving device is one of the multiple audio receiving devices.
[0416] Continuing with the above example, the audio sink device s(i) is one of the M audio sink devices that support the Bluetooth low energy service.
[0417] The above steps S4201 to S4205 are executed in a loop until i>N, and then the loop is exited to obtain multiple audio receiving devices that support low-power Bluetooth services and can be used for audio output.
[0418] In the above embodiment, the type information of the multiple audio receiving devices selected is the device type service and the UUID service, and the device type is a Bluetooth speaker or Bluetooth headset class, and the UUID indicates support for low-power audio services. Multiple audio receiving devices that can be used for audio output are selected from a number of audio receiving devices, providing convenience for users to select multiple audio output devices.
[0419] FIG43 is a second schematic diagram of a process for screening multiple audio receiving devices according to some embodiments of the present application. As shown in FIG43 , in some embodiments, after obtaining type information sent by multiple audio receiving devices via an ACL connection, which may include device attribute services, the following steps S4301 to S4304 are performed for each of the multiple audio receiving devices until all the multiple audio receiving devices are traversed and multiple audio receiving devices supporting Bluetooth low energy services are screened out:
[0420] S4301. Determine, based on the device attribute service of the audio receiving device, whether the audio receiving device is a low-power Bluetooth speaker or a low-power Bluetooth headset.
[0421] Assume that N audio receiving devices have established ACL connections with the electronic device. The i-th audio receiving device (where 1≤i≤N is an integer) among the N audio receiving devices is marked as audio receiving device s(i).
[0422] Execute step S4103 to obtain the device attribute service of the audio receiving device (S4103b). First, obtain the type of audio receiving device s(i) and determine whether audio receiving device s(i) is a low energy (LE) device. Execute step S4301. If yes, audio receiving device s(i+1) is an LE device, then execute step S4302 to read the Appearance field. If no, audio receiving device s(i+1) is not an LE device, indicating that audio receiving device s(i) does not meet the conditions for supporting the low energy Bluetooth service and cannot be used for audio output. Then return to step S4301 to determine the next audio receiving device s(i+1).
[0423] S4302. Read the Appearance field.
[0424] Continuing with the above example, the Appearance field represents the device attribute service of the audio receiving device s(i), indicating whether the audio receiving device s(i) is a low-power Bluetooth speaker or a low-power Bluetooth headset.
[0425] S4303: Determine whether the audio receiving device is a low-power Bluetooth speaker or a low-power Bluetooth headset.
[0426] Continuing with the above example, execute step S4303. If yes, the audio receiving device s(i) is a low-power speaker or a low-power Bluetooth headset, execute S4304. If no, it means that the audio receiving device s(i) does not meet the conditions for supporting the low-power Bluetooth service and cannot be used for audio output, then return to step S4301 to judge the next audio receiving device s(i+1).
[0427] S4304: Determine whether the audio receiving device is one of the multiple audio receiving devices.
[0428] The above steps S4301 to S4304 are executed in a loop until i>N, and then the loop is exited to obtain multiple audio receiving devices that support low-power Bluetooth services and can be used for audio output.
[0429] In the above embodiment, the type information of the multiple audio receiving devices selected is a device attribute service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset. Multiple audio receiving devices that can be used for audio output are selected from a plurality of audio receiving devices, providing convenience for users to select multiple audio output devices.
[0430] FIG44 is a third flow diagram of screening multiple audio receiving devices according to some embodiments of the present application. As shown in FIG44 , in some embodiments, after obtaining type information sent by multiple audio receiving devices via an ACL connection, which may include device attribute services and UUID services, the following steps S4401 to S4404 are performed for each of the multiple audio receiving devices until the multiple audio receiving devices are traversed and multiple audio receiving devices that support low-power Bluetooth services are screened:
[0431] S4401. Determine, based on the device attribute service of the audio receiving device, whether the audio receiving device is a low-power Bluetooth speaker or a low-power Bluetooth headset.
[0432] Assume that N audio receiving devices have established ACL connections with the electronic device. The i-th audio receiving device (where 1≤i≤N is an integer) among the N audio receiving devices is marked as audio receiving device s(i).
[0433] Execute step S4103 to obtain the device attribute service of the audio receiving device (S4103b), and read the Appearance field in the data sent by audio receiving device s(i) via the ACL. Execute step S4401. If yes, audio receiving device s(i) is a low-power Bluetooth speaker or low-power Bluetooth headset, then execute S4402. If no, audio receiving device s(i) is not a low-power Bluetooth speaker or low-power Bluetooth headset, indicating that audio receiving device s(i) does not support the low-power Bluetooth service and cannot be used for audio output, then return to S4401 to determine the next audio receiving device s(i+1).
[0434] S4402: Query whether the UUID service of the audio receiving device is saved in the local storage space.
[0435] Continuing with the above example, execute step S4402. If yes, execute step S4403b. If not, execute step S4403a, actively query the UUID service of the audio receiving device through GATT, and then execute S4403b to determine whether the UUID of the audio receiving device indicates support for low-power audio services.
[0436] Continuing with the above example, execute step S4403b. If the UUID indicates support for low-power audio services, the audio receiving device s(i) supports low-power Bluetooth services and can be used for audio output, execute S4404 to determine whether the audio receiving device is one of multiple audio receiving devices; if not, the UUID indicates that low-power audio services are not supported, return to step S4401 to judge the next audio receiving device s(i+1).
[0437] S4404: Determine whether the audio receiving device is one of the multiple audio receiving devices.
[0438] The above steps S4401 to S4404 are executed in a loop until i>N, and then the loop is exited to obtain multiple audio receiving devices that support low-power Bluetooth services and can be used for audio output.
[0439] In the above embodiment, the type information of the screened multiple audio receiving devices is device attribute service and UUID service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset, and the UUID indicates support for low-power audio service.
[0440] The above embodiment selects multiple audio receiving devices that can be used for audio output from a number of audio receiving devices based on the type information sent by the audio receiving device through the ACL connection, and then provides them to the user for selection. This makes the selection of multiple audio output terminals simpler, brings convenience to the user, and improves the user experience.
[0441] S4104. The electronic device displays a device selection interface.
[0442] The device selection interface may include a device identification of each of the multiple audio receiving devices, wherein the device identification is sent by the audio receiving device to the electronic device via the ACL connection.
[0443] Figure 45 is a schematic diagram of a device selection interface according to some embodiments of the present application. Figure 45 shows the device identification of each of multiple audio receiving devices to show the user that multiple audio receiving devices support low-power Bluetooth services and can be used for audio output. As shown in Figure 45, the device selection interface 391 shows multiple audio receiving devices: audio receiving device 1, audio receiving device 2, audio receiving device 3, and audio receiving device 4. Referring to Figure 45, icons corresponding to the audio receiving devices can also be shown, such as a headphone icon corresponding to audio receiving device 1 and a speaker icon corresponding to audio receiving device 2. It should be noted that the icons corresponding to the audio receiving devices are generated based on the device type of the audio receiving device. If the type of audio receiving device 1 is a Bluetooth speaker, the icon for audio receiving device 1 is a headphone icon. The icons shown in the figure are for example only, and this application does not impose specific restrictions on the style, size, etc. of the icons.
[0444] S4105. In response to the user's selection operation for at least one device identifier, the electronic device configures a BIS identifier for each audio receiving device in at least one audio receiving device indicated by the at least one device identifier, and sends the configured BIS identifier to the at least one audio receiving device.
[0445] In some embodiments, after executing step S4104, the electronic device obtains the channel information to be configured, and then, in the process of configuring a BIS identifier for each of the at least one audio receiving device, configures a BIS identifier for each of the audio receiving devices based on the channel information to be configured. The electronic device establishes an ACL connection with the multiple audio receiving devices and simultaneously configures the BIS identifiers corresponding to different channels for at least one audio receiving device.
[0446] In some embodiments, if the electronic device implementing this method is a display device, then during the process of obtaining the channel information to be configured, the display device first obtains the channel information of the currently playing audio media asset, and then determines the channel information to be configured that matches the channel information of the audio media asset from the channel information supported by the display device. The channel information may be information about a combination of one or more channels.
[0447] In some embodiments, channel information to be configured that matches the channel information of the audio media asset can be determined from the channel information supported by the display device according to the mapping relationship shown in Table 3. The channel information to be configured can represent channel information supported by both the currently playing audio media asset and the display device.
[0448] In other embodiments, if the electronic device implementing this method is a control device, the control device receives the channel information to be configured from the display device during the process of obtaining the channel information to be configured. In some embodiments, the display device determines the channel information to be configured that matches the channel information of the audio media asset from the channel information it supports, and sends the channel information to the control device.
[0449] During the process of configuring a BIS identifier for each of at least one audio receiving device based on the channel information to be configured, a BIS identifier can still be configured for the target audio receiving device based on the target channel information in response to a user's selection operation for target channel information, wherein the target channel information is any one of the channel information to be configured. Different audio receiving devices correspond to different BIS identifiers.
[0450] As shown in Figure 46, Figure 46 is a schematic diagram of BIS configuration according to some embodiments of the present application. In interface 461 shown in (a) of Figure 46, assuming that the target channel information is a 3.1 channel combination, it may include four channels: left channel, right channel, center channel, and subwoofer channel. In interface 462 shown in (b) of Figure 46, the electronic device has established ACL connections with four audio receiving devices. The device identifiers of these four audio receiving devices are: audio receiving device 1, audio receiving device 2, audio receiving device 3, and audio receiving device 4. In response to the user's selection operation for the device identifier of audio receiving device 1, interface 463 shown in (c) of Figure 46 is displayed, allowing the user to configure the channels for audio receiving device 1 and the volume for audio receiving device 1. Similarly, if the user clicks the "Continue Configuration" control in interface 463, BIS configuration can still be performed on audio receiving devices 2, 3, and 4. If audio receiving device 1 is configured as the left speaker, the electronic device sends BIS-A to audio receiving device 1 through the ACL connection; if audio receiving device 2 is configured as the right speaker, the electronic device sends BIS-B to audio receiving device 2 through the ACL connection; if audio receiving device 3 is configured as the center speaker, the corresponding electronic device sends BIS-C to audio receiving device 3 through the ACL connection; if audio receiving device 4 is configured as a subwoofer, the corresponding electronic device sends BIS-D to audio receiving device 4 through the ACL connection.
[0451] S4106. The audio receiving device receives the BIS identifier configured by the electronic device through the ACL connection.
[0452] The electronic device sends the configured BIS identifier to the audio receiving device through the ACL connection, so that after receiving multiple BIS audios, the audio receiving device can select the BIS audio corresponding to the channel it wants to play according to the configured BIS identifier, thereby realizing multi-channel output audio and achieving the effect of stereo playback.
[0453] In some embodiments, the electronic device can first start the built-in broadcast assistant function (i.e., the above-mentioned BASS) to scan the broadcast audio source. After scanning the BIS broadcast stream that matches the configured BIS identifier, the configured BIS identifier is sent to each audio receiving device in at least one audio receiving device through the ACL connection.
[0454] In some embodiments, a BIS identifier is configured for each audio receiving device in at least one audio receiving device, and after the configured BIS identifier is sent to at least one audio receiving device through an ACL connection, the Bluetooth module is controlled to broadcast at least one BIS stream, wherein each BIS stream may include BIS audio data and a BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain target BIS audio from multiple BIS streams and play their respective corresponding BIS audio, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0455] According to some embodiments of the present application, the audio processing method is applied to a system consisting of an electronic device and an audio receiving device. First, the electronic device controls a Bluetooth module to establish an ACL connection with multiple audio receiving devices. Then, type information sent by the multiple audio receiving devices via the ACL connection is obtained. Multiple audio receiving devices are selected from the multiple audio receiving devices based on the type information. The type information of the multiple audio receiving devices indicates that they support low-power Bluetooth services. Then, a device selection interface including a device identifier of each of the multiple audio receiving devices is displayed. In response to a user's selection operation for at least one device identifier, a BIS identifier is configured for each of the at least one audio receiving devices indicated by the at least one device identifier, and the corresponding BIS identifier is sent to each of the at least one audio receiving devices. Through this solution, at least one audio receiving device that supports low-power Bluetooth services can be selected from the already connected audio receiving devices based on the type information of the audio receiving devices, and the device identifier of the at least one audio receiving device is displayed, allowing the user to quickly and accurately select an audio receiving device for achieving a stereo effect for BIS configuration, thereby improving the user experience.
[0456] According to a schematic structural diagram of a terminal device in some embodiments of the present application, the terminal device may be the display device, control device, or audio receiving device described above. The terminal device may include: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the various processes of the following methods in the above-mentioned method embodiments: an audio processing method executed by the display device; an audio processing method executed by the control device; and an audio processing method executed by the audio receiving device.
[0457] According to some embodiments of the present application, a computer-readable non-volatile storage medium stores a computer program. When executed by a processor, the computer program implements the various processes of the above-described audio processing method and achieves the same technical effects. To avoid repetition, the details are not described here. The computer-readable non-volatile storage medium may be a read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk.
[0458] According to a computer program product of some embodiments of the present application, the computer program product may include a computer program, and when the computer program is run on a computer, the computer is enabled to implement the above-mentioned audio processing method.
[0459] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion of some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. An electronic device, include: At least one processor, and a Bluetooth module and a memory connected to the at least one processor; The memory is configured to: store computer instructions and / or data associated with the electronic device; The at least one processor is configured to execute the computer instructions to enable the electronic device to: control the Bluetooth module to obtain broadcast packets sent by a plurality of audio receiving devices to be connected through Bluetooth scanning; Determine, from the plurality of audio receiving devices, a plurality of audio receiving devices carrying target information in the broadcast packet, wherein the target information is used to indicate support for a low power Bluetooth service; Displaying a device selection interface, wherein the device selection interface includes a device identification of each audio receiving device among the multiple audio receiving devices; In response to a user's selection operation on at least one device identifier, the Bluetooth module is controlled to establish an access control list (ACL) connection with at least one audio receiving device indicated by the at least one device identifier, a broadcast isochronous stream (BIS) identifier is configured for each audio receiving device in the at least one audio receiving device, and the configured BIS identifier is sent to the at least one audio receiving device through the ACL connection.
2. The electronic device according to claim 1, wherein the target information includes any of the following: The advertising packet type information is a universal unique identifier UUID service, and the UUID indicates a receiving role device that supports low-power Bluetooth services; The advertising packet type information is Bluetooth feature service, and the Bluetooth feature is a dual-mode device that supports the classic Bluetooth BR / EDR protocol and the Bluetooth low energy BLE protocol; The advertising packet type information is Bluetooth feature service, and the Bluetooth feature is a device that supports low-power Bluetooth services; The advertising packet type information is device type service, and the device type is a speaker type device.
3. The electronic device according to claim 1, wherein the at least one processor is further configured to execute the computer instructions to cause the electronic device to perform: Before configuring the BIS identifier for each audio receiving device in the at least one audio receiving device, obtaining the channel information to be configured; When configuring the broadcast isochronous stream BIS identifier for each audio receiving device in the at least one audio receiving device, the at least one processor is further configured to execute the computer instructions to enable the electronic device to execute: Based on the channel information to be configured, a BIS identifier is configured for each audio receiving device in the at least one audio receiving device.
4. The electronic device according to claim 1, wherein the at least one processor is configured to execute the computer instructions to cause the electronic device to perform: Controlling the Bluetooth module to establish an ACL connection with the plurality of audio receiving devices; obtaining type information sent by the plurality of audio receiving devices through the ACL connection, and screening out a plurality of audio receiving devices from the plurality of audio receiving devices according to the type information, in, The type information of the multiple audio receiving devices indicates that they support low-power Bluetooth services; Displaying the device selection interface; In response to a user's selection operation on at least one device identifier, a BIS identifier is configured for each audio receiving device in at least one audio receiving device indicated by the at least one device identifier, and the configured BIS identifier is sent to the at least one audio receiving device.
5. The electronic device according to claim 4, wherein the type information of the plurality of audio receiving devices comprises at least one of the following situations: The type information of the multiple audio receiving devices is a device type service, and the device type is a Bluetooth speaker type or a Bluetooth headset type; The type information of the multiple audio receiving devices is a device attribute service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset; The type information of the multiple audio receiving devices is UUID service, and the UUID indicates support for low power audio service.
6. The electronic device according to claim 5, wherein the type information of the multiple audio receiving devices is a device type service, and the device type is a Bluetooth speaker class or a Bluetooth headset class; and the type information of the multiple audio receiving devices is a UUID service, and the UUID indicates support for low power audio services; When the at least one processor performs the step of selecting a plurality of audio receiving devices from the plurality of audio receiving devices according to the type information, the at least one processor is further configured to execute the computer instruction to enable the electronic device to perform: For each of the plurality of audio receiving devices, perform the following operations: According to the device type service of any audio receiving device among the plurality of audio receiving devices, determining whether the type of any audio receiving device is a Bluetooth speaker or a Bluetooth headset; If yes, query whether the UUID of any of the audio receiving devices is saved in the local storage space; In the case where the UUID service of any audio receiving device is not stored in the local storage space, querying, through a service discovery protocol or a common attribute protocol, whether the UUID of any audio receiving device indicates support for low power audio services; In a case where the UUID of any audio receiving device indicates support for low power audio service, it is determined that the any audio receiving device is one of the multiple audio receiving devices.
7. The electronic device according to claim 5, wherein the type information of the multiple audio receiving devices is a device attribute service, and the device attribute is a low-power Bluetooth speaker or a low-power Bluetooth headset; and the type information of the multiple audio receiving devices is a UUID service, and the UUID indicates support for low-power audio service; When the at least one processor performs the step of selecting a plurality of audio receiving devices from the plurality of audio receiving devices according to the type information, the at least one processor is further configured to execute the computer instruction to enable the electronic device to perform: For each of the plurality of audio receiving devices, perform the following operations: According to the device attribute service of any audio receiving device among the plurality of audio receiving devices, determining whether the any audio receiving device is a low-power Bluetooth speaker or a low-power Bluetooth headset; If yes, query whether the UUID service of any of the audio receiving devices is saved in the local storage space; When the UUID service of any one of the audio receiving devices is stored in the local storage space and the UUID of any one of the audio receiving devices indicates support for low power audio service, it is determined that any one of the audio receiving devices is one of the multiple audio receiving devices.
8. The electronic device according to claim 4, wherein the at least one processor, when executing the control of the Bluetooth module to establish an ACL connection with a plurality of audio receiving devices, is further configured to execute the computer instruction to enable the electronic device to execute: Acquire the Bluetooth link occupancy ratio of the Bluetooth module and / or the number of ACL connections that can be established simultaneously supported by the Bluetooth protocol stack; When the Bluetooth link occupancy rate of the Bluetooth module is less than a preset rate, and / or the Bluetooth protocol stack supports establishing multiple ACL connections simultaneously, scanning a plurality of audio receiving devices to be connected; Control the Bluetooth module to broadcast a periodic broadcast packet, wherein: The periodic broadcast packet is used to request to establish an ACL connection; When a response packet corresponding to the periodic broadcast packet is received, an ACL connection is established with the plurality of audio receiving devices.
9. The electronic device according to claim 1 or 4, wherein the electronic device is a display device, and the at least one processor is further configured to execute the computer instructions to enable the electronic device to perform: Control the Bluetooth module to broadcast at least one BIS stream, in, Each BIS stream includes BIS audio data and a BIS identifier corresponding to the BIS audio, so that the at least one audio receiving device obtains target BIS audio from the at least one BIS stream, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
10. The electronic device according to claim 4, wherein the at least one processor is further configured to execute the computer instructions to cause the electronic device to perform: After displaying the device selection interface, in response to a user's selection operation on at least one device identifier, configuring a BIS identifier for each audio receiving device in at least one audio receiving device indicated by the at least one device identifier, and before sending the configured BIS identifier to the at least one audio receiving device, obtaining the channel information to be configured; The at least one processor, when executing the step of configuring a BIS identifier for each audio receiving device in at least one audio receiving device indicated by the at least one device identifier, is further configured to execute the computer instructions to enable the electronic device to execute: Based on the channel information to be configured, a BIS identifier is configured for each audio receiving device in the at least one audio receiving device.
11. The electronic device according to claim 3 or 7, when executing the acquiring the channel information to be configured, the at least one processor is further configured to execute the computer instruction to enable the electronic device to execute: If the electronic device is a display device, then obtaining the channel information of the currently played audio media asset; determining the channel information to be configured that matches the channel information of the audio media asset from the channel information supported by the display device; or, If the electronic device is a control device, the channel information to be configured sent by the display device is received.
12. The electronic device according to claim 11, wherein the channel information to be configured includes but is not limited to at least one of the following: Channel information that is the same as the channel information of the audio media asset; The channel information having the most channels that are the same as the channel information of the audio media asset; The channel with the most channel information; The channel information with the highest frequency of user selection in history.
13. The electronic device according to claim 1, wherein the electronic device is a display device, and the at least one processor is configured to execute the computer instructions to enable the electronic device to perform: Acquire the channel information to be configured; control the Bluetooth module to determine a number of audio receiving devices to be connected through Bluetooth scanning; Control the Bluetooth module to establish an ACL connection with multiple audio receiving devices; configure a BIS identifier for each of the multiple audio receiving devices based on the channel information to be configured, and send the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection. in, The multiple audio receiving devices are part or all of the several audio receiving devices; Control the Bluetooth module to broadcast multiple BIS streams, wherein each BIS stream includes BIS audio data and a BIS identifier corresponding to the BIS audio, so that the multiple audio receiving devices obtain target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
14. The electronic device according to claim 13, wherein the at least one processor is further configured to execute the computer instructions to cause the electronic device to perform: A volume parameter is sent to each of the multiple audio receiving devices through the ACL connection.
15. The electronic device according to claim 13, wherein the at least one processor is further configured to execute the computer instructions to cause the electronic device to perform: After determining the plurality of audio receiving devices to be connected through Bluetooth scanning, before controlling the Bluetooth module to establish ACL connection with the plurality of audio receiving devices, the plurality of audio receiving devices supporting low-power Bluetooth are determined from the plurality of audio receiving devices.
16. The electronic device according to claim 15, when determining the plurality of audio receiving devices supporting Bluetooth low energy from the plurality of audio receiving devices, the at least one processor is further configured to execute the computer instructions to enable the electronic device to execute: Obtaining a UUID corresponding to each of the plurality of audio receiving devices; From the plurality of audio receiving devices, select the plurality of audio receiving devices whose device types indicated by the UUID are those supporting Bluetooth low energy consumption.
17. The electronic device according to claim 13, when executing the step of obtaining the channel information to be configured, the at least one processor is further configured to execute the computer instructions to enable the electronic device to execute: Get the channel information of the currently playing audio media; The channel information to be configured that matches the channel information of the audio media asset is determined from the channel information supported by the display device.
18. The electronic device according to claim 13, when executing the step of obtaining the channel information to be configured, the at least one processor is further configured to execute the computer instructions to enable the electronic device to execute: Receive a channel combination selection instruction; In response to the channel combination selection instruction, information of channels to be configured is obtained.
19. An audio receiving device, include: At least one processor, and a Bluetooth module, an audio output interface, and a memory connected to the at least one processor; The memory is configured to: store computer instructions and data associated with the audio receiving device; The at least one processor is configured to execute the computer instructions to cause the audio receiving device to perform: Controlling the Bluetooth module to send a broadcast packet, wherein the broadcast packet carries target information, and the target information is used to indicate support for low-power Bluetooth services; Control the Bluetooth module to establish an access control list (ACL) connection with the electronic device; and receive a broadcast isochronous stream (BIS) identifier configured by the electronic device through the ACL connection.
20. The audio receiving device according to claim 19, wherein the target information includes any of the following: The broadcast packet type information is a universal unique identifier UUID service, and the UUID indicates a receiving role device that supports low-power Bluetooth service; The advertising packet type information is Bluetooth feature service, and the Bluetooth feature is a dual-mode device that supports the classic Bluetooth BR / EDR protocol and the Bluetooth low energy BLE protocol; The advertising packet type information is Bluetooth feature service, and the Bluetooth feature is a device that supports low-power Bluetooth services; The advertising packet type information is device type service, and the device type is a speaker type device.
21. The audio receiving device of claim 19, wherein the at least one processor is configured to execute the computer instructions to cause the audio receiving device to: Controlling the Bluetooth module to establish an ACL connection with the electronic device; Sending type information to the electronic device through the ACL connection, in, The type information is used to indicate support for low-power Bluetooth services; The BIS identifier configured by the electronic device is received through the ACL connection.
22. The audio receiving device of claim 19, wherein the at least one processor is further configured to execute the computer instructions to cause the audio receiving device to: Controlling the Bluetooth module to receive a scanning signal sent by a display device; In response to a scan signal sent by the display device, control the Bluetooth module to establish an ACL connection with the display device; and receive a BIS identifier configured by the display device through the ACL connection; Control the Bluetooth module to receive multiple BIS streams, wherein each BIS stream includes BIS audio data and a BIS identifier corresponding to the BIS audio; obtain a target BIS audio from the multiple BIS audios, wherein the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier; Control the audio output interface to play the target BIS audio.
23. The audio receiving device of claim 22, wherein the at least one processor is further configured to execute the computer instructions to cause the audio receiving device to: The Bluetooth module is controlled to receive the volume parameter sent by the display device through the ACL connection.
24. An audio processing method for an electronic device, include: Control the Bluetooth module to obtain broadcast packets sent by several audio receiving devices to be connected through Bluetooth scanning; Determine, from the plurality of audio receiving devices, a plurality of audio receiving devices carrying target information in the broadcast packet, wherein the target information is used to indicate support for the low power consumption Bluetooth service; Displaying a device selection interface, wherein the device selection interface includes a device identification of each audio receiving device among the multiple audio receiving devices; In response to a user's selection operation on at least one device identifier, the Bluetooth module is controlled to establish an access control list (ACL) connection with at least one audio receiving device indicated by the at least one device identifier, a broadcast isochronous stream (BIS) identifier is configured for each audio receiving device in the at least one audio receiving device, and the configured BIS identifier is sent to the at least one audio receiving device through the ACL connection.
25. An audio processing method for an audio receiving device, include: Controlling the Bluetooth module to send a broadcast packet, wherein the broadcast packet carries target information, and the target information is used to indicate support for low-power Bluetooth services; Control the Bluetooth module to establish an access control list (ACL) connection with the electronic device; and receive a broadcast isochronous stream (BIS) identifier configured by the electronic device through the ACL connection.
