Display device and audio control method
Patent Information
- Application Number
- CN202480021187.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-12-29
- Filing Date
- 2024-01-31
- Publication Date
- 2025-12-09
AI Technical Summary
When existing Bluetooth audio devices turn on Bluetooth broadcast, the volume may be low, which affects the user experience. Especially in the context of supporting low-power audio (LE Audio) technology, it is difficult for display devices to play audio data normally.
By implementing the configuration of the Bluetooth module and processor in the display device, receiving the Bluetooth broadcast starts the trigger operation, determines the target audio receiving device, and connects based on the Voice Control Profile (VCP) protocol to send the preset volume value to the target audio receiving device. Adjust the volume of audio data.
It effectively solves the problem of insufficient volume, ensures that users can listen to music normally when using low-power audio technology, and improves the user experience.
Smart Images

Figure CN121100529A_ABST
Abstract
Description
Display device and audio control method
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This disclosure claims the priority of the Chinese patent application with application number 202311791243.7 filed with the State Intellectual Property Office of the People's Republic of China on December 25, 2023; claims the priority of the Chinese patent application with application number 202311864227.6 filed with the State Intellectual Property Office of the People's Republic of China on December 29, 2023; and claims the priority of the Chinese patent application with application number 202310331670.0 filed with the State Intellectual Property Office of the People's Republic of China on March 30, 2023, the entire contents of which are incorporated into this disclosure by reference. Technical Field
[0003] The present disclosure relates to the field of Bluetooth technology, and in particular to a display device and an audio control method. Background Art
[0004] With the introduction of Bluetooth Low Energy Audio (LE Audio), a new generation of Bluetooth audio technology, more and more display devices and audio receivers are now supporting the Bluetooth Low Energy Audio (LE Audio) protocol. Currently, when a display device broadcasts Bluetooth, the LE Audio device used to play the audio data broadcast by the display device may have a low volume, making it difficult for users to listen to music properly and affecting the user experience.
[0005] Summary of the Invention
[0006] In a first aspect, the present disclosure provides a display device, comprising: a display configured to display an identifier of at least one scanned broadcast signal source; a user interface configured to receive instructions from a user; a Bluetooth module configured to perform Bluetooth broadcasting; a communicator configured to communicate with an external device according to a predetermined protocol; a memory configured to store computer instructions and data associated with the display device; at least one processor connected to the display, user interface, Bluetooth module, communicator and memory, configured to execute computer instructions so that the display device performs: receiving a start trigger operation for Bluetooth broadcasting; determining a target audio receiving device; wherein the target audio receiving device is a low-power audio LE audio device that has established an isochronous stream CIS connection with the display device; if it is determined that the Bluetooth broadcast is successfully started, a preset volume value is sent to the target audio receiving device based on the voice control specification VCP protocol connection; wherein the preset volume value is used to adjust the volume of audio data played synchronously by the target audio receiving device.
[0007] In a second aspect, the present disclosure provides an audio control method, comprising:
[0008] Receive a trigger operation for starting Bluetooth broadcasting; determine a target audio receiving device; wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device; if it is determined that the Bluetooth broadcast is successfully started, send a preset volume value to the target audio receiving device based on the VCP protocol connection; wherein the preset volume value is used to adjust the volume of the audio data played synchronously by the target audio receiving device. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] FIG1 is a schematic diagram of one-to-one audio transmission of unicast media audio according to some embodiments;
[0010] FIG2 is a schematic diagram of a one-to-two audio transmission of unicast media audio according to some embodiments;
[0011] FIG3 is a schematic diagram of a scenario of an audio control method according to some embodiments;
[0012] FIG4 is a schematic diagram of another scenario of an audio control method according to some embodiments;
[0013] FIG5 is a block diagram of a configuration of a control device 100 according to some embodiments;
[0014] FIG6 is a block diagram illustrating a configuration of a display device 200 according to some embodiments;
[0015] FIG7 is a block diagram of a hardware configuration of a terminal device 300 according to some embodiments;
[0016] FIG8 is a block diagram of a configuration of an audio receiving device 400 according to some embodiments;
[0017] FIG9 is a schematic diagram of an operating system of a display device 200 according to some embodiments;
[0018] FIG10 is a schematic diagram of a software system architecture of a display device 200 according to some embodiments;
[0019] FIG11 is a flow chart of an audio control method according to some embodiments;
[0020] FIG12 is a schematic diagram of a device management page according to some embodiments;
[0021] FIG13 is another flowchart of an audio control method according to some embodiments;
[0022] FIG14 is another schematic flow chart of an audio control method according to some embodiments;
[0023] FIG15 is a schematic diagram of a process of enabling Bluetooth broadcasting according to some embodiments;
[0024] FIG16 is a schematic diagram of switching from an audio output channel to a target output channel according to some embodiments;
[0025] FIG17 is a schematic diagram of a process for disabling Bluetooth broadcasting according to some embodiments;
[0026] FIG18 is a schematic diagram illustrating the relationship between extended broadcast, periodic broadcast, and BIS according to some embodiments;
[0027] FIG19 is a schematic diagram of continuously sending BIG according to some embodiments;
[0028] FIG20 illustrates a configuration method for broadcasting BIS audio according to some embodiments;
[0029] FIG21 illustrates another configuration for broadcasting BIS audio according to some embodiments;
[0030] FIG22 illustrates another configuration for broadcasting BIS audio according to some embodiments;
[0031] FIG23 is a schematic diagram of another scenario of an audio control method according to some embodiments;
[0032] FIG24 is a schematic diagram of another scenario of an audio control method according to some embodiments;
[0033] FIG25 is a schematic diagram of another scenario of an audio control method according to some embodiments;
[0034] FIG26 is another flowchart of an audio control method according to some embodiments;
[0035] FIG27 is a schematic diagram of an interface for displaying an application logo of a Bluetooth speaker application on a display device according to some embodiments;
[0036] FIG28 is a schematic diagram of an interface for selecting a channel combination according to some embodiments;
[0037] FIG29 is a schematic diagram of an audio output mode selection interface according to some embodiments;
[0038] FIG30 is a schematic diagram of a settings interface for configuring a speaker combination according to some embodiments;
[0039] FIG31 is a schematic diagram of an interface for scanning audio receiving devices according to some embodiments;
[0040] FIG32 is a schematic diagram of a pairing interface according to some embodiments;
[0041] FIG33 is a schematic diagram of an interface of configuration information after speaker configuration according to some embodiments;
[0042] FIG34 is a schematic diagram of an audio media playback interface according to some embodiments;
[0043] FIG35 is a schematic diagram of a channel combination selection interface according to some embodiments;
[0044] FIG36 is a schematic diagram of another channel combination selection interface according to some embodiments;
[0045] FIG37 is a schematic diagram of a volume adjustment interface according to some embodiments;
[0046] FIG38 is a schematic diagram of another configuration interface for configuring a speaker combination according to some embodiments;
[0047] FIG39 is a schematic diagram of an interface for outputting prompt information according to some embodiments;
[0048] FIG40 is a schematic diagram of a setting success interface according to some embodiments;
[0049] FIG41 is a schematic diagram of a channel and volume configuration interface according to some embodiments;
[0050] FIG42 is a schematic diagram of a configuration-completed interface according to some embodiments;
[0051] FIG43 is a schematic diagram of a volume adjustment interface according to some embodiments;
[0052] FIG44 is another flowchart of an audio control method according to some embodiments;
[0053] FIG45 is a schematic diagram of an interface for triggering the launch of a broadcast assistant application according to some embodiments;
[0054] FIG46 is a schematic diagram of a control terminal scanning for available Bluetooth speakers according to some embodiments;
[0055] FIG47 is a diagram illustrating configuring channels for a connected Bluetooth speaker according to some embodiments;
[0056] FIG48 is a schematic diagram of an interface for adjusting volume through a control terminal according to some embodiments;
[0057] FIG49 is a schematic diagram of a channel selection interface according to some embodiments;
[0058] FIG50 is a schematic diagram of an interface for setting a left front speaker according to some embodiments;
[0059] FIG51 is another flowchart of an audio control method according to some embodiments;
[0060] FIG52 is a schematic diagram of the hardware structure of an electronic device according to some embodiments. DETAILED DESCRIPTION
[0061] The display device and audio receiving device provided in this disclosure can both support Bluetooth Low Energy Audio (LE Audio) technology, wherein the display device serves as an audio playback device or a device for configuring an audio receiving device. In embodiments of this disclosure, the display device can be a television, mobile phone, projector, etc., and the audio receiving device can be a Bluetooth speaker, Bluetooth headset, etc.
[0062] Compared with classic Bluetooth, LE Audio has the following advantages:
[0063] 1. One audio playback device can be connected to multiple audio receiving devices at the same time;
[0064] 2. A broadcast audio device can send broadcast audio to an unlimited number of audio receiving devices, supporting encrypted broadcasting;
[0065] 3. Adopt the latest Low Complexity Communication Codec (LC3) audio format, and the sound quality is improved;
[0066] 4. Support Internet phone and HD calls;
[0067] 5. Support hearing aid / assisted listening applications.
[0068] The LE Audio application layer specification Telephony and Media Audio Profile (TMAP) defines two media audio applications: unicast media audio and broadcast media audio.
[0069] Unicast media audio
[0070] Compared to the current Bluetooth Classic media audio specification (Advanced Audio Distribution Profile, A2DP), the unicast media audio in TMAP utilizes a more advanced audio codec to provide better sound quality and offers richer control features than the current Bluetooth Classic media playback control specification (Audio / Video Remote Control Profile, AVRCP). TMAP defines two roles for unicast media audio applications: the Unicast Media Sender (UMS) and the Unicast Media Receiver (UMR). Unicast media audio transmission is achieved between the UMS and UMR using a Connected Isochronous Stream (CIS).
[0071] It should be noted that the unicast media audio defined in TMAP is not limited to one-to-one audio transmission, but also supports a unicast media sender transmitting unicast media audio to two unicast media receivers.
[0072] Figure 1 is a schematic diagram of one-to-one unicast media audio transmission in the related art. As shown in Figure 1 , UMS 11 sends unicast media audio to UMR 12 .
[0073] Figure 2 is a schematic diagram of one-to-two audio transmission of unicast media audio in the related art. As shown in Figure 2, UMS 21 sends unicast media audio to UMR 22 and UMR 23 respectively.
[0074] Broadcast Media Audio
[0075] Broadcast media audio in TMAP is transmitted synchronously over multiple connectionless broadcast isochronous streams (BIS). The biggest advantage of broadcast media audio is that it can transmit audio data synchronously to multiple audio receiving devices.
[0076] The broadcast synchronization channel for broadcast media audio in TMAP utilizes two concepts: the Boardcast Isochronous Group (BIG) and the BIS. An audio transmitter can simultaneously transmit multiple BIGs. Each BIG can consist of multiple BISs, and a BIG can contain up to 31 BISs. Each BIS has a unique access address, generated using a unified algorithm based on the seed access address of the BIG to which it belongs.
[0077] Broadcast media audio may include multiple broadcasts with different access addresses. In an embodiment of the present disclosure, the broadcast media audio may include:
[0078] Extended Advertising: This is an extended advertisement on the main advertising channel. It uses the ADV_EXT_IND packet and uses time and frequency information to point to the subsidiary advertisement. Its access address uses the main advertising access address specified in the Bluetooth core specification: 0x8E89BED6.
[0079] Periodic Advertising: Ancillary advertising uses AUX_ADV_IND packets and points to the periodic advertising through time, frequency hopping map, and access address. The periodic advertising uses AUX_SYNC_IND packets and contains BIG information (BIGInfo).
[0080] Broadcast Isochronous Stream (BIS): A broadcast isochronous stream that periodically broadcasts digital audio using a time, frequency hopping map, access address, and BIGInfo pointing to the BIS. The BIS is encapsulated in BIS Protocol Data Unit (PDU).
[0081] The audio control method of the embodiment of the present disclosure can be implemented through a display device and an audio receiving device. The display device can be a mobile phone, a television, a computer, etc. The audio receiving device can be a speaker, a headset, a keyboard, a mouse, etc. The audio control method provided in the embodiment of the present disclosure mainly involves a pairing connection phase and a low-power Bluetooth device scanning phase. The pairing connection phase is mainly implemented through a display device and / or a control terminal. Among them, the control terminal can be a mobile terminal, for example, a mobile phone, a tablet computer, a remote control, a wearable device, etc., which can be used to establish a Bluetooth connection with the target device. Among them, the wearable device can be a smart watch, a smart bracelet, etc.
[0082] Figure 3 is a schematic diagram of a scenario of an audio control method according to some embodiments. As shown in Figure 3 , the scenario architecture according to some embodiments includes: a control device 100 , a display device 200 , a terminal device 300 , and an audio receiving device 400 .
[0083] The user can operate the display device 200 through the terminal device 300 or the control apparatus 100. A CIS connection is established between the display device 200 and the audio receiving device 400. The display device 200 can send a preset volume value to the audio receiving device 400 through a VCP protocol connection between the display device 200 and the audio receiving device 400.
[0084] According to some embodiments, the display device 200 may have various implementation forms, for example, the display device 200 may be a television, a smart speaker refrigerator with a display function, curtains with a display function, a personal computer (PC), a laser projection device, a monitor, an electronic whiteboard, a wearable device, an in-vehicle device, an electronic table, etc. This disclosure does not limit this.
[0085] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device 200 may be via infrared protocol, Bluetooth protocol, or other short-range communication methods, allowing the display device 200 to be controlled wirelessly or wired. A user may control the display device 200 by inputting user commands via buttons on the remote control, voice input, control panel input, etc. In some embodiments, the control device 100 may also be a terminal device (such as a mobile phone, tablet computer, computer, laptop computer, etc.). For example, the display device 200 may be controlled using an application running on the terminal device.
[0086] In some embodiments, the display device 200 may also be controlled by a terminal device 300 (such as a mobile phone, tablet computer, computer, laptop computer, etc.). For example, the display device 200 may be controlled by an application running on a smart device.
[0087] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100. For example, the display device 200 can directly receive the user's voice command control through a module for obtaining voice commands configured inside the display device 200, or receive the user's key operations through physical buttons on the display device 200, or receive the user's touch operations through the touch control panel of the display device 200.
[0088] In some embodiments, the display device 200 may also communicate with a server to obtain relevant media resources from the server. The display device 200 may be connected to the server via a local area network (LAN) or a wireless local area network (WLAN). The server may provide media resource services and various content and interactions to the display device 200. The server may be a single cluster or multiple clusters, and may include one or more types of servers.
[0089] FIG4 is another schematic diagram of an audio control method according to some embodiments. As shown in FIG4 , the scenario architecture according to some embodiments includes: a control device 100, a display device 200, a terminal device 300, an audio receiving device 400, an audio receiving device 500, and an audio receiving device 600. The audio receiving device 400 and the audio receiving device 500 are both audio receiving devices that support the LE audio protocol. Next, the audio receiving device 400 is used as an example of the target audio receiving device of the embodiment of the present disclosure.
[0090] The user can operate the display device 200 through the terminal device 300 or the control device 100. When the display device 200 receives a start trigger operation for Bluetooth broadcasting, it first determines the target audio receiving device (i.e., the audio receiving device 400) through the LE audio device that has established a CIS connection with the display device, and then determines whether the audio receiving device 400 belongs to any one or more device groups. If it is determined that the audio receiving device 400 belongs to any device group, a preset volume value is sent to the audio receiving devices in the device group based on the VCP protocol. For example, the preset volume value is sent to the audio receiving device 400 and the audio receiving device 500 in the device group to which the audio receiving device 400 belongs, so that the audio receiving device 400 and the audio receiving device 500 adjust the volume of the audio data played synchronously based on the preset volume value.
[0091] Figure 5 illustrates a block diagram of the configuration of the control device 100 in the embodiment shown in Figures 3 or 4. As shown in Figure 5, the control device 100 includes at least one of a processor 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input of operational instructions, convert the operational instructions into instructions that the display device 200 can recognize and respond to, and transmit the operational instructions or the instructions converted from voice instructions to the display device 200, acting as an intermediary for interaction between the user and the display device 200.
[0092] FIG6 exemplarily shows a block diagram of a configuration of the display device 200 in the embodiment shown in FIG3 or FIG4. As shown in FIG6, the display device 200 includes: a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, and at least one of a user interface.
[0093] In some embodiments, the tuner / demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. In some embodiments, the tuner / demodulator 210 can be located in different separate devices, that is, the tuner / demodulator 210 can also be located in a device external to the physical device where the processor 250 is located, such as an external set-top box.
[0094] Communicator 220 is a component used to communicate with external devices using various communication protocols. For example, communicator 220 may include at least one of a WiFi module, a Bluetooth module, a wired Ethernet module, or other network communication protocol chip, a near-field communication protocol chip, and an infrared receiver. Display device 200 can transmit and receive control signals and data signals with external devices via communicator 220.
[0095] Detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or detector 230 includes an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or detector 230 includes a sound collector, such as a microphone, for receiving external sounds.
[0096] The external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by multiple of the above interfaces.
[0097] Processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. Processor 250 controls the overall operation of display device 200. For example, in response to receiving a user command to select a UI object to be displayed on display 260, processor 250 may perform operations related to the object selected by the user command.
[0098] In some embodiments, the processor includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.
[0099] The display 260 includes a display screen component for presenting images, a driving component for driving image display, a component for receiving image signals output from a processor, and a component for displaying video content, image content, and a menu control interface and a user control UI interface.
[0100] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.
[0101] The user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific voice or gesture, and the user interface may recognize the voice or gesture through a sensor to receive the user input command.
[0102] The user interface is the medium for interaction and information exchange between an application or operating system and the user. It converts information between its internal form and a user-friendly form. A common user interface is the graphical user interface (GUI), which refers to a graphical user interface related to computer operations. It can be an icon, window, control, or other interface element displayed on an electronic device's display. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0103] The audio output interface 270 is an audio output component for outputting audio signals, including a speaker, an external audio output terminal, etc.
[0104] The user interface may be used to receive control signals input by the user through the control device 100 (eg, an infrared remote controller, etc.) or through touch or gestures.
[0105] For the scenario shown in FIG3 , when implementing the audio control method according to some embodiments, each component in the display device 200 may implement the following functions:
[0106] In some embodiments, at least one processor 250 is configured to execute computer instructions so that the display device:
[0107] Receive a trigger operation for starting Bluetooth broadcasting; determine a target audio receiving device; wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device; if it is determined that the Bluetooth broadcast is successfully started, send a preset volume value to the target audio receiving device based on the VCP protocol connection; wherein the preset volume value is used to adjust the volume of the audio data played synchronously by the target audio receiving device.
[0108] When the above-mentioned display device receives the Bluetooth broadcast start trigger operation, it can send the preset volume value for adjusting the volume of the audio data to the audio receiving device based on the VCP protocol connection, so that the audio receiving device can adjust the volume gain to a more normal value before playing the audio data, thereby improving the user experience.
[0109] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0110] The determining of the target audio receiving device includes: monitoring whether a UMS connection event of the LE audio device occurs; if the UMS connection event of the LE audio device is monitored, determining the LE audio device as the target audio receiving device.
[0111] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0112] The determining of the target audio receiving device includes: determining whether there is an LE audio device in a CIS connection with the display device; if it is determined that there is an LE audio device in a CIS connection with the display device, determining the LE audio device as the target audio receiving device.
[0113] In some embodiments, after determining the LE audio device as the target audio receiving device, the at least one processor 250 is further configured to execute computer instructions to cause the display device to:
[0114] The audio module is controlled to disconnect the target audio receiving device from the CIS connection and mute the music stream.
[0115] In some embodiments, when the audio module is controlled to disconnect the target audio receiving device from the CIS connection and mute the music stream, at least one processor 250 is configured to execute computer instructions to cause the display device to:
[0116] Control the Bluetooth protocol stack to set the UMS working mode of the target audio receiving device to the inactive state, and set the BMS working mode of the target audio receiving device to the active state; after monitoring the target event, control the audio module to mute the music stream, and perform Bluetooth audio offline processing on the target audio receiving device, and cut off the audio routing strategy from the LE audio hal; wherein, the target event includes an event that sets the UMS working mode of the target audio receiving device to the inactive state.
[0117] In some embodiments, after the audio routing policy is switched off from the LE audio hall, the at least one processor 250 is further configured to execute computer instructions to cause the display device to:
[0118] Control the Bluetooth protocol stack to create a Bluetooth broadcast and start the Bluetooth broadcast; if it is determined that the Bluetooth broadcast is successfully started, control the audio module to switch the audio routing strategy back to LE audio hal.
[0119] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0120] If it is determined that the Bluetooth broadcast fails to start, the current system volume value of the target audio receiving device is obtained; based on the VCP protocol connection, the current system volume value is sent to the target audio receiving device; wherein, the current real volume value is used to adjust the volume of the audio data played synchronously by the target audio receiving device.
[0121] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0122] The preset volume value is 60%-70%, 70%-75% or 75%.
[0123] For the scenario shown in FIG4 , when implementing the audio control method according to some embodiments, each component in the display device 200 may implement the following functions:
[0124] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0125] Receive a trigger operation for starting Bluetooth broadcasting; determine a target audio receiving device; wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device; if it is determined that the Bluetooth broadcast is successfully started, send a preset volume value to the target audio receiving device based on the VCP protocol connection; wherein the preset volume value is used to adjust the volume of the audio data played synchronously by the target audio receiving device.
[0126] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0127] Determine whether the target audio receiving device belongs to any one or more device groups; if it is determined that the target audio receiving device belongs to any one or more device groups, send the preset volume value to the audio receiving devices in any one or more device groups, so that the audio receiving devices adjust the volume of the synchronously played audio data based on the preset volume value.
[0128] FIG7 exemplarily shows a hardware configuration block diagram of the terminal device 300 in the embodiment shown in FIG3 or FIG4. It should be understood that the terminal device 300 shown in FIG7 is merely an example, and the terminal device 300 may have more or fewer components than shown in FIG7, may combine two or more components, or may have different component configurations. The various components shown in FIG7 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.
[0129] As shown in Figure 7, the terminal device 300 includes: a radio frequency (RF) circuit 310, a memory 320, a display unit 330, a camera 340, a sensor 350, an audio circuit 360, a wireless fidelity (Wi-Fi) module 370, a processor 380, a Bluetooth module 381, and a power supply 390.
[0130] The RF circuit 310 can be used to receive and transmit signals during information transmission or calls. It can receive downlink data from the base station and pass it to the processor 380 for processing; it can also transmit uplink data to the base station. The memory 320 can be used to store software programs and data. The memory 320 stores the operating system that enables the terminal device 300 to operate. In the present disclosure, the memory 320 can store the operating system and various application programs. It can also store program code that executes the channel configuration processing method implemented by the control terminal in some embodiments of the present disclosure.
[0131] The display unit 330 can be used to receive input digital or character information and generate signal input related to user settings and function control of the terminal device 300. Specifically, the display unit 330 may include a touch screen 331 set on the front of the terminal device 300, which can collect user touch operations on or near it, such as clicking a button.
[0132] The display unit 330 can also be used to display information input by the user or provided to the user, as well as a graphical user interface (GUI) for various menus of the terminal device 300. The display unit 330 may include a display screen 332 disposed on the front of the terminal device 300. A touch screen 331 may be overlaid on the display screen 332, or the touch screen 331 and the display screen 332 may be integrated to implement the input and output functions of the terminal device 300. The integrated touch screen may be referred to as a touch screen display. The terminal device 300 may also include at least one sensor 350, such as an acceleration sensor 351, a distance sensor 352, a fingerprint sensor 353, and a temperature sensor 354.
[0133] Audio circuit 360, speaker 361, and microphone 362 provide an audio interface between the user and terminal device 300. Wi-Fi is a short-range wireless transmission technology. Terminal device 300 can help users send and receive emails, browse web pages, and access streaming media through Wi-Fi module 370, providing users with wireless broadband Internet access.
[0134] The processor 380 is the control center of the terminal device 300. It connects the various components of the entire control terminal using various interfaces and lines. It executes the various functions of the terminal device 300 and processes data by running or executing software programs stored in the memory 320 and accessing data stored in the memory 320. In some embodiments, the processor 380 may include one or more processing units; the processor 380 may also integrate an application processor and a baseband processor, wherein the application processor primarily processes the operating system, user interface, and application programs, while the baseband processor primarily handles wireless communications. It is understood that the baseband processor may not be integrated into the processor 380. In the present disclosure, the processor 380 can run the operating system, application programs, user interface display, and touch response.
[0135] The Bluetooth module 381 is used to exchange information with other Bluetooth devices equipped with a Bluetooth module via the Bluetooth protocol. For example, the terminal device 300 can establish a Bluetooth connection with a display device equipped with a Bluetooth module via the Bluetooth module 381 to exchange data. The terminal device 300 also includes a power supply 390 (e.g., a battery) to power various components.
[0136] FIG8 exemplarily illustrates a block diagram of the configuration of the audio receiving device 400 in the embodiment shown in FIG3 or FIG4 . As shown in FIG8 , the audio receiving device 400 includes: a processor 410, a communicator 420, a user input / output interface 430, a memory 440, and a power supply 450. The communicator 420 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or an alternative module. The user input / output interface 430 includes at least one of a speaker, a microphone, a touchpad, a sensor, a button, or an alternative module.
[0137] As shown in Figure 9, in some embodiments, the operating system of the display device 200 is divided into four layers, from top to bottom, namely, the application (Applications) layer (referred to as "application layer"), the application framework (ApplicationFramework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.
[0138] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, clock programs, etc. that come with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.
[0139] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.
[0140] As shown in Figure 9, the application framework layer in the embodiment of the present disclosure includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to applications currently installed on the device; a notification manager (Notification Manager) is used to control the display and clearing of notification messages; and a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0141] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling the exit, opening, and backing of an application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling display window changes (such as shrinking the display window, shaking the display, distorting the display, etc.).
[0142] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.
[0143] In some embodiments, the kernel layer is a layer between hardware and software. As shown in FIG8 , the kernel layer includes at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a Wi-Fi driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver.
[0144] Figure 10 is a schematic diagram of the software system architecture of a display device 200 according to some embodiments. As shown in Figure 10 , the software system may include: an application (App) layer, a system framework (Framework) layer (referred to as the "Framework layer"), a dynamic library (Library), and a Bluetooth driver (Bluetooth Driver).
[0145] The application layer includes: TV settings (TVSettings) or TV services (TVService).
[0146] The system framework layer includes: Bluetooth interface (Bluetooth API), Bluetooth application (Bluetooth APK) and audio (audio) module.
[0147] Bluetooth applications include: A2DP application specifications, LE Audio application specifications, and Hearing Aid application specifications. A2DP (Advanced Audio Distribution Profile) application specifications are media audio application specifications in classic Bluetooth, LE Audio application specifications are low-power audio application specifications based on Bluetooth, and Hearing Aid application specifications are hearing aid application specifications based on Bluetooth Low Energy (BLE).
[0148] The dynamic library includes the Bluetooth protocol stack and the Bluetooth audio HAL layer. The Bluetooth protocol stack is responsible for scanning, connecting, and configuring Bluetooth devices. When establishing a Bluetooth connection with a Bluetooth device, the display device can send relevant data to the Bluetooth protocol stack through the Bluetooth application in the display device.
[0149] The audio module may include an audio manager, an audio service, etc. The audio module is mainly responsible for sending audio-related data from Bluetooth applications to the Bluetooth protocol stack.
[0150] The Bluetooth driver is mainly responsible for the Bluetooth connection between the display device and surrounding Bluetooth devices.
[0151] The Bluetooth protocol stack also includes the Generic Audio Framework (GAF); GAF also includes the Common Audio Profile (CAP), Common Audio Service (CAS), audio stream management, and volume control. Audio stream management includes the Basic Audio Profile (BAP), Audio Capability Presentation Service (PACS), Audio Stream Control Service (ASCS), and Broadcast Audio Scan Service (BASS). Volume control includes the Volume Control Profile (VCP), Volume Control Service (VCS), Voice Offset Control Service (VOCS), and Audio Input Control Service (AICS).
[0152] In the embodiment of the present disclosure, when the display device controls its own volume and adjusts the volume of audio data played synchronously by the audio receiving device, it can be achieved through the voice control specification VCP involved in volume control.
[0153] Corresponding to the scenario diagram shown in FIG3 , an embodiment of the present disclosure provides an audio control method as shown in FIG11 . FIG11 is a flowchart of an audio control method according to some embodiments. As shown in FIG11 , the method may include but is not limited to the following steps S1101-S1103:
[0154] S1101: Receive a start trigger operation for Bluetooth broadcasting.
[0155] In actual applications, when playing audio data of the display device based on audio output channels such as the local speaker output channel and the USB audio output channel, the volume bar can be used to adjust the volume of the audio data played by the current audio output channel. During the actual adjustment process, the volume of the audio data may be adjusted to a lower value. If Bluetooth broadcasting is turned on at this time, since the current system volume value of the LE audio device connected to the display device may also be at a lower value, after broadcasting audio data to the LE audio device, the volume of the audio data actually played by the LE audio device may be lower, affecting the user's normal listening experience.
[0156] The audio output channels may include local speaker output channels, Universal Serial Bus (USB) audio output channels, High Definition Multimedia Interface (HDMI) output channels, and other more traditional output channels.
[0157] In order to ensure that the volume of the audio data played synchronously by the LE audio device is at a relatively reasonable value and does not affect the user's listening experience, the display device in the embodiment of the present disclosure can send a preset volume value for adjusting the volume to the target audio receiving device based on the VCP protocol connection between the display device and the target audio receiving device after successfully turning on the Bluetooth broadcast, so that the target audio receiving device can synchronize the volume of the audio data played based on the preset volume value.
[0158] In the embodiment of the present disclosure, the triggering operation for starting Bluetooth broadcasting may include: clicking on a control to start Bluetooth broadcasting on a device management page to trigger an operation of entering a Bluetooth broadcasting page, etc.
[0159] As shown in Figure 12, this is a schematic diagram of a device management page according to some embodiments, wherein a Bluetooth broadcast start control is displayed on the page. When a user clicks on the Bluetooth broadcast start control, an LE audio device that has established a CIS connection with the display device is determined as a target audio receiving device for receiving audio data broadcast by the display device.
[0160] S1102: Determine a target audio receiving device; wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device.
[0161] In an embodiment of the present disclosure, when the display device receives a start trigger operation for Bluetooth broadcasting, it first determines the LE audio device that has established a CIS connection with the display device as the target audio receiving device, so that it can subsequently send a preset volume value to the target audio receiving device based on the VCP connection, and broadcast audio data to the target audio receiving device.
[0162] In some embodiments, the display device may further establish a UMS connection with the LE audio device after starting Bluetooth broadcasting, and broadcast audio data to the LE audio device after the UMS connection is successful.
[0163] In actual applications, when the display device establishes a UMS connection with the LE audio device, it can monitor the UMS connection events of the LE audio device in real time. Therefore, after turning on Bluetooth broadcasting, the display device can also determine whether the display device currently has a UMS connection with the LE audio device by monitoring the UMS connection events of the LE audio device. When monitoring the UMS connection event of the LE audio device, the LE audio device corresponding to the UMS connection event is determined as the target audio receiving device for synchronously playing the audio data of the display device.
[0164] In some embodiments, the display device may also, after turning on Bluetooth broadcast, first determine whether there is an LE audio device that is CIS-connected to the display device; if it is determined that there is currently no LE audio device that is CIS-connected to the display device (i.e., the display device has not been paired and connected to an LE audio device), then monitor whether a UMS connection event of the LE audio device occurs within a preset time period; if it is determined that a UMS connection event of the LE audio device occurs within the preset time period, then the LE audio device corresponding to the UMS event is determined as the target audio receiving device for synchronously playing the audio data of the display device.
[0165] S1103: If it is determined that the Bluetooth broadcast is successfully turned on, a preset volume value is sent to the target audio receiving device based on the VCP protocol connection; wherein the preset volume value is used to adjust the volume of the audio data synchronously played by the target audio receiving device.
[0166] In an embodiment of the present disclosure, after determining that an LE audio device has established a CIS connection with the display device, the display device can also, when determining that the Bluetooth broadcast is successfully turned on, send a preset volume value to the target audio receiving device based on the VCP protocol (Volume Control Profile) connection, so that after receiving the preset volume value, the target audio receiving device can adjust the playback volume of the audio data based on the preset volume value, so that the user can listen normally.
[0167] In some embodiments, the preset volume value may be 60%-70%, 70%-75% or 75%, etc. In an embodiment of the present disclosure, assuming that the initial volume of the target audio receiving device is 50, when the target audio receiving device receives the preset volume value sent by the display device, for example 75%, the volume of the audio data is adjusted from 50 to 192 (i.e., the default volume 256×75%).
[0168] In some embodiments, while the display device is broadcasting audio data to the target audio receiving device based on Bluetooth broadcasting, it can also play the audio data through audio output channels such as the local speaker output channel and the USB audio output channel, that is, while broadcasting the audio data, it can also play the audio data through the local speaker.
[0169] In some embodiments, if it is determined that the Bluetooth broadcast fails to start, the current system volume value of the target audio receiving device is obtained from the audio module, and then based on the VCP connection, the current system volume value is sent to the target audio receiving device, so that the target audio receiving device adjusts the volume of the audio data played synchronously based on the current system volume value.
[0170] According to the audio control method of some embodiments, first, a start trigger operation for Bluetooth broadcasting is received; then, a target audio receiving device is determined, wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device; then, if it is determined that the Bluetooth broadcasting is successfully started, a preset volume value is sent to the target audio receiving device based on the VCP protocol connection, so that the target audio receiving device can adjust the volume of the audio data played synchronously based on the preset volume value. It can be seen that when the display device in the embodiment of the present disclosure receives the start trigger operation for Bluetooth broadcasting, it can send the preset volume value for adjusting the volume to the audio receiving device based on the VCP protocol connection, so that the audio receiving device adjusts the volume gain to a relatively reasonable value according to the preset volume value, without affecting the user's listening experience.
[0171] 13 , as an extension and refinement of the embodiment shown in FIG11 , based on steps S1101 to S1103 shown in FIG11 , step S1102 (determining the target audio receiving device) is replaced with steps S1301 and S1302. According to some embodiments, the audio control method further includes the following steps:
[0172] S1101: Receive a start trigger operation for Bluetooth broadcasting.
[0173] S1301: Determine whether there is an LE audio device in a CIS connection with the display device.
[0174] In actual applications, the audio streams of the LE audio device connected to the display device in the CIS can include unicast audio streams and broadcast audio streams.
[0175] In some embodiments, for unicast audio streaming scenarios, the audio gain output by the display device defaults to the maximum value or 100% (i.e., the volume sent by the display device to the LE audio device is a fixed value). After the display device sends the audio data to the LE audio device via the VCP protocol (Volume Control Profile), the LE audio device adjusts the volume of the audio data based on the audio (index) value sent by the display device and outputs the adjusted audio data. It should be noted that in unicast scenarios, the volume bar is used to control the volume of the LE audio device output.
[0176] In some embodiments, for broadcast audio streams, the volume output by the LE audio device is fixed. Therefore, the display device can only adjust its own audio gain using the volume bar. After adjusting its own audio gain, it sends the adjusted audio gain to the LE audio device, which combines the display device's audio gain with its own audio gain to output the audio data. It should be noted that in broadcast scenarios, the volume bar is used to control the display device's own audio gain.
[0177] In actual applications, when the display device switches from a unicast scenario to a broadcast scenario, the audio gain of the display device may be low, and the audio gain of the LE audio device may also be low. As a result, after the LE audio device combines its own audio gain with the audio gain of the display device, the volume of the audio data output is low, affecting the user's listening experience.
[0178] To this end, an embodiment of the present disclosure provides an audio control method, which can send a preset volume value for adjusting the volume to an audio receiving device through a VCP protocol-based connection when switching from a unicast scenario to a broadcast scenario, so that the audio receiving device adjusts the volume gain to a relatively reasonable value according to the preset volume value, thereby not affecting the user's listening experience.
[0179] In an embodiment of the present disclosure, during the process of playing audio data based on an audio output channel established by a unicast media transmitter, the display device receives a trigger operation for Bluetooth broadcasting, first determines whether there is an LE audio device in a CIS connection with the display device, and when it is determined that there is an LE audio device in a CIS connection with the display device, determines the LE audio device as the target audio receiving device. In actual applications, after turning on Bluetooth broadcasting and then determining the LE audio device in a CIS connection with the display device, it can be regarded as a scenario in which the display device first establishes a CIS connection with the LE audio device and then turns on Bluetooth broadcasting, that is, a scenario of switching from unicast to broadcasting.
[0180] S1302: If it is determined that there is an LE audio device in a CIS connection with the display device, determine the LE audio device as a target audio receiving device.
[0181] In some embodiments, if it is determined that there is an LE audio device in a CIS connection with the display device, after determining the LE audio device as the target audio receiving device, the display device can also control the audio module to take the target audio receiving device offline and set the music stream to mute.
[0182] In the embodiment of the present disclosure, controlling the audio module to take the target audio receiving device offline means cutting off the routing policy of the audio module from the LE audio hal (hardware abstraction layer). At this time, the display device cannot send audio data to the LE audio hal based on a unicast connection, and therefore cannot send it to the target audio receiving device through the LE audio hal.
[0183] In actual applications, after the display device controls the audio module to take the target audio receiving device offline, the target audio receiving device may have some popping sounds or sudden interference sounds, which is a poor user experience. Therefore, when the target audio receiving device is taken offline, the embodiment of the present disclosure also needs to set the music stream to mute, so that the display device can seamlessly switch from unicast state to broadcast state.
[0184] In practice, the LE Audio application layer specification, Telephony and Media Audio Profile (TMAP), defines two media audio applications: unicast media audio and broadcast media audio. Unicast media audio includes a unicast media sender (UMS) and a unicast media receiver (UMR), while broadcast media audio includes a broadcast media sender (BMS) and a broadcast media receiver (BMR). In practice, the unicast media sender (UMS) and the broadcast media sender (BMS) are mutually exclusive. This means that an audio receiving device cannot operate in both unicast and broadcast modes simultaneously.
[0185] In some embodiments, since the working mode of the audio receiving device cannot be in the unicast state and the broadcast state at the same time, after receiving the start trigger operation for Bluetooth broadcast and determining that there is an LE audio device in a CIS connection with the display device, the display device can also control the Bluetooth protocol stack to set the UMS working mode of the target audio receiving device to the inactive state, and set the BMS working mode of the target audio receiving device to the active state.
[0186] In actual applications, after the display device sets the BMS working mode of the target audio receiving device to active, the target audio receiving device can receive the audio data broadcast by the display device and adjust the volume of the audio data based on a preset volume value.
[0187] In some embodiments, when the display device controls the Bluetooth protocol stack to set the UMS working mode of the target audio receiving device to the inactive state, and sets the BMS working mode of the target audio receiving device to the active state, it can also use the built-in Bluetooth application in the display device to monitor the event of setting the UMS working mode of the target audio receiving device to the inactive state, and after monitoring the event, control the audio module to mute the music stream, and perform Bluetooth audio offline processing on the target audio receiving device, and cut off the audio routing strategy from the LE audio hal.
[0188] In some embodiments, after the display device switches the audio routing policy away from the LE audio hal, it can also control the Bluetooth protocol stack to establish a Bluetooth broadcast and start the Bluetooth broadcast to broadcast audio data to the target audio receiving device.
[0189] In some embodiments, after the display device cuts off the audio routing policy from LE audio hal, it can also use the Bluetooth application to monitor the event of the audio receiving device going offline. If it is determined that the offline audio receiving device is the same device as the audio receiving device in the inactive UMS working state, the Bluetooth protocol stack is controlled to establish a Bluetooth broadcast and start the Bluetooth broadcast.
[0190] In actual applications, after the display device establishes and turns on the Bluetooth broadcast, there may be problems such as the Bluetooth broadcast failing to start, or the audio receiving device being unable to receive the Bluetooth broadcast, causing the display device to send a preset volume value to the target audio receiving device. Therefore, after turning on the Bluetooth broadcast, the display device also needs to determine whether the Bluetooth broadcast is successfully turned on; if it is determined that the Bluetooth broadcast is successfully turned on, the audio module is controlled to switch the audio routing strategy back to the LE audio hal. At this time, the display device can send the audio data to the LE audio hal, and then the LE audio hal will send the audio data to the target audio receiving device.
[0191] In some embodiments, if it is determined that the Bluetooth broadcast fails to start, the current system volume value of the target audio receiving device is obtained from the audio module, and then based on the VCP connection, the current system volume value is sent to the target audio receiving device, so that the target audio receiving device adjusts the volume of the audio data played synchronously based on the current system volume value.
[0192] S1103: If it is determined that the Bluetooth broadcast is successfully turned on, a preset volume value is sent to the target audio receiving device based on the VCP protocol connection; wherein the preset volume value is used to adjust the volume of the audio data synchronously played by the target audio receiving device.
[0193] In an embodiment of the present disclosure, after determining that there is an LE audio device in a CIS connection with the display device and determining the LE audio device as the target audio receiving device, the display device can also send a preset volume value to the target audio receiving device based on the VCP protocol connection when determining that the Bluetooth broadcast is successfully turned on, so that the target audio receiving device adjusts the volume of the audio data played synchronously based on the preset volume value.
[0194] According to the audio control method of some embodiments, first, a start trigger operation for Bluetooth broadcasting is received; then, it is determined whether there is an LE audio device in a CIS connection with the display device, and if it is determined that there is an LE audio device in a CIS connection with the display device, the LE audio device is determined as the target audio receiving device; then, if it is determined that the Bluetooth broadcast is successfully turned on, a preset volume value is sent to the target audio receiving device based on the VCP protocol connection, so that the target audio receiving device can adjust the volume of the synchronously played audio data based on the preset volume value. It can be seen that when the display device in the embodiment of the present disclosure receives the start trigger operation of Bluetooth broadcasting, it can send the preset volume value for adjusting the volume to the audio receiving device based on the VCP protocol connection, so that the audio receiving device adjusts the volume gain to a relatively reasonable value according to the preset volume value, without affecting the user's listening experience.
[0195] Corresponding to the scenario diagram shown in Figure 4, an embodiment of the present disclosure provides an audio control method, which first receives a start trigger operation for Bluetooth broadcasting; then, determines the target audio receiving device, and determines whether the target audio receiving device belongs to any one or more device groups; then, when it is determined that the Bluetooth broadcast is successfully started, based on the VCP protocol connection, sends a preset volume value to the target audio receiving device; and, when it is determined that the target audio receiving device belongs to any one or more device groups, sends the preset volume value to the audio receiving devices in any one or more device groups.
[0196] In an embodiment of the present disclosure, when the display device receives a start trigger operation for Bluetooth broadcasting, it first determines the LE audio device that has established a CIS connection with the display device as the target audio receiving device, so that it can subsequently send a preset volume value to the target audio receiving device based on the VCP connection, and broadcast audio data to the target audio receiving device.
[0197] In an embodiment of the present disclosure, after determining that an LE audio device has established a CIS connection with the display device, the display device can also, when determining that the Bluetooth broadcast is successfully turned on, send a preset volume value to the target audio receiving device based on the VCP protocol connection, so that after receiving the preset volume value, the target audio receiving device can adjust the playback volume of the audio data based on the preset volume value, so that the user can listen normally.
[0198] In some embodiments, after determining the target audio receiving device, the display device may further determine whether the target audio receiving device belongs to any one or more device groups.
[0199] In actual applications, since multiple audio receiving devices belonging to the same device group have the same group ID, it can be determined based on the group ID whether the target audio receiving device belongs to any one or more device groups.
[0200] In an embodiment of the present disclosure, if it is determined that the target audio receiving device belongs to any device group, a preset volume value is sent to each audio receiving device in the device group, so that each audio receiving device in the device group can adjust the volume of the audio data played synchronously based on the preset volume value; if it is determined that the target audio receiving device belongs to multiple device groups, the preset volume value is sent to the audio receiving devices in each device group, so that the audio receiving devices in each device group can adjust the volume of the audio data played synchronously based on the preset volume value.
[0201] In some embodiments, if it is determined that the Bluetooth broadcast has failed to start, the current system volume value of the audio receiving device in any one or more device groups is obtained from the audio module, and then based on the VCP connection, the current system volume value is sent to the audio receiving device in any one or more device groups, so that the audio receiving device in any one or more device groups adjusts the volume of the audio data played synchronously based on the current system volume value.
[0202] According to the audio control method of some embodiments, first, a start trigger operation for Bluetooth broadcasting is received; then, a target audio receiving device is determined, and it is determined whether the target audio receiving device belongs to any one or more device groups, wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device; if it is determined that the Bluetooth broadcast is successfully started, a preset volume value is sent to the target audio receiving device based on the VCP protocol connection; if it is determined that the target audio receiving device belongs to any one or more device groups, the preset volume value is sent to the audio receiving devices in any one or more device groups, so that the target audio receiving device and other audio receiving devices belonging to the same device group as the target audio receiving device can adjust the volume of the audio data played synchronously based on the preset volume value.
[0203] Next, as shown in FIG14 , the audio control method according to some embodiments may further include but is not limited to the following steps S1001 - S1004:
[0204] S1001: In response to a start trigger operation for Bluetooth broadcasting, determining whether there is a Bluetooth audio device currently in an active state.
[0205] According to the audio control method of some embodiments, the scenario of switching from the Bluetooth audio output channel to the Bluetooth broadcast corresponds to the case where the display device is in the Bluetooth audio output channel and several types of Bluetooth audio devices are currently connected, and does not involve the scenario of switching from traditional audio output channels such as local speakers or USB to Bluetooth broadcast.
[0206] In actual applications, Bluetooth broadcast and Bluetooth audio output channels correspond to different device lists. When playing sound through the Bluetooth audio output channel, the device emitting sound is a Bluetooth audio device, such as an A2DP device or Bluetooth hearing aid. When playing sound through Bluetooth broadcast, the device emitting sound is a Bluetooth broadcast device, such as a broadcast device that supports the LE audio protocol. The Bluetooth broadcast stream and Bluetooth audio stream are two parallel audio streams.
[0207] Because Bluetooth broadcast streams and Bluetooth audio streams are mutually exclusive, after turning on Bluetooth broadcast, the display device can only play the broadcast stream through Bluetooth broadcast devices that support the LE audio protocol. At this time, Bluetooth audio devices such as a2dp devices and Bluetooth hearing aids cannot play the Bluetooth audio stream.
[0208] In the embodiment of the present disclosure, the triggering operation for starting Bluetooth broadcasting may include: clicking on a control to start Bluetooth broadcasting on a device management page to trigger an operation of entering a Bluetooth broadcasting page, etc.
[0209] FIG15 is a schematic diagram of a process for enabling Bluetooth broadcasting according to some embodiments. As shown in FIG15(a), the sound settings page displays audio output channels and Bluetooth broadcast sound output options, wherein the current audio output channel is set to the Bluetooth audio output channel, and Bluetooth broadcasting is disabled. After the display device receives a user's trigger operation for enabling Bluetooth broadcasting and successfully enables Bluetooth broadcasting, as shown in FIG15(b), Bluetooth broadcasting is now enabled.
[0210] In some embodiments, the display device can also first control the Bluetooth protocol stack to create a Bluetooth broadcast, turn on the Bluetooth broadcast, and determine whether there is a Bluetooth audio device in an active state when receiving a trigger operation to start the Bluetooth broadcast; if it is determined that the Bluetooth audio device in the active state is an A2DP device or a Bluetooth hearing aid device, and it is determined that the Bluetooth broadcast is successfully turned on, the Bluetooth protocol stack is controlled to set the A2DP device or the Bluetooth hearing aid device to an inactive state.
[0211] In actual applications, if the Bluetooth broadcast fails to start, the sound will continue to be played based on the active a2dp device or Bluetooth hearing aid device.
[0212] S1002: If it is determined that there is a Bluetooth audio device in the active state, determine whether the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device.
[0213] In actual applications, when the display device switches from the Bluetooth audio output channel to the Bluetooth broadcast, it first needs to determine the device type of the connected Bluetooth audio device. For different types of Bluetooth audio devices, different offline processing methods need to be adopted when switching to Bluetooth broadcast.
[0214] In an embodiment of the present disclosure, when the display device receives a start trigger operation for Bluetooth broadcasting, it first determines whether there is a Bluetooth audio device in an active state, and when it is determined that there is a Bluetooth audio device in an active state, it determines whether the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device.
[0215] The Bluetooth hearing aid device in the embodiments of the present disclosure refers to a hearing aid device that supports the Hearing Aid protocol, wherein the Hearing Aid protocol is a hearing aid application specification based on Bluetooth Low Energy (BLE), which describes how to connect and disconnect two Bluetooth hearing aid devices to ensure interoperability between the devices.
[0216] The A2DP device in the embodiments of the present disclosure refers to a Bluetooth audio device that supports the A2DP protocol, where the A2DP protocol is the Advanced Audio Distribution Profile (AADP) in classic Bluetooth. The A2DP protocol is a transmission protocol for Bluetooth audio streams that can select different encoding methods and bandwidth occupancy to provide high-quality sound quality and a smooth experience.
[0217] S1003: If it is determined that the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device, save the device information of the Bluetooth audio device and control the Bluetooth protocol stack to set the Bluetooth audio device to an inactive state.
[0218] In an embodiment of the present disclosure, when the display device receives a start trigger operation for Bluetooth broadcasting, if it is determined that the Bluetooth audio device in the active state is an A2DP device or a Bluetooth hearing aid device, the device information of the Bluetooth audio device is saved and the Bluetooth protocol stack is controlled to set the Bluetooth audio device to the inactive state.
[0219] In actual applications, an active Bluetooth audio device is a Bluetooth audio device that is playing audio data (or making sound). After the display device controls the Bluetooth protocol stack to set the active Bluetooth audio device to an inactive state, the Bluetooth audio device stops playing audio data (or does not make sound).
[0220] In the disclosed embodiment, the device information may include the MAC address of the Bluetooth audio device. Saving the MAC address of the Bluetooth audio device in the memory of the display device facilitates finding the device that was originally playing audio after the Bluetooth broadcast is turned off, so that the device can continue to play the audio data. The MAC address of the Bluetooth audio device can be used to uniquely identify the Bluetooth audio device.
[0221] In actual applications, since the display device saves the device information of the active A2DP device and Bluetooth hearing aid device in memory in advance after turning on Bluetooth broadcasting, for users, when turning off Bluetooth broadcasting (that is, switching from Bluetooth broadcasting to the original Bluetooth audio output), they prefer to use the device before turning on Bluetooth broadcasting (that is, the device saved in memory) to continue playing audio data.
[0222] Therefore, when the display device receives a close trigger operation for the Bluetooth broadcast, it can also determine whether the currently saved Bluetooth audio device is in a connected state, and when it is determined that the currently saved Bluetooth audio device is in a connected state, it sets the Bluetooth audio device to the active state so that the Bluetooth audio device can continue to play the audio data.
[0223] S1004: Control the audio module to perform offline processing on the Bluetooth audio device and switch the audio routing strategy from the current HAL.
[0224] In the embodiment of the present disclosure, after the display device controls the Bluetooth protocol stack to set the active A2DP device or Bluetooth hearing aid device to the inactive state, it can also control the audio module to take the A2DP device or Bluetooth hearing aid device offline and cut out the audio routing strategy from the current HAL.
[0225] In the embodiment of the present disclosure, controlling the audio module to perform offline processing on the A2DP device or the Bluetooth hearing aid device means cutting off the audio routing policy of the audio module from the HAL (Hardware Abstraction Layer). After cutting off the audio routing policy from the HAL, the display device cannot send audio data to the HAL based on the Bluetooth connection, nor can it send audio data to the A2DP device or the Bluetooth hearing aid device through the HAL. That is, the A2DP device or the Bluetooth hearing aid cannot receive the audio data and cannot make any sound.
[0226] In some embodiments, after the display device controls the audio module to offline the a2dp device or the Bluetooth hearing aid device, it can also control the audio module to bring the Bluetooth broadcast device online and switch the audio routing strategy to the LE audio hal. At this time, the display device can send audio data to the LE audio hal based on the LE audio connection, and then send the audio data to the Bluetooth broadcast device through the LE audio hal, and the Bluetooth broadcast device plays the audio data.
[0227] In the embodiment of the present disclosure, a Bluetooth broadcast device refers to an audio receiving device in which the BMS working mode is in the active state, that is, a broadcast audio device that supports the LE audio protocol.
[0228] According to some embodiments of the switching processing method of Bluetooth broadcast, first, in response to the start trigger operation for Bluetooth broadcast, it is determined whether there is a Bluetooth audio device in the active state; if it is determined that there is a Bluetooth audio device in the active state, it is determined whether the Bluetooth audio device belongs to an A2DP device or a Bluetooth hearing aid device; if it is determined that the Bluetooth audio device belongs to an A2DP device or a Bluetooth hearing aid device, the device information of the Bluetooth audio device is saved, and the Bluetooth protocol stack is controlled to set the Bluetooth audio device to the inactive state; then, the audio module is controlled to perform offline processing on the Bluetooth audio device, and the audio routing strategy is cut out from the current HAL, thereby realizing the Bluetooth broadcast switching processing of the display device.
[0229] In actual applications, after the display device turns on Bluetooth broadcasting, the user can also manually switch from the Bluetooth audio channel to traditional audio output channels such as the local speaker, HDMI channel, or coaxial channel. After switching to any of these channels, the display device can simultaneously play audio data through the traditional audio output channels while broadcasting audio data.
[0230] In an embodiment of the present disclosure, the display device unmutes the music stream in response to a trigger operation to switch the audio output channel to a target output channel, where the target audio output channel may include an HDMI channel, a local speaker, or a coaxial channel.
[0231] In the embodiment of the present disclosure, the triggering operation of switching the audio output channel to the target output channel may include selecting the target output channel in the sound output channel on the sound setting page in the device manager, etc.
[0232] As shown in Figure 16, it is a schematic diagram of switching from an audio output channel to a target output channel according to some embodiments. In particular, the current audio output channel displayed on the sound setting page shown in Figure 16 (a) is Bluetooth audio; when Bluetooth broadcast is turned on, when the display device receives a switch trigger operation for the current audio output channel, it jumps to the audio output channel selection page shown in Figure 16 (b), which also displays audio output channels such as HDMI channel, coaxial channel and local speaker; when the display device receives a selection operation for the HDIM channel, as shown in Figure 16 (c), it determines the HDIM channel as the target output channel and unmutes the music stream corresponding to the HDMI channel; after successfully switching to the HDMI channel, as shown in Figure 16 (d), the current audio output channel displayed on the sound setting page is the HDMI channel, and at this time, the Bluetooth broadcast and HDMI channel sound at the same time.
[0233] It can be seen that during the broadcasting of the audio stream, the display device in the embodiment of the present disclosure switches from the current audio output channel to the target audio channel, and can make the Bluetooth broadcasting device and the target audio channel sound at the same time by releasing the mute setting of the music stream.
[0234] In practice, the LE Audio application layer specification, Telephony and Media Audio Profile (TMAP), defines two media audio applications: unicast media audio and broadcast media audio. Unicast media audio includes a unicast media sender (UMS) and a unicast media receiver (UMR), while broadcast media audio includes a broadcast media sender (BMS) and a broadcast media receiver (BMR). In practice, the unicast media sender (UMS) and the broadcast media sender (BMS) are mutually exclusive. This means that an audio receiving device cannot operate in both unicast and broadcast modes simultaneously.
[0235] Since the working mode of the Bluetooth audio device cannot be in the unicast state and the broadcast state at the same time, when the display device receives the user's trigger operation for starting Bluetooth broadcast and determines that the currently active audio receiving device is a unicast (UMS) device that supports the LE audio protocol, it first controls the Bluetooth protocol stack to set the UMS working mode device of the audio receiving device to the inactive state and the BMS working mode device of the audio receiving device to the active state.
[0236] In some embodiments, after the display device controls the Bluetooth protocol stack to set the UMS working mode device of the audio receiving device to the inactive state, and the BMS working mode device of the audio receiving device to the active state, it can also use the built-in Bluetooth application to monitor the event that the UMS working mode of the audio receiving device is set to the inactive state, and after monitoring the event, control the audio module to mute the music stream, and perform Bluetooth audio offline processing on the audio receiving device, and temporarily cut off the audio routing strategy from the LE audio hal.
[0237] In actual applications, after the display device controls the audio module to take the audio receiving device offline, the audio receiving device may have some popping sounds or sudden interference sounds. This phenomenon seriously affects the user experience when turning on Bluetooth broadcasting. Therefore, when the embodiment of the present disclosure takes the audio receiving device offline, the music stream can also be set to mute, so that the display device can seamlessly switch from unicast state to broadcast state.
[0238] In actual applications, after the display device cuts off the audio routing policy from LE audio hal, it can also use the Bluetooth application to monitor the event of the audio receiving device going offline. If it is determined that the offline audio receiving device is the same device as the audio receiving device in the inactive UMS working state, the Bluetooth protocol stack is controlled to establish a Bluetooth broadcast and start the Bluetooth broadcast.
[0239] In actual applications, after the display device establishes and turns on the Bluetooth broadcast, there may be problems such as the Bluetooth broadcast failing to start, or the audio receiving device being unable to receive the Bluetooth broadcast, resulting in the display device being unable to broadcast audio data to the audio receiving device. Therefore, after turning on the Bluetooth broadcast, the display device also needs to determine whether the Bluetooth broadcast is successfully turned on; if it is determined that the Bluetooth broadcast is successfully turned on, the audio module is controlled to switch the audio routing strategy back to the LE audio hal. At this time, the display device can send the broadcast stream to the LE audio hal, and then the LE audio hal broadcasts the Bluetooth broadcast stream to the audio receiving device.
[0240] In some embodiments, if it is determined that the Bluetooth broadcast startup fails, the audio data continues to be played based on the Bluetooth connection established by the original unicast media receiver UMR.
[0241] In some embodiments, in order to make the user have a certain expectation of the failure of Bluetooth broadcast activation, the display device can also control the display to display a prompt message about the failure of Bluetooth broadcast activation or re-activation of Bluetooth broadcast when it is determined that the Bluetooth broadcast activation has failed, so as to remind the user that the current activation trigger for Bluetooth broadcast has failed.
[0242] In some embodiments, when the display device turns off the Bluetooth broadcast, that is, when it switches back to the Bluetooth audio output channel from the Bluetooth broadcast, it can also determine whether the currently saved Bluetooth audio device is in a connected state, and when it is determined that the currently saved Bluetooth audio device is in a connected state, set the Bluetooth audio device to the active state so that the Bluetooth audio device can continue to play the audio data.
[0243] In actual applications, suppose that the display device is playing audio data based on the A2DP device before turning on the Bluetooth broadcast. At this time, after receiving the start trigger operation for the Bluetooth broadcast and saving the device information of the A2DP device in the memory, if the user turns off the A2DP device first and then turns off the Bluetooth broadcast, since the A2DP device has been offline before turning off the Bluetooth broadcast, the display device cannot find the connected Bluetooth audio device when receiving the user's turn off trigger operation for the Bluetooth broadcast.
[0244] Based on this, the display device in the embodiment of the present disclosure can also, upon receiving a shutdown trigger operation for Bluetooth broadcasting, first determine whether the currently saved Bluetooth audio device is in a connected state; if it is determined that the currently saved Bluetooth audio device is not in a connected state, then determine whether the current audio output channel is in a Bluetooth audio channel; if it is determined that the current audio output channel is in a Bluetooth audio channel, then determine a target Bluetooth audio device for playing audio data based on a preset priority relationship. Wherein, the target Bluetooth audio device is in a connected state.
[0245] In actual applications, due to the limited radio frequency capability of the Bluetooth module in the display device, when multiple Bluetooth audio devices are connected, it cannot be guaranteed that all devices can play audio data. Therefore, when the display device receives a shutdown trigger operation for the Bluetooth broadcast, it can also determine the target Bluetooth audio device for playing audio data from the connected Bluetooth audio devices based on a preset priority relationship.
[0246] In the embodiment of the present disclosure, the preset priority relationship may be used to characterize the audio output priority relationship between Bluetooth audio devices supporting different application layer Bluetooth protocols.
[0247] In some embodiments, the preset priority relationship can be determined based on actual needs. For example, the Bluetooth audio output priority relationship between the Bluetooth audio devices of the above-mentioned different application layer Bluetooth protocols can be characterized in the order of Bluetooth hearing aid devices supporting the hearingaid protocol being the best, Bluetooth audio devices supporting the A2DP protocol being the second, and Bluetooth audio devices supporting the LE Audio protocol being the last.
[0248] In an embodiment of the present disclosure, assuming that the preset priority relationship is hearingaid>A2DP>LE Audio, the Bluetooth audio devices currently connected to the display device include Bluetooth audio device 1 that supports the A2DP protocol and Bluetooth audio device 2 that supports the LE Audio protocol. When the display device receives a close trigger operation for the Bluetooth broadcast, based on the above preset priority relationship, it determines the target Bluetooth audio device from the currently connected Bluetooth audio devices, that is, determines Bluetooth audio device 1 as the target Bluetooth audio device.
[0249] In actual applications, for a connected Bluetooth audio device, the audio data transmitted by the display device can only be played when it is in the active state. Therefore, after determining the target Bluetooth audio device, the state of the target Bluetooth audio device can also be set to the active state, and the Bluetooth protocol stack can be notified that the target Bluetooth audio device is currently in the active state. The Bluetooth protocol stack can then be controlled to output the audio data of the display device to the target Bluetooth audio device.
[0250] In some embodiments, the display device may also first determine the device type of the connected Bluetooth audio device when receiving a close trigger operation for the Bluetooth broadcast. If there are multiple device types of connected Bluetooth audio devices, the Bluetooth audio device used to play the audio data is determined based on a preset priority relationship. If the Bluetooth audio device used to play the audio data is determined to be a Bluetooth hearing aid device that supports the hearing aid protocol, the last connected Bluetooth hearing aid device in the device connection list of the display device is determined as the target Bluetooth audio device, so that the Bluetooth hearing aid device can subsequently play the audio data of the display device.
[0251] In an embodiment of the present disclosure, after the last connected Bluetooth hearing aid device in the device connection list is determined as the target Bluetooth hearing aid device based on a preset priority relationship, the Audio module can also be controlled to route audio data to the target Bluetooth audio device so that the target Bluetooth audio device can synchronously play the audio data of the display device.
[0252] In some embodiments, the display device may also first determine the device type of the connected Bluetooth audio device when receiving a close trigger operation for Bluetooth broadcasting. If there are multiple device types of connected Bluetooth audio devices, the Bluetooth audio device used to play audio data is determined based on a preset priority relationship. If the device used to play audio data is determined to be an A2dp device that supports the A2dp protocol, the target A2dp device in the device connection list of the display device is determined as the target Bluetooth audio device.
[0253] The target A2dp device may also be determined based on the number of connected A2dp devices in the device connection list. In an embodiment of the present disclosure, if it is determined that the number of connected A2dp devices in the device connection list is 1, the connected A2dp device is determined as the target A2dp device; if it is determined that the number of connected A2dp devices in the device connection list is 2, any one of the connected A2dp devices is determined as the target A2dp device.
[0254] In actual applications, after determining that the number of connected A2dp devices is two and identifying any of the connected A2dp devices as the target A2dp device, the Bluetooth protocol stack can be controlled to enable two audio streams for the connected A2dp device. These two audio streams are used to output the audio data of the display device to the connected A2dp device respectively.
[0255] In some embodiments, when it is determined that the number of connected A2dp devices in the device connection list is 2, the Bluetooth protocol stack can also be controlled to open two audio streams for the connected A2dp devices, thereby outputting the audio data of the display device to the connected A2dp devices respectively.
[0256] It can be seen that when the display device in the embodiment of the present disclosure determines that the number of connected A2dp devices in the device connection list is 2, it can realize the function of synchronously playing the audio data of the display device by multiple connected A2dp devices by controlling the Bluetooth protocol stack to open two audio streams.
[0257] In some embodiments, the display device may also first determine the device type of the connected Bluetooth audio device when receiving a close trigger operation for Bluetooth broadcasting. If there are multiple device types of connected Bluetooth audio devices, the Bluetooth audio device used to play audio data is determined based on a preset priority relationship. If the device used to play audio data is determined to be an LE audio device that supports the LE audio protocol, the first connected LE audio device in the device connection list of the display device is determined as the target Bluetooth audio device.
[0258] After determining the first connected LE audio device in the device connection list as the target Bluetooth audio device based on the preset priority relationship, the Audio module can also be controlled to route audio data to the target Bluetooth audio device so that the target Bluetooth audio device can synchronously play the audio data of the display device.
[0259] It can be seen that the embodiment of the present disclosure can determine the target Bluetooth audio device based on the preset priority relationship when the Bluetooth broadcast is turned off (that is, when switching from the Bluetooth broadcast to the Bluetooth audio output channel), so as to control the audio module to route the audio data of the display device to the target Bluetooth audio device, thereby realizing the function of synchronously playing the audio data of the display device using the Bluetooth audio device when the Bluetooth broadcast is turned off.
[0260] In some embodiments, the display device may further determine a target Bluetooth audio device for playing audio data by determining whether there is a recently connected device when receiving a close trigger operation for Bluetooth broadcasting.
[0261] In an embodiment of the present disclosure, the display device determines whether there is a connected audio output device for the current audio output channel in response to a shutdown trigger operation for the Bluetooth broadcast, and when it is determined that there is a connected audio output device for the current audio output channel, sets the audio output device to an active state for playing audio data of the display device.
[0262] The connected audio output device may include an audio output device manually connected by the user after the display device turns on Bluetooth broadcasting, etc.
[0263] In some embodiments, when the display device determines that there is an audio output device connected to the current audio output channel, it can also control the display to display a prompt pop-up window so that the user can determine whether to use the connected audio output device to play audio data based on the connected audio output device displayed in the prompt pop-up window.
[0264] In the embodiment of the present disclosure, during the process of the display device controlling the display to display a prompt pop-up window, a confirmation message of the application audio output device can also be received based on the prompt pop-up window. As shown in Figure 17, it is a flow chart of turning off Bluetooth broadcasting according to some embodiments. As shown in Figure 17 (a), at this time, Bluetooth broadcasting is in the on state. When the display device receives a turn-off trigger operation for Bluetooth broadcasting, if it is determined that there is a connected audio output device 1 in the current audio output channel, a prompt pop-up window will be displayed on the current page; as shown in Figure 17 (b), the prompt pop-up window can display a prompt message "After turning off Bluetooth broadcasting, do you want to use audio output device 1?"; when the display device receives a confirmation message of using audio output device 1, it sets audio output device 1 to the active state for playing audio data of the display device.
[0265] In actual applications, if the display device does not receive a confirmation message for any audio output device of the application, it determines the target Bluetooth audio device from the connected audio output devices based on a preset priority relationship and sets the target Bluetooth audio device to the active state for playing audio data.
[0266] In some embodiments, when the display device receives a close trigger operation for a Bluetooth broadcast, if it determines that the currently saved Bluetooth audio device is not connected or there is no active Bluetooth audio device, it uses a Bluetooth application to broadcast to a TV service to notify the TV service to perform the following steps:
[0267] First, it is determined whether there is an audio output device connected to the current audio output channel manually switched by the user; if it is determined that there is an audio output device connected to the current audio output channel (for example, the display device is connected to a USB speaker device during Bluetooth broadcasting), the display is controlled to display a prompt pop-up window to prompt the user whether to switch to the audio output device; if a user selection operation for the audio output device is received based on the prompt pop-up window, the audio output device is set to the active state.
[0268] In some embodiments, after the display device sets the audio output device to the active state, it can also control the Audio module to route audio data to the audio output device, so that the audio output device can synchronously play the audio data of the display device.
[0269] Furthermore, when playing music or videos, devices such as TVs typically establish an Access Control List (ACL) connection with Bluetooth speakers to send the audio to be played. To achieve better sound quality, the Bluetooth speakers then play the audio after receiving the audio. However, due to limitations in the Bluetooth link within a TV, a TV can typically only establish an ACL connection with one Bluetooth speaker. Therefore, only one channel of audio can be played through each Bluetooth speaker, preventing stereo playback.
[0270] To facilitate understanding, the relationship between the aforementioned extended advertising, periodic advertising, and broadcast isochronous streaming (BIS) is first introduced, as shown in Figures 18 and 19:
[0271] Figure 18 illustrates the relationship between extended broadcast, periodic broadcast, and BIS. It should be noted that Bluetooth operates in the 2.4 GHz band, which ranges from 2402 MHz to 2480 MHz. There is a channel every 2 MHz, for a total of 40 channels. Three of these channels are primary broadcast channels: channel 37, channel 38, and channel 39. The remaining 37 channels are secondary broadcast channels: channel 0 through channel 36. As shown in Figure 18, the primary broadcast channels include channels 37, 38, and 39, while the secondary broadcast channels include channels 0 through 36. The extended broadcast on the main broadcast channel can use the ADV_EXT_IND packet and point to the subsidiary broadcast on the secondary broadcast channel through the time and frequency information. The subsidiary broadcast then uses the AUX_ADV_IND packet to point to the periodic broadcast through the time, frequency hopping map and access address. Furthermore, the periodic broadcast uses the AUX_SYNC_IND packet to point to the BIS through the time, frequency hopping map, access address and BIG information (BIGInfo). The BIS uses the BIS PDU packet to broadcast digital audio.
[0272] In actual applications, when broadcasting digital audio through BIS, it is achieved by continuously sending BIG. Each time a BIG is sent, it can be called a BIG event, and each BIG event can include multiple BIS.
[0273] Figure 19 is a schematic diagram of the continuous transmission of BIG in the related art. As shown in Figure 19, in the process of continuously sending BIG, BIG events are executed periodically and continuously. The BIG anchor point shown in Figure 19 indicates the start time of each BIG event, and the time interval between the two anchor points is a cycle of executing the BIG event. It should be noted that Figure 19 is illustrated by taking 3 BIG events, each of which includes 2 BISs as an example. Figure 19 shows the continuous execution of BIG event X, BIG event (X+1) and BIG event (X+2), wherein each BIG event includes 2 BIS streams, namely BIS1 and BIS2 shown in Figure 19. Among them, the BIS stream will be broadcast during the execution of the BIG time, and in the process of broadcasting the BIS stream, the BIS stream will be broadcast once after a fixed time interval.
[0274] There are many configurations for broadcasting BIS audio, as shown in Figures 20 to 22 below:
[0275] Figure 20 is a schematic diagram of a configuration for broadcasting BIS audio (which may be a BIS stream) according to some embodiments. As shown in Figure 20 , three audio receiving devices, namely Bluetooth headset 51, Bluetooth headset 52, and Bluetooth headset 53, are used as an example. In this configuration, one audio transmitting device broadcasts a BIS audio 54, which includes audio from a channel 55. Nearby Bluetooth headsets 51, 52, and 53 can receive this BIS audio 54 and obtain the audio from the channel 55.
[0276] FIG21 is a schematic diagram of another configuration for broadcasting BIS audio according to some embodiments. As shown in FIG21 , three audio receiving devices, namely Bluetooth headset 61, Bluetooth headset 62, and Bluetooth headset 63 in FIG21 , are used as an example for illustration. In this configuration, one audio transmitting device broadcasts two BIS audios, namely BIS audio 64 and BIS audio 66 shown in FIG21 . BIS audio 64 includes audio from a channel 65, and BIS audio 66 includes audio from a channel 67. Channels 65 and 67 can be the same or different. Bluetooth headsets 61, 62, and 63 can all receive BIS audio 64 and BIS audio 66, and obtain audio from channel 65 and audio from BIS audio 66.
[0277] Figure 22 is a third schematic diagram of a configuration for broadcasting BIS audio according to some embodiments. As shown in Figure 22 , using three audio receiving devices, namely Bluetooth headset 71, Bluetooth headset 72, and Bluetooth headset 73 in Figure 22 , as an example, this configuration illustrates an audio transmitting device broadcasting a BIS audio 74. This BIS audio 74 includes two channels of audio: channel 75 and channel 76, as shown in Figure 22 . Nearby Bluetooth headsets 71, 72, and 73 can receive this BIS audio 74 and obtain the audio from channels 75 and 76. In Figure 22 , the multiple audio receiving devices are Bluetooth headset 71, 72, and 73. Channels 75 and 76 in Figure 22 can be different channels, for example, channel 75 being the left front channel and channel 76 being the right front channel.
[0278] In the audio control method according to some embodiments, an audio transmitting device can transmit multiple channels of BIS audio to one or more audio receiving devices by broadcasting BIS audio. In the embodiments of the present disclosure, BIS audio can be broadcast using a configuration similar to any of the BIS audio broadcasting configurations shown in Figures 20, 21, or 22.
[0279] The audio control method of the embodiment of the present disclosure can be implemented through a display device and multiple audio receiving devices, and the display device can be a mobile phone, a television, a computer, etc. The audio receiving device can be a speaker, a headset, etc. The audio control method provided in the embodiment of the present disclosure may include a configuration stage and a multi-channel audio output stage. Among them, the configuration stage mainly involves the configuration of the BIS audio of the channel matched by the audio receiving device (i.e., configuring the BIS identifier), as well as the configuration of the volume for the display device and the audio receiving device. The configuration stage is mainly implemented through the display device and / or the control terminal, while the multi-channel audio output stage is mainly implemented by broadcasting the BIS audio from the display device to the audio receiving device. Among them, the control terminal can be a mobile terminal, for example, a mobile phone, a tablet computer, a remote control, a wearable device, etc., which can be used to implement the configuration of the BIS identifier and volume and other functions of the audio receiving device, wherein the wearable device can be a smart watch, a smart bracelet, etc.
[0280] Figure 23 is a scenario diagram of an audio control method according to some embodiments. As shown in Figure 23, Figure 23 takes the display device as a television and the audio receiving device as N speakers as an example for explanation. The scenario includes a television and N speakers. The television can configure channel-matched BIS audio for different speakers in advance, and then broadcast N BIS audios. Correspondingly, each speaker can receive N BIS audios and select channel-matched BIS audios from these N BIS audios for playback. Among them, the channels corresponding to different BIS streams may be different. In the embodiment of the present disclosure, N is greater than or equal to 1.
[0281] Figure 24 illustrates another scenario of an audio control method according to some embodiments. As shown in Figure 24 , the display device 200 can configure multiple audio receiving devices 400 using an ACL connection. After configuration, the display device 200 can broadcast multiple channels of audio to the multiple audio receiving devices 400 via BIS audio. In Figure 24 , the multiple audio receiving devices 400 are N speakers, designated as Speaker 1, Speaker 2, ..., Speaker N.
[0282] In some embodiments, the audio control method can also be implemented by a display device, a control terminal, and multiple audio receiving devices. The control terminal can be a mobile phone, a tablet computer, etc., and the control terminal is mainly used to configure the audio receiving devices.
[0283] Figure 25 is a scenario diagram three of an audio control method according to some embodiments. As shown in Figure 25, the display device 200 can establish a wireless connection with a mobile phone, and the display device 200 can send the channel information to be configured to the terminal device 300. After that, the terminal device 300 can configure multiple audio receiving devices 400 based on these channel information through ACL connection, and the display device 200 can send multiple channels of audio to the multiple audio receiving devices 400 by broadcasting BIS audio. In Figure 25, the multiple audio receiving devices 400 are N speakers, respectively represented as speaker 1, speaker 2...speaker N. In a certain embodiment of the present disclosure, the above-mentioned terminal device 300 can notify the display device 200 through a configuration completion message after the configuration is completed. After the display device 200 receives the configuration completion message, the display device 200 can send multiple channels of audio to the multiple audio receiving devices 400 by broadcasting BIS audio.
[0284] For the scenario shown in FIG24 , when implementing the audio control method according to some embodiments, each component in the display device 200 may implement the following functions:
[0285] In some embodiments, the at least one processor 250 is further configured to execute computer instructions so that the display device:
[0286] Obtain the channel information to be configured; control the Bluetooth module in the communicator 220 to determine several audio receiving devices to be connected through Bluetooth scanning; control the Bluetooth module to establish an ACL connection with multiple audio receiving devices; configure a BIS identifier for each audio receiving device in the multiple audio receiving devices based on the channel information to be configured, and send the configured BIS identifier to each audio receiving device in the multiple audio receiving devices through the ACL connection, where the multiple audio receiving devices are some or all of the several audio receiving devices; control the Bluetooth module in the communicator 220 to broadcast multiple BIS streams, each BIS stream including BIS audio data and a BIS identifier corresponding to the BIS audio, so that the multiple audio receiving devices can obtain target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0287] In some embodiments, the at least one processor 250 is further configured to execute computer instructions to enable the display device to send a configuration volume parameter to each of the multiple audio receiving devices through the ACL connection.
[0288] In some embodiments, after determining multiple audio receiving devices to be connected through Bluetooth scanning, and before controlling the Bluetooth module to establish ACL connections with the multiple audio receiving devices, the at least one processor 250 is further configured to execute computer instructions to cause the display device to:
[0289] The plurality of audio receiving devices that support Bluetooth low energy are determined from the plurality of audio receiving devices.
[0290] In some embodiments, when determining the multiple audio receiving devices that support Bluetooth Low Energy from the multiple audio receiving devices, at least one processor 250 is configured to execute computer instructions to enable the display device to:
[0291] Obtain a UUID corresponding to each audio receiving device from the plurality of audio receiving devices; and select, from the plurality of audio receiving devices, the plurality of audio receiving devices whose device types indicated by the UUIDs support Bluetooth low energy.
[0292] In some embodiments, when obtaining the channel information to be configured, at least one processor 250 is configured to execute computer instructions to enable the display device to: obtain the channel information of the currently played audio media; and determine the channel information to be configured that matches the channel information of the audio media from the channel information supported by the display device.
[0293] In some embodiments, when acquiring the channel information to be configured, at least one processor 250 is configured to execute computer instructions to enable the display device to: receive a channel combination selection instruction; and acquire the channel information to be configured in response to the channel combination selection instruction.
[0294] For the scenario shown in FIG25 , when implementing the audio control method according to some embodiments, each component in the display device 200 may implement the following functions:
[0295] In some embodiments, at least one processor 250 is configured to execute computer instructions to enable the display device to: determine the channel information to be configured; and control the communicator 220 to send the channel information to be configured to the terminal device 300, so that the terminal device 300 configures speakers for each channel of the display device based on the channel information to be configured, and after the terminal device 300 configures speakers for each channel of the display device (i.e., configures different audio receiving devices), broadcasts multiple BIS streams so that the speakers configured for each channel of the display device can receive and play the BIS audio of their corresponding channels.
[0296] In the embodiment of the present disclosure, the display device can transmit BIS audio of multiple channels to multiple audio receiving devices by broadcasting BIS streams, so that the audio receiving devices can play the BIS audio of their corresponding channels, thereby achieving a stereo playback effect without occupying the Bluetooth link in the current display device.
[0297] For the scenario shown in FIG24 , when implementing the audio control method according to some embodiments, the various components in the audio receiving device 400 may implement the following functions:
[0298] In some embodiments, the processor 210 is configured to: control the Bluetooth module in the communicator 220 to receive a scanning signal sent by the display device; in response to the scanning signal sent by the display device, control the Bluetooth module to establish an ACL connection with the display device; receive the BIS identifier configured by the display device through the ACL connection; control the Bluetooth module in the communicator 220 to receive multiple BIS streams, each BIS stream including BIS audio data and a BIS identifier corresponding to the BIS audio; obtain target BIS audio from the multiple BIS audios, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0299] For the scenario shown in FIG25 , when implementing the audio control method according to some embodiments, the various components in the audio receiving device 400 may implement the following functions:
[0300] In some embodiments, the Bluetooth module in the communicator 220 is configured to: receive a scanning signal sent by the terminal device 300;
[0301] The processor 210 is configured to: in response to a scan signal sent by the terminal device 300, control the Bluetooth module to establish an ACL connection with the terminal device 300; and receive a BIS identifier configured by the terminal device 300 through the ACL connection;
[0302] The Bluetooth module in the communicator 220 is configured to: receive a plurality of BIS streams, each BIS stream including BIS audio data and a BIS identifier corresponding to the BIS audio;
[0303] Obtain target BIS audio from the multiple BIS audios, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0304] Corresponding to the scenario diagram shown in FIG24 , an embodiment of the present disclosure provides an audio control method as shown in FIG26 below.
[0305] FIG26 is a flow chart of another audio control method according to some embodiments. As shown in FIG26 , the method is implemented through interaction between a display device and N audio receiving devices. FIG26 only shows audio receiving device 1 and audio receiving device N. The audio receiving devices involved in the following steps may refer to any of the N audio receiving devices. The method may include, but is not limited to, the following steps:
[0306] 1400. The display device determines the channel information to be configured.
[0307] The channel information to be configured may be information about a channel combination of one or more channels. In one embodiment of the present disclosure, a 2.0 channel combination for two channels includes a left front channel and a right front channel; a channel combination for three channels includes a 2.1 channel combination and a 3.0 channel combination, wherein the 2.1 channel combination includes a left front channel, a right front channel, and a bass channel, and the 3.0 channel combination includes a left front channel, a right front channel, and a center channel; a 3.1 channel combination, a 2.2 channel combination, and a 4.0 channel combination for four channels include a 3.1 channel combination, a 2.2 channel combination, and a 4.0 channel combination, wherein the 3.1 channel combination includes a left front channel, a right front channel, a center channel, and a bass channel, the 2.2 channel combination includes a left front channel, a right front channel, and two bass channels, and the 4.0 channel combination includes a left front channel, a right front channel, a left rear ambient channel, and a right rear ambient channel.
[0308] 1401. The display device determines, through Bluetooth scanning, several audio receiving devices to be connected.
[0309] In the embodiment of the present disclosure, the display device may select some devices from the aforementioned multiple audio receiving devices as speakers for each channel based on the to-be-configured channel information.
[0310] In an embodiment of the present disclosure, before the display device broadcasts multiple BIS audios, it can first scan several audio receiving devices to be connected, and configure the multiple audio receiving devices according to the channel combination information to be configured. During the configuration process, it is necessary to scan the audio receiving devices via Bluetooth and configure them through ACL connection.
[0311] In the disclosed embodiment, the audio receiving device may be scanned and configured when the display device is currently playing audio media, or the display device may be scanned and configured when the display device is not playing audio media.
[0312] In some embodiments, a home speaker application can be installed on a display device. The home speaker application can be a third-party application or a system application, and the application identifier of the home speaker application can be displayed in the interface of the display device. In one embodiment of the present disclosure, Figure 27 is a schematic diagram of an interface for displaying the application identifier of a Bluetooth speaker application on a display device according to some embodiments. As shown in Figure 27, the display device is a television, and the application identifier 151 of the Bluetooth speaker application is displayed on the screen of the television.
[0313] In response to a user's activation of the home speaker application, a channel combination selection interface is displayed on the display device. Figure 28 is a schematic diagram of a channel combination selection interface according to some embodiments. The activation of the home speaker application may be a click operation on the application identifier of the home speaker application. As shown in Figure 28, the channel combination selection interface may include identifications of six combinations: a 2.0 channel combination for two channels includes a left front channel and a right front channel; a channel combination for three channels includes a 2.1 channel combination and a 3.0 channel combination, the 2.1 channel combination includes a left front channel, a right front channel and a bass channel, and the 3.0 channel combination includes a left front channel, a right front channel and a center channel; a 3.1 channel combination, a 2.2 channel combination and a 4.0 channel combination for four channels, the 3.1 channel combination includes a left front channel, a right front channel, a center channel and a bass channel, the 2.2 channel combination includes a left front channel, a right front channel and two bass channels, and the 4.0 channel combination includes a left front channel, a right front channel, a left rear ambient channel and a right rear ambient channel.
[0314] In some embodiments, the channel combination selection interface shown in FIG. 28 may be an interface in a home speaker application, and the display of the channel combination selection interface may be triggered by operations on the home speaker application.
[0315] In other embodiments, the channel combination selection interface shown in FIG. 28 may also be an interface in a setting interface (also referred to as a setting interface) of a display device.
[0316] For the channel combinations displayed in the channel combination selection interface shown in Figure 28, if the display device is not currently playing audio media, a channel combination can be selected in response to a user instruction received by the display device. The user instruction can be a user touch operation on the icon of a channel combination in the channel combination selection interface, or the user instruction can be a selection instruction for a channel combination sent by the user via the remote control of the display device or other associated device.
[0317] For the channel combination displayed in the channel combination selection interface shown in Figure 28, when the display device is currently playing audio media, the channel information to be configured (channel combination to be configured) can be determined based on the channel information of the audio media currently played by the display device, that is, the corresponding channel combination can be selected from the channel combinations displayed in the channel combination selection interface.
[0318] In some embodiments, based on the channel information of the audio media currently played by the display device, the channel combination to be configured can be determined by selecting a channel combination that matches the channel information of the audio media currently played by the display device from the channel combinations displayed in the channel combination selection interface. Wherein, when there is a first channel combination with the same channel information as the audio media among the channel combinations displayed in the channel combination selection interface, the first channel combination can be selected for subsequent configuration. When there is no first channel combination with the same channel information as the audio media among the channel combinations displayed in the channel combination selection interface, the second channel combination with the highest similarity to the channel information of the audio media can be selected for subsequent configuration. Wherein, the channel combinations displayed in the channel combination selection interface are the channel combinations supported by the current display device.
[0319] The second channel combination having the highest similarity to the channel information of the audio media asset may be: the channel combination having the most channels identical to the channel information of the audio media asset among the channel combinations supported by the current display device.
[0320] In some embodiments, determining the channel combination to be configured based on the channel information of the audio media currently played by the display device may further include, if no channel combination supported by the current display device matches the channel information of the audio media currently played by the display device, determining the channel combination with the highest configuration among the channel combinations supported by the current display device as the channel information to be configured. The channel combination with the highest configuration may include the one with the largest number of channels.
[0321] In one embodiment of the present disclosure, it is assumed that the channel information of the audio media currently played by the display device is a 5.1 channel combination, and the 5.1 channel combination includes a center channel, a left front channel, a right front channel, a left rear ambient channel, a right rear ambient channel, and a subwoofer channel. The channel combinations shown in Figure 28 include: a 2.0 channel combination, a 2.1 channel combination, a 3.0 channel combination, a 3.1 channel combination, a 2.2 channel combination, and a 4.0 channel combination. Among them, the 4.0 channel combination includes a left front channel, a right front channel, a center channel, and a subwoofer channel. The 4.0 channel combination has the highest similarity with the 5.1 channel combination. Therefore, if the channel information of the audio media is 5.1 channels, the 4.0 channel combination can be selected for subsequent settings.
[0322] In one embodiment of the present disclosure, assuming that the channel information of the audio media currently being played by the display device is a 3.1 channel combination, the channel combinations to be selected shown in FIG28 include: 2.0 channel combination, 2.1 channel combination, 3.0 channel combination, 3.1 channel combination, 2.2 channel combination, and 4.0 channel combination. The 3.1 channel combination shown in FIG30 is the same as the channel information of the audio media, and the 3.1 channel combination can be selected for subsequent settings.
[0323] In some embodiments, in response to a user's activation of the home speaker application, the audio output mode selection interface shown in FIG. 29 is first displayed. After receiving a selection instruction for the "Bluetooth Home Theater" audio output mode in the audio output mode selection interface, the channel combination selection interface shown in FIG. 28 is displayed. In the "Bluetooth Home Theater" audio output mode, multiple audio receiving devices can be configured for the display device to output audio from different channels. FIG. 29 is a schematic diagram of an audio output mode selection interface according to some embodiments.
[0324] In some embodiments, after a certain channel combination is selected, speakers of different channels in the selected channel combination may be configured as different audio receiving devices, as shown in FIG. 28 and FIG. 30 described below.
[0325] Figure 30 is a schematic diagram of a setting interface for configuring a speaker combination according to some embodiments. After selecting a 3.1 channel combination in the channel combination selection interface shown in Figure 16, an interface 1701 as shown in (a) of Figure 30 may be displayed. This interface 1701 is a setting interface for the 3.1 channel speaker combination, and shows the speaker combination to be configured corresponding to the 3.1 channel combination, including a left front speaker, a right front speaker, a center speaker, and a subwoofer. The left front speaker in the speaker combination corresponds to the left front channel in the 3.1 channel combination, the right front speaker corresponds to the right front channel in the 3.1 channel combination, the center speaker corresponds to the center channel in the 3.1 channel combination, and the subwoofer corresponds to the bass channel in the 3.1 channel combination. As shown in (a) in Figure 30, after the TV receives the user's trigger operation for the setting control 1702 for the left front speaker, the TV can be triggered to determine one or more audio receiving devices to be connected through Bluetooth scanning (i.e., execute the above step 1401), and display the setting interface 1703 of the left front speaker as shown in (b) in Figure 30. In the setting interface 1703 of the left front speaker, the identification of the audio receiving device to be connected can be displayed: "Bluetooth Speaker 1 Tooth", "Bluetooth Speaker 2 Tooth" and "Bluetooth Speaker 3 Tooth".
[0326] In some embodiments, after selecting a certain channel combination, the display device can first determine the audio receiving devices that can be discovered through the Bluetooth scanning function, and then the display device can select different audio receiving devices from these audio receiving devices to be configured as speakers of different channels, as shown in Figures 31, 32 and 33.
[0327] FIG31 is a schematic diagram of an interface for scanning audio receiving devices according to some embodiments. After selecting a 3.1 channel combination in the channel combination selection interface shown in FIG28 , the display device can be triggered to perform a Bluetooth scan, pair with a nearby Bluetooth device, and identify the scanned Bluetooth device as an available Bluetooth speaker. The interface shown in FIG31 can be displayed, in which the device identifiers corresponding to the available Bluetooth speakers are displayed, namely: "Bluetooth Speaker 1 Bluetooth," "Bluetooth Speaker 2 Bluetooth," and "Bluetooth Speaker 3 Bluetooth."
[0328] After selecting the device identifier corresponding to the Bluetooth speaker "Bluetooth Speaker 1 tooth" in Figure 31, the audio receiving device and display device indicated by "Bluetooth Speaker 1 tooth" can be paired and connected, and an interface as shown in Figure 32 can be displayed. Figure 32 is a schematic diagram of a pairing interface according to some embodiments.
[0329] It should be noted that, in response to the user's opening operation for the home speaker application, the display device may first determine whether it is the first time to configure the speaker (i.e., the first time to configure the speaker for the display device). If it is the first time to configure the speaker, it may trigger the display of the channel combination selection interface shown in FIG28 for subsequent configuration operations. If it is not the first time to configure the speaker, the configuration information after the previous configuration can be displayed to facilitate the user to determine whether to reconfigure.
[0330] In one embodiment of the present disclosure, FIG33 is a schematic diagram of an interface displaying configuration information after speaker configuration has been performed according to some embodiments. In response to a user opening the home speaker application, if this is not the first time the speaker configuration has been performed, the interface shown in FIG33 may be triggered to display. FIG33 shows the identifiers of the Bluetooth speakers currently configured for each channel. Specifically, the left front speaker corresponding to the left front channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 1"; the right front speaker corresponding to the right front channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 2"; the center speaker corresponding to the center channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 3"; and the subwoofer corresponding to the bass channel may be configured as the audio receiving device indicated by "Bluetooth Speaker 4" . Furthermore, the interface includes a "Reset" control for triggering modification of the speaker configuration and a "Confirm" control for triggering confirmation of the currently saved speaker configuration.
[0331] In some embodiments, in the process of determining several audio receiving devices to be connected through Bluetooth scanning, the display device can first turn on the Bluetooth scanning function to scan the Bluetooth devices near the display device. After the display device receives the broadcast information sent by the Bluetooth device, the Bluetooth device that sends the broadcast information can be determined as the audio receiving device to be connected, wherein the broadcast information may include the identification of the Bluetooth device.
[0332] In the above embodiment, all Bluetooth devices that can receive broadcast information from the display device are determined as audio receiving devices to be connected, and can be displayed in the speaker settings interface. For example, the Bluetooth speakers 1, 2, and 3 displayed in the interface 1703 shown in FIG30(b) indicate that the display device can receive broadcast information. Since BIS audio needs to be sent based on LE Audio technology in the future, if there is a device that does not support LE Audio technology among Bluetooth speakers 1, 2, and 3, it will affect the subsequent audio transmission process and cannot be configured with a BIS identifier. Therefore, after receiving an instruction from the user to select a Bluetooth speaker (such as Bluetooth speaker 1) in the interface 1703, an ACL connection can be established with the Bluetooth speaker 1 first, and the type information of the Bluetooth speaker 1 sent by the Bluetooth speaker 1 can be obtained through the ACL connection. If the Bluetooth speaker 1 is determined to be a device that supports LE Audio technology, the Bluetooth speaker 1 can be determined as the audio receiving device to be connected. The type information of the Bluetooth speaker 1 can be the UUID of the Bluetooth speaker 1.
[0333] In some embodiments, in the process of determining several audio receiving devices to be connected through Bluetooth scanning, the display device can first turn on the Bluetooth scanning function to scan Bluetooth devices near the display device. After the display device receives the broadcast information sent by the Bluetooth device, it can first obtain the type of the Bluetooth device from the broadcast information. When it is determined that the device is a device that supports LE Audio technology, the Bluetooth device of the broadcast information can be determined as the audio receiving device to be connected, wherein the broadcast information may include the identification of the Bluetooth device and the type information of the Bluetooth device.
[0334] The Bluetooth device type information may be the UUID of the Bluetooth device. Since the UUIDs for Classic Bluetooth and LE Audio are different, the UUID can be used to identify whether the Bluetooth device's UUID supports LE Audio. If the UUID is determined to be a type that supports LE Audio, the Bluetooth device is considered to support LE Audio.
[0335] The following describes, in an embodiment of the present disclosure, how to trigger the execution of the above-mentioned step 1401 in the case where the display device currently plays audio media.
[0336] Figure 34 is a schematic diagram of an audio media playback interface according to some embodiments. As shown in Figure 34 , when a display device plays audio media, an audio playback interface 2001 shown in Figure 34 (a) may be displayed. After the display device receives a sound configuration instruction, a sound configuration interface 2002 shown in Figure 34 (b) may be invoked on top of the audio playback interface. A "Set Bluetooth Surround Sound" control 2003 may be configured in the sound configuration interface 2002. After the display device receives a selection instruction for control 2003, the display device may obtain channel information of the currently playing audio media and select subsequent channel combinations based on the channel information of the audio media.
[0337] Figure 35 is a schematic diagram of a channel combination selection interface according to some embodiments. Figure 35 (a) shows a channel combination selection interface 2101, which displays that the currently playing audio media is 5.1, i.e., the channel combination is 5.1, and displays four channel combinations for the user to select and configure: 3.1 channel combination, 2.1 channel combination, 3.0 channel combination, and 2.0 channel combination.
[0338] In some embodiments, FIG35(a) shows a channel combination selection interface 2101, where the user can learn the channel combination of the currently playing audio media and the available channel combinations, thereby facilitating user selection. The display device can then select a channel combination from the currently selected channel combinations in response to user instructions.
[0339] In some embodiments, the display device may automatically select, from the channel combinations to be selected, a 3.1 channel combination that is most similar to the 5.1 channel combination of the currently played audio media asset for configuration.
[0340] After a channel combination is selected in the channel combination selection interface 2101 as shown in (a) of Figure 35 and a selection instruction is received for the "Configure Speaker" control 2102, the display device can be triggered to perform Bluetooth scanning, pair with nearby Bluetooth devices, and determine the scanned Bluetooth device as an available Bluetooth speaker, and display the interface shown in (b) of Figure 35, in which the device identifiers corresponding to the available Bluetooth speakers can be displayed, namely: "Bluetooth Speaker 1 tooth", "Bluetooth Speaker 2 tooth" and "Bluetooth Speaker 3 tooth". Among them, Bluetooth Speaker 1, Bluetooth Speaker 2 and Bluetooth Speaker 3 are Bluetooth devices scanned by the display device through the Bluetooth scanning function. Further, after the display device receives the selection instruction for the device identifier "Bluetooth Speaker 1 tooth" in the interface shown in (b) of Figure 35, the display device can establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1 tooth", and further configure the BIS identifier of the corresponding channel for the audio receiving device, as well as the volume of the audio receiving device, etc. through the ACL connection.
[0341] In some embodiments, in the sound configuration interface 2002 shown in Figure 34, if a selection instruction for the "Set Bluetooth Surround Sound" control 2003 is received, the display device can first determine whether the audio output mode of the currently played audio media has been configured as Bluetooth Surround Sound mode, that is, whether different speakers have been configured for different channels for output, and display an interface as shown in Figure 36 when it is determined that it has been configured as Bluetooth Surround Sound mode. Figure 36 is a schematic diagram of another channel combination selection interface according to some embodiments. As shown in Figure 36, the interface can show that the currently configured channel combination is a 3.1 channel combination, and a "Turn Off Bluetooth Surround Sound" control is provided. After receiving the selection operation for the "Turn Off Bluetooth Surround Sound" control, the audio output mode can be switched to normal output mode, that is, the speaker output of the display device itself.
[0342] 1402. The display device establishes an ACL connection with multiple audio receiving devices.
[0343] 1403. The display device sends a configured BIS identifier to each of the multiple audio receiving devices through the ACL connection based on the channel information to be configured.
[0344] Among them, different audio receiving devices correspond to different BIS identifiers, and different BIS identifiers are used to represent BIS audio corresponding to different channels.
[0345] The display device sends the configured BIS identifier to the audio receiving device through the ACL connection so that when multiple BIS audios are subsequently broadcast, the audio receiving device can select the BIS audio corresponding to the channel it wants to play based on the configured BIS identifier after receiving multiple BIS audios.
[0346] In some embodiments, the display device sends a configured BIS identifier to each audio receiving device in a plurality of audio receiving devices through an ACL connection based on the channel information to be configured, including: the display device configures the BIS identifier based on the channel information to be configured, and the display device sends the configured BIS identifier to each audio receiving device in a plurality of audio receiving devices through an ACL connection.
[0347] In some embodiments, after configuring the BIS identifier based on the channel information to be configured, the display device may directly send the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection.
[0348] In other embodiments, after configuring the BIS identifier based on the channel information to be configured, the display device can first start the built-in broadcast assistant function (i.e., the above-mentioned BASS) to scan the broadcast sound source. After scanning the BIS broadcast stream that matches the configured BIS identifier, the display device can send the configured BIS identifier to each audio receiving device in the multiple audio receiving devices through the ACL connection.
[0349] Among them, the display device can broadcast preset audio, and during the broadcast process, the above-mentioned startup built-in broadcast assistant function is executed to scan the preset audio source of the display device's own broadcast to determine whether there is a BIS broadcast stream that matches the configured BIS identifier.
[0350] 1404. The display device configures the volume of multiple audio receiving devices through ACL connection.
[0351] The display device may send the volume parameters configured for each audio receiving device to the corresponding audio receiving device through the ACL connection, so that each audio receiving device may adjust its own volume after receiving the volume parameters.
[0352] The above volume parameters may be default configuration parameters or user-configured parameters.
[0353] In some embodiments, the display device can sequentially establish an ACL connection with each of the multiple audio receiving devices. After the display device establishes an ACL connection with an audio receiving device, the volume of the audio receiving device is configured while the ACL connection is maintained, and the configured BIS identifier is sent to the audio receiving device. After the configuration of the audio receiving device is completed, the ACL connection is disconnected, and the ACL connection is established with the next audio receiving device to configure the volume and BIS identifier.
[0354] In an embodiment of the present disclosure, before configuring the volume and BIS identifier by sequentially establishing an ACL connection between a display device and each of a plurality of audio receiving devices, consideration may be given to whether to sequentially establish ACL connections based on the occupancy of the display device's Bluetooth link and / or the number of ACL connections supported by the Bluetooth protocol stack. In the embodiment of the present disclosure, the ACL connections established for volume configuration and BIS identifier configuration may both be ACL connections established based on LE Audio.
[0355] In some embodiments, when the occupancy of the Bluetooth link of the display device indicates that there is only one idle Bluetooth link, the configuration can be performed by establishing ACL connections in sequence; in the opposite case, the configuration can be performed by establishing ACL connections between the display device and multiple audio receiving devices at the same time.
[0356] In some embodiments, if the occupancy of the Bluetooth link of the display device indicates that the current Bluetooth link is occupied by other ACL connections established based on classic Bluetooth, then it is possible to consider disconnecting the ACL connection established based on classic Bluetooth, giving priority to configuring the Bluetooth link to the ACL connection established based on LE Audio, and performing volume configuration and BIS identifier configuration. Among them, if there is only one idle Bluetooth link after disconnecting the ACL connection established based on classic Bluetooth, then the method of establishing ACL connections in sequence can be used for configuration; in the opposite case, the display device can be configured by simultaneously connecting to multiple audio receiving devices through ACL.
[0357] In some embodiments, when the Bluetooth protocol stack supports one ACL connection to be established simultaneously, the configuration can be performed by sequentially establishing ACL connections. Conversely, the configuration can be performed by simultaneously establishing ACL connections between the display device and multiple audio receiving devices.
[0358] In some embodiments, when the Bluetooth protocol stack supports multiple ACL connections to be established simultaneously, the number of ACL connections that the Bluetooth protocol stack supports to be established simultaneously can be compared with the number of ACL connections that have been established currently to determine the number of ACL connections that are currently remaining to be established. When the number of ACL connections that are currently remaining to be established is 1, the configuration can be performed by sequentially establishing ACL connections. In the opposite case, the configuration can be performed by simultaneously connecting the display device to multiple audio receiving devices through ACLs.
[0359] In one embodiment of the present disclosure, after the display device receives the selection instruction for “Bluetooth Speaker 1 Tooth” in the setting interface 1703 for the left front speaker shown in (b) of Figure 30, the display device can establish an ACL connection with the audio receiving device indicated by the “Bluetooth Speaker 1 Tooth”, and establish an ACL with the audio receiving device indicated by the “Bluetooth Speaker 1 Tooth”. Furthermore, since the setting interface 1703 for the left front speaker shown in (b) of Figure 30 is for setting up a speaker for the left front channel, after receiving the selection instruction for “Bluetooth Speaker 1 Tooth”, the audio receiving device indicated by the “Bluetooth Speaker 1 Tooth” is configured as the speaker corresponding to the left front channel, and after the display device establishes an ACL connection with the audio receiving device indicated by the “Bluetooth Speaker 1 Tooth”, the display device will send the BIS identifier indicating the left front channel to the audio receiving device indicated by the “Bluetooth Speaker 1 Tooth” through the ACL connection.
[0360] Figure 37 is a schematic diagram of a volume adjustment interface according to some embodiments. After the display device receives the selection instruction of "Bluetooth Speaker 1 Tooth" in the setting interface 1703 for the left front speaker shown in (b) of Figure 30, it can trigger the display of the volume adjustment interface 2201 shown in Figure 37, which includes a volume adjustment control 2202 for the audio receiving device indicated by "Bluetooth Speaker 1 Tooth" and a volume adjustment control 2203 for TV volume adjustment (the display device is a TV). The display device can control the volume adjustment control 2202 through the received volume adjustment instruction, and obtain the corresponding volume parameter and send it to the audio receiving device indicated by "Bluetooth Speaker 1 Tooth" through the ACL connection; the display device can also control the volume adjustment control 2203 through the received volume adjustment instruction, and obtain its own volume parameter to adjust the volume of the display device itself.
[0361] The above-mentioned volume adjustment commands can all be input by the user. When controlling the volume adjustment control 2202 and the volume adjustment control 2203 using the received volume adjustment command, a preset audio can be played so that the user can understand the volume effect of the adjustment based on the audio heard during the volume adjustment process, facilitating the adjustment of the volume to the appropriate parameters. Furthermore, after the volume adjustment is completed, the settings for the left front speaker of the left front channel can be saved. The user can then enter the next speaker setting interface and continue to set the speaker for the next channel.
[0362] FIG38 is a schematic diagram of another setting interface for configuring a speaker combination according to some embodiments. After the configuration of the left front speaker is completed, an interface 2301 as shown in (a) of Figure 38 can be displayed. In the interface 2301, the current configuration status information 2303 of the left front speaker can be displayed as "Bluetooth Speaker 1 tooth, identifying the left front speaker as the audio receiving device indicated by "Bluetooth Speaker 1 tooth". As shown in (a) of Figure 38, after the display device receives the trigger operation of the setting control 2302 for the right front speaker in the interface 2301, the TV can be triggered to determine one or more audio receiving devices to be connected through Bluetooth scanning (i.e., execute the above step 1401), and display the setting interface 2304 of the right front speaker as shown in (b) of Figure 38. In the setting interface 2304 of the right front speaker, the identification of the audio receiving device to be connected can be displayed: "Bluetooth Speaker 1 tooth", "Bluetooth Speaker 2 tooth and "Bluetooth Speaker 3 tooth", and for the "Bluetooth Speaker 1 tooth" that has been configured as the left front speaker, the identification information 2305 can be displayed: "Left Front" to indicate that "Bluetooth Speaker 1 tooth has been configured as the left front speaker.
[0363] In some embodiments, if an audio receiving device that has been configured for other channels is selected when configuring speakers for a certain channel, the display device can output a prompt message to indicate that the audio receiving device has been configured for other channels and ask the user whether to change it, which can improve human-computer interaction performance.
[0364] FIG39 is a schematic diagram of an interface for outputting prompt information according to some embodiments. In the right front speaker setting interface 2304 shown in (b) of FIG38 above, if the display device receives a selection operation for "Bluetooth speaker 1 tooth", since the audio receiving device indicated by "Bluetooth speaker 1 tooth" has previously been configured as the left front speaker and is now to be configured as the right front speaker, the display device can display an interface as shown in FIG39, prompting the user through the prompt information in the interface "This Bluetooth speaker 1 has been set as the left front speaker, confirm whether to reset the location information of the device?", and further confirm whether to configure the audio receiving device indicated by "Bluetooth speaker 1 tooth" as the right front speaker by the user selecting "Cancel" or "Reset" on the control. In particular, if a selection instruction for the "Reset" control is received, the audio receiving device indicated by "Bluetooth speaker 1 tooth" is configured as the right front speaker. If a selection instruction for the "Cancel" control is received, the display device can return to the right front speaker setting interface 2304 shown in (b) of FIG38 above, and reselect the audio receiving device to be configured as the right front speaker. After the speakers for each channel are set up, a setting success interface as shown in Figure 40 can be displayed. Figure 40 is a schematic diagram of a setting success interface according to some embodiments. A prompt message is displayed in the setting success interface shown in Figure 40 to remind the user that the speakers for each channel have been set up. After the display device receives the selection operation for the "Done" control, it can save the current configuration, trigger the Bluetooth home theater function, and start broadcasting multiple BIS streams.
[0365] In some embodiments, in the interface shown in (b) of Figure 21 above, when a selection instruction for "Bluetooth Speaker 1 Tooth" is received, the display device can establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1 Tooth" and further configure the channel and volume.
[0366] FIG41 is a schematic diagram of a channel and volume configuration interface according to some embodiments. As shown in FIG41 , for the connected Bluetooth speaker "Bluetooth Speaker 1 tooth," one can select a channel from "Left Front Channel," "Right Front Channel," "Center Channel," and "Bass Channel" for configuration. Furthermore, the volume of the connected Bluetooth speaker "Bluetooth Speaker 1 tooth" can be adjusted using the volume adjustment control 2601 for "Bluetooth Speaker 1 tooth" shown in FIG41 . The adjusted volume parameter is then sent to the audio receiving device indicated by "Bluetooth Speaker 1 tooth" for volume configuration.
[0367] After configuring the volume and channels of "Bluetooth Speaker 1" in the configuration interface shown in Figure 41, you can also trigger the configuration of the next connected Bluetooth speaker by receiving a selection instruction for the "Continue Configuration" control in the matching interface, and until the speakers of all channels are configured, you can complete all configurations by receiving a selection instruction for the "Finish" control in the matching interface. After completing all configurations, the interface shown in Figure 42 can be displayed. Figure 42 is a schematic diagram of a configuration completed interface according to some embodiments. In Figure 42, "Switched to Bluetooth Surround Sound 3.1" can be displayed to prompt the user that the current mode of playing audio media is channel combination 3.1.
[0368] In the above implementation, the display device sequentially establishes an ACL connection with each audio receiving device, and configures the audio receiving device using the ACL connection device. After the configuration is complete, the display device disconnects the ACL connection with the audio receiving device and continues to establish an ACL connection with the next audio receiving device, continuing the configuration until all the speakers of all channels are configured. This method of sequentially establishing ACL connections for configuration takes into account the limited number of Bluetooth links that currently support ACL connections in display devices. By only establishing one ACL connection at a time for configuration, the number of Bluetooth links that support ACL connections can be reduced during the configuration process, preventing the Bluetooth link that supports ACL connections in the display device from being occupied by a single audio receiving device for a long time.
[0369] In some embodiments, the display device may also establish ACL connections with multiple audio receiving devices at the same time, and simultaneously configure BIS identifiers corresponding to different channels and perform volume configuration on the multiple audio receiving devices.
[0370] In an embodiment of the present disclosure, taking the example of configuring the left front speaker as the audio receiving device indicated by "Bluetooth speaker 1 tooth", the right front speaker as the audio receiving device indicated by "Bluetooth speaker 2 tooth", the center speaker as the audio receiving device indicated by "Bluetooth speaker 3 tooth", and the subwoofer as the audio receiving device indicated by "Bluetooth speaker 4 tooth", when configuring the volume, the display device can obtain the current volume parameters of the four audio receiving devices and display them in the same interface, so that the display device can adjust the volume of the display device and the four audio receiving devices in the interface by receiving the user's volume adjustment instructions for the interface.
[0371] FIG43 is a schematic diagram of a volume adjustment interface according to some embodiments. As shown in FIG43 , the volume adjustment interface can simultaneously display: a volume adjustment control 2801 for the audio receiving device indicated by “Bluetooth Speaker 1 tooth,” a volume adjustment control 2802 for the audio receiving device indicated by “Bluetooth Speaker 2 tooth,” a volume adjustment control 2803 for the audio receiving device indicated by “Bluetooth Speaker 3 tooth,” a volume adjustment control 2804 for the audio receiving device indicated by “Bluetooth Speaker 4 tooth,” and a volume adjustment control 2805 for TV volume adjustment (the display device is a TV). The volume of each audio receiving device and / or display device can be adjusted separately through control instructions for different volume adjustment controls.
[0372] 1405. The audio receiving device saves the BIS identifier.
[0373] In the embodiment of the present disclosure, each audio receiving device will receive a BIS identifier corresponding to a certain channel sent by the display device through the ACL connection, and can save the BIS identifier.
[0374] In an embodiment of the present disclosure, taking the display device configuring four audio receiving devices as four-channel speakers as an example, it is assumed that the four audio receiving devices are identified as: Bluetooth speaker 1, Bluetooth speaker 2, Bluetooth speaker 3 and Bluetooth speaker 4, among which Bluetooth speaker 1 is configured as the left front speaker, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 1 is BIS-A, and Bluetooth speaker 1 saves the BIS-A; Bluetooth speaker 2 is configured as the right front speaker, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 2 is BIS-B, and Bluetooth speaker 2 saves the BIS-B; Bluetooth speaker 3 is configured as the center speaker, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 3 is BIS-C, and Bluetooth speaker 3 saves the BIS-C; Bluetooth speaker 4 is configured as a subwoofer, and the corresponding BIS identifier sent by the display device to Bluetooth speaker 3 is BIS-D, and Bluetooth speaker 4 saves the BIS-D.
[0375] 1406. The display device broadcasts multiple BIS streams.
[0376] Each BIS stream includes BIS audio data and a BIS identifier corresponding to the BIS audio.
[0377] In the embodiment of the present disclosure, FIG26 shows a solution in which the display device first configures the audio receiving device and then broadcasts multiple BIS streams. It should be noted that multiple BIS streams can also be broadcast before the display device configures the audio receiving device.
[0378] In some embodiments, the BIS audio in each BIS stream may include audio of a single channel or audio of multiple channels.
[0379] 1407. The audio receiving device receives multiple BIS streams.
[0380] Among them, after the display device sends the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection, it can broadcast multiple BIS streams, each BIS stream including BIS audio data and the BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain the target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0381] In the disclosed embodiments, when broadcasting multiple BIS streams, public broadcasting or encrypted broadcasting can be used. Using encrypted broadcasting when broadcasting multiple BIS streams means that the multiple BIS streams are encrypted. Authorized devices can obtain the decryption key to correctly decrypt the broadcast information, while unauthorized devices cannot obtain the decryption key and cannot obtain the correct information even if they intercept the broadcast data. This ensures information security.
[0382] 1408. The audio receiving device obtains target BIS audio from multiple BIS audios.
[0383] The BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0384] In one embodiment of the present disclosure, a display device broadcasts audio data that may include four channels of BIS audio, including: BIS audio for the left front channel, with a corresponding BIS identifier of BIS-A; BIS audio for the right front channel, with a corresponding BIS identifier of BIS-B; BIS audio for the center channel, with a corresponding BIS identifier of BIS-C; and BIS audio for the subwoofer channel, with a corresponding BIS identifier of BIS-D. Accordingly, after receiving the audio data, Bluetooth speakers 1, 2, 3, and 4 can match the audio data with their stored BIS identifiers and select the target BIS audio. In a certain embodiment of the present disclosure, taking the example of Bluetooth speaker 1 storing BIS-A, Bluetooth speaker 2 storing BIS-B, Bluetooth speaker 3 storing BIS-C, and Bluetooth speaker 4 storing BIS-D, Bluetooth speaker 1 will determine the BIS audio of the left front channel as the target BIS audio; Bluetooth speaker 2 will determine the BIS audio of the right front channel as the target BIS audio; Bluetooth speaker 3 will determine the BIS audio of the center channel as the target BIS audio; Bluetooth speaker 2 will determine the BIS audio of the bass channel as the target BIS audio.
[0385] 1409. The audio receiving device plays the target BIS audio.
[0386] In the disclosed embodiment, each audio receiving device can play the BIS audio of its corresponding channel, thereby achieving a stereo playback effect, that is, a Bluetooth home theater playback effect.
[0387] According to the display device, audio receiving device and multi-channel audio transmission method of some embodiments, the display device can obtain the channel information to be configured, and can determine several audio receiving devices to be connected through Bluetooth scanning, and establish an ACL connection with multiple audio receiving devices therein. After the ACL connection is established, a BIS identifier can be configured for each of the multiple audio receiving devices based on the channel information to be configured, and the configured BIS identifier can be sent to each of the multiple audio receiving devices through the ACL connection. The multiple audio receiving devices are some or all of the several audio receiving devices. After the configuration is completed, the display device can broadcast multiple BIS streams, each BIS stream including BIS audio data and a BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain target BIS audio from multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier. Through this solution, the display device configures different channel speakers (i.e., audio receiving devices corresponding to different channels) based on ACL connection, and can simultaneously send multiple channel broadcast isochronous streams (Broadcaster, BIS) of multiple channels to multiple audio receiving devices based on broadcast mode. In this way, without occupying the Bluetooth link of the display device, multiple channel audio can be played simultaneously through multiple audio receiving devices, thereby achieving a stereo playback effect.
[0388] Corresponding to the scenario diagram shown in FIG24 , an embodiment of the present disclosure provides an audio control method as shown in FIG44 below.
[0389] Figure 44 is a flowchart of another audio control method according to some embodiments. As shown in Figure 44, the method is implemented through interaction between a display device, a control terminal, and N audio receiving devices. Figure 44 only shows audio receiving device 1 and audio receiving device N. The audio receiving device involved in the following steps may refer to any audio receiving device among the N audio receiving devices. The method may include but is not limited to the following steps:
[0390] 2901. The display device determines the channel information to be configured.
[0391] The description of step 2901 can refer to the above description of step 1400 and will not be repeated here.
[0392] 2902. The display device sends the channel information to be configured to the control terminal.
[0393] In an embodiment of the present disclosure, the display device may send the channel information to be configured to the control terminal, so that after the control terminal learns the channel information to be configured, it configures the corresponding audio receiving device as the speaker of each channel for the display device based on the channel information to be configured.
[0394] The display device and the control terminal may establish a communication connection via wireless communication, and send the channel information to be configured.
[0395] In one embodiment of the present disclosure, a Wi-Fi connection may be established between the display device and the control terminal via a Wireless Fidelity (Wi-Fi) network, and the display device sends the channel information to be configured to the control terminal via the Wi-Fi connection; or, an ACL connection may be established between the display device and the control terminal via a Bluetooth network, and the display device sends the channel information to be configured to the control terminal via the ACL connection.
[0396] In an embodiment of the present disclosure, in the interface shown in FIG. 28 above, after receiving the selection instruction for the 3.1 channel combination, the display device determines the channel information to be configured. At this time, the display device can be triggered to send the channel information to be configured to the control terminal, that is, the information of the 3.1 channel combination is sent to the control terminal.
[0397] In an embodiment of the present disclosure, in the interface 2101 shown in (a) in the above Figure 35, after receiving the selection instruction for the control 2103 "Configure speakers through mobile phone", the display device determines the channel information to be configured. At this time, the display device can be triggered to send the channel information to be configured to the control terminal, that is, to send the information of the 3.1 channel combination to the control terminal.
[0398] 2903. The control terminal determines several audio receiving devices to be connected through Bluetooth scanning.
[0399] In a certain embodiment of the present disclosure, after the display device sends the channel information to be configured to the control terminal, the control terminal can configure the corresponding audio receiving device as the speaker of each channel for the display device based on the channel information to be configured, that is, configure the BIS identifier, and further configure the volume.
[0400] In some embodiments, a broadcast assistant application may be provided in the control terminal, and the broadcast assistant application may be used to implement a function of configuring a corresponding audio receiving device for the display device as a speaker for each channel.
[0401] Figure 45 is a schematic diagram of an interface for triggering the start of a broadcast assistant application according to some embodiments. In one embodiment of the present disclosure, as shown in Figure 45, the application identifier 3001 of the broadcast assistant application can be displayed on the display screen of the control terminal. After receiving the user's selection instruction for the application identifier of the broadcast assistant application, the broadcast assistant function can be turned on in response to the selection instruction for subsequent configuration. After the broadcast assistant function is turned on and the control terminal receives the channel information to be configured sent by the display device, the control terminal can determine several audio receiving devices to be connected based on the broadcast assistant application through Bluetooth scanning.
[0402] FIG46 is a schematic diagram of a control terminal scanning for available Bluetooth speakers according to some embodiments. As shown in FIG46 , the interface displays the device identifiers corresponding to the available Bluetooth speakers, namely, "Bluetooth Speaker 1," "Bluetooth Speaker 2," and "Bluetooth Speaker 3." Bluetooth Speaker 1, Bluetooth Speaker 2, and Bluetooth Speaker 3 are Bluetooth devices scanned by the control terminal using the Bluetooth scanning function. Furthermore, after the control terminal receives a selection instruction for "Bluetooth Speaker 1," the display device may establish an ACL connection with the audio receiving device indicated by "Bluetooth Speaker 1."
[0403] 2904. The control terminal establishes ACL connections with multiple audio receiving devices.
[0404] 2905. The control terminal configures a BIS identifier based on the channel information to be configured, and sends the configured BIS identifier to each of the multiple audio receiving devices via the ACL connection. In some embodiments, after configuring the BIS identifier based on the channel information to be configured, the control terminal may directly send the configured BIS identifier to each of the multiple audio receiving devices via the ACL connection.
[0405] In other embodiments, after configuring the BIS identifier based on the channel information to be configured, the control terminal can first start the built-in broadcast assistant function (i.e., the above-mentioned BASS) to scan the broadcast sound source. After scanning the BIS broadcast stream that matches the configured BIS identifier, the control terminal can send the configured BIS identifier to each audio receiving device in the multiple audio receiving devices through the ACL connection.
[0406] Among them, after the display device sends the channel information to be configured to the control terminal, it can broadcast the preset audio. During the broadcast process, the above-mentioned built-in broadcast assistant function is started to scan the preset audio broadcasted by the display device to determine whether there is a BIS broadcast stream that matches the configured BIS identifier.
[0407] 2906. The control terminal configures the volume of multiple audio receiving devices through ACL connection.
[0408] It should be noted that the above step 2906 is a step in a certain embodiment of the present disclosure, that is, the control terminal can configure the volume of multiple audio receiving devices through ACL connection, or it may not configure the volume of multiple audio receiving devices.
[0409] The controlling terminal configuring the volume of the multiple audio receiving devices through the ACL connection may include: the controlling terminal sending the volume parameter configured for each of the multiple audio receiving devices to the corresponding audio receiving device through the ACL connection.
[0410] In some embodiments, the control terminal can sequentially establish an ACL connection with each of the multiple audio receiving devices. After the control terminal establishes an ACL connection with an audio receiving device, the volume of the audio receiving device is configured while the ACL connection is maintained, and the configured BIS identifier is sent to the audio receiving device. After the configuration of the audio receiving device is completed, the ACL connection is disconnected, and the ACL connection is established with the next audio receiving device to configure the volume and BIS identifier.
[0411] The control terminal establishes an ACL connection with each audio receiving device in sequence, and configures the audio receiving device through the ACL connection establishment device. After the configuration is complete, the control terminal disconnects the ACL connection with the audio receiving device and continues to establish an ACL connection with the next audio receiving device, continuing the configuration until all the speakers of all channels are configured. This method of establishing ACL connections in sequence for configuration takes into account the limited number of Bluetooth links that support ACL connections in the control terminal. Only one ACL connection is established at a time for configuration. This saves the Bluetooth links that support ACL connections during the configuration process and prevents the Bluetooth link that supports ACL connections in the control terminal from being occupied by a single audio receiving device for a long time.
[0412] In some embodiments, the control terminal may also establish ACL connections with multiple audio receiving devices at the same time, and simultaneously configure BIS identifiers corresponding to different channels and perform volume configuration on the multiple audio receiving devices.
[0413] Among them, different audio receiving devices correspond to different BIS identifiers, and different BIS identifiers are used to represent BIS audio corresponding to different channels.
[0414] The above-mentioned control terminal can first determine the BIS identifier corresponding to each channel based on the channel information to be configured, and send the configured BIS identifier to the audio receiving device through the ACL connection. This is so that when multiple BIS audios are broadcast subsequently, the audio receiving device can select the BIS audio corresponding to the channel it wants to play based on the configured BIS identifier after receiving multiple BIS audios.
[0415] In one embodiment of the present disclosure, assuming the channel information to be configured is the channel information of a 3.1-channel combination, including a left front channel, a right front channel, a center channel, and a subwoofer, BIS-A can be configured as the BIS identifier for the left front channel; BIS-B can be configured as the BIS identifier for the right front channel; BIS-C can be configured as the BIS identifier for the center channel; and BIS-D can be configured as the BIS identifier for the subwoofer.
[0416] In some embodiments, the control terminal may first connect to the Bluetooth speaker and then configure the audio channels.
[0417] FIG47 is a schematic diagram of configuring channels for a connected Bluetooth speaker according to some embodiments. After the control terminal has connected to the audio receiving device indicated by “Bluetooth speaker 1 tooth”, the channel to be played can be further selected for the audio receiving device. When the left front channel is selected as shown in FIG47 , the audio receiving device indicated by “Bluetooth speaker 1 tooth” is configured as the speaker for the left front channel of the display device. At this time, the BIS identifier corresponding to the left front channel can be sent to the audio receiving device indicated by “Bluetooth speaker 1 tooth”.
[0418] Furthermore, in the interface shown in Figure 47, after the audio receiving device indicated by "Bluetooth Speaker 1" is configured as the speaker of the left front channel of the display device, you can also use the "Continue Configuration" control to trigger the return to the interface for connecting other Bluetooth speakers, such as the interface shown in Figure 46, and further connect other Bluetooth speakers and configure channels until all channels are configured with speakers. You can then use the "Done" control in the interface shown in Figure 47 to trigger the saving of the configuration.
[0419] In some embodiments, when the left front channel is selected as shown in FIG47 , the interface shown in FIG48 can be further triggered to display. FIG48 is a schematic diagram of an interface for adjusting volume through a control terminal according to some embodiments. As shown in FIG48 , the interface displays a volume adjustment control 3301 corresponding to the audio receiving device indicated by the Bluetooth speaker 1, and a TV volume adjustment control 3302 corresponding to the display device (the display device is a TV). By controlling the volume adjustment control 3301, the volume of the audio receiving device indicated by the Bluetooth speaker 1 is adjusted, and by controlling the TV volume adjustment control 3302, the volume of the display device is adjusted.
[0420] It should be noted that the interface diagram for volume adjustment through the control terminal shown in Figure 48 above is set based on the situation where the control terminal establishes ACL connections with multiple audio receiving devices in sequence. For the situation where the control terminal also establishes ACL connections with multiple audio receiving devices at the same time and configures volume to multiple audio receiving devices at the same time, the interface for volume adjustment on the control terminal can be similar to the above Figure 41.
[0421] When the control terminal establishes an ACL connection with multiple audio receiving devices, it can send corresponding volume parameters to each of the multiple audio receiving devices through the ACL connection. At the same time, when the control terminal is connected to a display device via wireless communication, the control terminal can also send the configured volume parameters to the display device, thereby enabling volume adjustment of multiple audio receiving devices and display devices through the control terminal. Furthermore, a volume setting interface similar to that shown in FIG. 41 can also be provided in the control terminal, facilitating volume adjustment of multiple audio receiving devices and display devices through the control terminal through operations on a visual interface.
[0422] In other embodiments, the control terminal may first configure the audio channel and then select the Bluetooth speaker connected to the corresponding audio channel.
[0423] Figure 49 is a schematic diagram of a channel selection interface according to some embodiments. Before the control terminal performs a Bluetooth scan, the control terminal may first display a schematic diagram of the channel selection interface as shown in Figure 49, in which the channels currently to be played are displayed: left front channel, right front channel, center channel, and bass channel.
[0424] After the control terminal receives the selection instruction for the "left front channel" shown in Figure 49, it can trigger the display of the interface shown in Figure 50. Figure 50 is a schematic diagram of an interface for setting the left front speaker according to some embodiments. Figure 50 shows the identifiers of available Bluetooth speakers scanned by the control terminal through the Bluetooth scanning function, including: "Bluetooth Speaker 1 tooth", "Bluetooth Speaker 2 tooth" and "Bluetooth Speaker 3 tooth". After receiving the selection instruction for "Bluetooth Speaker 1 tooth" shown in Figure 50, the control terminal can establish an ACL connection with the audio receiving device indicated by the Bluetooth speaker 1, and send the BIS identifier corresponding to the left front channel to the audio receiving device indicated by the Bluetooth speaker 1 through the ACL connection.
[0425] 2907. The audio receiving device saves the BIS identifier.
[0426] 2908. The display device broadcasts multiple BIS streams.
[0427] Each BIS stream includes BIS audio data and a BIS identifier corresponding to the BIS audio.
[0428] After the display device sends the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection, multiple BIS streams can be broadcast, each BIS stream including BIS audio data and the BIS identifier corresponding to the BIS audio, so that the multiple audio receiving devices can obtain the target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0429] 2909. The audio receiving device receives multiple BIS streams.
[0430] 2910. The audio receiving device obtains target BIS audio from multiple BIS audios.
[0431] The BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
[0432] 2911. The audio receiving device plays the target BIS audio.
[0433] For the description of steps 2907 to 2911 above, please refer to the description of steps 1405 to 1409 above, and will not be repeated here.
[0434] According to the multi-channel audio transmission method of some embodiments, the display device can obtain the channel information to be configured and send the channel information to be configured to the control terminal. The control terminal can then configure speakers of different channels (i.e., audio receiving devices corresponding to different channels) for the display device based on the channel information to be configured. In a certain embodiment of the present disclosure: a number of audio receiving devices to be connected can be determined through Bluetooth scanning, and an ACL connection can be established with multiple audio receiving devices therein. After the ACL connection is established, a BIS identifier can be configured for each of the multiple audio receiving devices based on the channel information to be configured, and the configured BIS identifier can be sent to each of the multiple audio receiving devices through the ACL connection. The multiple audio receiving devices are some or all of the multiple audio receiving devices. After the control terminal completes the configuration, the display device can broadcast multiple BIS streams, each BIS stream including BIS audio data and a BIS identifier corresponding to the BIS audio, so that multiple audio receiving devices can obtain target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier. Through this solution, the control terminal can be used to configure speakers with different channels for the display device, and the display device can realize the broadcast isochronous stream (BIS) of multiple channels to multiple audio receiving devices at the same time based on the broadcast method. In this way, without occupying the Bluetooth link of the display device, multiple channels of audio can be played simultaneously through multiple audio receiving devices, thereby achieving a stereo playback effect.
[0435] In some embodiments, the BIS identifier may be configured by the display device based on the channel information to be configured and sent to the control terminal. The control terminal, as a relay device, forwards the BIS identifier to multiple audio receiving devices.
[0436] In one embodiment of the present disclosure, FIG51 is a flowchart diagram of an audio control method according to some embodiments. FIG51 may be based on FIG44 above, with step 2902 in FIG44 replaced by the following steps 2902a and 2902b:
[0437] 2902a. The display device configures a BIS identifier based on the channel information to be configured.
[0438] The manner in which the display device configures the BIS identifier based on the channel information to be configured is similar to the manner in which the control terminal configures the BIS identifier based on the channel information to be configured, and will not be repeated here.
[0439] 2902b. The display device sends the configured BIS identifier to the control terminal.
[0440] Among them, a Wi-Fi connection can be established between the display device and the control terminal through a wireless fidelity technology (Wi-Fi) network, and the display device sends the configured BIS identifier to the control terminal through the Wi-Fi connection, or an ACL connection can be established between the display device and the control terminal through a Bluetooth network, and the display device sends the configured BIS identifier to the control terminal through the ACL connection.
[0441] Accordingly, in FIG51 , step 2905 in FIG44 may be replaced by the following step 2905a:
[0442] 2905a. The control terminal sends a BIS identifier to each of the multiple audio receiving devices through the ACL connection.
[0443] The control terminal may receive the BIS identifiers sent by the display device, and send these BIS identifiers to different audio receiving devices respectively.
[0444] The above-mentioned control terminal acts as a relay device to forward the BIS identifier sent by the display device, and it is also possible to configure speakers of different channels for the display device through the control terminal, and the display device can be based on the broadcast method to realize the display device sending multiple-channel broadcast isochronous streams to multiple audio receiving devices at the same time (Broadcaster, and the display device can be based on the broadcast method, implement, BIS), so that without occupying the Bluetooth link of the display device, multiple channels of audio can be played simultaneously through multiple audio receiving devices, thereby achieving a stereo playback effect.
[0445] Figure 52 is a schematic diagram of the structure of an electronic device according to some embodiments, which may be the display device, control terminal, or audio receiving device described above. As shown in Figure 52, the electronic device includes: a processor 5201, a memory 5202, and a computer program stored in the memory 5202 and executable on the processor 5201. When executed by the processor 5201, the computer program implements the various processes of the following method in the above-mentioned method embodiment: an audio control method executed by a display device.
[0446] The present disclosure provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the above-described audio control method and achieves the same technical effects. To avoid repetition, the details are not described here. The computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0447] The present disclosure provides a computer program product, which includes a computer program. When the computer program is run on a computer, the computer is enabled to implement the above-mentioned audio control method.
Claims
1. A display device, include: A display configured to display an identification of at least one broadcast signal source scanned: A user interface configured to receive instructions from a user; A Bluetooth module configured to perform Bluetooth broadcasting; a communicator configured to communicate with an external device according to a predetermined protocol; a memory configured to store computer instructions and data associated with a display device; At least one processor, connected to the display, the user interface, the Bluetooth module, the communicator and the memory, is configured to execute computer instructions to cause the display device to perform: Receive the start trigger operation for Bluetooth broadcast; Determine a target audio receiving device; wherein the target audio receiving device is a low-power audio LE audio device that has established an isochronous stream CIS connection with the display device; If it is determined that the Bluetooth broadcast is successfully turned on, a preset volume value is sent to the target audio receiving device based on a voice control specification VCP protocol connection; wherein the preset volume value is used to adjust the volume of audio data synchronously played by the target audio receiving device.
2. The display device according to claim 1, when determining the target audio receiving device, the at least one processor is configured to execute computer instructions so that the display device: Monitors whether a unicast media sender UMS connection event of the LE audio device occurs; If a UMS connection event of an LE audio device is monitored, the LE audio device is determined as a target audio receiving device.
3. The display device according to claim 1, when determining the target audio receiving device, the at least one processor is configured to execute computer instructions so that the display device: Determine whether there is an LE audio device in CIS connection with the display device; If it is determined that there is an LE audio device in CIS connection with the display device, the LE audio device is determined as a target audio receiving device.
4. The display device according to claim 3, after determining the LE audio device as the target audio receiving device, the at least one processor is further configured to execute computer instructions so that the display device: The audio module is controlled to disconnect the target audio receiving device from the CIS connection and mute the music stream.
5. The display device according to claim 4, when the control audio module disconnects the target audio receiving device from the CIS connection and sets the music stream to mute, the at least one processor is configured to execute computer instructions so that the display device: Controlling the Bluetooth protocol stack to set the UMS working mode of the target audio receiving device to an inactive state, and setting the BMS working mode of the target audio receiving device to an active state; After monitoring the target event, the audio module is controlled to mute the music stream, and the target audio receiving device is offline processed for Bluetooth audio, and the audio routing strategy is cut off from the hardware abstraction layer LE audio hal; in, The target event includes an event of setting the UMS working mode of the target audio receiving device to an inactive state.
6. The display device according to claim 5, after the audio routing policy is cut off from the LE audio hal, the at least one processor is further configured to execute computer instructions so that the display device: Control the Bluetooth protocol stack to create a Bluetooth broadcast and start the Bluetooth broadcast; If it is determined that the Bluetooth broadcast is successfully turned on, the audio module is controlled to switch the audio routing strategy back to LE audio hal.
7. The display device according to claim 1, wherein the at least one processor is further configured to execute computer instructions so that the display device: If it is determined that the Bluetooth broadcast fails to be turned on, obtaining the current system volume value of the target audio receiving device; Based on the VCP protocol connection, sending the current system volume value to the target audio receiving device; in, The current system volume value is used to adjust the volume of the audio data synchronously played by the target audio receiving device.
8. The display device according to claim 1, wherein the at least one processor is further configured to execute computer instructions so that the display device: Determining whether the target audio receiving device belongs to any one or more device groups; If it is determined that the target audio receiving device belongs to any one or more device groups, the preset volume value is sent to the audio receiving devices in the any one or more device groups, so that the audio receiving devices adjust the volume of the synchronously played audio data based on the preset volume value.
9. The display device according to claim 1, wherein the at least one processor is further configured to execute computer instructions so that the display device: The preset volume value is 60%-70%, 70%-75% or 75%.
10. The display device according to any one of claims 1 to 9, wherein the at least one processor is further configured to execute computer instructions so that the display device: In response to a start trigger operation for a Bluetooth broadcast, determining whether there is a Bluetooth audio device currently in an active state; If it is determined that there is currently an active Bluetooth audio device, determine whether the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device; If it is determined that the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device, the device information of the Bluetooth audio device is saved, and the Bluetooth protocol stack is controlled to set the Bluetooth audio device to an inactive state; The audio module is controlled to perform offline processing on the Bluetooth audio device and the audio routing strategy is switched out from the current HAL.
11. The display device according to claim 10, wherein the at least one processor is further configured to execute computer instructions so that the display device: Control the audio module to bring the Bluetooth broadcast device online and switch the audio routing strategy to the LE audio hal.
12. The display device according to claim 10, wherein the at least one processor is further configured to execute computer instructions so that the display device: In response to the trigger operation for starting the Bluetooth broadcast, controlling the Bluetooth protocol stack to create a Bluetooth broadcast and start the Bluetooth broadcast; Correspondingly, if it is determined that the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device, the Bluetooth protocol stack is controlled to set the Bluetooth audio device to an inactive state. include: If it is determined that the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device, and it is determined that the Bluetooth broadcast is successfully started, the Bluetooth protocol stack is controlled to set the Bluetooth audio device to an inactive state.
13. The display device according to claim 10, wherein the at least one processor is further configured to execute computer instructions so that the display device: In response to a trigger operation of switching the audio output channel to the target output channel, unmute the music stream; in, The target output channel includes an HDMI channel or a local speaker.
14. The display device according to claim 10, after determining that the Bluetooth audio device is an A2DP device or a Bluetooth hearing aid device, the at least one processor is further configured to execute computer instructions so that the display device: Saving device information of the Bluetooth audio device; in, The device information includes a media access control MAC address.
15. The display device according to claim 14, wherein the at least one processor is further configured to execute computer instructions so that the display device: in response to a shutdown trigger operation for the Bluetooth broadcast, determines whether the currently saved Bluetooth audio device is in a connected state; If the Bluetooth audio device is in a connected state, the Bluetooth audio device is set to an active state.
16. The display device according to claim 10, wherein the at least one processor is further configured to execute computer instructions so that the display device: In response to a close trigger operation for the Bluetooth broadcast, determining whether there is an audio output device connected to the current audio output channel; If it is determined that there is an audio output device connected to the current audio output channel, the audio output device is set to an active state.
17. The display device according to claim 16, wherein when the audio output device is set to an active state, the at least one processor is configured to execute computer instructions so that the display device: If it is determined that there is an audio output device connected to the current audio output channel, control the display to display a prompt pop-up window; the prompt pop-up window is used to determine whether to use the audio output device; If a confirmation message to apply the audio output device is received based on the prompt pop-up window, the audio output device is set to an active state.
18. The display device according to claim 10, wherein the at least one processor is further configured to execute computer instructions so that the display device: In response to a shutdown trigger operation for the Bluetooth broadcast, if it is determined that the current audio output channel is in the Bluetooth audio channel, a target Bluetooth audio device is determined based on a preset priority relationship; the target Bluetooth audio device is in a connected state; Set the target Bluetooth audio device to active state.
19. The display device according to any one of claims 1 to 9, wherein the at least one processor is further configured to execute computer instructions so that the display device: Obtain the channel information to be configured; control the Bluetooth module to determine several audio receiving devices to be connected through Bluetooth scanning; Control the Bluetooth module to establish an access control list (ACL) connection with multiple audio receiving devices; configure a broadcast isochronous stream (BIS) identifier for each of the multiple audio receiving devices based on the channel information to be configured, and send the configured BIS identifier to each of the multiple audio receiving devices through the ACL connection, wherein the multiple audio receiving devices are some or all of the multiple audio receiving devices; Control the Bluetooth module to broadcast multiple BIS streams, each BIS stream includes BIS audio data and a BIS identifier corresponding to the BIS audio, so that the multiple audio receiving devices can obtain target BIS audio from the multiple BIS streams, and the BIS identifier corresponding to the target BIS audio matches the configured BIS identifier.
20. The display device according to claim 19, wherein the at least one processor is further configured to execute computer instructions so that the display device: A volume parameter is sent to each of the multiple audio receiving devices through the ACL connection.
21. The display device according to claim 19, after determining a plurality of audio receiving devices to be connected through Bluetooth scanning and before controlling the Bluetooth module to establish an ACL connection with the plurality of audio receiving devices, the at least one processor is further configured to execute computer instructions so that the display device executes: The plurality of audio receiving devices supporting Bluetooth low energy consumption are determined from the plurality of audio receiving devices.
22. The display device according to claim 21, when determining the plurality of audio receiving devices supporting Bluetooth low energy from the plurality of audio receiving devices, the at least one processor is configured to execute computer instructions so that the display device: Obtaining a UUID corresponding to each of the plurality of audio receiving devices; From the plurality of audio receiving devices, the plurality of audio receiving devices whose device types indicated by the broadcast audio announcement service universal unique identifier UUID are supported by low power Bluetooth are selected.
23. The display device according to claim 19, wherein when acquiring the channel information to be configured, the at least one processor is configured to execute computer instructions so that the display device: Get the channel information of the currently playing audio media; The channel information to be configured that matches the channel information of the audio media asset is determined from the channel information supported by the display device.
24. The display device according to claim 19, wherein when acquiring the channel information to be configured, the at least one processor is configured to execute computer instructions to enable the display device to: Receive a channel combination selection instruction; In response to the channel combination selection instruction, information of channels to be configured is obtained.
25. An audio control method, the method include: Receive the start trigger operation for Bluetooth broadcast; Determine a target audio receiving device; wherein the target audio receiving device is an LE audio device that has established a CIS connection with the display device; If it is determined that the Bluetooth broadcast is successfully turned on, a preset volume value is sent to the target audio receiving device based on the VCP protocol connection; wherein the preset volume value is used to adjust the volume of the audio data synchronously played by the target audio receiving device.