Display devices and audio data processing methods

Abstract

This disclosure relates to a display device and an audio data processing method, specifically in the field of Bluetooth technology. The display device includes a controller and a Bluetooth module connected to the controller. The controller is configured to: when a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the VCP connection with the LE audio device; when Bluetooth broadcast is enabled, acquire the volume value of a broadcast volume parameter, adjust the original gain of the audio data of a target audio resource based on the volume value of the broadcast volume parameter to obtain a first target gain, and send the audio data with the first target gain to the Bluetooth module to control the Bluetooth module to output a BIS audio stream based on the audio data with the first target gain. This disclosure achieves individual control of the Bluetooth broadcast volume by controlling the Bluetooth module to disconnect the VCP connection with the connected LE audio device and adjusting the original gain of the audio data based on the acquired broadcast volume parameter volume value to output a BIS audio stream using the adjusted gain.

Description

Technical Field

[0001] This disclosure relates to the field of Bluetooth technology, and more particularly to a display device and an audio data processing method. Background Technology

[0002] With the introduction of the next-generation Bluetooth audio technology standard—Bluetooth Low Energy Audio (LE audio)—more and more display devices, such as televisions and mobile phones, can support the LE audio protocol. For display devices supporting the LE audio protocol, controlling the volume in Bluetooth broadcast scenarios is a pressing technical problem that needs to be solved. Summary of the Invention

[0003] To solve the above-mentioned technical problems, or at least partially solve them, this disclosure provides a display device and an audio data processing method. When a Bluetooth broadcast start message is received, the method controls the Bluetooth module to disconnect the VCP connection with the connected LE audio device, and adjusts the original gain of the audio data based on the volume value of the obtained broadcast volume parameter, so as to emit the BIS audio stream using the adjusted first target gain, thereby realizing individual control of the Bluetooth broadcast volume.

[0004] To achieve the above objectives, the technical solutions provided by the embodiments of this disclosure are as follows:

[0005] In a first aspect, this disclosure provides a display device, including: a display; a sound output module; and a Bluetooth module;

[0006] The controller connected to the Bluetooth module is configured to:

[0007] When a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, the Bluetooth module is controlled to disconnect the Volume Control Protocol (VCP) connection with the LE audio device.

[0008] When the Bluetooth broadcast is enabled, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast an isochronous BIS audio stream based on the audio data of the first target gain.

[0009] Secondly, this disclosure provides an audio data processing method, including:

[0010] When a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, the Bluetooth module is controlled to disconnect the Volume Control Protocol (VCP) connection with the LE audio device.

[0011] When the Bluetooth broadcast is enabled, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast an isochronous BIS audio stream based on the audio data of the first target gain.

[0012] Thirdly, this disclosure provides a computer-readable storage medium on which a computer program is stored, which, when executed by a processor, implements the audio data processing method as described in the second aspect.

[0013] Fourthly, this disclosure provides a computer program product comprising a computer program that, when run on a computer, causes the computer to implement the audio data processing method as described in the second aspect.

[0014] The display device and audio data processing method for the display device provided in this disclosure include: a display, a sound output module, a Bluetooth module, and a controller connected to the Bluetooth module. The controller is configured to: when a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the VCP connection with the LE audio device; when Bluetooth broadcast is enabled, acquire the volume value of the broadcast volume parameter, adjust the original gain of the audio data of the target audio resource based on the volume value of the broadcast volume parameter to obtain a first target gain, and send the audio data of the first target gain to the Bluetooth module to control the Bluetooth module to emit a BIS audio stream based on the audio data of the first target gain.

[0015] As can be seen, the embodiments of this disclosure can, upon receiving a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the VCP connection with the connected LE audio device, and adjust the original gain of the audio data based on the volume value of the acquired broadcast volume parameter, so as to emit the BIS audio stream using the adjusted first target gain, thereby realizing independent control of the Bluetooth broadcast volume. Attached Figure Description

[0016] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0017] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a schematic diagram of a one-to-one audio transmission method for unicast media in related technologies;

[0019] Figure 2 This is a schematic diagram illustrating a one-to-two audio transmission method for unicast media, as provided in related technologies.

[0020] Figure 3 A diagram illustrating the relationship between extended broadcasting, periodic broadcasting, and BIS;

[0021] Figure 4 A diagram illustrating the relationship between extended broadcast packets, auxiliary broadcast packets, periodic broadcast packets, and BIS;

[0022] Figure 5 This is a schematic diagram of a continuous BIG transmission technique in related technologies;

[0023] Figure 6 A hardware configuration block diagram of a display device 100 provided in this disclosure embodiment;

[0024] Figure 7 A schematic diagram of the software system architecture of a display device 100 provided in this embodiment of the present disclosure;

[0025] Figure 8 A hardware configuration block diagram of an audio receiving device 200 provided in this disclosure embodiment;

[0026] Figure 9 A hardware configuration block diagram of a control terminal 300 provided in an embodiment of this disclosure;

[0027] Figure 10 A flowchart illustrating an audio data processing method provided in an embodiment of this disclosure;

[0028] Figure 11 A schematic diagram of a display broadcast volume component provided in an embodiment of this disclosure;

[0029] Figure 12 A flowchart illustrating another audio data processing method provided in this embodiment of the disclosure;

[0030] Figure 13 A timing diagram for Bluetooth broadcast volume adjustment and Bluetooth unicast volume adjustment provided in this embodiment of the disclosure;

[0031] Figure 14 A timing flowchart for the online status of a current audio output device is provided as an embodiment of this disclosure;

[0032] Figure 15 A schematic diagram illustrating simultaneous Bluetooth broadcasting and speaker output as provided in an embodiment of this disclosure;

[0033] Figure 16 A flowchart of a speaker volume adjustment method provided in this disclosure embodiment;

[0034] Figure 17 This disclosure provides a flowchart for adjusting Bluetooth broadcast volume according to an embodiment;

[0035] Figure 18 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0036] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0037] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0038] The display device and audio receiving device provided in this disclosure both support Bluetooth Low Energy (LE audio) technology, wherein the display device serves as an audio playback device or a device for configuring the audio receiving device. For example, the display device can be a television, mobile phone, projector, etc., and the audio receiving device can be a Bluetooth speaker, Bluetooth headset, etc.

[0039] Compared to classic Bluetooth, LE Audio has the following advantages:

[0040] 1. One audio playback device can connect to multiple audio receiving devices simultaneously;

[0041] 2. A single broadcast audio device can send broadcast audio to an unlimited number of audio receiving devices, and supports encrypted broadcasting;

[0042] 3. The latest low-complexity communication codec (LC3) audio format is used, resulting in improved sound quality;

[0043] 4. Supports VoIP and HD calling;

[0044] 5. Supports hearing aid / assisted hearing applications.

[0045] The LE audio application layer specification, Telephony and Media Audio Profile (TMAP), defines two types of media audio applications: unicast media audio and broadcast media audio.

[0046] Unicast Media Audio

[0047] TMAP's unicast audio uses a more advanced audio codec to provide better sound quality compared to the current classic Bluetooth audio distribution profile (A2DP), while also offering richer control functions than the current classic Bluetooth media playback control profile (Audio / Video Remote Control Profile, AVRCP). TMAP defines two roles for unicast audio applications: the unicast media sender (UMS) and the unicast media receiver (UMR). Unicast audio transmission between the UMS and UMR is achieved through a connection of isochronous streams (CIS).

[0048] It should be noted that the unicast media audio defined in TMAP is not limited to one-to-one audio transmission; it also supports one unicast media transmitter transmitting unicast media audio to two unicast media receivers.

[0049] Figure 1 This is a schematic diagram of a one-to-one audio transmission method for unicast media in related technologies. For example... Figure 1 As shown, UMS11 sends unicast media audio to UMR12.

[0050] Figure 2 This is a schematic diagram illustrating a one-to-two audio transmission method for unicast media, as provided in related technologies. Figure 2 As shown, UMS21 sends unicast media audio to UMR22 and UMR23 respectively.

[0051] Broadcast Media Audio

[0052] In TMAP, broadcast audio is transmitted synchronously across multiple connectionless Broadcast Isochronous Streams (BIS). The biggest advantage of broadcast audio is its ability to transmit audio data synchronously to multiple audio receiving devices.

[0053] In TMAP, the broadcast synchronization channel for broadcast media audio has two concepts: Broadcast Isochronous Group (BIG) and BIS. An audio transmitting device can transmit multiple BIGs simultaneously, and each BIG can consist of multiple BISs. A BIG can contain up to 31 BISs. Each BIS has a unique access address, which is generated based on the seed access address of its BIG using a uniform algorithm.

[0054] Broadcast media audio can include multiple broadcasts with different access addresses; for example, it can include:

[0055] Extended Advertising: This is an extended broadcast on the main broadcast channel, using the ADV_EXT_IND packet and directing the secondary broadcast via time and frequency information. Its access address uses the main broadcast access address specified in the Bluetooth core specification: 0x8E89BED6.

[0056] Periodic Advertising: The auxiliary broadcast uses AUX_ADV_IND packets and points to this periodic broadcast through time, frequency hopping map and access address. This periodic broadcast uses AUX_SYNC_IND packets and contains BIG information (BIGInfo).

[0057] Broadcast Isochronous Stream (BIS): This is a periodic broadcast of digital audio via time, frequency hopping map, access address, and BIG information (BIGInfo) pointing to the BIS. It uses BIS Protocol Data Unit (PDU) packets.

[0058] Figure 3 This diagram illustrates the relationship between Extended Broadcast, Periodic Broadcast, and BIS. It should be noted that Bluetooth operates in the 2.4GHz band, which ranges from 2402MHz to 2480MHz. There are 40 channels, each 2MHz wide. Three are primary broadcast channels (channels 37, 38, and 39), and the remaining 37 are secondary broadcast channels (channels 0 to 36). Figure 3As shown, the main broadcast channels include channels 37, 38, and 39; the secondary broadcast channels include channels 0 to 36. Extended broadcasts on the main broadcast channels can use ADV_EXT_IND packets, pointing to the secondary broadcast channels' auxiliary broadcasts via time and frequency information. These auxiliary broadcasts then use AUX_ADV_IND packets, pointing to periodic broadcasts via time, frequency hopping map, and access address. Further, these periodic broadcasts use AUX_SYNC_IND packets, pointing to the BIS via time, frequency hopping map, access address, and BIG information (BIGInfo). The BIS then uses BIS PDU packets to broadcast digital audio.

[0059] Figure 4 This diagram illustrates the relationship between extended broadcast packets, auxiliary broadcast packets, periodic broadcast packets, and the BIS. Figure 4 As shown, the audio transmitting device sends an extended broadcast packet (ADV_EXT_IND) on the main broadcast channel (37,38,39). The extended broadcast packet includes: the broadcast device address (AdvA), broadcast data information (ADI), and a pointer to the auxiliary broadcast packet (AuxiliaryPointer, AuxPtr). AuxPtr indicates that an auxiliary broadcast will be performed on the subsequent secondary broadcast channel. The auxiliary broadcast packet (AUX_ADV_IND) includes: extended broadcast data (AdvData), a Broadcastaudio Announcement Service UUID, and other service UUIDs. The auxiliary broadcast packet indicates the data channel and broadcast period for the periodic broadcast. The periodic broadcast packet (AUX_SYNC_IND) includes: Additional Controller Advertising Data BIGinfo (ACAD BIGinfo), the basic audio announcement service UUID of the extended broadcast data (AdvData Basicaudio Announcement Service UUID), and BASE. The periodic broadcast packet contains all the information of the broadcast isochronous BIS. After receiving the periodic broadcast packet, the broadcast receiver receives the BIS data on a specific channel at a specific time anchor point according to the data it contains, and obtains the BIS audio stream.

[0060] In practical applications, when broadcasting digital audio via BIS, it is achieved by continuously sending BIGs. Each BIG sent can be called a BIG event, and each BIG event can include multiple BISs.

[0061] Figure 5This is a schematic diagram of a method for continuously sending BIG signals in related technologies. For example... Figure 5 As shown, during the continuous sending of BIG, the BIG event is executed periodically. Figure 5 The BIG anchor points shown indicate the start time of each BIG event, and the time interval between two anchor points is one cycle of executing a BIG event. It should be noted that... Figure 5 The example used here is three BIG events, each of which includes two BIS events. Figure 5 The diagram illustrates the sequential execution of BIG events X, X+1, and X+2, where each BIG event includes two BIS streams. Figure 5 The diagram shows BIS1 and BIS2. During the execution of the BIG time, a BIS stream is broadcast, and during the broadcast of the BIS stream, the BIS stream is broadcast once at fixed time intervals.

[0062] In the audio data processing method of the display device in the embodiments of this disclosure, the display device can be a mobile phone, television, computer, etc.

[0063] Figure 6 This is a hardware configuration block diagram of a display device 100 provided in an embodiment of this disclosure. For example... Figure 6 The display device 100 includes: a tuner / demodulator 110, a communicator 120, a detector 130, an external device interface 140, a controller 150, a display 160, an audio output interface 170, a memory, a power supply, etc. The controller 150 includes a central processing unit, a video processor, an audio processor, a graphics processor, random access memory (RAM), read-only memory (ROM), and a first to nth interface for input / output. The display 160 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner / demodulator 110 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as Electronic Program Guide (EPG) data signals, from multiple wireless or wired broadcast television signals. The detector 130 is used to collect signals from the external environment or signals interacting with the external environment. The controller 150 and the tuner 110 can be located in different separate devices, that is, the tuner 110 can also be located in an external device of the main device where the controller 150 is located, such as an external set-top box.

[0064] The various components in the display device 100 can perform the following functions:

[0065] In some embodiments, the controller 150 is configured to: upon establishing a connection with an LE audio device, in response to a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the Volume Control Protocol (VCP) connection with the LE audio device;

[0066] When the Bluetooth broadcast is enabled, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast an isochronous BIS audio stream based on the audio data of the first target gain.

[0067] In some embodiments, the controller 150 is further configured to: in the Bluetooth broadcast enabled state, in response to a first volume adjustment operation on the broadcast volume parameter, obtain an adjusted volume value corresponding to the first volume adjustment operation, and update the volume value of the broadcast volume parameter using the adjusted volume value.

[0068] In some embodiments, the controller 150 is further configured to: in the Bluetooth broadcast enabled state, in response to a second volume adjustment operation on the volume parameter of the first audio output device, obtain an adjusted volume value corresponding to the second volume adjustment operation, and update the volume value of the volume parameter of the first audio output device using the adjusted volume value; wherein the first audio output device includes at least one of the sound output module, an HDMI audio output device, and a USB audio output device;

[0069] The original gain of the audio data of the target audio resource is adjusted based on the volume value of the volume parameter of the first audio output device to obtain a second target gain, and the audio data of the second target gain is sent to the first audio output device.

[0070] In some embodiments, the controller 150, in response to a Bluetooth broadcast enable message, is further configured to: control the display to show a broadcast volume component; wherein the broadcast volume component is used to adjust the volume value of the broadcast volume parameter.

[0071] In some embodiments, the controller 150 is further configured to control the broadcast volume component to turn off its display in response to a Bluetooth broadcast shutdown message.

[0072] In some embodiments, the controller 150 is further configured to: control the Bluetooth module to establish a VCP connection with a connected LE audio device in response to switching from the Bluetooth broadcast enabled state to the Bluetooth unicast enabled state;

[0073] The volume value of the Bluetooth unicast volume parameter is obtained, and the volume value of the Bluetooth unicast volume parameter is sent to the connected LE audio device through the Bluetooth module based on the VCP connection; wherein, the volume value of the Bluetooth unicast volume parameter is used to adjust the gain of the audio data received by the connected LE audio device.

[0074] In some embodiments, the controller 150 is further configured to, in response to switching from the Bluetooth broadcast enabled state to the Bluetooth unicast enabled state:

[0075] When Bluetooth unicast is enabled, the original gain audio data is sent to the Bluetooth module to control the Bluetooth module to send the original gain audio data to the connected LE audio device.

[0076] In some embodiments, the controller 150 is specifically configured to:

[0077] The step of adjusting the original gain of the audio data of the target audio resource based on the volume value of the broadcast volume parameter to obtain the first target gain includes:

[0078] If it is determined that the current audio output device includes a Bluetooth broadcasting device, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain.

[0079] In some embodiments, the controller 150 is specifically configured to:

[0080] The step of adjusting the original gain of the audio data of the target audio resource based on the volume value of the volume parameter of the first audio output device to obtain the second target gain includes:

[0081] If it is determined that the current audio output device includes the first audio output device, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the volume parameter of the first audio output device to obtain the second target gain.

[0082] In some embodiments, the controller 150 is further configured to:

[0083] When the audio module receives an audio output device switching message, it records the information of the current audio output device according to the device protocol information carried in the audio output device switching message.

[0084] Figure 7 This is a schematic diagram of the software system architecture of a display device 100 provided in an embodiment of this disclosure. For example... Figure 7As shown, the software system may include: an application (App) layer, a system framework (Framework) layer (referred to as the "Framework Layer"), a dynamic library (Library), and a Bluetooth driver (BluetoothDriver).

[0085] The application layer includes TV Settings or TV Services.

[0086] The system framework layer includes: Bluetooth interface (BluetoothAPI), Bluetooth application (BluetoothAPK), and audio module.

[0087] Bluetooth applications may include: VCP application specification, CSIP application specification, and LE audio application specification. The VCP application specification, also known as the VCP protocol (Volume Control Profile), is used to control the volume of Bluetooth audio devices. The CSIP protocol is used to identify and manage a pair of Bluetooth audio devices, such as a pair of Bluetooth headphones or a pair of Bluetooth hearing aids. The LE audio application specification is a Bluetooth-based low-power audio application specification.

[0088] In addition, Bluetooth applications may also include: A2DP application specification, HearingAid application specification, etc. Among them, A2DP (Advanced Audio Distribution Profile) application specification is the media audio application specification in classic Bluetooth, while HearingAid application specification is the hearing aid application specification based on Low Energy (BLE).

[0089] The dynamic library includes a Bluetooth protocol stack, which is primarily responsible for scanning, connecting to, and configuring Bluetooth devices. During the Bluetooth connection establishment process, the display device can send relevant data to the Bluetooth protocol stack through its Bluetooth application.

[0090] The audio module can include an audio manager, audio service, audio policy, and audio abstraction layer (HAL). The audio module is primarily responsible for sending audio data to the Bluetooth protocol stack. The audio data is then transmitted through the audio channel between the audio module and the Bluetooth protocol stack. After receiving the audio data, the Bluetooth protocol stack encapsulates it into a BIS stream and sends it out.

[0091] The Bluetooth driver is primarily responsible for the Bluetooth connection between the display device and surrounding Bluetooth devices.

[0092] The Bluetooth protocol stack also includes the Common Audio Framework (GAF); GAF includes the Common Audio Profile (CAP), Common Audio Service (CAS), audio stream management, and volume control. Audio stream management includes the Basic Audio Profile (BAP), Audio Capability Presentation Service (PACS), Audio Stream Control Service (ASCS), and Broadcast Audio Scan Service (BASS). In this embodiment, BASS is used for broadcast synchronization. Volume control includes the Volume Control Service (VCS), Voice Offset Control Service (VOCS), and Audio Input Control Service (AICS).

[0093] Figure 8 This is a hardware configuration block diagram of an audio receiving device 200 provided in an embodiment of this disclosure. For example... Figure 10 As shown, the audio receiving device 200 includes: a controller 210, a communicator 220, a user input / output interface 230, a memory 240, and a power supply 250. The communicator 220 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or a compatible module. The user input / output interface 230 includes at least one of a speaker, a microphone, a touchpad, a sensor, buttons, or a compatible module.

[0094] Figure 9 This is a hardware configuration block diagram of a control terminal 300 provided in an embodiment of this disclosure. It should be understood that... Figure 9 The control terminal 300 shown is merely an example, and the control terminal 300 can have more than... Figure 9 The more or fewer components shown can be combined into two or more components, or they can have different component configurations. Figure 9 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application-specific integrated circuits.

[0095] like Figure 9As shown, the control terminal 300 includes components such as a radio frequency (RF) circuit 310, a memory 320, a display unit 330, a camera 340, a sensor 350, an audio circuit 360, a wireless Fidelity (Wi-Fi) module 370, a controller 380, a Bluetooth module 381, and a power supply 390.

[0096] The RF circuit 310 can be used to receive and transmit signals during information transmission or calls. It can receive downlink data from the base station and hand it over to the controller 380 for processing; it can also send uplink data to the base station. The memory 320 can be used to store software programs and data. The memory 320 stores the operating system that enables the control terminal 300 to run. In this application, the memory 320 can store the operating system and various application programs, and can also store program code that executes the audio data processing method implemented based on the control terminal in some embodiments of this application.

[0097] The display unit 330 can be used to receive input digital or character information and generate signal inputs related to user settings and function control of the control terminal 300. Specifically, the display unit 330 may include a touch screen 331 disposed on the front of the control terminal 300, which can collect touch operations of the user on or near it, such as clicking a button.

[0098] The display unit 330 can also be used to display information input by the user or information provided to the user, as well as a graphical user interface (GUI) for various menus of the control terminal 300. The display unit 330 may include a display screen 332 disposed on the front of the control terminal 300. A touchscreen 331 may cover the display screen 332, or the touchscreen 331 may be integrated with the display screen 332 to realize the input and output functions of the control terminal 300; the integrated touchscreen can be simply referred to as a touch display screen. The control terminal 300 may also include at least one sensor 350, such as an accelerometer 351, a proximity sensor 352, a fingerprint sensor 353, and a temperature sensor 354.

[0099] Audio circuitry 360, speaker 361, and microphone 362 provide an audio interface between the user and control terminal 300. Wi-Fi is a short-range wireless transmission technology, and control terminal 300 can use Wi-Fi module 370 to help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband internet access.

[0100] The controller 380 is the control center of the control terminal 300. It connects various parts of the control terminal via various interfaces and lines, and executes various functions and processes data of the control terminal 300 by running or executing software programs stored in the memory 320 and calling data stored in the memory 320. In some embodiments, the controller 380 may include one or more processing units; the controller 380 may also integrate an application processor and a baseband processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the baseband processor mainly handles wireless communication. It is understood that the baseband processor may not be integrated into the controller 380. In this application, the controller 380 can run the operating system, applications, user interface display and touch response, and audio data processing methods executed by the control terminal in some embodiments of this application. Furthermore, the controller 380 is coupled to the display unit 330.

[0101] The Bluetooth module 381 is used to interact with other Bluetooth devices that also have a Bluetooth module via the Bluetooth protocol. For example, the control terminal 300 can establish a Bluetooth connection with a display device that also has a Bluetooth module through the Bluetooth module 381, thereby exchanging data. In this embodiment of the present disclosure, the control terminal 300 can establish a BSA connection with a display device that also has a Bluetooth module through the Bluetooth module 381 to receive the BIS identifier sent by the display device. The control terminal 300 also includes a power supply 390 (such as a battery) for supplying power to various components.

[0102] Figure 10 The flowchart of the audio data processing method provided in the embodiments of this application is illustrated by way of example. Figure 10 The diagram shown is a flowchart of an audio data processing method provided in this embodiment of the present disclosure. The method may include, but is not limited to, the following steps S1002-S1004:

[0103] S1002: When a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the Volume Control Protocol (VCP) connection with the LE audio device.

[0104] In practical applications, when the display device is in Bluetooth unicast mode, the volume of the LE audio device can be adjusted via the volume bar on the display device. This volume value is then sent to the LE audio device via the VCP (Volume Control Profile) protocol. The LE audio device adjusts its volume based on this value and plays the audio data accordingly. However, during this adjustment process, the audio volume may be turned down to a low value. If Bluetooth broadcasting is then activated, the LE audio device's volume will already be low. Therefore, when playing audio data via Bluetooth broadcasting, the actual audio volume played by the LE audio device will be low because both the display device and the LE audio device are adjusting their volumes, affecting the user's listening experience.

[0105] Therefore, in order to ensure that the volume of the audio data played by the LE audio device is at a relatively reasonable value and does not affect the user's listening experience, in this embodiment of the disclosure, when the display device and the LE audio device establish a connection, in response to the Bluetooth broadcast start message, the Bluetooth module is first controlled to disconnect the volume control protocol VCP connection with the LE audio device, so that the volume of the LE audio device itself will not be affected when the Bluetooth broadcast volume is adjusted later, thereby realizing independent control of the volume value of the broadcast volume parameter.

[0106] In this embodiment of the disclosure, when the user clicks the Bluetooth broadcast control on the settings page of the display device, a Bluetooth broadcast enable message is triggered to be sent to the controller. The Bluetooth broadcast enable message is used to indicate that Bluetooth broadcast is enabled or that the Bluetooth unicast is switched to Bluetooth broadcast.

[0107] In this embodiment of the disclosure, the Volume Control Profile (VCP) is a protocol used in Bluetooth audio technology to control the volume of LE audio devices. After the display device establishes a VCP protocol connection with the LE audio device, it can send a volume value index to the LE audio device to control the LE audio device to adjust its own volume based on the volume value index.

[0108] In this embodiment of the disclosure, when the display device has already established a Bluetooth connection with the LE audio device, when Bluetooth broadcasting is turned on, the VCP protocol connection between the Bluetooth module and the connected LE audio device can be disconnected by controlling the Bluetooth module, so that the display device stops adjusting the volume of the LE audio device through the VCP protocol. That is, after Bluetooth broadcasting is turned on, the volume value of the connected LE audio device will no longer change.

[0109] LE audio devices refer to devices that support the LE audio protocol, such as Bluetooth headsets that support LE audio. Since LE audio devices communicate with each other via Bluetooth Low Energy (BLE), they have low communication power consumption.

[0110] In practical applications, since devices supporting the classic Bluetooth protocol and the LEaudio protocol have different universal unique identifiers (UUIDs), the UUID can be used to identify whether a device that has established a Bluetooth connection with the display device supports the LEaudio protocol. If the UUID is determined to be of the type that supports the LEaudio protocol, the connected device is considered to be a device that supports the LEaudio protocol.

[0111] The Universally Unique Identifier (UUID) can be used to characterize the types of protocols supported by the device, such as whether the device supports the Bluetooth Low Energy (LE) audio protocol or the Advanced Audio Distribution Protocol (A2DP). In this embodiment, the device's UUID can be used to determine whether a connected LE audio device exists on the display device.

[0112] In one alternative implementation, when a Bluetooth broadcast enable message is received, the display can be controlled to show a broadcast volume component, so that the user can adjust the volume value of the broadcast volume parameter through the broadcast volume component, making the volume played by the LEaudio device more in line with the user's listening experience.

[0113] like Figure 11 The diagram shown is a schematic representation of a display broadcast volume component according to an embodiment of this disclosure. Figure 11 (a) The audio playback page shows a Bluetooth broadcast enable control 1101. When a trigger operation is received for the Bluetooth broadcast enable control, the display is controlled to... Figure 11 (b) shows the audio playback page displaying a broadcast volume component 1102, the volume value of which ranges from 0 to 100.

[0114] During the display of the broadcast volume component, when a volume increase operation is received for the broadcast volume component 1102, the adjusted volume value corresponding to the volume increase operation can be obtained, and the volume value of the broadcast volume parameter can be updated using the adjusted volume value; when a volume decrease operation is received for the broadcast volume component 1102, the adjusted volume value corresponding to the volume decrease operation can be obtained, and the volume value of the broadcast volume parameter can be updated using the adjusted volume value.

[0115] In another alternative implementation, the broadcast volume component can also be turned off in response to a Bluetooth broadcast shutdown message, i.e., the broadcast volume component can be hidden on the current page.

[0116] S1004: In the Bluetooth broadcast enabled state, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast the isochronous BIS audio stream based on the audio data of the first target gain.

[0117] In this embodiment of the disclosure, after the Bluetooth module disconnects the VCP protocol connection with the connected LE audio device, the volume value of the broadcast volume parameter is first obtained when the Bluetooth broadcast is enabled.

[0118] In one optional implementation, the volume value of the broadcast volume parameter can be stored in the broadcast volume storage area, and the volume value of the Bluetooth unicast volume parameter can be stored in the unicast volume storage area. This allows for the use of different storage areas to store the broadcast volume and unicast volume, so that in a broadcast scenario, the volume value stored in the broadcast volume storage area can be used to independently control the broadcast volume.

[0119] In this embodiment of the disclosure, after obtaining the volume value of the broadcast volume parameter, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain.

[0120] The target audio resource can be the audio resource currently being played on the display device, or any audio resource among those to be played. In practical applications, the audio resource can be pre-stored in the display device, or it can be obtained by the display device according to preset conditions. For example, the target audio resource can be an audio resource downloaded from a multimedia server to the display device and currently being played, based on a specific address.

[0121] The original gain of the audio data of the target audio resource refers to the volume set by the audio source device before transmitting the target audio resource to the display device, i.e., the initial volume of the audio data. The original gain of the audio data can be adjusted in multiple places, such as the audio source device, the display device (e.g., a TV), and the audio receiving device (e.g., an LE audio device).

[0122] For example, assuming the volume value index of the broadcast volume parameter is 50 and the original gain of the audio data of the target audio-visual resource is 256, the original gain of the audio data can be adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain of 256 × 0.50 = 128, and the audio data with the first target gain of 128 is sent to the Bluetooth module.

[0123] In this embodiment of the disclosure, after sending the audio data of the first target gain to the Bluetooth module, the Bluetooth module is controlled to emit a broadcast isochronous BIS audio stream based on the audio data of the first target gain.

[0124] Since the display device has controlled the Bluetooth module to disconnect the VCP protocol connection with the LE audio device when Bluetooth broadcasting is enabled, the volume of the LE audio device itself will no longer change. At this time, after the Bluetooth module sends out the BIS audio stream based on the audio data of the first target gain, the LE audio device can play the target audio resource based on the audio data of the first target gain without the volume being too low, thus not affecting the user's listening experience.

[0125] In one alternative implementation, the volume of the Bluetooth broadcast can be adjusted independently when Bluetooth broadcast is enabled.

[0126] Specifically, in response to a first volume adjustment operation on the broadcast volume parameter, the adjusted volume value corresponding to the first volume adjustment operation is obtained, and the volume value of the broadcast volume parameter is updated using the adjusted volume value.

[0127] In this embodiment of the disclosure, the first volume adjustment operation for the broadcast volume parameter may include a volume increase operation for the broadcast volume parameter, a volume decrease operation for the broadcast volume parameter, etc. In practical applications, the broadcast volume parameter can be adjusted using buttons on a remote control device. Specifically, the broadcast volume increase button (e.g., the up button) on the remote control device is used to increase the Bluetooth broadcast volume, and the broadcast volume decrease button (e.g., the down button) on the remote control device is used to decrease the Bluetooth broadcast volume.

[0128] For example, assuming the initial broadcast volume parameter is 50, when a volume increase operation is received for the broadcast volume parameter, the adjusted volume value of 60 corresponding to the volume increase operation is obtained, and the volume value of the broadcast volume parameter is updated using the adjusted volume value, that is, the volume value of the broadcast volume parameter is 60 at this time.

[0129] As can be seen, this embodiment of the present disclosure also supports adjusting the volume value of the broadcast volume parameter separately when Bluetooth broadcasting is enabled, so that the volume output by the LE audio device is more in line with the user's listening experience.

[0130] In the audio data processing method provided in this embodiment, when a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, the Bluetooth module is controlled to disconnect the VCP connection with the LE audio device; when the Bluetooth broadcast is enabled, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain, and the audio data of the first target gain is sent to the Bluetooth module to control the Bluetooth module to emit a BIS audio stream based on the audio data of the first target gain.

[0131] As can be seen, the embodiments of this disclosure can, upon receiving a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the VCP connection with the connected LE audio device, and adjust the original gain of the audio data based on the volume value of the acquired broadcast volume parameter, so as to emit the BIS audio stream using the adjusted first target gain, thereby realizing independent control of the Bluetooth broadcast volume.

[0132] In one optional implementation, when Bluetooth broadcasting is enabled, not only can the volume value of the broadcasting volume parameter be adjusted independently, but also the volume value of other audio output devices, such as the speaker volume, can be adjusted independently, thereby enabling Bluetooth broadcasting and speaker sound to be emitted simultaneously.

[0133] In this embodiment of the present disclosure, when Bluetooth broadcasting is enabled, in response to a second volume adjustment operation on the volume parameter of the first audio output device, the adjusted volume value corresponding to the second volume adjustment operation is obtained, and the adjusted volume value is used to update the volume value of the volume parameter of the first audio output device.

[0134] The first audio output device includes at least one of a sound output module, an HDMI audio output device, and a USB audio output device; the HDMI (High Definition Multimedia Interface) audio output device is also known as a high-definition multimedia interface output device, the USB (Universal Serial Bus) audio output device is also known as a universal serial bus audio output device, and the sound output module can be, for example, a local speaker.

[0135] In this embodiment of the disclosure, the second volume adjustment operation for the volume parameter of the first audio output device may include a volume increase operation acting on the volume component of the first audio output device, a volume decrease operation acting on the volume component of the first audio output device, etc. In practical applications, corresponding volume components can be set for different audio output devices, and different device identifiers can be used to represent different audio output devices. For example, the volume component corresponding to the sound output module may be marked with a "speaker" identifier, etc.

[0136] Because this disclosure uses broadcast volume parameters to record the volume value of Bluetooth broadcasting and uses the volume parameters of the first audio output device to record the volume value of the first audio output device, that is, uses different volume parameters to record their respective volume values, it enables Bluetooth broadcasting and other audio output devices to emit sound simultaneously.

[0137] In this embodiment of the disclosure, after updating the volume value of the volume parameter of the first audio output device using the adjusted volume value, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the volume parameter of the first audio output device to obtain a second target gain, and the audio data of the second target gain is sent to the first audio output device so that the first audio output device can play the target audio resource based on the audio data of the second target gain.

[0138] In one optional implementation, adjusting the original gain of the audio data of the target audio resource based on the volume value of the volume parameter of the first audio output device to obtain a second target gain includes: when it is determined that the current audio output device includes the first audio output device, adjusting the original gain of the audio data of the target audio resource based on the volume value of the volume parameter of the first audio output device to obtain a second target gain.

[0139] In this embodiment of the disclosure, when it is determined that the current audio output device includes at least one of a sound output module, an HDMI audio output device, and a USB audio output device, the original gain of the audio data of the target audio resource can be adjusted based on the volume value index of its corresponding volume parameter to obtain a second target gain, so that the second target gain can be sent to the first audio output device so that the first audio output device can play the target audio and video resource based on the audio data of the second target gain.

[0140] As can be seen, in the Bluetooth broadcasting state, the Bluetooth broadcasting device and other audio output devices can simultaneously output sound. In addition, since the embodiments of the present disclosure use different volume parameters to record their respective volume values, the Bluetooth broadcasting device and other audio output devices can adjust their volumes individually.

[0141] In related technologies, when switching from Bluetooth unicast mode to Bluetooth broadcast mode, in the broadcast scenario, after the display device adjusts the gain of the audio data based on the volume bar, it sends the adjusted audio gain to the LE audio device. At the same time, the display device also connects based on the VCP protocol and sends the volume value to the LE audio device, which then combines the adjusted audio gain and the volume value to play the audio data. For example, when switching from the volume value of 256×0.50 in unicast mode to broadcast mode, the volume value of the audio data broadcast by the display device is 256×0.50, and the volume value sent to the LE audio device based on the VCP protocol is also 50. At this time, the actual playback volume of the LE audio device is 256×0.50×0.50, which is smaller than the original volume value of 256×0.50 in unicast mode. For users, the volume in broadcast mode is significantly smaller than the volume in unicast mode. In order to obtain a better listening experience, the volume is usually adjusted based on the volume bar, for example, from 50 to 75. Obviously, for users on the LE audio device in broadcast mode, this volume level is just right.

[0142] If you switch back to Bluetooth unicast mode from Bluetooth broadcast mode, the volume value has been adjusted from 50 to 75 in broadcast mode. For the LE audio device, in unicast mode, the display device outputs the original audio data gain of 256. After sending the volume value of 75 to the LE audio device based on the VCP protocol connection, the actual playback volume of the LE audio device is 256 × 0.75. Obviously, compared to the original unicast mode where the LE audio device played 256 × 0.50, the volume of the LE audio device in unicast mode is much louder, affecting the user's normal listening experience.

[0143] Based on this, this disclosure provides an audio data processing method, such as... Figure 12 The diagram shown is a flowchart of another audio data processing method provided in this embodiment of the present disclosure. The method may include, but is not limited to, the following steps S1202-S1208:

[0144] S1202: When a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the Volume Control Protocol (VCP) connection with the LE audio device.

[0145] In this embodiment of the disclosure, step S1202 can be specifically referred to Figure 10 Step S1002 in the method shown is for reference only and will not be explained in detail here.

[0146] S1204: In the Bluetooth broadcast enabled state, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast the isochronous BIS audio stream based on the audio data of the first target gain.

[0147] In this embodiment of the disclosure, step S1204 can be specifically referred to Figure 10 Step S1004 in the method shown is for reference only and will not be explained in detail here.

[0148] As can be seen, the embodiments of this disclosure can, upon receiving a Bluetooth broadcast enable message, control the Bluetooth module to disconnect the VCP connection with the connected LE audio device, and adjust the original gain of the audio data based on the volume value of the acquired broadcast volume parameter, so as to emit the BIS audio stream using the adjusted first target gain, thereby realizing independent control of the Bluetooth broadcast volume.

[0149] S1206: In response to switching from the Bluetooth broadcast enabled state to the Bluetooth unicast enabled state, control the Bluetooth module to establish a VCP connection with the connected LE audio device.

[0150] In this embodiment of the disclosure, since the Bluetooth module disconnects the VCP connection with the connected LE audio device in order to control the volume of Bluetooth broadcast independently when Bluetooth broadcast is enabled, it is necessary to first establish a VCP connection between the Bluetooth module and the connected LE audio device when switching from Bluetooth broadcast enabled to Bluetooth unicast mode in order to achieve volume adjustment in Bluetooth unicast mode.

[0151] In this embodiment of the disclosure, the Volume Control Profile (VCP) is a protocol used in Bluetooth audio technology to control the volume of LE audio devices. After the display device establishes a VCP protocol connection with the LE audio device, it can send a volume value index to the LE audio device to control the LE audio device to adjust its own volume based on the volume value index.

[0152] S1208: Obtain the volume value of the Bluetooth unicast volume parameter, and send the volume value of the Bluetooth unicast volume parameter to the connected LE audio device through the Bluetooth module based on the VCP connection; wherein, the volume value of the Bluetooth unicast volume parameter is used to adjust the gain of the audio data received by the connected LE audio device.

[0153] In this embodiment of the disclosure, after the control Bluetooth module establishes a VCP connection with the connected LE audio device, the volume value of the Bluetooth unicast audio parameters is obtained, and the volume value of the obtained Bluetooth unicast audio parameters is sent to the connected LE audio device through the Bluetooth module based on the VCP connection.

[0154] Because this embodiment uses different volume parameters to record the Bluetooth broadcast volume and the Bluetooth unicast volume, the Bluetooth broadcast volume can be adjusted independently when Bluetooth broadcast is enabled without affecting the Bluetooth unicast volume. Therefore, after switching from the Bluetooth broadcast enabled state to the Bluetooth unicast enabled state, the audio data of the target audio resource can still be played with the original volume value recorded in the Bluetooth unicast audio parameters, so as not to affect the user's listening experience.

[0155] In one optional implementation, when Bluetooth unicast is enabled, the original gain audio data can also be sent to the Bluetooth module to control the Bluetooth module to send the original gain audio data to the connected LE audio device.

[0156] In this embodiment of the disclosure, the original gain audio data refers to the volume of the target audio resource itself. After sending the volume value of the Bluetooth unicast audio parameters to the connected LE audio device based on the VCP connection, and sending the original gain audio data to the connected LE audio device through the Bluetooth module, the connected LE audio device can play the target audio resource according to the volume value of the Bluetooth unicast audio parameters and the original gain audio data.

[0157] like Figure 13The diagram shown illustrates a timing diagram for Bluetooth broadcast volume adjustment and Bluetooth unicast volume adjustment according to an embodiment of this disclosure. The audio service, audio policy module, and audioHal abstraction layer all belong to the audio framework.

[0158] When the audio service receives a user's volume adjustment command, it first determines whether the connected LEaudio device is a unicast device or a broadcast device.

[0159] When Bluetooth unicast is enabled, the volume value of the Bluetooth unicast volume parameter is first obtained, and the volume value of the Bluetooth unicast volume parameter is stored in the database using the audio service. The audio data with the original gain is also sent to the audio policy module audioPolicy.

[0160] After receiving the audio data with the original gain, the audio strategy module forwards the audio data with the original gain to the audio abstraction layer, Audio Hal, so that the audio abstraction layer can output audio data using the original gain.

[0161] Then, the control audio service sends the volume value of the Bluetooth unicast volume parameter to the Bluetooth application, so that the Bluetooth application can call the VCP protocol in the Bluetooth protocol stack to adjust the volume interface and send the volume value of the Bluetooth unicast volume parameter to the LEaudio device.

[0162] When Bluetooth broadcast is enabled, the system first controls the Bluetooth module to disconnect the VCP connection with the connected LE audio device and obtains the volume value of the Bluetooth broadcast volume parameter. Then, it uses the audio service to store the volume value of the Bluetooth broadcast volume parameter in the database and sends the volume value of the Bluetooth broadcast volume parameter to the audio policy module.

[0163] After receiving the volume value of the Bluetooth broadcast volume parameter, the audio strategy module sends the volume value of the Bluetooth broadcast volume parameter to the audio abstraction layer (audio HAL) so that the audio abstraction layer can output audio data using the first target gain.

[0164] In practical applications, when it is determined that the current audio output device includes a Bluetooth broadcasting device, the original gain of the audio data of the target audio resource can be adjusted based on the volume value of the broadcast volume parameter to obtain the first target gain.

[0165] In one alternative implementation, since the audio module can be used to record information about the audio output device after device switching, it can be used to determine whether the current audio output device contains a Bluetooth broadcast device.

[0166] Specifically, when the audio control module receives an audio output device switching message, it records the information of the current audio output device based on the device protocol information carried in the audio output device switching message.

[0167] For example, if the MAC address information of the current audio output device recorded in the device protocol profile information carried in the audio output device switching message is a preset address, then the current audio output device is determined to be a Bluetooth broadcast device; if the information of the current audio output device recorded in the device protocol profile information is a specific MAC address or IP address, then the current audio output device is determined to be a Bluetooth unicast device.

[0168] If the current audio output device is determined to be a Bluetooth broadcasting device, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. Then, the audio data of the first target gain is sent to the Bluetooth module to control the Bluetooth module to emit a BIS audio stream based on the audio data of the first target gain.

[0169] If the current audio output device is determined to be a Bluetooth unicast device, the volume value of the Bluetooth unicast volume parameter is obtained, and the volume value of the Bluetooth unicast volume parameter is sent to the connected LE audio device via the Bluetooth module based on the VCP connection, so that the connected LE audio device can adjust the gain of the audio data based on the volume value of the Bluetooth unicast volume parameter.

[0170] In addition, if it is determined that the current audio output device includes the first audio output device, the original gain of the audio data of the target audio resource can be adjusted based on the volume value of the volume parameter of the first audio output device to obtain a second target gain, and the audio data of the second target gain can be sent to the first audio output device.

[0171] like Figure 14 The diagram shown is a timing flowchart for the online status of a current audio output device provided in an embodiment of this disclosure.

[0172] When the Bluetooth application detects that an audio output device is online, it sends an audio output device switching message to the audio module and carries the device protocol information in the audio output device.

[0173] When the audio module receives an audio output device switching message, it records the information of the current audio output device based on the device protocol information carried in the audio output device switching message.

[0174] If the MAC address of the current audio output device recorded in the profile is FF, then the current audio output device is determined to be a Bluetooth broadcast device; if the profile records a specific MAC address or IP address, then the current audio output device is determined to be a Bluetooth unicast device.

[0175] Then, the audio module sends the information of the current audio output device to the audio policy, so that the audio policy can forward the information of the current audio output device to the audio abstraction layer, audio Hal.

[0176] After receiving information about the current audio output device, the audio abstraction layer HAL records the type of the current audio output device, i.e., a Bluetooth broadcast device or a Bluetooth unicast device.

[0177] like Figure 15 The diagram shown is a schematic representation of a simultaneous Bluetooth broadcast and speaker output according to an embodiment of this disclosure. The speaker is a first audio output device.

[0178] When Bluetooth broadcasting is enabled, the Bluetooth service notifies the audio module that the current audio output device is a Bluetooth broadcasting device.

[0179] When the audio module receives an audio output device switching message, it notifies the audio abstraction layer, Audio Hal, through the audio server. The audio abstraction layer, Audio Hal, then starts the audio capture thread.

[0180] After the audio track information is written at the application (APP) layer, it is first sent to the audio server. The audio server then abstracts the audio into an audio HAL and writes it to the kernel's mixing PCM module. The PCM (Pulse-Code Modulation) module is a digital signal processing module. In audio processing, the PCM module is typically used to convert analog audio signals to digital audio signals, or vice versa.

[0181] In the PCM mixing module, two audio buffers are created. One audio buffer, audiobuffer, is sent to the audio processing thread capture thread in the audio HAL layer through a thread read operation in the audio processing tool. Finally, it is written to the Bluetooth protocol stack through the LE audio HAL abstraction layer so that the Bluetooth protocol stack can broadcast the audio stream.

[0182] Another audio buffer is sent to the speaker. At this time, the speaker's data stream needs to be unmuteed, and the audio stream in the audio buffer is output to the speaker.

[0183] As can be seen, this embodiment of the present disclosure achieves simultaneous Bluetooth broadcasting and speaker output by copying two audio buffers in the mixing PCM module and sending the two audio buffers to the Bluetooth protocol stack and the speaker respectively.

[0184] like Figure 16 The diagram shown is a flowchart illustrating speaker volume adjustment according to an embodiment of this disclosure. The speaker volume is adjusted using the volume "+" and volume "-" buttons on a remote control.

[0185] When the display device receives a volume adjustment command from the remote control's "+" or "-" button, it first determines whether Bluetooth broadcasting is enabled.

[0186] If Bluetooth broadcasting is enabled, it checks whether the current audio output device includes a speaker. If it is determined that the current audio output device includes a speaker, it calls the display device middleware to set the speaker volume and calls the Android interface setDeviceVolume to synchronize the speaker volume to the Android side. The purpose is to synchronize the volume of the currently output speaker to the Android layer in the Bluetooth broadcasting scenario so that when a third-party application calls the interface provided by the Android layer to obtain the volume, it can accurately obtain the speaker volume, rather than the volume of the connected Bluetooth device.

[0187] If Bluetooth broadcast is off, the TV middleware is called to set the speaker volume, and the setStreamVolume interface is called to synchronize the speaker volume to the Android device.

[0188] like Figure 17 The diagram shown is a flowchart of a Bluetooth broadcast volume adjustment method provided in an embodiment of this disclosure.

[0189] With Bluetooth broadcast enabled, the first step is to determine if a connected LE audio device exists on the display device.

[0190] If a connected LE audio device exists, the control Bluetooth module will disconnect the VCP connection with the LE audio device.

[0191] Upon receiving a first volume adjustment operation for the broadcast volume parameter, the system obtains the adjusted volume value corresponding to the first volume adjustment operation and updates the volume value of the broadcast volume parameter using the adjusted volume value.

[0192] Then, the setStreamVolume interface is called to synchronize the volume value of the broadcast volume parameter to the Android device.

[0193] Figure 18 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. The electronic device can be the aforementioned display device, control terminal, or audio receiving device. Figure 18 As shown, the electronic device includes: a processor 1801, a memory 1802, and a computer program stored in the memory 1802 and executable on the processor 1801. When the computer program is executed by the processor 1801, it implements various processes of the following methods in the above method embodiments: a configuration method for a multi-channel audio receiving device executed by a display device; and a configuration method for a multi-channel audio receiving device executed by an audio receiving device.

[0194] This disclosure provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the configuration method for the multi-channel audio receiving device described above, achieving the same technical effects. To avoid repetition, further details are omitted here. The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.

[0195] This disclosure provides a computer program product that includes a computer program that, when run on a computer, enables the computer to implement the above-described configuration method for a multi-channel audio receiving device.

[0196] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.

Claims

1. A display device, characterized in that, include: monitor; Audio output module; Bluetooth module; The controller connected to the Bluetooth module is configured to: When a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, the Bluetooth module is controlled to disconnect the Volume Control Protocol (VCP) connection with the LE audio device. When the Bluetooth broadcast is enabled, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast an isochronous BIS audio stream based on the audio data of the first target gain.

2. The display device according to claim 1, characterized in that, The controller is also configured to: When the Bluetooth broadcast is enabled, in response to a first volume adjustment operation on the broadcast volume parameter, the adjusted volume value corresponding to the first volume adjustment operation is obtained, and the volume value of the broadcast volume parameter is updated using the adjusted volume value.

3. The display device according to claim 1, characterized in that, The controller is also configured to: In the Bluetooth broadcast enabled state, in response to a second volume adjustment operation on the volume parameter of the first audio output device, the adjusted volume value corresponding to the second volume adjustment operation is obtained, and the volume value of the volume parameter of the first audio output device is updated using the adjusted volume value; wherein, the first audio output device includes at least one of the sound output module, HDMI audio output device, and USB audio output device; The original gain of the audio data of the target audio resource is adjusted based on the volume value of the volume parameter of the first audio output device to obtain a second target gain, and the audio data of the second target gain is sent to the first audio output device.

4. The display device according to claim 1, characterized in that, The controller, in response to a Bluetooth broadcast enable message, is also configured to: The display is controlled to show a broadcast volume component; wherein the broadcast volume component is used to adjust the volume value of the broadcast volume parameter.

5. The display device according to claim 4, characterized in that, The controller is also configured to: In response to the Bluetooth broadcast shutdown message, the broadcast volume component is controlled to turn off its display.

6. The display device according to claim 1, characterized in that, The controller is also configured to: In response to switching from the Bluetooth broadcast enabled state to the Bluetooth unicast enabled state, the Bluetooth module is controlled to establish a VCP connection with the connected LE audio device; The volume value of the Bluetooth unicast volume parameter is obtained, and the volume value of the Bluetooth unicast volume parameter is sent to the connected LE audio device through the Bluetooth module based on the VCP connection; wherein, the volume value of the Bluetooth unicast volume parameter is used to adjust the gain of the audio data received by the connected LE audio device.

7. The display device according to claim 6, characterized in that, The controller, in response to switching from the Bluetooth broadcast enabled state to the Bluetooth unicast enabled state, is further configured to: When Bluetooth unicast is enabled, the original gain audio data is sent to the Bluetooth module to control the Bluetooth module to send the original gain audio data to the connected LE audio device.

8. The display device according to claim 1, characterized in that, The controller is specifically configured as follows: The step of adjusting the original gain of the audio data of the target audio resource based on the volume value of the broadcast volume parameter to obtain the first target gain includes: If it is determined that the current audio output device includes a Bluetooth broadcasting device, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain.

9. The display device according to claim 3, characterized in that, The controller is specifically configured as follows: The step of adjusting the original gain of the audio data of the target audio resource based on the volume value of the volume parameter of the first audio output device to obtain the second target gain includes: If it is determined that the current audio output device includes the first audio output device, the original gain of the audio data of the target audio resource is adjusted based on the volume value of the volume parameter of the first audio output device to obtain the second target gain.

10. The display device according to claim 8, characterized in that, The controller is also configured to: When the audio control module receives an audio output device switching message, it records the information of the current audio output device according to the device protocol information carried in the audio output device switching message.

11. An audio data processing method, characterized in that, include: When a connection is established with an LE audio device, in response to a Bluetooth broadcast enable message, the Bluetooth module is controlled to disconnect the Volume Control Protocol (VCP) connection with the LE audio device. When the Bluetooth broadcast is enabled, the volume value of the broadcast volume parameter is obtained, and the original gain of the audio data of the target audio resource is adjusted based on the volume value of the broadcast volume parameter to obtain a first target gain. The audio data of the first target gain is then sent to the Bluetooth module to control the Bluetooth module to broadcast an isochronous BIS audio stream based on the audio data of the first target gain.

Images