Display device and audio data processing method

Abstract

The invention relates to a display device and an audio data processing method, and relates to the technical field of Bluetooth. The display equipment comprises a controller and a Bluetooth module connected with the controller, and the controller is configured to send a broadcast pause instruction to the Bluetooth module in response to a first key instruction from Bluetooth remote control equipment under the condition that the Bluetooth module is in a Bluetooth broadcast state so as to control the Bluetooth module to pause to send broadcast isochronous stream BIS audio data; after a broadcast pause success signal returned by the Bluetooth module is received, a voice starting instruction is sent to the Bluetooth remote control equipment through the Bluetooth module, so that the Bluetooth remote control equipment is instructed to start a voice receiving module to receive voice data input by a user. Visibly, according to the embodiment of the invention, when the first key instruction from the Bluetooth remote control equipment is received, the Bluetooth module is controlled to stop sending the BIS audio data, so that the occupation of Bluetooth chip resources is reduced, and the accuracy of voice recognition of the Bluetooth remote control equipment is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of Bluetooth technology, and in particular to a display device and an audio data processing method. Background Art

[0002] With the launch of the new generation of Bluetooth audio technology standard - Bluetooth-based low-energy audio (LE audio) technology, more and more display devices can support Bluetooth-based low-energy audio (LE audio) protocol, such as TVs, mobile phones and other devices.

[0003] At present, due to the limited capabilities of Bluetooth chips, display devices need to occupy more Bluetooth chip resources when broadcasting Bluetooth audio data. If voice data is transmitted to the display device through a Bluetooth remote control device at this time, the probability of packet loss of the user's input voice data is high, resulting in inaccurate recognition of the user's input voice data. Summary of the invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a display device and an audio data processing method, which can reduce the occupation of Bluetooth chip resources by controlling the Bluetooth module to suspend sending BIS audio data when receiving a first button command from a Bluetooth remote control device, thereby reducing the probability of packet loss when transmitting voice data to the display device via the Bluetooth remote control device and improving the recognition accuracy of voice data input by the user.

[0005] In order to achieve the above objectives, the technical solutions provided by the embodiments of the present disclosure are as follows:

[0006] In a first aspect, the present disclosure provides a display device, comprising: a controller, and a Bluetooth module connected to the controller;

[0007] The controller is configured to:

[0008] When the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data;

[0009] After receiving the broadcast pause success signal returned by the Bluetooth module, sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user;

[0010] In response to a second key command from the Bluetooth remote control device, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

[0011] In a second aspect, the present disclosure provides an audio data processing method, comprising:

[0012] When the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data;

[0013] After receiving the broadcast pause success signal returned by the Bluetooth module, sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user;

[0014] In response to a second key command from the Bluetooth remote control device, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

[0015] In a third aspect, the present disclosure provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the audio data processing method as shown in the second aspect.

[0016] In a fourth aspect, the present disclosure provides a computer program product, which includes a computer program. When the computer program is executed on a computer, the computer implements the audio data processing method as shown in the second aspect.

[0017] The display device and the audio data processing method of the display device provided by the embodiments of the present disclosure, wherein the display device includes: a controller and a Bluetooth module connected to the controller, and the controller is configured to: when the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, send a pause broadcast command to the Bluetooth module to control the Bluetooth module to pause sending the broadcast isochronous stream (BIS) audio data; after receiving a pause broadcast success signal returned by the Bluetooth module, send a voice start command to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to turn on the voice receiving module to receive the voice data input by the user; in response to a second key command from the Bluetooth remote control device, send a resume broadcast command to the Bluetooth module to control the Bluetooth module to continue sending the BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end the input of voice data.

[0018] It can be seen that the embodiment of the present disclosure can reduce the occupation of Bluetooth chip resources by controlling the Bluetooth module to suspend sending BIS audio data when receiving the first button command from the Bluetooth remote control device, thereby reducing the probability of packet loss when transmitting the voice data input by the user to the display device through the Bluetooth remote control device, and improving the recognition accuracy of the voice data input by the user.

[0019] In addition, when the embodiment of the present disclosure receives a second button command from the Bluetooth remote control device, it can restore the Bluetooth broadcast state by controlling the Bluetooth module to continue sending BIS audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 A schematic diagram of one-to-one audio transmission of unicast media audio in the related art;

[0023] Figure 2 A schematic diagram of one-to-two audio transmission of unicast media audio provided in the related art;

[0024] Figure 3 A schematic diagram of the relationship between extended broadcast, periodic broadcast and BIS;

[0025] Figure 4 A schematic diagram showing the relationship between extended broadcast packets, subsidiary broadcast packets, periodic broadcast packets and BIS;

[0026] Figure 5 It is a schematic diagram of continuously sending BIG in the related art;

[0027] Figure 6 A broadcast scenario diagram provided in an embodiment of the present disclosure Figure 1 ;

[0028] Figure 7 A broadcast scenario diagram provided in an embodiment of the present disclosure Figure 2 ;

[0029] Figure 8 A hardware configuration block diagram of a display device 100 provided in an embodiment of the present disclosure;

[0030] Fig. 9 A schematic diagram of a software system architecture of a display device 100 provided in an embodiment of the present disclosure;

[0031] Fig.10 A hardware configuration block diagram of a Bluetooth remote control device 200 provided in an embodiment of the present disclosure;

[0032] Fig.11 A schematic flow chart of an audio data processing method for a display device provided in an embodiment of the present disclosure;

[0033] Fig.12 A schematic flow chart of another method for processing audio data of a display device provided by an embodiment of the present disclosure;

[0034] Fig.13 A speech recognition flow chart provided for an embodiment of the present disclosure;

[0035] Fig.14 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0036] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0037] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0038] The display device and the audio receiving device provided in the present disclosure can support the low-power audio (LE Audio) technology based on Bluetooth, wherein the display device is used as an audio playback device or a device for configuring an audio receiving device. For example, the display device can be a TV, a mobile phone, a projector, etc., and the audio receiving device can be a Bluetooth speaker, a Bluetooth headset, etc.

[0039] Compared with classic Bluetooth, LE Audio has the following advantages:

[0040] 1. One audio playback device can be connected to multiple audio receiving devices at the same time;

[0041] 2. A broadcast audio device can send broadcast audio to an unlimited number of audio receiving devices, supporting encrypted broadcasting;

[0042] 3. Adopt the latest Low Complexity Communication Codec (LC3) audio format, and the sound quality is improved;

[0043] 4. Support Internet phone and HD calls;

[0044] 5. Support hearing aid / assisted listening applications.

[0045] The LE Audio application layer specification Telephony and Media Audio Profile (TMAP) defines two media audio applications: unicast media audio and broadcast media audio.

[0046] Unicast Media Audio

[0047] Compared with the current media audio application specification (Advanced Audio Distribution Profile. A2DP) in classic Bluetooth, the unicast media audio in TMAP uses a more advanced audio codec to provide better sound quality, and at the same time provides richer control functions than the current classic Bluetooth media playback control specification (Audio / Video Remote Control Profile, AVRCP). TMAP defines two roles for unicast media audio applications: Unicast Media Sender (UMS) and Unicast Media Receiver (UMR). Unicast media audio transmission is achieved between UMS and UMR through the connection isochronous stream (CIS).

[0048] It should be noted that the unicast media audio defined in TMAP is not limited to one-to-one audio transmission, but also supports a unicast media sender transmitting unicast media audio to two unicast media receivers.

[0049] Figure 1 FIG. 1 is a schematic diagram of a one-to-one audio transmission of unicast media audio in the related art. Figure 1 As shown, UMS11 sends unicast media audio to UMR12.

[0050] Figure 2 FIG. 1 is a schematic diagram of a one-to-two audio transmission of unicast media audio provided in the related art. Figure 2 As shown, UMS21 sends unicast media audio to UMR22 and UMR23 respectively.

[0051] Broadcast Media Audio

[0052] Broadcast media audio in TMAP is transmitted synchronously based on multiple connectionless broadcast isochronous streams (BIS). The biggest advantage of broadcast media audio is that it can transmit audio data synchronously to multiple audio receiving devices.

[0053] The broadcast synchronization channel of broadcast media audio in TMAP has two concepts: broadcast isochronous group (BIG) and BIS. An audio sending device can send multiple BIGs at the same time, each BIG can be composed of multiple BISs, and a BIG can contain up to 31 BISs. Each BIS has a unique access address (Access Address), and the access address of the BIS is generated according to a unified algorithm based on the seed access address (Seed Access Address) of the BIG to which it belongs.

[0054] Broadcast media audio may include multiple broadcasts with different access addresses, for example, including:

[0055] Extended Advertising: Extended advertising on the main advertising channel, using ADV_EXT_IND packets, and pointing to the subsidiary advertising through time and frequency information. Its access address uses the main advertising access address specified in the Bluetooth core specification: 0x8E89BED6.

[0056] Periodic Advertising: The subsidiary broadcast uses the AUX_ADV_IND packet and points to the periodic broadcast through time, frequency hopping map and access address. The periodic broadcast uses the AUX_SYNC_IND packet and contains BIG information (BIGInfo).

[0057] Broadcast Isochronous Stream (BIS): A broadcast isochronous stream that periodically broadcasts digital audio using a time, frequency hopping map, access address, and BIGInfo pointing to the BIS, using BIS Protocol Data Unit (PDU) packets.

[0058] Figure 3 The diagram is a diagram of the relationship between extended broadcast, periodic broadcast and BIS. It should be noted that Bluetooth operates in the 2.4GHz band, which has a frequency range of 2402MHz to 2480MHz, with a channel every 2MHz, for a total of 40 channels, of which there are 3 main broadcast channels, namely channel 37, channel 38 and channel 39, and the remaining 37 channels are secondary broadcast channels, which are channel 0 to channel 36. Figure 3 As shown, the main broadcast channel includes channel 37, channel 38 and channel 39; the secondary broadcast channel includes: channel 0 to channel 36. The extended broadcast on the main broadcast channel can use ADV_EXT_IND packets, and point to the subsidiary broadcast of the secondary broadcast channel through time and frequency information. After that, the subsidiary broadcast uses AUX_ADV_IND packets, and points to the periodic broadcast through time, frequency hopping map and access address. Further, the periodic broadcast uses AUX_SYNC_IND packets, and points to BIS through time, frequency hopping map, access address and BIG information (BIGInfo). BIS uses BIS PDU packets to broadcast digital audio.

[0059] Figure 4 Figure 1 is a schematic diagram showing the relationship between extended broadcast packets, auxiliary broadcast packets, periodic broadcast packets, and BIS. Figure 4As shown, the audio sending device sends an extended broadcast packet (ADV_EXT_IND) on the main broadcast channel (37, 38, 39), and the extended broadcast packet includes: the broadcast device address (AdvA), broadcast data information (ADI) and the pointer of the auxiliary broadcast packet (AuxiliaryPointer, AuxPtr), wherein AuxPtr indicates that the auxiliary broadcast will be carried out on the secondary broadcast channel next, and the auxiliary broadcast packet (AUX_ADV_IND) includes: extended broadcast data (AdvData), broadcast audio announcement service universal unique identifier (BroadcastAudio Announcement Service UUID), other service universal unique identifiers (Others ServiceUUIDs), and the auxiliary broadcast packet indicates the data channel and broadcast period of the periodic broadcast. The periodic broadcast packet (AUX_SYNC_IND) includes: additional broadcast data BIG information (Additional Controller Advertising Data BIGinfo, ACAD BIGinfo), and the basic audio broadcast service universal unique identifier (AdvData BasicAudio Announcement Service UUID), BASE of the extended broadcast data. The periodic broadcast packet contains all the information of the broadcast isochronous stream BIS. After receiving the periodic broadcast packet, the broadcast receiver receives the BIS data on a specific channel at a specific time anchor point according to the data included therein to obtain the BIS audio stream.

[0060] In actual applications, when broadcasting digital audio via BIS, it is achieved by continuously sending BIG. Each time a BIG is sent, it can be called a BIG event, and each BIG event can include multiple BISs.

[0061] Figure 5 FIG. 1 is a schematic diagram of continuously sending BIG in the related art. Figure 5 As shown, in the process of continuously sending BIG, BIG events are executed periodically and continuously. Figure 5 The BIG anchor points shown in indicate the start time of each BIG event, and the time interval between two anchor points is a cycle for executing the BIG event. Figure 5 The following example uses three BIG events, each of which includes two BIS events. Figure 5 The diagram shows the continuous execution of BIG event X, BIG event (X+1) and BIG event (X+2), wherein each BIG event includes two BIS streams, namely Figure 5BIS1 and BIS2 are shown in FIG. In the process of executing the BIG time, the BIS stream will be broadcasted, and in the process of broadcasting the BIS stream, the BIS stream will be broadcasted once every fixed time interval.

[0062] The audio data processing method of the display device of the embodiment of the present disclosure can be implemented by a display device and multiple audio receiving devices, and the display device can be a mobile phone, a television, a computer, etc. The audio receiving device can be a speaker, a headset, etc. The audio data processing method of the display device provided in the embodiment of the present disclosure mainly involves the configuration of the BIS audio of the channel matched by the audio receiving device (i.e., the configuration of the BIS identifier), and the configuration stage is mainly implemented through the display device and / or the control terminal. Among them, the control terminal can be a mobile terminal, for example, a mobile phone, a tablet computer, a remote control, a wearable device, etc., which can be used to implement functions such as configuring the BIS identifier for the audio receiving device, and the wearable device can be a smart watch, a smart bracelet, etc.

[0063] Figure 6 A broadcast scenario diagram provided in an embodiment of the present disclosure Figure 1 .like Figure 6 As shown, Figure 6 In the description, the display device is a TV set as an example, and the TV set has a built-in Bluetooth module that supports LE Audio devices. For example, a TV is deployed in the center of the conference room, and an LE audio device, such as a speaker and a headset, is deployed in each of the four different areas of the conference room, area A, area B, area C, and area D. The Bluetooth module of the display device sends multiple Bluetooth broadcasts based on at least two target audio tracks to achieve the effect of LE audio devices in different areas playing different languages. In addition, in the process of sending multiple Bluetooth broadcasts based on at least two target audio tracks, the user can also transmit the user's voice data to the TV through the Bluetooth remote control device, and the TV is used to perform voice recognition on the input voice data.

[0064] Figure 7 A broadcast scenario diagram provided in an embodiment of the present disclosure Figure 2 .like Figure 7 As shown, Figure 7In the example, the display device is a TV, and the connected audio receiving device is a speaker, where data is transmitted between the TV and the speaker via a BSA connection. Among them, speaker 1 is the audio receiving device corresponding to the left channel, speaker 2 is the audio receiving device corresponding to the right channel, speaker 3 is the audio receiving device corresponding to the left front channel, and speaker 4 is the audio receiving device corresponding to the right front channel. When the TV is broadcasting the BIS stream, speaker 1 can synchronize the channel audio data in the corresponding BIS stream based on the identifier "BIS0". In addition, in the process of broadcasting the BIS stream based on at least two channels, the user can also transmit the user's voice data to the TV through a Bluetooth remote control device, and the TV is used to perform voice recognition on the input voice data.

[0065] Figure 8 FIG. 1 is a hardware configuration block diagram of a display device 100 provided in an embodiment of the present disclosure. Figure 8 The display device 100 shown includes: a tuner 110, a communicator 120, a detector 130, an external device interface 140, a controller 150, a display 160, an audio output interface 170, a memory, a power supply, etc. Among them, the controller 150 includes a central processing unit, a video processor, an audio processor, a graphics processor, a random access memory (Random Access Memory, RAM), a read-only memory (Read-Only Memory, ROM), and a first interface to an nth interface for input / output. The display 160 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner 110 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals from multiple wireless or wired broadcast television signals, such as and an electronic program guide (EPG) data signal. The detector 130 is used to collect signals of the external environment or interact with the outside. The controller 150 and the tuner-demodulator 110 may be located in different separate devices, that is, the tuner-demodulator 110 may also be located in an external device of the main device where the controller 150 is located, such as an external set-top box.

[0066] For example Figure 6 or Figure 7 In the scenario shown, when implementing the audio data processing method of the display device provided by the embodiment of the present disclosure, each component in the display device 100 can implement the following functions:

[0067] In some embodiments, the controller 150 is configured to:

[0068] When the Bluetooth module is in the Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, a broadcast pause command is sent to the Bluetooth module to control the Bluetooth module to pause sending the broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data; after receiving a broadcast pause success signal returned by the Bluetooth module, a voice start command is sent to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user;

[0069] In response to a second key command from the Bluetooth remote control device, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

[0070] In some embodiments, the controller 150, in response to the second key command from the Bluetooth remote control device, is further configured to:

[0071] A voice ending instruction is sent to the Bluetooth remote control device through the Bluetooth module; wherein the voice ending instruction is used to instruct the Bluetooth remote control device to turn off the voice receiving module to stop receiving the voice data input by the user.

[0072] In some embodiments, the controller 150 is specifically configured to:

[0073] The sending of a voice end instruction to the Bluetooth remote control device through the Bluetooth module includes: after receiving a resume broadcast success signal returned by the Bluetooth module, sending a voice end notification signal to the audio module in the display device to control the audio module to send a voice end instruction to the Bluetooth remote control device through the Bluetooth module.

[0074] In some embodiments, the controller 150 is specifically configured to:

[0075] After receiving the pause broadcast success signal returned by the Bluetooth module, sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to turn on the voice receiving module to receive the voice data input by the user, including: after receiving the pause broadcast success signal returned by the Bluetooth module, sending a voice start notification signal to the audio module in the display device to control the audio module to send a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to turn on the voice receiving module to receive the voice data input by the user.

[0076] In some embodiments, the controller 150 is specifically configured to:

[0077] The method comprises: when the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, sending a pause broadcast command to the Bluetooth module to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data, including: when the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, sending a pause broadcast command to the Bluetooth module to control the Bluetooth protocol stack in the Bluetooth module to pause sending broadcast isochronous stream BIS audio data to the Bluetooth chip end.

[0078] In some embodiments, before the controller 150 executes the step of sending a pause broadcast instruction to the Bluetooth module in response to a first key instruction from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state, the controller 150 is further configured to:

[0079] The Bluetooth module is controlled to send a Bluetooth broadcast based on at least two audio tracks of the target audio and video resources; wherein the at least two audio tracks correspond to at least two BIS audio data respectively.

[0080] In some embodiments, before the controller 150 executes the step of sending a pause broadcast instruction to the Bluetooth module in response to a first key instruction from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state, the controller 150 is further configured to:

[0081] The Bluetooth module is controlled to send out a Bluetooth broadcast based on multiple channels configured based on the target audio and video resources; wherein the multiple channels respectively correspond to at least one BIS audio data.

[0082] In some embodiments, after the controller 150 executes the step of sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module after receiving the broadcast pause success signal returned by the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user, the controller 150 is further configured to:

[0083] The Bluetooth module is controlled to receive voice data from the Bluetooth remote control device, and the voice data is forwarded to the audio module of the display device, so that the audio module performs voice recognition on the voice data by calling the voice recognition module.

[0084] In some embodiments, before the controller 150 executes the step of sending a pause broadcast instruction to the Bluetooth module in response to a first key command from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data, the controller 150 is further configured to:

[0085] Control the Bluetooth module to receive the first button information sent by the Bluetooth remote control device through the low-power Bluetooth BLE transmission channel, and determine the button instruction corresponding to the first button information as the first button instruction; wherein the first button information includes button value information and button control information, and the button control information includes button pressing information.

[0086] In some embodiments, before the controller 150 executes the step of sending a resume broadcast instruction to the Bluetooth module in response to the second button instruction from the Bluetooth remote control device to control the Bluetooth module to continue sending BIS audio data, the controller 150 is further configured to:

[0087] Control the Bluetooth module to receive the second button information sent by the Bluetooth remote control device through the low-power Bluetooth BLE transmission channel, and determine the button instruction corresponding to the second button information as the second button instruction; wherein the second button information includes button value information and button control information, and the button control information includes button lift information.

[0088] In some embodiments, the controller 150 is specifically configured to:

[0089] The method of responding to a first button instruction from a Bluetooth remote control device and sending a pause broadcast instruction to the Bluetooth module to control the Bluetooth module to pause sending BIS audio data includes: responding to a first button instruction from a Bluetooth remote control device, if the Bluetooth module is in a Bluetooth broadcast state, controlling the Bluetooth module to obtain the number of broadcast isochronous streams (BIS) contained in the currently issued Bluetooth broadcast; if the number of BIS contained in the Bluetooth broadcast is greater than a preset number threshold, sending a pause broadcast instruction to the Bluetooth module to control the Bluetooth module to pause sending BIS audio data.

[0090] Fig. 9 FIG. 1 is a schematic diagram of a software system architecture of a display device 100 provided in an embodiment of the present disclosure. Fig. 9 As shown,

[0091] The software system at least includes: one or more of an application (App) layer, a system framework (Framework) layer (referred to as "framework layer"), a dynamic library (Library) and a Bluetooth driver (BluetoothDriver).

[0092] The application layer is used to deploy TV-related functions. For example, the application layer includes at least one or more of TV settings (TVSettings), TV services (TVService) or multimedia application center (MediaPlayer).

[0093] The system framework layer includes: one or more of a Bluetooth interface (Bluetooth API), a Bluetooth application (Bluetooth APK), and an audio (audio) module.

[0094] Bluetooth applications may include specifications related to the Bluetooth protocol, for example, one or more of the A2DP application specification, the LE Audio application specification, and the Hearing Aid application specification. Among them, the A2DP (Advanced Audio Distribution Profile) application specification is a media audio application specification in classic Bluetooth, the LE Audio application specification is a low-power audio application specification based on Bluetooth, and the Hearing Aid application specification is a hearing aid application specification based on low power (BLE).

[0095] The dynamic library includes: one or more of the Bluetooth protocol stack and the Bluetooth audio HAL layer, wherein the Bluetooth protocol stack is mainly responsible for scanning, connecting and configuring Bluetooth devices, etc. When the display device establishes a Bluetooth connection with the Bluetooth device, the Bluetooth application in the display device can send relevant data to the Bluetooth protocol stack.

[0096] The audio module may include one or more of an audio manager (audioManager) and an audio service (audioService). The audio module is mainly responsible for sending audio data from the Bluetooth application to the Bluetooth protocol stack. For example, the channel audio data of the channel can be transmitted through the audio channel between the audio module and the Bluetooth protocol stack. After receiving the channel audio data, the Bluetooth protocol stack encapsulates the channel audio data into a BIS stream.

[0097] The Bluetooth driver is a software program in the display device that can be used to control and manage the Bluetooth chip. The Bluetooth driver allows the display device to communicate with the Bluetooth device, so that the user can use the Bluetooth function through the display device's settings application, such as connecting Bluetooth headsets, mice and other devices.

[0098] The Bluetooth protocol stack may also include a general audio framework (GAF); GAF also includes a common audio profile (CAP), a common audio service (CAS), audio stream transmission management and volume control, wherein the audio stream transmission management includes a basic audio profile (BAP), an audio capability display service (PACS), an audio stream control service (ASCS) and a broadcast audio scan service (BASS), and BASS is required for broadcast synchronization in the disclosed embodiment. Volume control includes: a voice control profile (Volume Control Profile, VCP), a volume control service (Volume Control Service, VCS), a voice offset control service (Voice Offset Control Service, VOCS), and an audio input control service (Audio Input Control Service, AICS).

[0099] Fig.10 FIG. 2 is a hardware configuration block diagram of a Bluetooth remote control device 200 provided in an embodiment of the present disclosure. Fig.10 As shown, the Bluetooth remote control device 200 includes: a controller 210, a communicator 220, a user input / output interface 230, a memory 240, and a power supply 250. The communicator 220 is used to communicate with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user input / output interface 230 includes at least one of a speaker, a microphone, a touch panel, a sensor, a button or an alternative module.

[0100] Fig.11 The flowchart of the audio data processing method provided by the embodiment of the present application is exemplarily shown in FIG. Figure 6 The display device or Figure 7 The display device in the embodiment shown is as follows: Fig.11 As shown, it is a flowchart of an audio data processing method provided by an embodiment of the present disclosure, and the method may include but is not limited to the following steps S1102-S1104:

[0101] S1102: When the Bluetooth module is in the Bluetooth broadcast state, in response to a first key command from the Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending the broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data.

[0102] In the disclosed embodiment, the Bluetooth remote control device is a remote control that uses Bluetooth technology for wireless communication, which allows the user to control the display device without physical connection, for example, to control the switch, volume, channel switching, voice recognition and other functions of the TV through the buttons on the Bluetooth remote control device. Among them, the buttons on the Bluetooth remote control device may include voice buttons. After the user presses the voice button, the Bluetooth remote control device starts to receive the voice data input by the user through the microphone, and sends the voice data to the display device so that the display device can recognize the voice data. For example, when the display device recognizes that the voice data is "volume plus 1", it controls the display device to play music or video at a higher volume.

[0103] In the disclosed embodiment, the first button instruction may be an instruction to press a voice button on the Bluetooth remote control device, and the first button instruction is used to request to start inputting voice data through a voice receiving module of the Bluetooth remote control device, wherein the voice receiving module may be a module for receiving voice data, such as a microphone deployed on the Bluetooth remote control device.

[0104] In the disclosed embodiment, when the Bluetooth module is in the Bluetooth broadcast state, upon receiving the first button command from the Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending the broadcast isochronous stream BIS audio data. Specifically, when the display device is in the process of controlling the Bluetooth module to send the broadcast isochronous stream BIS audio data, upon receiving the voice button pressing command from the Bluetooth remote control, the display device first sends a pause broadcast command to the Bluetooth module. When the Bluetooth module receives the pause broadcast command, it pauses sending the broadcast isochronous stream BIS audio data to reduce the bandwidth occupation of the Bluetooth chip.

[0105] In actual applications, a low-power Bluetooth BLE transmission channel is established between the display device and the Bluetooth remote control device. The Bluetooth remote control device can send key information to the display device through the BLE transmission channel to control the display device to realize voice recognition, volume adjustment and other functions. In actual applications, multiple buttons can be deployed on the Bluetooth remote control device. When each button is pressed, a key information will be generated and sent to the display device through the BLE transmission channel.

[0106] In some embodiments, before performing voice recognition of the Bluetooth remote control device, the display device may also control the Bluetooth module to send first key information through the low-power Bluetooth BLE transmission channel, and determine the key instruction corresponding to the first key information as the first key instruction. The first key information includes key value information and key control information, the key value information is used to identify which button on the Bluetooth remote control is pressed or lifted by the user, and the key control information in the first key information includes key pressing information.

[0107] For example, assuming that the "volume +" button on the Bluetooth remote control is pressed, the button information received by the Bluetooth module from the Bluetooth remote control will be interpreted as an instruction to increase the volume; assuming that the voice button on the Bluetooth remote control is pressed, the button information received by the Bluetooth module from the Bluetooth remote control will be interpreted as an instruction for voice recognition.

[0108] In some embodiments, the display device can also send a pause broadcast instruction to the Bluetooth module in response to a first button instruction from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state, so as to control the Bluetooth protocol stack in the Bluetooth module to pause sending broadcast isochronous stream BIS audio data to the Bluetooth chip end.

[0109] In the disclosed embodiments, the Bluetooth protocol stack refers to the software layer in the Bluetooth module used to implement the Bluetooth function. The Bluetooth protocol stack is mainly responsible for processing the communication between the display device and the Bluetooth device. In the display device supporting the LEAudio protocol, the Bluetooth protocol stack is used to encapsulate the audio data from the Bluetooth application into a BIS stream and send the BIS stream to the Bluetooth chip through the audio channel. The Bluetooth chip is the hardware part that implements Bluetooth communication and is mainly responsible for processing the sending and receiving of wireless signals, such as receiving the broadcast isochronous stream BIS audio data from the Bluetooth protocol stack.

[0110] S1104: After receiving the broadcast pause success signal returned by the Bluetooth module, a voice start instruction is sent to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user.

[0111] In the disclosed embodiment, after receiving the broadcast pause instruction, the Bluetooth module suspends sending the broadcast isochronous stream BIS audio data to reduce the bandwidth resource load of the Bluetooth chip, and returns a broadcast pause success signal to the display device after the broadcast is successfully paused. Since the Bluetooth broadcast data is silent during the voice recognition process, the user will not be aware of the broadcast pause at this time, so it will not affect the user's experience. After receiving the broadcast pause success signal returned by the Bluetooth module, the display device sends a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user.

[0112] Exemplarily, when the display device receives an instruction of pressing a voice button from a Bluetooth remote control, i.e., a first button instruction, it first sends a pause broadcast instruction to the Bluetooth module, and after receiving a pause broadcast success signal returned by the Bluetooth module, it sends a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to turn on the microphone and receive the voice data input by the user through the microphone.

[0113] In some embodiments, the display device may also send a voice start notification to the audio module in the display device after receiving the pause broadcast instruction returned by the Bluetooth module, so as to control the audio module to send a voice start instruction to the Bluetooth remote control device through the Bluetooth module.

[0114] In some embodiments, after receiving the broadcast pause success signal returned by the Bluetooth module and sending a voice start command to the Bluetooth remote control device through the Bluetooth module, the display device can also control the Bluetooth module to receive voice data from the Bluetooth remote control device and forward the voice data to the audio module of the display device, so that the audio module can perform voice recognition on the voice data by calling the voice recognition module.

[0115] S1106: In response to a second button instruction from the Bluetooth remote control device, sending a resume broadcast instruction to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data.

[0116] The second key instruction is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

[0117] In the disclosed embodiment, the second button instruction may be a lift instruction of a voice button from the Bluetooth remote control device, and the second button instruction is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

[0118] In the disclosed embodiment, when the display device receives a command to lift the voice button, it indicates that the user has completed the input of voice data. At this time, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data. At this time, the LEaudio device connected to the display device can listen to the BIS audio data normally.

[0119] In some embodiments, the display device responds to the second button instruction from the Bluetooth remote control device and, before sending the resume broadcast instruction to the Bluetooth module, can also control the Bluetooth module to receive the second button information sent by the Bluetooth remote control device through the Bluetooth low energy BLE transmission channel, and determine the button instruction corresponding to the second button information as the second button instruction.

[0120] In the disclosed embodiment, a BLE (Bluetooth Low Energy) connection is established between the Bluetooth module of the display device and the Bluetooth remote control device, and communication is performed through the BLE transmission channel. The second button information may be the lifting operation information of the voice button sent by the Bluetooth remote control device.

[0121] Exemplarily, when the Bluetooth remote control device receives a lift operation from the user on the voice button, it sends the lift operation information of the voice button to the Bluetooth module of the display device through the BLE transmission channel. When the Bluetooth module receives the lift operation information of the voice button, it determines the key instruction corresponding to the lift operation information of the voice button as the second key instruction, i.e., the lift instruction of the voice button.

[0122] In some embodiments, when the display device receives the second key command from the Bluetooth remote control device, it can also send a voice end command to the Bluetooth remote control device through the Bluetooth module, wherein the voice end command is used to instruct the Bluetooth remote control device to turn off the voice receiving module to stop receiving the voice data input by the user.

[0123] In the disclosed embodiment, when the Bluetooth module of the display device receives the voice button lift operation information sent by the Bluetooth remote control device, it determines the key instruction corresponding to the voice button lift operation information as the second key instruction, that is, the voice button lift instruction. When the display device receives the voice button lift instruction, it forwards the voice end instruction to the Bluetooth remote control device through the Bluetooth module, instructing the Bluetooth remote control device to turn off the voice receiving module to stop receiving the voice data input by the user, that is, turn off the microphone on the Bluetooth remote control.

[0124] In some embodiments, the display device can also send a resume broadcast instruction to the Bluetooth module when receiving a second button instruction from the Bluetooth remote control device, and after receiving the resume broadcast success signal returned by the Bluetooth module, send a voice end notification signal to the audio module in the display device to control the audio module to send a voice end instruction to the Bluetooth remote control device through the Bluetooth module.

[0125] In the audio data processing method provided by the embodiment of the present disclosure, when the Bluetooth module is in the Bluetooth broadcast state, in response to the first key command from the Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending the broadcast isochronous stream BIS audio data; wherein the first key command is used to request to start inputting voice data through the voice receiving module of the Bluetooth remote control device; after receiving the pause broadcast success signal returned by the Bluetooth module, a voice start command is sent to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to turn on the voice receiving module to receive the voice data input by the user. It can be seen that the embodiment of the present disclosure can reduce the occupation of Bluetooth chip resources by controlling the Bluetooth module to pause sending BIS audio data when receiving the first key command from the Bluetooth remote control device, thereby reducing the probability of packet loss of the voice data input by the user transmitted to the display device through the Bluetooth remote control device, and improving the recognition accuracy of the voice data input by the user.

[0126] In addition, when receiving a second button command from the Bluetooth remote control device, the embodiment of the present disclosure can control the Bluetooth module to continue sending BIS audio data by sending a resume broadcast command to the Bluetooth module to restore the Bluetooth broadcast state.

[0127] like Figure 6 As shown, the audio data processing method provided by the embodiment of the present disclosure can be applied to a Bluetooth broadcast scenario with multiple audio tracks. For example, when a TV sends multiple Bluetooth broadcasts based on at least two audio tracks, a user can input voice data to the TV through a Bluetooth remote control.

[0128] In the disclosed embodiment, the Bluetooth module is first controlled to send multiple Bluetooth broadcasts based on at least two audio tracks of the target audio and video resources, wherein the at least two audio tracks correspond to at least two BIS audio data respectively.

[0129] In the disclosed embodiment, the target audio and video resource may be the audio and video resource currently being played by the display device, or may be any video resource among the audio and video resources to be played. Exemplarily, a plurality of audio and video resources to be played may be displayed on the audio and video resource list page, such as audio and video resource A, audio and video resource B, and audio and video resource C, etc. When a selection operation is received for any audio and video resource to be played, such as audio and video resource B, audio and video resource B is determined as the target audio and video resource.

[0130] The audio and video resources include at least one or more of audio resources and video resources. In practical applications, the audio and video resources may be pre-stored in the display device, or may be acquired by the display device according to preset conditions. For example, the target audio and video resource may be an audio resource downloaded from a multimedia server to the display device according to a specific address and being played.

[0131] In the disclosed embodiment, the target audio and video resource includes at least two audio tracks, wherein the audio track (English name is AudioTrack) can be used to indicate the audio information included in the target audio and video resource, and different audio tracks correspond to different audio information; there is a one-to-one correspondence between the audio track and the language of the target audio and video resource, for example, one audio can correspond to one language, and the audio track can be used to store audio data of the corresponding language. Exemplarily, assuming that the target audio and video resource includes multiple languages, such as Chinese, English and French, the audio and video resource may include three audio tracks, such as audio track 1, audio track 2 and audio track 3, and there is a correspondence between the above audio tracks and the languages, for example, audio track 1 corresponds to Chinese, audio track 2 corresponds to English, and audio track 3 corresponds to French.

[0132] In the disclosed embodiment, the display device may also send a pause broadcast instruction to the Bluetooth module in response to a first key instruction from the Bluetooth remote control device while controlling the Bluetooth module to issue a Bluetooth broadcast based on at least two audio tracks of the target audio and video resources.

[0133] In actual applications, when the LEaudio multi-track function is turned on and the display device plays the target audio and video resources, the Bluetooth protocol stack in the Bluetooth module will continue to send at least two BIS audio data to the Bluetooth chip. In addition, in order to transmit audio data to the audio receiving device, the display device can also establish a BSA connection with the audio receiving device, where the BSA connection refers to a Bluetooth connection established based on the broadcast assistant.

[0134] Exemplarily, it is assumed that the display device has established Bluetooth connections with Bluetooth headset A and Bluetooth headset B supporting the LEaudio protocol, respectively, and the target audio and video resources include at least two tracks, such as a Chinese track and an English track. Bluetooth headset A is used to receive audio data of the Chinese track, and Bluetooth headset B is used to receive audio data of the English track. In the Bluetooth broadcast process of multiple tracks, two BIS audio data can be sent to the left ear device and the right ear device of Bluetooth headset A based on the Chinese track, and two BIS audio data can be sent to the left ear device and the right ear device of Bluetooth headset B based on the English track. At this time, the Bluetooth module maintains 4 BIS connections, 4 BSA connections and 1 BLE connection. Obviously, in this scenario, more bandwidth resources of the Bluetooth chip need to be occupied. At this time, when transmitting voice data to the display device through the Bluetooth remote control, packet loss of voice data may occur, resulting in inaccurate voice recognition.

[0135] Therefore, in the process of controlling the Bluetooth module to issue a Bluetooth broadcast based on at least two audio tracks of the target audio and video resources, the embodiment of the present disclosure can also reduce the bandwidth occupancy of the Bluetooth chip by controlling the Bluetooth module to pause sending BIS audio data when receiving a first key command from the Bluetooth remote control device, thereby reducing the probability of packet loss when transmitting voice data input by the user to the display device via the Bluetooth remote control device, and improving the recognition accuracy of the voice data input by the user.

[0136] like Figure 7 As shown, the audio data processing method provided by the embodiment of the present disclosure can also be applied to multi-channel Bluetooth broadcast scenarios. For example, when a TV broadcasts a BIS stream based on at least two channels, a user can input voice data to the TV through a Bluetooth remote control.

[0137] In the embodiment of the present disclosure, the display device can also send a pause broadcast instruction to the Bluetooth module in response to a first key instruction from the Bluetooth remote control device while controlling the Bluetooth module to issue a Bluetooth broadcast based on multiple channels configured by the target video resource. The multiple channels correspond to at least one BIS audio data respectively.

[0138] Exemplarily, after the user processes the left channel, right channel and subwoofer for the left audio data of the target audio and video resources, in the process of sending at least one BIS audio data based on the left channel, right channel and subwoofer respectively, when receiving a voice button pressing command from the Bluetooth remote control device, the Bluetooth module can be controlled to pause sending BIS audio data, thereby reducing the occupancy of Bluetooth chip resources, thereby reducing the probability of packet loss when transmitting the voice data input by the user to the display device through the Bluetooth remote control device, and improving the recognition accuracy of the voice data input by the user.

[0139] Fig.12 The flowchart of the audio data processing method provided by the embodiment of the present application is exemplarily shown in FIG. Figure 6 The display device 100 or Figure 7 The display device 100 in the illustrated embodiment is as follows: Fig.12 FIG. 1 is a flow chart of an audio data processing method of a display device provided by an embodiment of the present disclosure, the method comprising the following steps:

[0140] S1202: When the Bluetooth module is in the Bluetooth broadcast state, in response to a first key command from the Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending the broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data.

[0141] In some embodiments, after receiving the first button command from the Bluetooth remote control device, the display device can also judge the broadcast status of the Bluetooth module; specifically, if it is determined that the Bluetooth module is in the Bluetooth broadcast state, the Bluetooth module is controlled to obtain the number of broadcast isochronous streams BIS contained in the currently issued Bluetooth broadcast; if it is determined that the number of BIS contained in the Bluetooth broadcast is greater than a preset number threshold, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending BIS audio data.

[0142] In practical applications, the preset number threshold may be determined based on the performance of the hardware chip of the display device. Specifically, the preset number threshold may be positively correlated with the performance of the hardware chip. Currently, the number of shared audio tracks that the hardware chip can support is 2 (i.e., the preset number threshold is usually set to 2). In practical applications, as the performance of the hardware chip improves, the corresponding preset number threshold may also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the size of the preset number threshold.

[0143] For example, assuming that the number of BIS audio data contained in the currently issued Bluetooth broadcast is 4, which is greater than the preset number threshold of 2, it is obvious that in this case, the bandwidth load of the Bluetooth chip is heavy. At this time, when the voice data is transmitted to the display device through the Bluetooth remote control, voice data packet loss may occur, resulting in inaccurate voice recognition. Therefore, the embodiment of the present disclosure can reduce the occupation of Bluetooth chip resources by controlling the Bluetooth module to suspend sending BIS audio data when determining that the number of BIS contained in the Bluetooth broadcast is greater than the preset number threshold, thereby reducing the probability of packet loss of the voice data input by the user when transmitting the voice data input by the user to the display device through the Bluetooth remote control device, and improving the recognition accuracy of the voice data input by the user.

[0144] S1204: After receiving the broadcast pause success signal returned by the Bluetooth module, a voice start instruction is sent to the Bluetooth remote control device through the Bluetooth module; wherein the voice start instruction is used to instruct the Bluetooth remote control device to turn on the voice receiving module to receive voice data input by the user.

[0145] In the embodiment of the present disclosure, steps S1202-S1204 may be specifically referred to in Fig.11 Steps S1102-S1104 in the method shown are understood for convenience only and will not be described in detail here.

[0146] S1206: Control the Bluetooth module to receive voice data from the Bluetooth remote control device, and forward the voice data to the audio module of the display device, so that the audio module performs voice recognition on the voice data by calling the voice recognition module.

[0147] In the disclosed embodiment of the present invention, after receiving the broadcast pause success signal returned by the Bluetooth module and sending a voice start command to the Bluetooth remote control device through the Bluetooth module, the display device can also control the Bluetooth module to receive voice data from the Bluetooth remote control device and forward the voice data to the audio module of the display device, so that the audio module can perform voice recognition on the voice data by calling the voice recognition module.

[0148] Exemplarily, after receiving the voice start command, the Bluetooth remote control device first turns on the microphone and receives the voice data input by the user through the microphone, and then sends the received voice data to the Bluetooth module of the display device; after receiving the voice data from the Bluetooth remote control device, the Bluetooth module forwards the voice data to the audio module, and the audio module performs voice recognition on the above voice signal by calling the voice recognition module.

[0149] In the disclosed embodiment, the Bluetooth module is used to communicate with the Bluetooth chip end through the Bluetooth protocol stack, and receive audio data from a Bluetooth remote control device or other Bluetooth audio devices. These audio data will be converted to the audio module of the display device, and the audio module will decode, amplify and process the audio data, and drive the speaker to play the audio data after the processing is completed.

[0150] In actual applications, when the audio module on the display device needs to perform voice recognition on voice data, the voice recognition module is first called to process the voice data. Specifically, the voice recognition module can convert voice data into executable commands, such as searching for programs, switching channels, or increasing the volume, etc. The process of converting voice data into executable commands usually involves converting analog voice information into digital voice signals, so the voice data can also be converted to the cloud for voice processing.

[0151] S1208: In response to a second key command from the Bluetooth remote control device, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

[0152] In the disclosed embodiment, when the display device receives a command to lift the voice button, it indicates that the user has completed the input of voice data. At this time, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data. At this time, the LEaudio device connected to the display device can listen to the BIS audio data normally.

[0153] In some embodiments, when the display device receives the second key command from the Bluetooth remote control device, it can also send a voice end command to the Bluetooth remote control device through the Bluetooth module, wherein the voice end command is used to instruct the Bluetooth remote control device to turn off the voice receiving module to stop receiving the voice data input by the user.

[0154] In the disclosed embodiment, when the Bluetooth module of the display device receives the voice button lift operation information sent by the Bluetooth remote control device, it determines the key instruction corresponding to the voice button lift operation information as the second key instruction, that is, the voice button lift instruction. When the display device receives the voice button lift instruction, it forwards the voice end instruction to the Bluetooth remote control device through the Bluetooth module, instructing the Bluetooth remote control device to turn off the voice receiving module to stop receiving the voice data input by the user, that is, turn off the microphone on the Bluetooth remote control.

[0155] In some embodiments, the display device can also send a resume broadcast instruction to the Bluetooth module when receiving a second button instruction from the Bluetooth remote control device, and after receiving the resume broadcast success signal returned by the Bluetooth module, send a voice end notification signal to the audio module in the display device to control the audio module to send a voice end instruction to the Bluetooth remote control device through the Bluetooth module.

[0156] In the disclosed embodiment, when the display device receives a command to lift the voice button, it first sends a resume broadcast command to the Bluetooth module; when the Bluetooth module receives the resume broadcast command, it controls the Bluetooth protocol stack to continue broadcasting BIS audio data; after receiving the resume broadcast success signal returned by the Bluetooth module, the display device sends a voice end notification signal to the audio module. When the audio module receives the voice end notification signal, it first sends a voice end command to the Bluetooth module. When the Bluetooth module receives the voice end command, it sends the voice end command to the Bluetooth remote control device through the BLE transmission channel. After receiving the voice end command sent by the Bluetooth module, the Bluetooth remote control device turns off the microphone to stop receiving the voice data input by the user, and the voice recognition process ends.

[0157] It can be seen that the embodiment of the present disclosure can also control the Bluetooth module to continue sending BIS audio data by sending a resume broadcast instruction to the Bluetooth module when receiving a second button command from the Bluetooth remote control device. At this time, the LEaudio device connected to the display device can listen to the BIS audio data normally.

[0158] like Fig.13 As shown, a speech recognition flow chart provided in an embodiment of the present disclosure is provided.

[0159] When the Bluetooth remote control device receives the user's pressing operation on the voice button, it sends the voice button pressing information to the Bluetooth module of the display device through the BLE transmission channel; after receiving the voice button pressing information (i.e., the first button information), the Bluetooth module sends the voice button pressing instruction to the controller in the display device (e.g., the media center application integrated in the controller of the display device).

[0160] When the display device receives a voice button press instruction (i.e., the first button instruction), it sends a pause broadcast instruction to the Bluetooth module, and after receiving the pause broadcast success signal returned by the Bluetooth module, it sends a voice start notification signal to the audio module in the display device; after receiving the voice start notification signal, the audio module sends a voice start instruction to the Bluetooth module.

[0161] After receiving the voice start command, the Bluetooth module forwards the voice start command to the Bluetooth remote control device through the BLE transmission channel. After receiving the voice start command, the Bluetooth remote control device turns on the voice receiving module.

[0162] After the Bluetooth remote control device turns on the voice receiving module, it receives the voice data input by the user and transmits the voice data input by the user to the Bluetooth module through the BLE transmission channel, so that the Bluetooth module forwards the voice data to the audio module of the display device. After receiving the voice data, the audio module performs voice recognition on the voice data by calling the voice recognition module.

[0163] When the display device receives the voice button lift command (ie, the second button command), it sends a resume broadcast command to the Bluetooth module to control the Bluetooth module to continue sending the broadcast isochronous stream BIS audio data.

[0164] In some embodiments, the display device can also send a voice end signal to the audio module in the display device when receiving a voice button lift instruction (i.e., a second button instruction); after receiving the voice end notification signal, the audio module sends a voice end instruction to the Bluetooth module.

[0165] In other embodiments, the display device may also send a resume broadcast instruction to the Bluetooth module when receiving a voice button lift instruction (i.e., a second button instruction), and after receiving a resume broadcast success signal returned by the Bluetooth module, send a voice end notification signal to the audio module in the display device.

[0166] The embodiments of the present disclosure do not limit the execution order of the above steps. For example, when the second key command is received, the step of "sending a resume broadcast command to the Bluetooth module" can be executed first, and then the step of "after receiving the resume broadcast success signal returned by the Bluetooth module, sending a voice end notification signal to the audio module in the display device" can be executed; or when the second key command is received, the step of "sending a resume broadcast command to the Bluetooth module" and the step of "sending a voice end notification signal to the audio module in the display device" can be executed at the same time.

[0167] After receiving the voice end instruction, the Bluetooth module forwards the voice end instruction to the Bluetooth remote control device through the BLE transmission channel. After receiving the voice end instruction, the Bluetooth remote control device turns off the voice receiving module to stop receiving the voice data input by the user.

[0168] Fig.14 Schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure, the electronic device may be the above-mentioned display device, control terminal or audio receiving device. Fig.14 As shown, the electronic device includes: a processor 1401, a memory 1402, and a computer program stored in the memory 1402 and executable on the processor 1401. When the computer program is executed by the processor 1401, each process of the following methods involved in the above method embodiment is implemented: a configuration method of a multi-channel audio receiving device executed by a display device; a configuration method of a multi-channel audio receiving device executed by an audio receiving device.

[0169] The embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the configuration method of the multi-channel audio receiving device described above is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. Among them, the computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0170] The present disclosure provides a computer program product, which includes a computer program. When the computer program is executed on a computer, the computer implements the configuration method of the multi-channel audio receiving device.

[0171] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: monitor; Bluetooth module; A controller connected to the Bluetooth module, wherein the controller is configured as follows: When the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data; After receiving the broadcast pause success signal returned by the Bluetooth module, sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user; In response to a second key command from the Bluetooth remote control device, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

2. The display device according to claim 1, characterized in that The controller is further configured to: A voice ending instruction is sent to the Bluetooth remote control device through the Bluetooth module; wherein the voice ending instruction is used to instruct the Bluetooth remote control device to turn off the voice receiving module to stop receiving the voice data input by the user.

3. The display device according to claim 2, characterized in that The controller is specifically configured as follows: The sending of a voice ending instruction to the Bluetooth remote control device through the Bluetooth module includes: After receiving the broadcast resumption success signal returned by the Bluetooth module, a voice end notification signal is sent to the audio module in the display device to control the audio module to send a voice end instruction to the Bluetooth remote control device through the Bluetooth module.

4. The display device according to claim 1, characterized in that The controller is specifically configured as follows: After receiving the broadcast pause success signal returned by the Bluetooth module, sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user, including: After receiving the broadcast pause success signal returned by the Bluetooth module, a voice start notification signal is sent to the audio module in the display device to control the audio module to send a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to turn on the voice receiving module to receive the voice data input by the user.

5. The display device according to claim 1, characterized in that The controller is specifically configured as follows: When the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, sending a pause broadcast command to the Bluetooth module to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data, including: When the Bluetooth module is in the Bluetooth broadcast state, in response to a first button command from the Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth protocol stack in the Bluetooth module to pause sending broadcast isochronous stream BIS audio data to the Bluetooth chip end.

6. The display device according to claim 1, characterized in that Before the controller executes the step of sending a pause broadcast instruction to the Bluetooth module in response to a first key instruction from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state, the controller is further configured to: The Bluetooth module is controlled to send a Bluetooth broadcast based on at least two audio tracks of the target audio and video resources; wherein the at least two audio tracks correspond to at least two BIS audio data respectively.

7. The display device according to claim 1, characterized in that Before the controller executes the step of sending a pause broadcast instruction to the Bluetooth module in response to a first key instruction from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state, the controller is further configured to: The Bluetooth module is controlled to send out a Bluetooth broadcast based on multiple channels configured based on the target audio and video resources; wherein the multiple channels respectively correspond to at least one BIS audio data.

8. The display device according to claim 1, characterized in that After the controller executes the step of sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive voice data input by the user after receiving the broadcast pause success signal returned by the Bluetooth module, the controller is further configured to: The Bluetooth module is controlled to receive voice data from the Bluetooth remote control device, and the voice data is forwarded to the audio module of the display device, so that the audio module performs voice recognition on the voice data by calling the voice recognition module.

9. The display device according to claim 1, characterized in that: Before the controller executes the step of sending a pause broadcast instruction to the Bluetooth module in response to a first key instruction from a Bluetooth remote control device when the Bluetooth module is in a Bluetooth broadcast state to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data, the controller is further configured as follows: Control the Bluetooth module to receive the first button information sent by the Bluetooth remote control device through the low-power Bluetooth BLE transmission channel, and determine the button instruction corresponding to the first button information as the first button instruction; wherein the first button information includes button value information and button control information, and the button control information includes button pressing information.

10. The display device according to claim 1, characterized in that Before the controller executes the step of sending a resume broadcast instruction to the Bluetooth module in response to the second key instruction from the Bluetooth remote control device to control the Bluetooth module to continue sending the BIS audio data, the controller is further configured to: Control the Bluetooth module to receive the second button information sent by the Bluetooth remote control device through the low-power Bluetooth BLE transmission channel, and determine the button instruction corresponding to the second button information as the second button instruction; wherein the second button information includes button value information and button control information, and the button control information includes button lift information.

11. The display device according to claim 1, characterized in that The controller is specifically configured as follows: When the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, sending a pause broadcast command to the Bluetooth module to control the Bluetooth module to pause sending BIS audio data, comprising: In response to a first key command from a Bluetooth remote control device, if the Bluetooth module is in a Bluetooth broadcast state, controlling the Bluetooth module to obtain the number of broadcast isochronous streams (BIS) contained in a currently issued Bluetooth broadcast; If the number of BIS included in the Bluetooth broadcast is greater than a preset number threshold, a broadcast pause instruction is sent to the Bluetooth module to control the Bluetooth module to pause sending BIS audio data.

12. An audio data processing method, characterized in that: include: When the Bluetooth module is in a Bluetooth broadcast state, in response to a first key command from a Bluetooth remote control device, a pause broadcast command is sent to the Bluetooth module to control the Bluetooth module to pause sending broadcast isochronous stream BIS audio data; wherein the first key command is used to request the voice receiving module of the Bluetooth remote control device to start inputting voice data; After receiving the broadcast pause success signal returned by the Bluetooth module, sending a voice start instruction to the Bluetooth remote control device through the Bluetooth module to instruct the Bluetooth remote control device to start the voice receiving module to receive the voice data input by the user; In response to a second key command from the Bluetooth remote control device, a resume broadcast command is sent to the Bluetooth module to control the Bluetooth module to continue sending BIS audio data; wherein the second key command is used to request the voice receiving module of the Bluetooth remote control device to end inputting voice data.

Images