Display device and audio broadcast method
By introducing a Bluetooth module that supports low-power audio protocols into the display devices of smart TVs, synchronous playback in multilinguals is realized, solving the problem that smart TVs cannot broadcast multilingual audio simultaneously, and improving user experience and broadcast efficiency.
Patent Information
- Application Number
- CN202411405498.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-03-27
- Filing Date
- 2024-10-09
- Publication Date
- 2025-03-07
AI Technical Summary
Smart TV cannot achieve simultaneous broadcast of multilingual audio when broadcasting in multilingual audio, resulting in the inability to provide synchronous multilingual audio to different users, affecting the user experience.
By introducing Bluetooth modules into the display device, it supports low-power audio protocols to realize multilingual synchronous playback for the same audio and video resource. The specific method is to control the display to present a multi-track sharing control when the number of audio tracks meets the preset conditions, and stop outputting the original audio data in response to user selection operations, and send multiple Bluetooth broadcast data to multiple Bluetooth devices through the Bluetooth module, each data corresponds to the audio data of different audio tracks.
It realizes multi-language synchronous playback for the same audio and video resource, improves broadcast efficiency, meets the multi-language audio needs of different users, and improves user experience.
Smart Images

Figure CN119583872A_ABST
Abstract
Description
[0001] This application claims the priority of the Chinese patent application filed with the China Patent Office on March 27, 2024, with application number 202410361462.X, the contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the technical field of display devices, and in particular to a display device and an audio broadcasting method. Background Art
[0003] With the continuous development of smart TV technology, its functions and application scenarios have also been significantly expanded, such as the realization of multi-language audio broadcasting. For example, taking the airport scenario as an example, in order to meet the needs of passengers from different countries and regions, smart TVs need to be able to broadcast multi-language audio.
[0004] However, in the related art, there are certain limitations in the multi-language audio broadcasting of smart TVs. Usually, after broadcasting audio in one language, the smart TV switches to broadcasting audio in another language. This means that the smart TV cannot broadcast audio in multiple languages at the same time, and thus cannot provide synchronized multi-language audio to different users, affecting the user experience. Summary of the invention
[0005] The present application provides a display device and an audio broadcasting method, which utilize audio broadcasting to realize the function of multi-language synchronous playback for the same audio and video resources.
[0006] In a first aspect, some embodiments of the present application provide a display device, comprising: a display, a sound output device, a Bluetooth module, and a controller connected to the display, the sound output device and the Bluetooth module respectively; wherein the Bluetooth module supports a low-power audio protocol; and the controller is configured to:
[0007] Present the video data of the target resource on the display, and control the sound output device to output the first audio data of the target resource; in response to the first operation, obtain the audio track information of the target resource; determine the number of audio tracks of the target resource according to the audio track information; when the number of audio tracks meets the first preset condition, control the display to present a multi-audio track sharing control; in response to the selection operation of the multi-audio track sharing control, control the sound output device to stop outputting the first audio data; control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource.
[0008] In a second aspect, some embodiments of the present application provide a display device, comprising: a display, a sound output device, a Bluetooth module, and a controller connected to the display, the sound output device and the Bluetooth module respectively; wherein the Bluetooth module supports a low-power audio protocol; and the controller is configured to:
[0009] Present the video data of the target resource on the display, and control the sound output device to output the first audio data of the target resource; in response to the first operation, obtain the audio track information of the target resource; determine the number of audio tracks of the target resource according to the audio track information; when the number of audio tracks meets the first preset condition, control the display to present a multi-audio track sharing control; in response to the selection operation of the multi-audio track sharing control, control the sound output device to stop outputting the first audio data; control the Bluetooth module to send multiple Bluetooth broadcast data, the multiple Bluetooth broadcast data correspond one-to-one to the multiple audio track data of the target resource, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data.
[0010] In a third aspect, some embodiments of the present application also provide an audio broadcasting method, which is applied to the display device provided in the first aspect, and the display device includes: a display, a sound output device, a Bluetooth module and a controller, and the method includes: presenting video data of a target resource on the display, and controlling the sound output device to output first audio data of the target resource; in response to a first operation, obtaining audio track information of the target resource; determining the number of audio tracks of the target resource based on the audio track information; when the number of audio tracks meets a first preset condition, controlling the display to present a multi-audio track sharing control; in response to a selection operation on the multi-audio track sharing control, controlling the sound output device to stop outputting the first audio data; controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data corresponding one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data being used to broadcast audio data corresponding to one audio track data of the target resource.
[0011] In a fourth aspect, some embodiments of the present application also provide an audio broadcasting method, which is applied to the display device provided in the second aspect, and the display device includes: a display, a sound output device, a Bluetooth module and a controller, and the method includes: presenting video data of a target resource on the display, and controlling the sound output device to output first audio data of the target resource; in response to a first operation, obtaining audio track information of the target resource; determining the number of audio tracks of the target resource based on the audio track information; when the number of audio tracks meets a first preset condition, controlling the display to present a multi-audio track sharing control; in response to a selection operation on the multi-audio track sharing control, controlling the sound output device to stop outputting the first audio data; controlling the Bluetooth module to send multiple Bluetooth broadcast data, the multiple Bluetooth broadcast data correspond one-to-one to multiple audio track data of the target resource, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data.
[0012] In the fifth aspect, some embodiments of the present application provide a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor executes the audio broadcasting method described in the third aspect, or the processor executes the audio broadcasting method described in the fourth aspect.
[0013] In the sixth aspect, some embodiments of the present application provide a computer program product, which includes: a computer program code, which, when executed on a display device, enables the display device to execute the audio broadcasting method described in the third aspect, or enables the display device to execute the audio broadcasting method described in the fourth aspect.
[0014] In a seventh aspect, some embodiments of the present application provide a display device, comprising: a display, a Bluetooth module, a sound output device, and a controller connected to the Bluetooth module; wherein the controller is configured to: obtain an audio track of a target audio and video resource; wherein there is a one-to-one correspondence between an audio track and a language, and the audio track is used to store audio data of the language corresponding to itself; if it is determined that the number of audio tracks of the target audio and video resource is not less than a preset number threshold, then upon receiving an audio track configuration operation for at least two target audio tracks among the audio tracks of the target audio and video resource, control the display to display a device management page, and display the connected LE audio device on the device management page; receive a first target audio track configured for a first LE audio device among the connected LE audio devices; wherein the first target audio track belongs to at least two target audio tracks; in response to an audio broadcast trigger operation for at least two target audio tracks, issue multiple Bluetooth broadcasts based on the at least two target audio tracks, and send the broadcast information corresponding to the first target audio track to the first LE audio device; wherein each target audio track corresponds to at least one Bluetooth broadcast, the Bluetooth broadcast is used to broadcast the audio data of the corresponding target audio track, and the broadcast information is used to receive the audio data of the first target audio track.
[0015] In some embodiments, the controller is further configured to: after controlling the display to display the device management page, it also includes: controlling the Bluetooth module to perform device scanning, and controlling the display to display the scanned LE audio device on the device management page; in response to a connection request for the scanned LE audio device, establish a connection with the scanned LE audio device.
[0016] In some embodiments, the controller is further configured to: before sending out multiple Bluetooth broadcasts based on at least two target audio tracks, further include: controlling the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel.
[0017] In some embodiments, the controller is also configured to: before sending multiple Bluetooth broadcasts based on at least two target audio tracks, it also includes: in response to the audio broadcast trigger operation for at least two target audio tracks, control the player to pause playing the target audio and video resources, and obtain the playback progress information of the target audio and video resources; when it is determined that the Bluetooth broadcast channel switching is successful, restart the audio decoder, and according to the playback progress information and at least two target audio tracks, control the audio decoder to decode the target audio and video resources, and send the decoded audio data to the Bluetooth protocol stack; wherein the Bluetooth protocol stack is used to send multiple Bluetooth broadcasts based on the decoded audio data.
[0018] In some embodiments, the controller is also configured to: before sending multiple Bluetooth broadcasts based on at least two target audio tracks, it also includes: in response to the audio broadcast trigger operation for at least two target audio tracks, control the player to pause playing the target audio and video resources, and obtain the playback progress information of the target audio and video resources; when it is determined that the Bluetooth broadcast channel switching is successful, restart the audio decoder and the video decoder, and according to the playback progress information and at least two target audio tracks, control the audio decoder and the video decoder to decode the target audio and video resources, and send the decoded audio data to the Bluetooth protocol stack; wherein, the Bluetooth protocol stack is used to send multiple Bluetooth broadcasts based on the decoded audio data.
[0019] In some embodiments, the controller is further configured to: send multiple Bluetooth broadcasts based on at least two target audio tracks, including: controlling the Bluetooth protocol stack to encapsulate the decoded audio data corresponding to the at least two target audio tracks into corresponding BIS streams according to the preset correspondence between the audio tracks and the BIS streams, and send a Bluetooth broadcast based on the BIS stream.
[0020] In some embodiments, the controller is also configured to: before sending the decoded audio data to the Bluetooth protocol stack, it also includes: controlling the audio decoder to add target header information to the decoded audio data to obtain processed audio data carrying the target header information; wherein the target header information encapsulates the track information of the target audio track corresponding to the decoded audio data, and the target header information is used to determine the BIS stream corresponding to the target audio track; accordingly, sending the decoded audio data to the Bluetooth protocol stack includes: sending the processed audio data to the Bluetooth protocol stack.
[0021] In some embodiments, the controller is further configured to: before issuing multiple Bluetooth broadcasts based on at least two target audio tracks, it also includes: setting corresponding BIS streams for at least two target audio tracks respectively; accordingly, issuing multiple Bluetooth broadcasts based on at least two target audio tracks includes: controlling the Bluetooth protocol stack to determine the corresponding BIS stream according to the audio track information encapsulated in the target header information of the received processed audio data, encapsulating the processed audio data into the BIS stream, and issuing a Bluetooth broadcast based on the BIS stream.
[0022] In some embodiments, the controller is further configured to: upon receiving a track configuration operation for at least two target audio tracks among the audio tracks of the target audio and video resources, control the display to display the device management page, and before displaying the connected LE audio device on the device management page, it also includes: if it is determined that the number of audio tracks of the target audio and video resources is not less than a preset number threshold, control the display to display a multi-track sharing control; in response to a trigger operation for the multi-track sharing control, determine whether the number of audio tracks of the target audio and video resources is greater than the preset number threshold; if it is determined that the number of audio tracks is greater than the preset number threshold, display the identifier of the audio track of the target audio and video resource; receive and display the identifiers of at least two target audio tracks selected from the audio tracks of the target audio and video resources.
[0023] In an eighth aspect, some embodiments of the present application further provide an audio broadcasting method, which is applied to the display device provided in the seventh aspect, and the display device includes: a display, a sound output device, a Bluetooth module and a controller, and the method includes: obtaining an audio track of a target audio and video resource; wherein there is a one-to-one correspondence between an audio track and a language, and the audio track is used to store audio data of the language corresponding to itself; if it is determined that the number of audio tracks of the target audio and video resource is not less than a preset number threshold, then when an audio track configuration operation for at least two target audio tracks in the audio tracks of the target audio and video resource is received, the display is controlled to display a device management page, and the connected LE audio device is displayed on the device management page; a first target audio track configured for a first LE audio device in the connected LE audio devices is received; wherein the first target audio track belongs to at least two target audio tracks; in response to an audio broadcast trigger operation for at least two target audio tracks, multiple Bluetooth broadcasts are issued based on the at least two target audio tracks, and the broadcast information corresponding to the first target audio track is sent to the first LE audio device; wherein each target audio track corresponds to at least one Bluetooth broadcast, and the Bluetooth broadcast is used to broadcast the audio data of the corresponding target audio track, and the broadcast information is used to receive the audio data of the first target audio track.
[0024] It can be seen from the above technical scheme that the display device and audio broadcasting method provided by the embodiment of the present application, when presenting the video data of the target resource on the display and controlling the sound output device to output the first audio data of the target resource, in response to the first operation, obtain the audio track information of the target resource, and determine the number of audio tracks of the target resource according to the audio track information; when the number of audio tracks meets the first preset condition, control the display to present a multi-audio track sharing control; in response to the selection operation for the multi-audio track sharing control, control the sound output device to stop outputting the first audio data, and control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, multiple Bluetooth broadcast data correspond to multiple Bluetooth devices one by one, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource. In this way, the embodiment of the present application can send Bluetooth broadcast data corresponding to different audio track data for different Bluetooth devices, so as to realize the function of synchronous playback of multiple audio track data for the same audio and video resource by using audio broadcasting, which can improve the broadcasting efficiency. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0026] Figure 1 A schematic diagram of one-to-one audio transmission of unicast media audio in the related art;
[0027] Figure 2 A schematic diagram of one-to-two audio transmission of unicast media audio provided in the related art;
[0028] Figure 3 A schematic diagram showing the relationship between extended broadcast, periodic broadcast and BIS;
[0029] Figure 4 A schematic diagram showing the relationship between extended broadcast packets, subsidiary broadcast packets, periodic broadcast packets and BIS;
[0030] Figure 5 It is a schematic diagram of continuously sending BIG in the related art;
[0031] Figure 6 A schematic diagram of an audio broadcasting scenario provided in the related art;
[0032] Figure 7A schematic diagram of an audio broadcasting scenario provided in an embodiment of the present application;
[0033] Figure 8 A schematic diagram of an implementation environment of an audio broadcasting method provided in an embodiment of the present application;
[0034] Fig. 9 A schematic diagram of the hardware configuration of a display device provided in an embodiment of the present application;
[0035] Fig.10 A schematic diagram of a software system architecture of a display device provided in an embodiment of the present application;
[0036] Fig.11 A hardware configuration block diagram of a Bluetooth device provided in an embodiment of the present application;
[0037] Fig.12 One of the flowcharts of the audio broadcasting method provided in the embodiment of the present application;
[0038] Fig.13 A schematic diagram of interface changes in a target resource selection process provided in an embodiment of the present application;
[0039] Fig.14 A schematic diagram of an interface change from a playback page to a multilingual sharing page provided in an embodiment of the present application;
[0040] Fig.15 A schematic diagram of a change in the interface for selecting a track provided in an embodiment of the present application;
[0041] Fig.16 A second flowchart of the audio broadcasting method provided in an embodiment of the present application;
[0042] Fig.17 A schematic diagram of interface changes for configuring a Bluetooth device provided in an embodiment of the present application;
[0043] Fig.18 A schematic diagram of a mapping relationship between a target audio track and a BIS stream provided in an embodiment of the present application;
[0044] Fig.19 The third flowchart of the audio broadcasting method provided in the embodiment of the present application;
[0045] Fig. 20 A fourth flowchart of the audio broadcasting method provided in an embodiment of the present application;
[0046] Fig.21 One of the interactive flow charts of the audio broadcasting method provided in the embodiment of the present application;
[0047] Fig. 22The second interactive flow chart of the audio broadcasting method provided in the embodiment of the present application;
[0048] Fig.23 A fifth flowchart of the audio broadcasting method provided in an embodiment of the present application;
[0049] Fig.24 Flow chart six of the audio broadcasting method provided in the embodiment of the present application;
[0050] Fig.25 The third interactive flow chart of the audio broadcasting method provided in the embodiment of the present application;
[0051] Fig.26 Flow chart of the audio broadcasting method provided in the embodiment of the present application is shown in FIG7;
[0052] Fig. 27 A schematic diagram of interface changes for presenting a multi-track sharing control provided in an embodiment of the present application;
[0053] Fig.28 A schematic diagram of interface changes for entering multi-track sharing provided in an embodiment of the present application;
[0054] Fig.29 A schematic diagram of an interface change for audio broadcast switching provided in an embodiment of the present application;
[0055] Fig.30 A schematic diagram of another interface change for audio broadcast switching provided in an embodiment of the present application;
[0056] Fig.31 A schematic diagram of a change in a device connection state provided in an embodiment of the present application;
[0057] Fig.32 A schematic diagram of an interface change for canceling multi-track sharing provided in an embodiment of the present application. DETAILED DESCRIPTION
[0058] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.
[0059] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0060] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0061] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0062] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.
[0063] In order to better understand the embodiments of the present application, the terms or concepts that may be involved in the embodiments of the present application are explained below.
[0064] The bluetooth low energy audio (LE audio) protocol is a communication protocol based on Bluetooth technology that uses low-power audio transmission to achieve broadcast signal reception.
[0065] Compared with classic Bluetooth technology, the LE audio protocol has the following advantages:
[0066] 1. An audio playback device (such as a display device) can be connected to multiple audio receiving devices (such as Bluetooth headsets) at the same time;
[0067] 2. A broadcast audio device (also called an audio sending device, such as a display device) can send broadcast audio to an unlimited number of audio receiving devices, supporting encrypted broadcasting;
[0068] 3. Adopt the latest Low Complexity Communication Codec (LC3) audio format, and the sound quality is improved;
[0069] 4. Support Internet phone and HD calls;
[0070] 5. Support hearing aid / assisted listening applications.
[0071] The LE Audio application layer specification telephony and media audio profile (TMAP) defines two media audio applications: unicast media audio and broadcast media audio.
[0072] Unicast Media Audio
[0073] Compared with the current media audio application specification (Advanced Audio Distribution Profile, A2DP) in classic Bluetooth, the unicast media audio in TMAP uses a more advanced audio codec to provide better sound quality, and at the same time provides richer control functions than the current classic Bluetooth media playback control specification (Audio / Video Remote Control Profile, AVRCP). TMAP defines two roles for unicast media audio applications: unicast media sender (UMS) and unicast media receiver (UMR). Unicast media audio transmission is achieved between UMS and UMR through connection isochronous stream (CIS).
[0074] It should be noted that the unicast media audio defined in TMAP is not limited to one-to-one audio transmission, but also supports a unicast media sender transmitting unicast media audio to two unicast media receivers.
[0075] Figure 1 FIG. 1 is a schematic diagram of a one-to-one audio transmission of unicast media audio in the related art. Figure 1 As shown, UMS11 sends unicast media audio to UMR12.
[0076] Figure 2 FIG. 1 is a schematic diagram of a one-to-two audio transmission of unicast media audio provided in the related art. Figure 2 As shown, UMS21 sends unicast media audio to UMR22 and UMR23 respectively.
[0077] Broadcast Media Audio
[0078] Broadcast media audio in TMAP is based on synchronous transmission of multiple connectionless broadcast isochronous streams (BIS). The biggest advantage of broadcast media audio is that audio data can be synchronously transmitted to multiple audio receiving devices.
[0079] The broadcast synchronization channel of broadcast media audio in TMAP has two concepts: broadcast isochronous group (BIG) and BIS. An audio sending device can send multiple BIGs at the same time, each BIG can be composed of multiple BISs, and a BIG can contain up to 31 BISs. Each BIS has a unique access address, which is generated according to a unified algorithm based on the seed access address of the BIG to which it belongs.
[0080] Broadcast media audio may include multiple broadcasts with different access addresses, for example, including:
[0081] Extended advertising: Extended advertising on the main advertising channel, using ADV_EXT_IND packets, and pointing to the subsidiary advertising through time and frequency information. Its access address uses the main advertising access address specified in the Bluetooth core specification: 0x8E89BED6.
[0082] Periodic advertising: The subsidiary advertising uses the AUX_ADV_IND packet and points to the periodic advertising through time, frequency hopping map and access address. The periodic advertising uses the AUX_SYNC_IND packet and contains BIG information (BIGinfo).
[0083] Broadcast Isochronous Stream (BIS): A broadcast isochronous stream that periodically broadcasts digital audio using a time, frequency hopping map, access address, and BIG information (biginfo) pointing to the BIS, using BIS protocol data unit (PDU) packets.
[0084] It should be noted that Bluetooth operates in the 2.4GHz band, which has a frequency range of 2402MHz to 2480MHz, with a channel every 2MHz, for a total of 40 channels. Among them, the 40 channels include 3 primary broadcast channels, namely channel 37, channel 38 and channel 39, and the remaining 37 channels are secondary broadcast channels, which are channel 0 to channel 36.
[0085] Figure 3 Figure 1 is a diagram showing the relationship between extended broadcast, periodic broadcast and BIS. Figure 3 As shown, the main broadcast channel includes channel 37, channel 38 and channel 39. The secondary broadcast channel includes: channel 0 to channel 36. The extended broadcast on the main broadcast channel can use ADV_EXT_IND packets, and point to the subsidiary broadcast of the secondary broadcast channel through time and frequency information. After that, the subsidiary broadcast uses AUX_ADV_IND packets, and points to the periodic broadcast through time, frequency hopping map and access address. Further, the periodic broadcast uses AUX_SYNC_IND packets, and points to BIS through time, frequency hopping map, access address and BIG information (BIGinfo). BIS uses BIS PDU packets to broadcast digital audio.
[0086] Figure 4 Figure 1 is a schematic diagram showing the relationship between extended broadcast packets, auxiliary broadcast packets, periodic broadcast packets, and BIS. Figure 4 As shown, the audio sending device sends an extended broadcast packet (ADV_EXT_IND) on the main broadcast channel (37, 38, 39), and the extended broadcast packet includes: the broadcast device address (AdvA), broadcast data information (ADI) and the pointer of the auxiliary broadcast packet (auxiliarypointer, AuxPtr), wherein AuxPtr indicates that the auxiliary broadcast will be carried out on the secondary broadcast channel next. The auxiliary broadcast packet (AUX_ADV_IND) includes: extended broadcast data (AdvData), broadcast audio announcement service universal unique identifier (BroadcastAudio Announcement Service UUID), other service universal unique identifiers (Others ServiceUUIDs), wherein the auxiliary broadcast packet indicates the data channel and broadcast period of the periodic broadcast. The periodic broadcast packet (AUX_SYNC_IND) includes: additional broadcast data BIG information (additional controller advertising databiginfo, ACAD BIGinfo), and the basic audio announcement service universal unique identifier (AdvDataBasic Audio Announcement Service UUID) of the extended broadcast data. The periodic broadcast packet contains all the information of the broadcast isochronous stream BIS. After receiving the periodic broadcast packet, the broadcast receiver receives the BIS data on a specific channel at a specific time anchor point according to the data included therein to obtain the BIS audio stream.
[0087] In actual applications, when broadcasting digital audio via BIS, it is achieved by continuously sending BIG. Each time a BIG is sent, it can be called a BIG event, and each BIG event can include multiple BISs.
[0088] Figure 5 FIG. 1 is a schematic diagram of continuously sending BIG in the related art. Figure 5 As shown, in the process of continuously sending BIG, BIG events are executed periodically and continuously. Figure 5 The BIG anchor points shown in indicate the start time of each BIG event, and the time interval between two anchor points is a cycle for executing the BIG event. Figure 5 The following example uses three BIG events, each of which includes two BIS events. Figure 5 The diagram shows the continuous execution of BIG event X, BIG event (X+1) and BIG event (X+2), wherein each BIG event includes two BIS streams, namely Figure 5BIS1 and BIS2 are shown in FIG. In the process of executing the BIG time, the BIS stream will be broadcasted, and in the process of broadcasting the BIS stream, the BIS stream will be broadcasted once every fixed time interval.
[0089] The above part describes the terms or concepts involved in the embodiments of the present application. The following describes the technical solutions of the embodiments of the present application.
[0090] With the continuous development of smart TV technology, its functions and application scenarios have also been significantly expanded, such as the realization of multi-language audio broadcasting. For example, taking the airport scenario as an example, in order to meet the needs of passengers from different countries and regions, smart TVs need to be able to broadcast multi-language audio. Figure 6 As shown, a TV is deployed in each of the four different areas of the airport, Area A, Area B, Area C, and Area D, and audio is broadcast to users in the respective areas through the speakers of the TV.
[0091] However, in the related art, there are certain limitations in the multi-language audio broadcasting of smart TVs. Usually, after broadcasting audio in one language, smart TVs switch to broadcasting audio in another language. For example, when broadcasting flight rules, they will broadcast once in Chinese, once in English, and once in Korean. This means that smart TVs cannot broadcast multi-language audio simultaneously, and thus cannot provide synchronized multi-language audio to different users, resulting in low broadcast efficiency and poor user experience.
[0092] In view of this, an embodiment of the present application provides a display device, which may include a Bluetooth module supporting a low-power audio protocol (bluetooth low energy audio, LE audio). While the display of the display device presents the video data of the target resource, the Bluetooth module is controlled to send multiple Bluetooth broadcast data, wherein the multiple Bluetooth broadcast data correspond to the multiple audio tracks (audio track) data of the target resource one by one, that is, one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource. In this way, the embodiment of the present application can send Bluetooth broadcast data corresponding to different audio track data for different Bluetooth devices, so as to realize the function of synchronous playback of multiple audio track data for the same audio and video resource by using audio broadcasting, and can improve broadcast efficiency. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource.
[0093] The display device and audio broadcasting method provided in the embodiments of the present application are described below with reference to the accompanying drawings.
[0094] First, the application scenarios of the display device and the audio broadcasting method provided in the embodiments of the present application are introduced.
[0095] Scenario 1: In the airport scenario, in order to provide information (such as flight information, missing person notices, etc.) to users with different language backgrounds, display devices are usually arranged in different areas of the airport. Each display device can simultaneously broadcast audio data corresponding to multiple audio track data of the target resource (such as audio data in multiple languages).
[0096] Figure 7 A schematic diagram of an audio broadcasting scenario provided by an embodiment of the present application. For example, the display device is a television, and the target resource includes audio track data in four languages, such as audio track data 1 corresponding to Chinese audio data, audio track data 2 corresponding to English audio data, audio track data 3 corresponding to Korean audio data, and audio track data 4 corresponding to Japanese audio data. Figure 7 As shown, a TV is deployed in the airport hall, and an LE audio device (such as a Bluetooth speaker) is arranged in different areas of the airport (such as area A, area B, area C and area D). The Bluetooth module of the TV deployed in the hall can send multiple Bluetooth broadcast data, and Bluetooth broadcast data corresponding to the target audio track data can be sent to the LE audio device.
[0097] For example, the Bluetooth broadcast data corresponding to track data 1 is sent to the LE audio device in area A, the Bluetooth broadcast data corresponding to track data 2 is sent to the LE audio device in area B, the Bluetooth broadcast data corresponding to track data 3 is sent to the LE audio device in area C, and the Bluetooth broadcast data of track data 4 is sent to the LE audio device in area D. Then, the LE audio devices deployed in different areas receive the corresponding Bluetooth broadcast data and play the corresponding audio data, so that the LE audio devices in different areas can play audio data in different languages.
[0098] At the same time, when the user is within the coverage of the TV's Bluetooth broadcast signal, the user can also receive the TV's Bluetooth broadcast data through a Bluetooth device (such as a mobile phone or a Bluetooth headset). For example, user 1 can choose to receive Chinese audio data (i.e., audio track data 1), and user 2 can choose to receive English audio data (i.e., audio track data 2).
[0099] That is to say, Figure 6 The audio broadcasting method of the related technology shown, the audio broadcasting method provided in the embodiment of the present application does not need to deploy multiple display devices in different areas to play different languages, but can use audio broadcasting to achieve the function of simultaneous playback of multiple languages for the same audio and video resources through one display device and multiple LE audio devices.
[0100] Scenario 2: In a multi-person conference, the conference screen can be presented through the display device, and at the same time, the audio data of multiple audio tracks corresponding to the conference content (such as audio data in multiple languages) can be broadcast simultaneously through the display device. In this way, each participant can choose to receive a certain audio track data (i.e., audio data in a certain language) through the Bluetooth device, thereby realizing the simultaneous broadcast of multi-language audio to meet the needs of different users.
[0101] Of course, the display device and audio broadcasting method provided in the embodiments of the present application can also be applied to other scenarios, which is not limited in the embodiments of the present application.
[0102] It should be noted that the display device provided in the embodiment of the present application can support the LE audio protocol, and the display device can be used as an audio playback device (i.e., an audio sending device) or a device for configuring an audio receiving device. Of course, the audio receiving device in the embodiment of the present application can also support the LE audio protocol.
[0103] Before introducing the audio broadcasting method provided in the embodiment of the present application, the electronic device to which the audio broadcasting method provided in the present application is applicable is described below.
[0104] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.
[0105] Figure 8 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 8 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.
[0106] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.
[0107] For example, Figure 8It is also shown that the display device 200 can also establish a Bluetooth communication connection with the Bluetooth device 500. The user can control the display device 200 through the mobile terminal 300 or the control device 100, so that the display device 200 executes the audio broadcasting method provided in the embodiment of the present application according to the user's instructions to broadcast multiple audio track data, so that the Bluetooth device (such as a Bluetooth headset) 500 within the coverage range of the broadcast signal of the display device 200 can select any language of audio data broadcast by the display device 200 for listening.
[0108] like Figure 8 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.
[0109] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.
[0110] Fig. 9 Some embodiments of the present application provide Figure 8 2 is a block diagram of the hardware configuration of the display device 200.
[0111] In some embodiments, Fig. 9 As shown, the display device 200 may include at least one of a tuner and demodulator 210, a communicator (also referred to as a communication device) 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280.
[0112] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.
[0113] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.
[0114] Exemplarily, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
[0115] In some embodiments, the communicator 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communicators 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communicator 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communicator 220 including a Bluetooth function.
[0116] The communicator 220 can connect the display device 200 to the external device or the server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 to the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 to the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.
[0117] Exemplarily, the display device 200 may obtain a user instruction sent by the control device through the communicator 220, and implement the audio broadcasting method provided in the embodiment of the present application according to the user instruction.
[0118] When the display device 200 broadcasts audio through its own Bluetooth module, the Bluetooth module may be a Bluetooth module that supports the LE Audio protocol. When the display device 200 broadcasts audio through an external Bluetooth speaker, the Bluetooth module may be a Bluetooth module that supports the LE Audio protocol or a Bluetooth module that does not support the LE Audio protocol.
[0119] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0120] In some embodiments, the external device interface 240 may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.
[0121] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0122] In some embodiments, the display device 200 may further include a sound output device, which includes an audio output interface 270 and a speaker.
[0123] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user interface receives the user input command through the graphical user interface (GUI).
[0124] In some embodiments, the user interface 280 may be used to receive instructions input from a user, and may also be used to receive control signals from a control device (eg, an infrared remote controller, etc.).
[0125] In some embodiments, when implementing the audio broadcasting method provided in the embodiments of the present application, the operations performed by the display device 200 can be implemented by the controller 250.
[0126] In some embodiments, the controller 250 is configured to: present video data of the target resource on a display, and control a sound output device to output first audio data of the target resource; obtain audio track information of the target resource in response to a first operation; determine the number of audio tracks of the target resource based on the audio track information; control the display to present a multi-audio track sharing control when the number of audio tracks meets a first preset condition; control the sound output device to stop outputting the first audio data in response to a selection operation on the multi-audio track sharing control; control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data of the target resource.
[0127] Exemplarily, when the controller 250 controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, it is specifically configured as follows: if the number of audio tracks is not greater than a second preset number, then the Bluetooth module is controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously; if the number of audio tracks is greater than the second preset number, then a first number of first audio track data is determined from multiple audio track data of the target resource, and the Bluetooth module is controlled to send Bluetooth broadcast data to the first number of Bluetooth devices, and the Bluetooth broadcast data corresponding to one Bluetooth device is used to broadcast audio data corresponding to one first audio track data in the first number of first audio track data, wherein the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
[0128] Exemplarily, before determining a first quantity of first track data from multiple track data of a target resource, the controller 250 is further configured to: if the number of tracks is greater than a second preset number, control the display to present multiple track identifiers, and the multiple track identifiers correspond one-to-one to the multiple track data of the target resource; wherein, when the controller 250 determines a first quantity of first track data from multiple track data of a target resource, the controller 250 is specifically configured to: in response to a selection operation for a first quantity of first track identifiers among the multiple track identifiers, determine the track data corresponding to each first track identifier as the first track data.
[0129] Exemplarily, the multiple audio track data of the target resource include second audio track data and third audio track data; when the controller 250 controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, it is specifically configured to: determine the first Bluetooth device corresponding to the second audio track data based on the association relationship between the audio track index and the device identifier; control the Bluetooth module to send first Bluetooth broadcast data to the first Bluetooth device based on the first Bluetooth broadcast channel corresponding to the second audio track data, and the first Bluetooth broadcast data is used to broadcast the audio data corresponding to the second audio track data; determine the second Bluetooth device corresponding to the third audio track data based on the association relationship; control the Bluetooth module to send second Bluetooth broadcast data to the second Bluetooth device based on the second Bluetooth broadcast channel corresponding to the third audio track data, and the second Bluetooth broadcast data is used to broadcast the audio data corresponding to the third audio track data.
[0130] Exemplarily, the controller 250 is further configured to: create a first Bluetooth broadcast channel according to the track identifier corresponding to the second audio track data; and create a second Bluetooth broadcast channel according to the track identifier corresponding to the third audio track data.
[0131] Exemplarily, the controller 250 is further configured to: upon receiving a track data configuration operation, control the display to present multiple device options, the multiple device options corresponding one-to-one to multiple Bluetooth devices, and the multiple Bluetooth devices are Bluetooth devices that support the low power audio protocol; in response to a selection operation for a first device option among the multiple device options, control the display to present multiple track options, the multiple track options corresponding one-to-one to multiple track data; in response to a selection operation for a first track option among the multiple track options, associate the first track index with the first device identifier to obtain an association relationship between the track index and the device identifier, wherein the first track index is the track identifier of the track data corresponding to the first track option, and the first device identifier is the device identifier of the Bluetooth device corresponding to the first device option.
[0132] Exemplarily, before controlling the Bluetooth module to send a plurality of Bluetooth broadcast data to a plurality of Bluetooth devices, the controller 250 is further configured to: control the Bluetooth module to switch to a Bluetooth broadcast channel.
[0133] Exemplarily, before controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller 250 is also configured to: control the player to pause playing the video data in response to a selection operation on the multi-track sharing control; wherein, when controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller 250 is specifically configured to: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and control the player to replay the video data from the start time of the video.
[0134] Exemplarily, before controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller 250 is also configured to: control the player to pause playing video data and obtain playback progress information of the video data in response to a selection operation on a multi-track sharing control; wherein, when controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller 250 is specifically configured to: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, control the player to replay the video data according to the playback progress information, and process the audio data corresponding to the multiple audio track data of the target resource according to the playback progress information, and control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices based on multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
[0135] Exemplarily, after controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller 250 is also configured to: when a second preset condition is met, control the Bluetooth module to stop sending multiple Bluetooth broadcast data to multiple Bluetooth devices, control the player to pause playing video data, and obtain the playback progress information of the video data; based on the playback progress information, control the player to replay the video data, and the sound output device to output the first audio data; wherein the second preset condition includes at least one of the following: receiving an instruction to exit multi-audio track sharing; detecting that the Bluetooth module is switched to the off state; detecting that the player is switched to background operation; receiving an operation to stop playing the target resource.
[0136] In some embodiments, the controller 250 is further configured to: present video data of the target resource on a display, and control the sound output device to output first audio data of the target resource; in response to a first operation, obtain audio track information of the target resource; determine the number of audio tracks of the target resource based on the audio track information; when the number of audio tracks meets a first preset condition, control the display to present a multi-audio track sharing control; in response to a selection operation on the multi-audio track sharing control, control the sound output device to stop outputting the first audio data, and control the Bluetooth module to send multiple Bluetooth broadcast data, the multiple Bluetooth broadcast data correspond one-to-one to the multiple audio track data of the target resource, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data.
[0137] Exemplarily, when the controller 250 controls the Bluetooth module to send multiple Bluetooth broadcast data, it is specifically configured as follows: if the number of audio tracks is not greater than the second preset number, then the Bluetooth module is controlled to send multiple Bluetooth broadcast data, and the second preset number is the number of audio track data that the Bluetooth module supports to broadcast simultaneously; if the number of audio tracks is greater than the second preset number, then a first number of first audio track data is determined from the multiple audio track data, and the Bluetooth module is controlled to send the first number of Bluetooth broadcast data, one Bluetooth broadcast data is used to broadcast the audio data corresponding to one first audio track data in the first number of first audio track data, wherein the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
[0138] Exemplarily, before determining a first quantity of first audio track data from a plurality of audio track data, the controller 250 is further configured to: if the number of audio tracks is greater than a second preset number, control the display to present a plurality of audio track identifiers, and the plurality of audio track identifiers correspond one-to-one to the plurality of audio track data of the target resource; wherein, when determining a first quantity of first audio track data from a plurality of audio track data, the controller 250 is specifically configured to: in response to a selection operation for a first quantity of first audio track identifiers among the plurality of audio track identifiers, determine the audio track data corresponding to each first audio track identifier as the first audio track data.
[0139] Exemplarily, when controlling the Bluetooth module to send multiple Bluetooth broadcast data, the controller 250 is specifically configured to: control the Bluetooth module to switch to the Bluetooth broadcast channel; when determining that the Bluetooth module has switched to the Bluetooth broadcast channel, control the Bluetooth module to send multiple Bluetooth broadcasts based on multiple Bluetooth broadcast channels, wherein the multiple Bluetooth broadcast channels correspond one-to-one to the multiple audio track data.
[0140] Exemplarily, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, the controller 250 is also configured to: control the player to pause playing the video data in response to a selection operation on the multi-track sharing control; wherein, when controlling the Bluetooth module to send multiple Bluetooth broadcast data, the controller 250 is specifically configured to: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, control the Bluetooth module to send multiple Bluetooth broadcasts based on multiple Bluetooth broadcast channels, and control the player to replay the video data from the start time of the video.
[0141] Exemplarily, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, the controller 250 is also configured to: in response to a selection operation on a multi-track sharing control, control the player to pause playing video data, and obtain playback progress information of the video data; wherein, when controlling the Bluetooth module to send multiple Bluetooth broadcast data, the controller 250 is specifically configured to: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, control the player to replay the video data according to the playback progress information, and process the audio data corresponding to the multiple audio track data of the target resource according to the playback progress information, and control the Bluetooth module to send multiple Bluetooth broadcast data based on multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
[0142] Fig.10 FIG. 2 is a schematic diagram of a software system architecture of a display device 200 provided in an embodiment of the present application. Fig.10 As shown, the software system at least includes: an application (APP) layer (abbreviated as application layer), an application framework (framework) layer (abbreviated as framework layer), a dynamic library (Library), a kernel layer and a hardware layer.
[0143] The application layer is used to deploy TV-related functions. For example, the application layer may include a TV settings application and a TV service.
[0144] In an embodiment of the present application, the application layer may also include a media center application (i.e., media center APP) and a Bluetooth setting application (i.e., Bluetooth setting). Among them, the media center APP is a bridge between the user and the TV media playback function, providing a user interface and interaction logic. Exemplarily, the media center APP can be used to manage and play media resources stored locally or on the network of the display device, such as audio and video resources. The Bluetooth setting application can be used to turn on and off the Bluetooth connection function of the display device, and to manage the Bluetooth device list.
[0145] It is understandable that the Bluetooth setting application may be an Android application package (APK) for setting Bluetooth in the TV device application.
[0146] The framework layer may include a media player, Bluetooth API, Bluetooth APK, and audio module. The player is the core component that actually performs the media playback task, and is responsible for playing audio and video files of various formats. In addition, the player usually has built-in or supports multiple codecs for decoding compressed media files so that the original audio and video data can be played on the display device.
[0147] Bluetooth applications may include specifications related to the Bluetooth protocol, for example, one or more of the A2DP application specification, the LE Audio application specification, and the Hearing Aid application specification. Among them, the A2DP (Advanced Audio Distribution Profile) application specification is a media audio application specification in classic Bluetooth, the LE Audio application specification is a low-power audio application specification based on Bluetooth, and the Hearing Aid application specification is a hearing aid application specification based on low power (BLE).
[0148] It should be noted that a Bluetooth application may include a Bluetooth broadcast component. The Bluetooth broadcast component is used to send broadcast information so that other Bluetooth devices can scan the display device. Exemplarily, the Bluetooth broadcast component can be integrated into a media center APP at the application layer, so that the media center APP can perform Bluetooth-related operations, such as discovering other Bluetooth devices, establishing Bluetooth connections, transmitting data, etc.
[0149] The audio module may include one or more of an audio manager and an audio service. The audio module is mainly responsible for sending audio-related data from the Bluetooth application to the Bluetooth protocol stack. In the disclosed embodiment, the channel audio data of the channel is mainly transmitted through the audio channel between the audio module and the Bluetooth protocol stack. After receiving the channel audio data, the Bluetooth protocol stack encapsulates the channel audio data into a BIS stream.
[0150] The dynamic library (Library) may include the Bluetooth protocol stack (BT Stack) and the Bluetooth audio hardware abstraction layer (Bluetooth audio HAL). The Bluetooth protocol stack is mainly responsible for scanning, connecting and configuring Bluetooth devices. When the display device establishes a Bluetooth connection with a Bluetooth device, the Bluetooth application in the display device can send relevant data to the Bluetooth protocol stack.
[0151] The Bluetooth protocol stack may also include a general audio framework (GAF); GAF also includes a common audio profile (CAP), a common audio service (CAS), audio stream transmission management and volume control, wherein the audio stream transmission management includes a basic audio profile (BAP), an audio capability display service (PACS), an audio stream control service (ASCS) and a broadcast audio scan service (BASS), and BASS is required for broadcast synchronization in the disclosed embodiment. Volume control includes: a voice control profile (Volume Control Profile, VCP), a volume control service (Volume Control Service, VCS), a voice offset control service (Voice Offset Control Service, VOCS), and an audio input control service (Audio Input Control Service, AICS).
[0152] The kernel layer is the layer between hardware and software. The kernel layer can at least include the Bluetooth driver. The Bluetooth driver is the driver layer of the Bluetooth module, which is mainly responsible for interacting with the hardware.
[0153] The hardware layer may include a Bluetooth module (i.e. Fig. 9 The Bluetooth protocol stack can interact with the Bluetooth module of the hardware layer through a Bluetooth driver.
[0154] Fig.111 is a hardware configuration block diagram of a Bluetooth device 500 provided in an embodiment of the present application. Fig.11 As shown, the Bluetooth device 500 includes: a controller 510, a communicator 520, a user input / output interface 530, a memory 540, and a power supply 550. The communicator 520 is used to communicate with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module. The user input / output interface 530 includes at least one of a speaker, a microphone, a touchpad, a sensor, a button or an alternative module.
[0155] It should be noted that the Bluetooth module in the Bluetooth device can also support the LE audio protocol.
[0156] The following embodiments of this application will be based on Fig. 9 and Fig.10 Taking the display device of the shown structure as an example, the audio broadcasting method provided in the embodiment of the present application is specifically explained in combination with the accompanying drawings and application scenarios.
[0157] In an embodiment of the present application, after the user selects a target resource, the video data of the target resource can be presented on the display, and the sound output device can be controlled to output the first audio data of the target resource. At the same time, the audio track information of the target resource can be obtained, and the number of audio tracks of the target resource can be determined according to the audio track information of the target resource. Then, according to the number of audio tracks of the target resource, it is determined whether the target resource can share multi-track data. If the target resource can share multi-track data, the display is controlled to present a multi-track sharing control. In this way, in response to the selection operation for the multi-track sharing control, the Bluetooth module can be controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, or the Bluetooth module can be directly controlled to send multiple Bluetooth broadcast data.
[0158] That is to say, in the embodiment of the present application, there are two ways to share multi-track data, namely, sending Bluetooth broadcast data corresponding to different track data to different Bluetooth devices, or directly sending Bluetooth broadcast data corresponding to multiple different track data. The following embodiments respectively describe these two ways of sharing multi-track data in detail.
[0159] Method 1: Send Bluetooth broadcast data corresponding to different audio tracks to different Bluetooth devices
[0160] Fig.12 A flowchart of an audio broadcasting method provided in an embodiment of the present application is shown in FIG. Fig.12 As shown, the method may include the following steps:
[0161] S1210, presenting video data of the target resource on a display, and controlling a sound output device to output first audio data of the target resource.
[0162] The target resource (also referred to as the target audio and video resource) may be the audio and video resource currently to be played selected by the user, that is, the audio and video resource currently being played by the display device. Exemplarily, the target audio and video resource may also be any video resource among the audio and video resources to be played.
[0163] Among them, the audio and video resources at least include one or more of audio resources (i.e., audio data) and video resources (i.e., video data). In practical applications, the audio and video resources can be pre-stored in the display device, or they can be acquired by the display device according to preset conditions. For example, the target audio and video resources can be audio resources that are downloaded from a multimedia server to the display device according to a specific address and are being played. In an embodiment of the present application, the target resource may include one or more audio track data (also referred to as audio track for short), and the audio track data is used to indicate the audio data included in the target resource, that is, different audio track data correspond to different audio data.
[0164] Exemplarily, the audio track can be used to indicate the audio information included in the target audio and video resource, and different audio tracks correspond to different audio information; there is a one-to-one correspondence between the audio track and the language of the target audio and video resource, that is, the language type (i.e., language) of the audio data corresponding to different audio track data is different, that is, one audio track data corresponds to audio data of one language type. For example, taking the target resource including three audio track data (i.e., audio track data 1, audio track data 2, and audio track data 3) as an example, the language type of the audio data corresponding to audio track data 1 is Chinese (audio track data 1 corresponds to Chinese audio data), the language type of the audio data corresponding to audio track data 2 is English (audio track data 2 corresponds to English audio data), and the language type of the audio data corresponding to audio track data 3 is French (audio track data 2 corresponds to French audio data). Exemplarily, the channel configuration information corresponding to different audio track data is different. For example, continuing to take the target resource including three audio track data (i.e., audio track data 1, audio track data 2, and audio track data 3) as an example, audio track data 1 is mono, audio track data 2 is stereo, and audio track data 3 is surround sound. Exemplarily, the audio processing (such as equalization, compression, reverberation, etc.) that the audio data corresponding to different audio track data undergoes may have different formats of the corresponding audio data.
[0165] It should be noted that one audio track data may include one or more channels, wherein the channel may be used to represent a transmission and processing channel of an audio signal in a physical or virtual environment.
[0166] The first audio data refers to the audio data corresponding to the audio track data output by the sound output device when the display device plays the video data of the target resource. Specifically, when the target resource includes one audio track data, the first audio data is the audio data corresponding to the audio track data. When the target resource includes multiple audio track data, the first audio data can be the audio data corresponding to any one of the multiple audio track data. For example, taking the example that the target resource includes audio track data 1 and audio track data 2, where audio track data 1 corresponds to Chinese audio data and audio track data 2 corresponds to English audio data, the first audio data can be the audio data corresponding to audio track data 1, that is, Chinese audio data.
[0167] In some examples, the user can select the target resource through a first application, wherein the first application can be the media center APP in the aforementioned embodiment, or a third-party audio and video application installed on the display device.
[0168] The following takes the first application as a media center APP as an example to schematically illustrate the process of a user selecting a target resource. Fig.13 The following is a schematic diagram of the interface for the target resource selection process provided in the embodiment of the present application. Fig.13 As shown in (a) of FIG. 1 , after the user turns on the display device, the display device starts the media center APP and presents the audio and video resource interface 1301 of the media center APP on the display. The audio and video resource interface 1301 includes multiple audio and video resources to be played, such as audio and video resource A, audio and video resource B, and audio and video resource C. In response to the selection operation for audio and video resource B, the media center APP determines audio and video resource B as the target resource and enters Fig.13 The playback interface 1302 of the audio and video resource B shown in (b) of FIG. 1302 , wherein the selection operation for the audio and video resource B may be an operation of the user selecting the audio and video resource B through a control device, or may be a voice command for selecting the audio and video resource B input by the user.
[0169] Of course, the user can also select the target resource through other applications (such as third-party audio and video applications) in the display device other than the media center APP. Specifically, after the display device is started, the user can first open the third-party audio and video application, and then select the target resource to be played from the audio and video resources provided by the third-party audio and video application.
[0170] Optionally, the target resource may be a local audio and video resource stored in the display device, or a network audio and video resource. The embodiment of the present application does not limit the specific type and acquisition method of the target resource.
[0171] After the user selects the target resource, the display device parses the video data corresponding to the target resource and the audio data of a track data in the target resource (i.e., the first audio data) according to the storage address of the target resource, and then controls the display to present the video data of the target resource, and controls the sound output device to output the first audio data.
[0172] Exemplarily, continuing to take the first application as a media center APP as an example, the process of controlling the display to present the video data of the target resource and controlling the sound output device to output the first audio data is explained. After the user selects the target resource, the media center APP of the application layer obtains the storage address of the target resource and sends the storage address of the target resource to the player of the framework layer. After the player receives the storage address of the target resource sent by the media center APP, the player parses the video data of the target resource and the audio data corresponding to one of the audio track data (i.e., the first audio data) based on the storage address of the target resource. Afterwards, the player controls the display to present the video data of the target resource through the display driver, and the player controls the sound output device to output the first audio data through the sound driver.
[0173] S1220: In response to the first operation, obtain audio track information (also referred to as audio information) of the target resource.
[0174] During the process of playing the target audio and video resource (i.e., the target resource), the target resource can also be decoded to obtain the audio information (i.e., the audio track information) of the target resource, that is, to obtain the audio track information of the target resource. Exemplarily, obtaining the audio track information of the target resource can include: in response to a first operation (i.e., an audio track menu invoking operation), obtaining the audio track information of the target resource. Among them, the first operation is an invoking operation of the audio track menu. Exemplarily, the first operation can be an operation of the user pressing a menu key of the control device. Exemplarily, the first operation can also be a voice command input by the user to invoke the audio track menu.
[0175] The audio track information of the target resource may include index information, language type information, audio track type information, and audio track format information. The index information is used to indicate the storage location corresponding to the audio track data, that is, the storage location of the audio data corresponding to the audio track data. The language type information is used to indicate the language type of the audio data corresponding to the audio track data. For example, the voice type information of audio track data 1 is Chinese, the voice type information of audio track data 2 is English, and the voice type information of audio track data 3 is French. The audio track type information is used to distinguish audio track data from subtitle data.
[0176] The audio track format information is used to indicate the format type of the audio data corresponding to the audio track data. In some examples, the format type of the audio data may include a lossy compression format, a lossless compression format, and a multi-channel audio format according to the technical characteristics. The lossy compression format may include, for example, an MPEG-2 audio coding format, an MPEG-4 audio coding format, an AC-3 audio coding format, and an EAC-3 audio coding format. The lossless compression format may include, for example, a DTS-LBR audio coding format and a DTS-HD Master Audio audio coding format. The multi-channel audio format may include, for example, an AC-4 audio coding format, a DTS-HD audio coding format, an AC-3 audio coding format, an EAC-3 audio coding format, a DTS-HD audio coding format, and a DTS audio coding format.
[0177] In other examples, according to the application scenario, the format type of audio data may include a home theater system format, a DVD video format, a digital video and streaming media format, and a high-quality audio transmission format. Among them, the home theater system format may include, for example, an AC-4 audio coding format, an AC-3 audio coding format, an EAC-3 audio coding format, a DTS-HD audio coding format, and a DTS-HD Master Audio audio coding format. The DVD video format may include, for example, an MPEG-2 audio coding format and a DTS audio coding format. The digital video and streaming media format may include, for example, an MPEG-4 audio coding format. The high-quality audio transmission format may include, for example, a DTS-LBR audio coding format.
[0178] It should be noted that different formats of audio data correspond to different decoding types. For example, the decoding types of AC-4 audio encoding format, DTS-HD audio encoding format, DTS-LBR audio encoding format, and DTS-True-HD audio encoding format are only hardware decoding types (referred to as hard decoding types). In contrast, the decoding types of MPEG-2 audio encoding format, MPEG-4 audio encoding format, AC-3 audio encoding format, EAC-3 audio encoding format, and DTS audio encoding format can be software decoding types (referred to as soft decoding types) or hardware decoding types.
[0179] Exemplarily, taking the first application as a media center APP as an example, the process of obtaining the audio track information of the target resource is described. After receiving the storage address of the target resource sent by the media center APP, the player parses and obtains the audio track information of the target resource based on the storage address of the target resource. In response to the first operation, the media center APP sends an audio track information acquisition instruction to the player. After receiving the audio track information acquisition instruction sent by the media center APP, the player returns the audio track information of the target resource to the media center APP.
[0180] Optionally, the player can obtain the track information (track info) array of the target resource, and the track information (track info) array includes the track information of each track data in at least one track data of the target resource and the subtitle information corresponding to each track data. After obtaining the track information (track info) array of the target resource, the player creates a track information (i.e., base track info) list based on the track information (track info) array of the target resource, and the track information (i.e., base track info) list includes the track information of each track data in at least one track data, and the track information of each track data includes the aforementioned index information, language type information, track type information, and track format information. Afterwards, the player sends the track information (i.e., base track info) list to the media center APP.
[0181] S1230: Determine the number of audio tracks of the target resource according to the audio track information.
[0182] Exemplarily, during the process of playing the target resource, the target resource may also be decoded to obtain audio information (ie, audio track information) of the target resource, and then the number of audio tracks of the target resource may be determined based on the audio information of the target resource.
[0183] The number of audio tracks of the target resource refers to the number of audio track data included in the target resource.
[0184] In some examples, after obtaining the audio track information, that is, the audio track information list, the number of audio tracks of the target resource is determined according to the length of the audio track information list.
[0185] For example, the process of determining the number of audio tracks of the target resource is described by taking the first application as a media center APP. After receiving the audio track information list sent by the player, the media center APP determines the number of audio tracks of the target resource according to the length of the audio track information list.
[0186] In some examples, the name of the audio track based on the target resource may also be determined based on the audio information of the target resource. The name of the audio track of the target resource refers to the name (channel name) of each audio track data of the target resource, that is, the audio track identifier.
[0187] S1240: When the number of audio tracks meets a first preset condition, control the display to present a multi-audio track sharing control.
[0188] Among them, the multi-audio track sharing control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, or to trigger the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices. The multiple Bluetooth broadcast data correspond one-to-one to multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource.
[0189] The first preset condition is whether the target resource meets the condition of multi-track sharing. In some examples, the first preset condition may include at least one of the following: the number of tracks is greater than a first preset number (also referred to as a preset number threshold); the number of tracks is equal to the first preset number. Exemplarily, the first preset number is 2.
[0190] In some examples, the length of the track information list can be used to determine whether the number of tracks of the target resource is greater than or equal to a first preset number. Specifically, after obtaining the track information list of the target resource, determine whether the length of the track information list of the target resource is greater than or equal to the preset length. If the length of the track information list of the target resource is greater than or equal to the preset length, it means that the number of tracks of the target resource is greater than or equal to the first preset number, that is, the number of tracks meets the first preset condition. At this time, the control display presents a multi-track sharing control. If the length of the track information list of the target resource is less than the preset length, it means that the number of tracks of the target resource is less than the first preset number, that is, the number of tracks does not meet the first preset condition. At this time, the multi-track sharing control is not displayed.
[0191] Fig.14 A schematic diagram of an interface change from a playback page to a multilingual sharing page provided in an embodiment of the present application. Fig.14 , presenting the video data of the target resource on the display, that is, displaying Fig.14 In response to the audio track menu call-up operation (i.e., the first operation) input by the user, the audio track information of the target resource is obtained, and the number of audio tracks of the target resource is determined according to the audio track information, and then it is determined whether the number of audio tracks of the target resource is greater than or equal to a first preset number (e.g., 2). If the number of audio tracks of the target resource is greater than or equal to the first preset number (e.g., 2), the display is controlled to present the following Fig.14 The track menu page shown in (b) in FIG. The track menu page displays a multi-track sharing control, such as a "bilingual sharing" control. Otherwise, multi-track sharing is not supported, and the "bilingual sharing" control is not displayed.
[0192] In some examples, the display may be controlled to present multiple track selection controls, each of which corresponds to multiple track data of the target resource; in response to a selection operation on a first selection control, the sound output device is controlled to output first audio data of the target resource, wherein the first audio data is audio data of the track data corresponding to the first selection control. The first selection control is any one of the multiple track selection controls.
[0193] In a possible implementation, prompt information is displayed on each audio track selection control, and the prompt information is determined based on language type information of the audio track data corresponding to the audio track selection control.
[0194] For example, the target resource includes three audio track data (i.e., audio track data 1, audio track data 2, and audio track data 3). The language type of the audio data corresponding to audio track data 1 is Chinese (audio track data 1 corresponds to Chinese audio data), the language type of the audio data corresponding to audio track data 2 is English (audio track data 2 corresponds to English audio data), and the language type of the audio data corresponding to audio track data 3 is Japanese (audio track data 2 corresponds to French audio data). For this, Fig.14 As shown in (b), the track menu page may also include a "Chinese" track selection control corresponding to track data 1, an "English" track selection control corresponding to track data 2, and a "Japanese" track selection control corresponding to track data 3.
[0195] In this embodiment, multiple track selection controls can also be presented in the track menu page, so that users can also choose to listen to audio data corresponding to a certain track data, that is, audio data in a certain language, according to actual needs, which can meet the different needs of users.
[0196] S1250: In response to a selection operation on a multi-track sharing control, control a sound output device to stop outputting the first audio data.
[0197] Among them, the triggering operation for the multi-track sharing control may include a click operation on the multi-track sharing control, etc.
[0198] In some examples, in response to a selection operation on a multi-track sharing control, the first application may send a pause instruction to the player to instruct the player to pause playing the video data of the target resource. In this way, after the user enters the multi-track sharing interface, the video data of the target resource is paused to avoid affecting the user's viewing experience. Furthermore, it can be avoided that the sharing of multi-track data cannot operate normally due to the end of the playback of the video data of the target resource.
[0199] S1260, control the Bluetooth module to send multiple Bluetooth broadcast data (also referred to as Bluetooth broadcast) to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data of the target resource.
[0200] That is to say, each piece of audio track data (ie, target audio track) corresponds to at least one piece of Bluetooth broadcast data, and the Bluetooth broadcast data is used to broadcast the audio data of the corresponding target audio track.
[0201] In some examples, when the number of audio tracks of the target resource is greater than a first preset number (i.e., a preset number threshold), the control display is presented with multiple audio track identifiers, the multiple audio track identifiers correspond one-to-one to the multiple audio track data of the target resource, and in response to a selection operation for a first number of first audio track identifiers among the multiple audio track identifiers, the audio track data corresponding to each first audio track identifier is determined as the first audio track data (i.e., the target audio track), and the Bluetooth module is controlled to send Bluetooth broadcast data to a first number of Bluetooth devices, and the Bluetooth broadcast data corresponding to one Bluetooth device is used to broadcast audio data corresponding to one first audio track data among the first number of first audio track data.
[0202] That is to say, after acquiring the audio tracks of the target resource, first determine whether the number of audio tracks of the target resource is less than a preset number threshold (i.e., determine whether the number of audio tracks meets the first preset condition); if it is determined that the number of audio tracks of the target resource is not less than the preset number threshold (i.e., meets the first preset condition), monitor the audio broadcast trigger operation for the audio tracks of the target resource; after receiving the audio broadcast trigger operation for at least two of the audio tracks of the target resource (i.e., audio track data), control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices based on at least two audio track data.
[0203] In some examples, after acquiring the audio tracks of the target resource, the display device can also first control the display to display the multi-track sharing control when it is determined that the number of audio tracks of the target resource is not less than the preset number threshold, and when receiving a trigger operation for the multi-track sharing control (i.e., a selection operation for the multi-track control), determine whether the number of audio tracks of the target resource is greater than the preset number threshold, and when it is determined that the number of audio tracks is greater than the preset number threshold, display the identifiers of at least two audio tracks in the audio tracks of the target resource; then, receive an audio broadcast trigger operation for at least two target audio tracks, and send a Bluetooth broadcast based on the at least two target audio tracks. Among them, the trigger operation for the multi-track sharing control can include a click operation on the multi-track sharing control, etc.
[0204] For example, assuming that the preset number threshold is 2, it means that the display device can support 2 audio tracks that can be shared simultaneously. At this time, if it is determined that the number of audio tracks of the target audio and video resources (for example, 2) is not less than 2, the display is controlled to display a multi-audio track sharing control with the words "bilingual sharing".
[0205] In some embodiments, during the process of the display device controlling the display to display a multi-language sharing control, upon receiving a trigger operation for the multi-language sharing control, it can also first determine whether the number of audio tracks of the target resource is equal to a preset number threshold, and if it is determined that the number of audio tracks of the target resource is equal to the preset number threshold, display the identifier of the audio track of the target resource; upon receiving an audio broadcast trigger operation for the audio track of the target resource, send multiple Bluetooth broadcast data to multiple Bluetooth devices based on at least two audio track data.
[0206] Since the preset quantity threshold can be used to represent the number of audio tracks that the display device can support for simultaneous sharing, when it is determined that the number of audio tracks of the target resource is equal to the preset quantity threshold, it means that the number of audio tracks of the target resource is exactly the number of audio tracks that the display device can support for simultaneous sharing. At this time, the display device plays all the audio track contents of the target resource, thereby realizing the function of simultaneous multi-language playback of the same audio and video resource by means of audio broadcasting.
[0207] In some embodiments, after obtaining the audio track of the target resource, it is also possible to determine whether the display device is a device that supports the LE audio protocol. Specifically, by obtaining the local configuration information of the display device, it is determined whether the display device supports the LE audio protocol. When it is determined that the display device supports the audio protocol and the number of audio tracks of the target audio and video resource currently being played is not less than the first preset threshold (i.e., the second preset number), the display is controlled to display a multi-audio track sharing control.
[0208] That is to say, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices may include: if the number of audio tracks is not greater than a second preset number, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices; if the number of audio tracks is greater than the second preset number, determining a first number of first audio track data from multiple audio track data of the target resource, and controlling the Bluetooth module to send Bluetooth broadcast data to the first number of Bluetooth devices, the Bluetooth broadcast data corresponding to one Bluetooth device being used to broadcast audio data corresponding to one first audio track data in the first number of first audio track data.
[0209] Among them, the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared audio tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0210] The first number is less than or equal to the second preset number, and the first number is greater than or equal to two. For example, the second preset number is 2, and the first number is 2. For example, the second preset number is 3, and the first number can be 2 or 3.
[0211] Exemplarily, after receiving a selection operation for a multi-audio track sharing control, it is determined whether the number of audio tracks of the target resource is not greater than a second preset number. If the number of audio tracks of the target resource is not greater than the second preset number, it indicates that the number of audio tracks of the target resource does not exceed the performance of the hardware chip of the display device. Therefore, the Bluetooth module can be controlled to send Bluetooth broadcast data to multiple Bluetooth devices.
[0212] Specifically, according to the pre-established association relationship between the Bluetooth device and the audio track data, the Bluetooth module can be controlled to send the Bluetooth broadcast data corresponding to the audio track data matched with the Bluetooth device.
[0213] Optionally, when the number of audio tracks of the target resource is equal to a second preset number, the Bluetooth module is controlled to send Bluetooth broadcast data to multiple Bluetooth devices.
[0214] In addition, when the number of audio tracks of the target resource is not greater than the second preset number, the display can be controlled to present the audio track identifiers of the multiple audio track data of the target resource, and then the Bluetooth module can be controlled to send Bluetooth broadcast data to multiple Bluetooth devices. In this embodiment, by presenting the audio track identifiers of the audio track data on the display, the user can be prompted to share the multiple audio track data and to perform the sharing operation of the multiple audio track data.
[0215] Exemplarily, the track identifier is used to present relevant information of the track data that can be shared by multiple tracks to the user. Exemplarily, the track identifier may include the channel name of the track data, wherein the language type information of the track data can usually be used to represent the track name, such as Chinese, English. Exemplarily, the track identifier may also be a global variable generated based on the track information of the track data. For example, English (ENG-TVAudioShare), Chinese (CHN-TVAudioShare).
[0216] It should be noted that if the language types of two audio track data are the same, a number can be added after the language type to distinguish different audio track data. For example, audio track data 1 is Chinese 1, and audio track data 2 is Chinese 2.
[0217] Of course, when the number of audio tracks of the target resource is equal to the second preset number, the display can also be controlled to present the audio track identifiers of multiple audio track data of the target resource, and then the Bluetooth module can be controlled to send Bluetooth broadcast data to multiple Bluetooth devices.
[0218] For example, taking the second preset number as 2, and the target resource including two track data (track data 1 and track data 2) as an example, please continue to refer to Fig.14 In response to a selection operation on the "bilingual sharing" control, a display device is presented Fig.14 The bilingual sharing page shown in (c) may include the track identifier "Chinese" corresponding to the track data 1 and the track identifier "English" corresponding to the track data 2.
[0219] In some examples, when the number of audio tracks of the target resource is greater than a second preset number, the control display is presented with multiple audio track identifiers, the multiple audio track identifiers correspond one-to-one to the multiple audio track data of the target resource, in response to a selection operation for a first number of first audio track identifiers among the multiple audio track identifiers, the audio track data corresponding to each first audio track identifier is determined as the first audio track data, and the Bluetooth module is controlled to send Bluetooth broadcast data to a first number of Bluetooth devices, and the Bluetooth broadcast data corresponding to one Bluetooth device is used to broadcast audio data corresponding to one first audio track data among the first number of first audio track data.
[0220] For example, taking the second preset number being 2 and the first number being 2 as an example, the process of controlling the Bluetooth module to send a plurality of Bluetooth broadcast data to a plurality of Bluetooth devices is described.
[0221] In response to the selection operation for the multi-track sharing control, it is determined whether the number of tracks of the target resource is not greater than the second preset number (such as 2). If the number of tracks of the target resource is not greater than the second preset number (such as 2), the display is controlled to present the track identifiers of each track data, and the corresponding track data is sent to each Bluetooth device according to the pre-established association relationship between the Bluetooth device and the track data. If the number of tracks of the target resource is greater than the second preset number (such as 2), two first track data are determined from the multiple track data of the target resource, the display is controlled to present the track identifiers of the two first track data, and according to the pre-established association relationship between the Bluetooth device and the first track data matched therewith, the Bluetooth module is controlled to send the Bluetooth broadcast data corresponding to the first track data matched therewith to the Bluetooth device.
[0222] For example, taking the second preset number as 2 and the number of audio tracks of the target resource as 3, see Fig.15 , in response to Fig.15 The "Bilingual Sharing" control shown in (a) is selected to determine whether the number of audio tracks of the target resource is not greater than a second preset number (such as 2). If the number of audio tracks of the target resource is greater than the second preset number (such as 2), the display device is displayed. Fig.15 The track selection pop-up window shown in (b) in the figure. The track selection pop-up window can display multiple track options, such as a "Chinese" track option, an "English" track option, and a "Japanese" track option, and each track option has a corresponding check box. In addition, the pop-up window can also display the words "Please select the shared track, only Bluetooth devices that support the LE audio protocol" to prompt the user to select multiple languages for sharing. In response to the selection operation for the "Chinese" track option and the "English" track option, the display device presents Fig.15 The multi-language sharing page shown in (c) in FIG. The multi-language sharing page displays the track identifiers of the Chinese track data corresponding to the selected "Chinese" track option and the English track data corresponding to the "English" track option, such as "Chinese" and "English", that is, the Chinese track data corresponding to the "Chinese" track option and the English track data corresponding to the "English" track option are determined as the track data to be shared by multiple tracks.
[0223] In some examples, the association between the Bluetooth device and the track data may be an association between a track index (i.e., the index information of the track data in the previous text) and a device identifier. One track data uniquely corresponds to one track index. The device identifier is used to uniquely identify the Bluetooth device. Exemplarily, the device identifier may be the MAC address of the Bluetooth device.
[0224] The following takes the second audio track data and the third audio track data among the multiple audio track data of the target resource as an example to illustrate the process of sending the corresponding audio track data to each Bluetooth device according to the pre-established association relationship between the audio track index and the device identifier.
[0225] Specifically, according to the association relationship between the audio track index and the device identifier, the first Bluetooth device corresponding to the second audio track data is determined; the Bluetooth module is controlled to send first Bluetooth broadcast data to the first Bluetooth device based on the first Bluetooth broadcast channel corresponding to the second audio track data, and the first Bluetooth broadcast data is used to broadcast the audio data corresponding to the second audio track data; according to the association relationship, the second Bluetooth device corresponding to the third audio track data is determined; the Bluetooth module is controlled to send second Bluetooth broadcast data to the second Bluetooth device based on the second Bluetooth broadcast channel corresponding to the third audio track data, and the second Bluetooth broadcast data is used to broadcast the audio data corresponding to the third audio track data.
[0226] In some examples, such as Fig.16 As shown, the step of establishing an association relationship between the track index and the device identifier may include:
[0227] S1610, when the audio track data configuration operation is received, controlling the display to present a plurality of device options, wherein the plurality of device options correspond one to one to the plurality of Bluetooth devices.
[0228] The Bluetooth device is a Bluetooth device that supports the low-power audio protocol (i.e., an LE audio device). The device option is used for the user to select the device to be broadcasted via Bluetooth. Exemplarily, when the audio track data configuration operation is received, the display is controlled to present a list of connected Bluetooth devices, and the Bluetooth device list includes multiple device options.
[0229] S1620, in response to a selection operation on a first device option among a plurality of device options, controlling a display to present a plurality of audio track options, wherein the plurality of audio track options correspond one-to-one to the plurality of audio track data.
[0230] The first device option is any one of the multiple device options. The audio track option is used for the user to match the audio track data to be sent for the Bluetooth device corresponding to the selected first device option.
[0231] S1630, in response to a selection operation for a first audio track option among multiple audio track options, the first audio track index and the first device identifier are associated to obtain an association relationship between the audio track index and the device identifier, wherein the first audio track index is the audio track identifier of the audio track data corresponding to the first audio track option, and the first device identifier is the device identifier of the Bluetooth device corresponding to the first device option.
[0232] Exemplarily, the first track index of the track data corresponding to the first track option is obtained, and the first device identifier of the Bluetooth device corresponding to the first device option is obtained, and an association relationship between the first track index and the first device identifier is established. According to the above process, the device identifier of each Bluetooth device is associated with the track index of the track data matching the Bluetooth device, and the association relationship between the track index and the device identifier is obtained, that is, the association relationship between the track data and the Bluetooth device is obtained.
[0233] Of course, after the display presents the track identifiers of each audio track data, you can first select a connected Bluetooth device for multi-track sharing, and match the audio track data for the selected connected Bluetooth device (i.e., establish an association between the audio track index and the device identifier), and then send the corresponding audio track data to the Bluetooth device.
[0234] Specifically, when the track data configuration operation is received, the device management page is displayed, and the connected Bluetooth device (i.e., LE audio device) can be displayed in the device management page. After the connected Bluetooth device is displayed on the device management page, the display device responds to the device selection operation and selects the Bluetooth device 1 (i.e., the first LE audio device, i.e., LE audio device 1) to be configured with the track data from multiple Bluetooth devices. Afterwards, the display device matches the track data 1 (i.e., the first target track) for the Bluetooth device 1 in response to the track configuration operation. In this way, in combination with subsequent steps, the Bluetooth broadcast data corresponding to the track data 1 can be sent to the Bluetooth device 1. In some embodiments, after the display device controls the display to display the device management page, it can also control the Bluetooth module to perform device scanning, and control the display to display the scanned LE audio device on the device management page.
[0235] In actual applications, the display device can also control the Bluetooth module to perform device scanning and control the display to display the scanned LE audio device on the device management page in response to a trigger operation on the device scanning control while controlling the display to display the device management page and display the connected LE audio device on the device management page.
[0236] In the embodiment of the present disclosure, during the process of displaying the scanned LE audio devices on the device management page, upon receiving a connection request for any LE audio device among the scanned LE audio devices, a connection can be established with the LE audio device; after successfully establishing a connection with the scanned LE audio device, the LE audio device can also be displayed in the list of connected devices on the device management page.
[0237] Optionally, after matching the track data for the Bluetooth device, broadcast information corresponding to the track data matched with the Bluetooth device may be sent to the Bluetooth device, so that the Bluetooth device can receive the corresponding Bluetooth broadcast data based on the broadcast information. The broadcast information corresponding to the track data may include address information, device address, broadcast source address, broadcast packet cluster ID number, broadcast ID information, synchronization interval, encryption, broadcast code, rendering delay time, SUB Group information, Android version information and other broadcast parameter information.
[0238] For example, Fig.17 As shown in (a) of FIG. 1 , a device management page is displayed on the display device, and the connected Bluetooth device (LE audio device) is displayed on the device management page. In response to the selection operation for device A (i.e., Bluetooth device 1), a Fig.17The track selection page shown in (b) in FIG. The track selection page may include multiple track options, such as a "Chinese" track option and an "English" track option. In response to the selection operation for the "Chinese" track option, the Chinese track data corresponding to the "Chinese" track option is determined as the track data matched by device A. Of course, after matching the Chinese track data for device A, the broadcast information corresponding to the Chinese track data can be sent to device A, so that device A can receive the Bluetooth broadcast data corresponding to the Chinese track data based on the broadcast information. In this way, in combination with the subsequent steps, the Bluetooth broadcast data corresponding to the Chinese track data can be sent to device A.
[0239] like Fig.17 As shown in (b) of FIG. 1 , the track selection page may further include a “continue selecting device” control. In response to a selection operation on the “continue selecting device” control, a display device presents Fig.17 The device management page shown in (c) in the figure. Fig.17 Compared with the device management page shown in (a) in FIG. 1 , the page displays a prompt "Chinese audio track" for device A to prompt the user that the configuration of the audio track data of device A has been completed. In response to the selection operation for device B, the display device displays Fig.17 The track selection page shown in (d) is used to match the track data for device B.
[0240] In some embodiments, after the display device controls the display to present the device management page, it can also control the Bluetooth module to scan for devices and control the display to display the scanned Bluetooth devices (ie, LE audio devices) on the device management page.
[0241] In actual applications, the display device can also control the Bluetooth module to perform device scanning in response to a trigger operation on the device scanning control while controlling the display to display the device management page and display the connected LE audio device on the device management page, and control the display to display the scanned Bluetooth device (i.e., LE audio device) on the device management page.
[0242] In an embodiment of the present application, during the process of displaying the scanned LE audio device on the device management page, upon receiving a connection request for any Bluetooth device (i.e., LE audio device) among the scanned Bluetooth devices (i.e., LE audio devices), a connection can be established with the Bluetooth device (i.e., LE audio device); after successfully establishing a connection with the scanned Bluetooth device (i.e., LE audio device), the Bluetooth device (i.e., LE audio device) can also be displayed in the list of connected devices on the device management page.
[0243] In some embodiments, after matching the audio track data for the Bluetooth device, the display device can control the Bluetooth module to send Bluetooth broadcast data to multiple Bluetooth devices after receiving a trigger operation of Bluetooth broadcast.
[0244] Exemplary, take Bluetooth device 1 sending Chinese track data as an example, the process of controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices is described. According to the track identifier (such as channelname) corresponding to the Chinese track data, create Bluetooth broadcast channel 1 (i.e. sub group). From the association relationship between the track index and the device information, obtain the device identifier (mac address) of Bluetooth device 1, and generate the Bluetooth device object (BluetoothDevice object) of Bluetooth device 1 according to the device identifier (mac address) of Bluetooth device 1. Send the Bluetooth device object (BluetoothDevice object) of Bluetooth device 1 to the Bluetooth protocol stack, and the Bluetooth protocol stack sends the track index corresponding to the Chinese track data and the Bluetooth device object (BluetoothDevice object) of Bluetooth device 1 to the Bluetooth module. The Bluetooth module sends the Bluetooth broadcast data corresponding to the Chinese track data to Bluetooth device 1 based on the track index corresponding to the Chinese track data and the Bluetooth device object (BluetoothDevice object) of Bluetooth device 1 through Bluetooth broadcast channel 1.
[0245] In an embodiment of the present application, after receiving the audio track data configured for the Bluetooth device 1 in the connected Bluetooth device (i.e., the LE audio device), when the display device receives an audio broadcast trigger operation for at least two audio track data, the broadcast information corresponding to the configured audio track data 1 is sent to the Bluetooth device 1. Furthermore, the Bluetooth device 1 receives the audio data of the audio track data 1 according to the broadcast information corresponding to the configured audio track data 1.
[0246] It can be understood that after obtaining the association relationship between the track index and the device information, a Bluetooth device object (BluetoothDevice object) corresponding to each Bluetooth device is generated according to the device identifier (mac address) of each Bluetooth device in the association relationship.
[0247] In actual applications, in the process of sending multiple Bluetooth broadcast data based on at least two audio track data, there may be a situation where the audio track data selected by the user is Chinese audio track data, but what is actually heard is an English broadcast (that is, the audio data heard by the user is not in the same language as the audio track selected by the user). In order to solve the above technical problem or at least partially solve the above technical problem, the embodiment of the present disclosure controls the Bluetooth protocol stack to encapsulate the decoded audio data corresponding to at least two audio track data into the corresponding BIS stream according to the preset correspondence between the audio track data and the BIS stream, and then sends a broadcast based on the BIS stream, so that the Bluetooth broadcast can be sent more accurately.
[0248] In the embodiment of the present application, for the case where one audio track corresponds to one channel, there is a one-to-one correspondence between the audio track and the BIS stream, for example, BIS1 corresponds to audio track 1, and BIS2 corresponds to audio track 2.
[0249] When one audio track data corresponds to multiple channels, the corresponding relationship between the audio track data and the BIS stream can be expressed in groups or sets, such as Fig.18 As shown, it is a schematic diagram of the mapping relationship between track data and BIS stream provided in an embodiment of the present application. Among them, track data 1 and track data 2 respectively identify audio data of different languages obtained by decoding, such as Chinese audio data and English audio data, track data 1 has a corresponding relationship with subgroup0, and track data 2 has a corresponding relationship with subgroup1; subgroup0 and subgroup1 are different group identifiers, subgroup0 includes BIS0 and BIS1, and subgroup1 includes BIS2 and BIS3.
[0250] Since there is a corresponding relationship between audio track data 1 and subgroup 0, and subgroup 0 includes BIS0 and BIS1, therefore, for example, the left channel of Chinese audio data can be represented by BIS0, and the right channel of audio track data 1 can be represented by BIS1; correspondingly, since there is a corresponding relationship between audio track data 2 and subgroup 1, and subgroup 1 includes BIS2 and BIS3, therefore, BIS2 can be used to represent the left channel of audio track data 2, and BIS3 can be used to represent the right channel of audio track data 2.
[0251] Exemplarily, when an audio broadcast trigger operation for at least two audio track data is received, it means that the user wants to perform bilingual sharing or multilingual sharing. First, the audio module is controlled to decode the target resource to obtain decoded audio data corresponding to each audio track data, such as audio data in Chinese (audio track data 1) and audio data in English (audio track data 2); then the Bluetooth protocol stack is controlled to decode the target resource according to the audio data. Fig.18According to the corresponding relationship shown, the decoded audio data corresponding to the left channel of audio track data 1 is encapsulated into BIS0, the decoded audio data corresponding to the right channel of audio track data 1 is encapsulated into BIS1, the decoded audio data corresponding to the left channel of audio track data 2 is encapsulated into BIS2, and the decoded audio data corresponding to the right channel of audio track data 2 is encapsulated into BIS3, and multiple Bluetooth broadcast data are sent based on BIS0, BIS1, BIS2, and BIS3.
[0252] In some embodiments, before sending the decoded audio data to the Bluetooth protocol stack, the display device can also control the audio decoder to add target header information to the decoded audio data to obtain processed audio data carrying the target header information, and further send the processed audio data to the Bluetooth protocol stack.
[0253] In the disclosed embodiment, since the target header information can encapsulate the audio information of the audio track data corresponding to the decoded audio data, after receiving the processed audio data, the Bluetooth protocol stack can automatically match the BIS stream corresponding to the audio track data according to the target header information carried in the processed audio data, thereby issuing a Bluetooth broadcast more accurately.
[0254] Exemplarily, assuming that the target resource includes two audio track data in Chinese and English, where the Chinese audio track data includes a left channel and a right channel, and the English audio track data includes a left channel and a right channel, then BIS0 corresponding to the left channel of the Chinese audio track data, BIS1 corresponding to the right channel of the Chinese audio track data, BIS2 corresponding to the left channel of the English audio track data, and BIS3 corresponding to the right channel of the English audio track data can be encapsulated in the target header information to obtain processed audio data carrying the target header information.
[0255] In other embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, corresponding BIS streams can be set for at least two audio track data respectively; further, after sending the processed audio data to the Bluetooth protocol stack, the Bluetooth protocol stack is controlled to determine the corresponding BIS stream based on the audio track information encapsulated in the target header information of the received processed audio data, encapsulate the processed audio data into the BIS stream, and send the Bluetooth broadcast data based on the BIS stream.
[0256] For example, assuming that the target header information of the processed audio data contains track information such as "track data 1-BIS0, track data 2-BIS2", after receiving the above track information, the Bluetooth protocol stack will encapsulate the audio data of track data 1 in BIS0, and the audio data of track data 2 in BIS1, and send out multiple Bluetooth broadcast data based on BIS0 and BIS2.
[0257] It can be seen that the embodiment of the present disclosure can automatically match the corresponding BIS stream for the audio track data by adding header information to the decoded audio data, thereby sending out Bluetooth broadcast data more accurately.
[0258] In some embodiments, before the display device controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the display device may further include: controlling the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel.
[0259] In the embodiment of the present application, the audio channel may include a local speaker output channel, a Universal Serial Bus (USB) audio output channel, a High Definition Multimedia Interface (HDMI) output channel and other more traditional output channels, and may also include an audio output channel established based on a unicast media sender (Broadcast Media Sender, BMS), etc. The current audio channel may be any one of the above audio output channels.
[0260] In actual applications, when the display device controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, it first controls the sound output device to mute, and then switches the current audio channel to the Bluetooth broadcast channel. After the switch is successful, it controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices.
[0261] The display device can also first switch the current audio channel to the Bluetooth broadcast channel when controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and control the sound output device to mute after the switching is successful, and control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices.
[0262] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices may include: when determining that the Bluetooth module switches to a Bluetooth broadcast channel, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and controlling the player to replay the video data from the start time of the video.
[0263] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data, and obtaining playback progress information of the video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices may include: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, controlling the player to replay the video data according to the playback progress information, and processing the audio data corresponding to the multiple audio track data of the target resource according to the playback progress information, and controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices based on multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
[0264] In actual applications, when the display device controls the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel, there may be a problem that the audio data is inconsistent with the playback progress of the target resource. In order to solve the above technical problems or at least partially solve the above technical problems, the embodiment of the present application can also control the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel when controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices; then control the player to pause playing the target audio and video resources, and obtain the playback progress information of the target resources; further, when it is determined that the Bluetooth broadcast channel is switched successfully, restart the audio decoder and the video decoder, control the audio decoder to decode the audio data corresponding to the multiple audio track data of the target resource according to the playback progress information, and send the decoded audio data to the Bluetooth protocol stack, so that the Bluetooth protocol stack can call the Bluetooth module through the Bluetooth driver to send multiple Bluetooth broadcast data to multiple Bluetooth devices. And, control the video decoder to decode the video data according to the playback progress information.
[0265] In the embodiment of the present application, the audio decoder is an audio decoder, which is mainly used to decode the compressed audio data into the original digital audio signal. After the audio decoder decodes the target resource to obtain Chinese audio data, English audio data and other data, the decoded audio data can be sent to the audio processor or audio output device for playback. The video decoder is a video decoder, which is used to decode the compressed video data into the original video image sequence. Specifically, it can decode the target audio and video resources and restore the image frame rate, resolution and other video data for subsequent video processing and display. The Bluetooth protocol stack is used to send multiple Bluetooth broadcasts based on the decoded audio data.
[0266] In an embodiment of the present application, the playback progress information of the target resource may include information such as the current playback time of the target resource. After obtaining the playback progress information of the target resource, the audio decoder can be controlled to decode the target resource according to the playback progress information, and the decoded audio data can be sent to the Bluetooth protocol stack, so that the Bluetooth protocol stack can send multiple Bluetooth broadcast data based on the decoded audio data, thereby realizing the function of simultaneously broadcasting multiple audio track data for the same audio and video resources.
[0267] Exemplarily, when an audio broadcast trigger operation for at least two audio track data is received, the player is controlled to pause playing the target resource. Assuming that the target resource is paused at 30 seconds of playback, when it is determined that the Bluetooth broadcast switch is successful, the audio decoder is restarted and the audio decoder is controlled to start decoding the target resource from the 30th second to achieve the effect of keeping the playback progress of the audio data and the target resource consistent.
[0268] The embodiment of the present application does not limit the execution order of the above steps. For example, the step of "controlling the player to pause playing video data" can be executed first, and then the step of "controlling the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel" can be executed; or the step of "controlling the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel" can be executed first, and then the step of "controlling the player to pause playing video data" can be executed. One or more steps can also be added before the above steps at the same time. For example, before the step of "controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices", steps such as "restarting the audio decoder" or "restarting the audio decoder and video decoder" can be added.
[0269] In some embodiments, after controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the method may also include: when a second preset condition is met, controlling the Bluetooth module to stop sending multiple Bluetooth broadcast data to multiple Bluetooth devices, controlling the player to pause playing video data, and obtaining playback progress information of the video data; based on the playback progress information, controlling the player to replay the video data, and the sound output device to output the first audio data.
[0270] The second preset condition is used to determine whether to exit the sharing of multi-track data. Exemplarily, the second preset condition includes at least one of the following: receiving an instruction to exit the sharing of multi-track data; detecting that the Bluetooth module is switched to the off state; detecting that the player is switched to the background operation; receiving an operation to stop playing the target resource.
[0271] In the audio broadcasting method provided by the embodiment of the present application, when the video data of the target resource is presented on the display, and the sound output device is controlled to output the first audio data of the target resource, in response to the first operation, the track information of the target resource is obtained, and the number of tracks of the target resource is determined according to the track information; when the number of tracks meets the first preset condition, the display is controlled to present a multi-track sharing control; in response to the selection operation for the multi-track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and the multiple Bluetooth broadcast data correspond to the multiple Bluetooth devices one by one, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one track data of the target resource. In this way, the embodiment of the present application can send Bluetooth broadcast data corresponding to different track data for different Bluetooth devices, so as to realize the function of synchronous playback of multiple track data for the same audio and video resource by using audio broadcasting, which can improve the broadcasting efficiency. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource.
[0272] Fig.19 A flowchart of another audio broadcasting method provided in an embodiment of the present application. Fig.19 As shown, the audio broadcasting method may include the following steps:
[0273] S1910, presenting video data of the target resource on a display, and controlling a sound output device to output first audio data of the target resource.
[0274] The target resource may be an audio or video resource selected by the user and currently to be played. In the embodiment of the present application, the target resource may include one or more audio track data, and the audio track data is used to indicate the audio data included in the target resource, that is, different audio track data correspond to different audio data.
[0275] The first audio data refers to audio data corresponding to the audio track data output by the sound output device when the display device plays the video data of the target resource.
[0276] Specifically, the specific implementation method of S1910 can refer to the specific implementation method of S1210 mentioned above, and will not be repeated here to avoid repetition.
[0277] S1920: In response to the first operation, obtain audio track information of the target resource.
[0278] Among them, the first operation is the call-up operation of the audio track menu.
[0279] The audio track information of the target resource may include index information, language type information, audio track type information and audio track format information. Among them, the index information is used to indicate the storage location corresponding to the audio track data, that is, the storage location of the audio data corresponding to the audio track data. The language type information is used to indicate the language type of the audio data corresponding to the audio track data. For example, the voice type information of audio track data 1 is Chinese, the voice type information of audio track data 2 is English, and the voice type information of audio track data 3 is French. The audio track type information is used to distinguish between audio track data and subtitle data. The audio track format information is used to indicate the format type of the audio data corresponding to the audio track data.
[0280] Wherein, the audio track format information is used to indicate the format type of the audio data corresponding to the audio track data. Wherein, in some examples, according to the technical characteristics, the format type of the audio data may include a lossy compression format, a lossless compression format and a multi-channel audio format. Wherein, the lossy compression format may include, for example, an MPEG-2 audio coding format, an MPEG-4 audio coding format, an AC-3 audio coding format and an EAC-3 audio coding format. The lossless compression format may include, for example, a DTS-LBR audio coding format and a DTS-HD Master Audio audio coding format. The multi-channel audio format may include, for example, an AC-4 audio coding format, a DTS-HD audio coding format, an AC-3 audio coding format, an EAC-3 audio coding format, a DTS-HD audio coding format and a DTS audio coding format.
[0281] In other examples, according to the application scenario, the format type of audio data may include a home theater system format, a DVD video format, a digital video and streaming media format, and a high-quality audio transmission format. Among them, the home theater system format may include, for example, an AC-4 audio coding format, an AC-3 audio coding format, an EAC-3 audio coding format, a DTS-HD audio coding format, and a DTS-HD Master Audio audio coding format. The DVD video format may include, for example, an MPEG-2 audio coding format and a DTS audio coding format. The digital video and streaming media format may include, for example, an MPEG-4 audio coding format. The high-quality audio transmission format may include, for example, a DTS-LBR audio coding format.
[0282] It should be noted that different formats of audio data correspond to different decoding types. For example, the decoding types of AC-4 audio encoding format, DTS-HD audio encoding format, DTS-LBR audio encoding format, and DTS-True-HD audio encoding format are only hardware decoding types (referred to as hard decoding types). In contrast, the decoding types of MPEG-2 audio encoding format, MPEG-4 audio encoding format, AC-3 audio encoding format, EAC-3 audio encoding format, and DTS audio encoding format can be software decoding types (referred to as soft decoding types) or hardware decoding types.
[0283] Specifically, for the specific implementation method of S1920, please refer to the specific implementation method of S1220 mentioned above. To avoid repetition, it will not be repeated here.
[0284] S1930: Determine the number of audio tracks of the target resource and the decoding type of the audio track data of the target resource according to the audio track information.
[0285] In some embodiments, determining the decoding type of the audio track data of the target resource based on the audio track information may include: determining the decoding type corresponding to each audio track data based on the audio track format information corresponding to each audio track data in the audio track information, that is, determining the decoding type of the audio track data of the target resource.
[0286] Specifically, the specific implementation method of "determining the number of audio tracks of the target resource according to the audio track information" in S1930 can be referred to the specific implementation method of the aforementioned S1230, and will not be repeated here to avoid repetition.
[0287] S1940: When the number of audio tracks meets the first preset condition and the decoding type of the audio track data of the target resource meets the third preset condition, control the display to present a multi-audio track sharing control.
[0288] Among them, the multi-audio track sharing control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, or to trigger the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices. The multiple Bluetooth broadcast data correspond one-to-one to multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource.
[0289] The first preset condition is whether the target resource meets the condition of multi-track sharing. In some examples, the first preset condition may include at least one of the following: the number of tracks is greater than a first preset number (also referred to as a preset number threshold); the number of tracks is equal to the first preset number. Exemplarily, the first preset number is 2.
[0290] In some examples, the length of the track information list can be used to determine whether the number of tracks of the target resource is greater than or equal to a first preset number. Specifically, after obtaining the track information list of the target resource, determine whether the length of the track information list of the target resource is greater than or equal to the preset length. If the length of the track information list of the target resource is greater than or equal to the preset length, it means that the number of tracks of the target resource is greater than or equal to the first preset number, that is, the number of tracks meets the first preset condition. At this time, the control display presents a multi-track sharing control. If the length of the track information list of the target resource is less than the preset length, it means that the number of tracks of the target resource is less than the first preset number, that is, the number of tracks does not meet the first preset condition. At this time, the multi-track sharing control is not displayed.
[0291] In some embodiments, when the number of audio tracks meets the first preset condition, it is determined whether the decoding type of the audio track data of the target resource meets the third preset condition. If the decoding type of the audio track data of the target resource meets the third preset condition, the display is controlled to present a multi-audio track sharing control.
[0292] Among them, the third preset condition may include that the multiple track data of the target resource include at least two types of track data. Among them, the decoding type may include a first decoding type, a second decoding type and a third decoding type. The first decoding type indicates that the audio data corresponding to the track data can only be decoded by hardware, that is, a hardware decoding type. The second decoding type indicates that the audio data corresponding to the track data can only be decoded by software, that is, a software decoding type. The third decoding type indicates that the audio data corresponding to the track data can be decoded by software or by software, that is, a hardware-decoding and a software-decoding type.
[0293] Exemplarily, the third preset condition may be that the number of audio tracks of the target resource is not equal to the number of fourth audio track data, and the number of audio tracks is not equal to the number of fifth audio track data, wherein the decoding type of the fourth audio track data is the first decoding type (i.e., hardware decoding type), and the decoding type of the fifth audio track data is the second decoding type (i.e., software decoding type).
[0294] Fig. 20 The following is a flow chart of the audio broadcasting method provided in the embodiment of the present application. Fig. 20 As shown, the process of displaying multi-track sharing controls may include the following steps:
[0295] S2001, obtain the number of audio tracks of the target resource.
[0296] S2002, determine whether the number of audio tracks of the target resource is greater than or equal to a first preset number (such as 2), if so, execute S2003, otherwise, execute S2007.
[0297] S2003, determining the amount of fourth audio track data in the target resource, and determining the amount of fifth audio track data in the target resource.
[0298] S2004, determine whether the number of audio tracks of the target resource is equal to the number of fourth audio track data, if so, execute S2007, otherwise, execute S2005.
[0299] S2005, determine whether the number of audio tracks of the target resource is equal to the number of fifth audio track data, if so, execute S2007, otherwise, execute S2006.
[0300] That is to say, when it is determined that the number of audio tracks of the target resource is greater than or equal to the first preset number (such as 2), it is determined whether the number of audio tracks of the target resource is equal to the number of data of the fourth audio track, and whether the number of audio tracks of the target resource is equal to the number of data of the fifth audio track. If the number of audio tracks of the target resource is not equal to the number of data of the fourth audio track, and the number of audio tracks of the target resource is not equal to the number of data of the fifth audio track, it means that the decoding type of the audio track data of the target resource is not all the first decoding type (i.e., the hardware decoding type), nor is it all the second decoding type (i.e., the software decoding type), that is, the decoding type of the audio track data of the target resource meets the third preset condition, at this time, the control display presents a multi-track sharing control. Otherwise, it means that the decoding type of the audio track data of the target resource is all the first decoding type (i.e., the hardware decoding type), or the decoding type of the audio track data of the target resource is all the second decoding type (i.e., the software decoding type), at this time, the decoding type of the audio track data of the target resource does not meet the third preset condition, does not support multi-track sharing, and the multi-track sharing control is not displayed at this time.
[0301] S2006, controlling the display to present multi-track display controls.
[0302] S2007: It is determined that multi-track sharing is not supported, that is, the multi-track display control is not displayed.
[0303] Please continue to see Fig.14 ,like Fig.14 As shown in (a), the video data of the target resource is presented on the display, that is, the playback page of the audio and video resource is displayed. In response to the audio track menu call-up operation (i.e., the first operation) input by the user, the audio track information of the target resource is obtained, and the number of audio tracks of the target resource is determined based on the audio track information, and then it is determined whether the number of audio tracks of the target resource is greater than or equal to the first preset number (e.g., 2). If the number of audio tracks of the target resource is greater than or equal to the first preset number (e.g., 2), it is determined whether the number of audio tracks of the target resource is equal to the number of the fourth audio track data, and it is determined whether the number of audio tracks of the target resource is equal to the number of the fifth audio track data. If the number of audio tracks of the target resource is not equal to the number of the fourth audio track data, and the number of audio tracks of the target resource is not equal to the number of the fifth audio track data, the display is controlled to display as shown. Fig.14 The track menu page shown in (b) in FIG. The track menu page displays a multi-track sharing control, such as a "bilingual sharing" control. Otherwise, multi-track sharing is not supported, and the "bilingual sharing" control is not displayed.
[0304] S1950: In response to a selection operation on a multi-track sharing control, control the sound output device to stop outputting the first audio data.
[0305] In some examples, in response to a selection operation on a multi-track sharing control, the first application may send a pause instruction to the player to instruct the player to pause playing the video data of the target resource. In this way, after the user enters the multi-track sharing interface, the video data of the target resource is paused to avoid affecting the user's viewing experience. Furthermore, it can be avoided that the sharing of multi-track data cannot operate normally due to the end of the playback of the video data of the target resource.
[0306] Specifically, the specific implementation method of S1950 can refer to the specific implementation method of S1250 mentioned above, and will not be repeated here to avoid repetition.
[0307] S1960, control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond to the multiple Bluetooth devices one by one, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data of the target resource.
[0308] In some embodiments, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices may include: if the number of audio tracks is not greater than a second preset number, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices; if the number of audio tracks is greater than the second preset number, determining a first number of first audio track data from multiple audio track data of the target resource, and controlling the Bluetooth module to send Bluetooth broadcast data to the first number of Bluetooth devices, the Bluetooth broadcast data corresponding to one Bluetooth device being used to broadcast audio data corresponding to one first audio track data in the first number of first audio track data.
[0309] Among them, the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared audio tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0310] Among them, the number of audio track data of the first number of first audio track data whose decoding type belongs to the first decoding type (i.e., hardware decoding type) is less than or equal to the third preset number, and the number of audio track data of the first number of first audio track data whose decoding type belongs to the second decoding type (i.e., software decoding type) is less than or equal to the fourth preset number. And, the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
[0311] Optionally, the third preset number may be determined based on the performance of a hardware chip (such as a Bluetooth module and a player) of the display device. The fourth preset number may be determined based on the performance of a hardware chip (such as a Bluetooth module and a player) of the display device.
[0312] Exemplarily, the second preset number is 2, the first number is 2, the third preset number is 1, and the fourth preset number is 1. That is, the display device supports one hardware decoding and one software decoding at the same time.
[0313] In this regard, the steps of determining a first number of first audio track data from multiple audio track data of the target resource, and controlling the Bluetooth module to send Bluetooth broadcast data to a first number of Bluetooth devices may include: determining two first audio track data from multiple audio track data of the target resource, and controlling the Bluetooth module to send Bluetooth broadcast data to two Bluetooth devices, one Bluetooth broadcast data being used to broadcast audio data corresponding to one first audio track data; wherein, the decoding types of the two first audio track data are different.
[0314] Exemplarily, the decoding type of one of the two first audio track data is the first decoding type (i.e., hardware decoding type), and the decoding type of the other first audio track data is the second decoding type (i.e., software decoding type). Exemplarily, the decoding type of one of the two first audio track data is the first decoding type (i.e., hardware decoding type) or the second decoding type (i.e., software decoding type), and the decoding type of the other first audio track data is the third decoding type (i.e., hardware-decoding type or software-decoding type).
[0315] In addition, when the number of tracks of the target resource is not greater than the second preset number, the display can be controlled to present track identifiers of multiple track data of the target resource, and the multiple track identifiers correspond one-to-one to the multiple track data of the target resource, and then the Bluetooth module can be controlled to send Bluetooth broadcast data to multiple Bluetooth devices. In this embodiment, by presenting the track identifiers of the track data on the display, the user can be prompted to share the multiple track data and to perform the sharing operation of the multiple track data.
[0316] Exemplarily, the track identifier is used to present relevant information of the track data that can be shared by multiple tracks to the user. Exemplarily, the track identifier may include the track name (CHANNEL NAME) of the track data, wherein the track name can usually be represented by the language type information of the track data, such as Chinese, English. Exemplarily, the track identifier may also be a global variable generated based on the track information of the track data. For example, English (ENG-TVAUDIOSHARE), Chinese (CHN-TVAUDIOSHARE).
[0317] More specifically, the step of determining two first audio track data from multiple audio track data of the target resource may include: in response to a selection operation on a second audio track identifier among multiple audio track identifiers, determining the audio track data corresponding to the second audio track identifier as the first audio track data, and controlling the display to present at least one third audio track identifier, wherein the third audio track identifier includes the audio track identifiers of the audio track data among the multiple audio track data except the audio track data corresponding to the second audio track identifier, and the decoding type of the audio track data corresponding to the third audio track identifier is different from the decoding type of the audio track data corresponding to the second audio track identifier; in response to a selection operation on a fourth audio track identifier among the at least one third audio track identifier, determining the audio track data corresponding to the fourth audio track identifier as the first audio track data.
[0318] That is to say, after the user selects an audio track data to be shared, the display device can determine the remaining audio track data available for the user to select based on the decoding type of the selected audio track data, and present the corresponding audio track identifier on the display device to facilitate the user to select other audio track data to be shared, thereby ensuring that the selected audio track data meets the restrictions of the decoding type conditions, thereby realizing the sharing function of multiple audio track data.
[0319] In some embodiments, according to the pre-established association relationship between the Bluetooth device and the audio track data, the Bluetooth module can be controlled to send Bluetooth broadcast data corresponding to the audio track data matched with the Bluetooth device.
[0320] In some examples, the association between the Bluetooth device and the track data may be an association between a track index (i.e., the index information of the track data in the previous text) and a device identifier. One track data uniquely corresponds to one track index. The device identifier is used to uniquely identify the Bluetooth device. Exemplarily, the device identifier may be the MAC address of the Bluetooth device.
[0321] The following takes the second audio track data and the third audio track data among the multiple audio track data of the target resource as an example to illustrate the process of sending the corresponding audio track data to each Bluetooth device according to the pre-established association relationship between the audio track index and the device identifier.
[0322] Specifically, according to the association relationship between the audio track index and the device identifier, the first Bluetooth device corresponding to the second audio track data is determined; the Bluetooth module is controlled to send first Bluetooth broadcast data to the first Bluetooth device based on the first Bluetooth broadcast channel corresponding to the second audio track data, and the first Bluetooth broadcast data is used to broadcast the audio data corresponding to the second audio track data; according to the association relationship, the second Bluetooth device corresponding to the third audio track data is determined; the Bluetooth module is controlled to send second Bluetooth broadcast data to the second Bluetooth device based on the second Bluetooth broadcast channel corresponding to the third audio track data, and the second Bluetooth broadcast data is used to broadcast the audio data corresponding to the third audio track data.
[0323] In some examples, the step of establishing an association relationship between a track index and a device identifier may include: upon receiving a track data configuration operation, controlling a display to present multiple device options, the multiple device options corresponding one-to-one to multiple Bluetooth devices, and the multiple Bluetooth devices being Bluetooth devices that support a low-power audio protocol; in response to a selection operation for a first device option among the multiple device options, controlling a display to present multiple track options, the multiple track options corresponding one-to-one to multiple track data; in response to a selection operation for a first track option among the multiple track options, associating a first track index with a first device identifier to obtain an association relationship between the track index and the device identifier, wherein the first track index is the track identifier of the track data corresponding to the first track option, and the first device identifier is the device identifier of the Bluetooth device corresponding to the first device option.
[0324] According to the above process, the device identification of each Bluetooth device is associated with the track index of the track data matching the Bluetooth device to obtain the association relationship between the track index and the device identification, that is, the association relationship between the track data and the Bluetooth device is obtained.
[0325] In some examples, the step of creating a Bluetooth broadcast channel may include: creating a first Bluetooth broadcast channel based on the track identifier and decoding type corresponding to the second audio track data; creating a second Bluetooth broadcast channel based on the track identifier and decoding type corresponding to the third audio track data.
[0326] Specifically, the track identifier (channel name) of the second track data is written into the Bluetooth broadcast channel (subgroup object), and the track identifier (channel name) of the third track data is written into the Bluetooth broadcast channel (subgroup object), and a Bluetooth broadcast channel list (i.e., subgroupList) is obtained. Among them, the Bluetooth broadcast channel list includes the Bluetooth broadcast channels (subgroup objects) corresponding to each target track data. It is understandable that in the Bluetooth broadcast channel list, the subgroup object of the track data whose decoding type is the first decoding type (i.e., hardware decoding type) is ranked first, and the subgroup object of the track data whose decoding type is the second decoding type (i.e., software decoding type) is ranked second.
[0327] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the method also includes: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices may include: when determining that the Bluetooth module switches to a Bluetooth broadcast channel, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and controlling the player to replay the video data from the start time of the video.
[0328] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data, and obtaining playback progress information of the video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices may include: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, controlling the player to replay the video data according to the playback progress information, and processing the audio data corresponding to the multiple audio track data of the target resource according to the playback progress information, and controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices based on multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
[0329] In some embodiments, after controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the method may further include: when a second preset condition is met, controlling the Bluetooth module to stop sending multiple Bluetooth broadcast data to multiple Bluetooth devices, controlling the player to pause playing video data, and obtaining playing progress information of the video data; based on the playing progress information, controlling the player to replay the video data, and the sound output device to output the first audio data;
[0330] Among them, the second preset condition includes at least one of the following: receiving an instruction to exit multi-track sharing; detecting that the Bluetooth module is switched to the off state; detecting that the player is switched to background operation; receiving an operation to stop playing the target resource.
[0331] Specifically, the above process of the player replaying video data and exiting multi-track data sharing can be referred to the specific implementation method in the aforementioned S1260. To avoid repetition, it will not be repeated here.
[0332] In the audio broadcasting method provided in the embodiment of the present application, when the video data of the target resource is presented on the display and the sound output device is controlled to output the first audio data of the target resource, in response to a first operation, the audio track information of the target resource is obtained, and the number of audio tracks of the target resource and the decoding type of the audio track data of the target resource are determined according to the audio track information; when the number of audio tracks meets a first preset condition and the decoding type of the audio track data of the target resource meets a third preset condition, the display is controlled to present a multi-audio track sharing control; in response to a selection operation on the multi-audio track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data of the target resource. In this way, when the number of audio track data of the target resource meets the conditions and the decoding type of the audio track data meets the conditions, a multi-track sharing control can be presented, and then, after receiving the selection operation for the multi-track sharing control, the Bluetooth module is controlled to send Bluetooth broadcast data corresponding to different audio track data to different Bluetooth devices, so that the function of synchronous playback of multi-track data for the same audio and video resource can be realized by audio broadcasting, which can improve the broadcast efficiency. And, it can be applicable to display devices with different hardware capabilities. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource.
[0333] Combine the following Fig.21 and Fig. 22 , the interaction process between the various modules of the display device during the implementation of the audio broadcasting method provided in the embodiment of the present application is explained.
[0334] Fig.21 The following is a schematic diagram of the interactive process of the audio broadcasting method provided in the embodiment of the present application. Fig.21 As shown, the audio broadcasting method may include the following steps:
[0335] A1. A first application at an application layer receives a selection operation for a target resource among multiple media resources.
[0336] The first application may be the media center APP in the aforementioned embodiment, or may be a third-party audio and video application installed on the display device.
[0337] The target resource (also referred to as the target audio and video resource) can be the audio and video resource selected by the user and currently to be played. In an embodiment of the present application, the target resource may include one or more track data, and the track data is used to indicate the audio data included in the target resource, that is, the audio data corresponding to different track data is different. Exemplarily, the language type (i.e., language) of the audio data corresponding to different track data is different, that is, one track data corresponds to audio data of one language type. For example, taking the target resource including three track data (i.e., track data 1, track data 2, and track data 3) as an example, the language type of the audio data corresponding to track data 1 is Chinese (track data 1 corresponds to Chinese audio data), the language type of the audio data corresponding to track data 2 is English (track data 2 corresponds to English audio data), and the language type of the audio data corresponding to track data 3 is French (track data 2 corresponds to French audio data). A2, in response to the selection operation for the target resource, the first application sends the storage address of the target resource to the player of the framework layer.
[0338] A3, after receiving the storage address of the target resource sent by the first application, the player parses the target resource based on the storage address of the target resource to obtain the video data of the target resource, the audio data corresponding to one of the audio track data (ie, the first audio data), and the audio track information of the target resource.
[0339] The first audio data refers to the audio data corresponding to the audio track data output by the sound output device when the display device plays the video data of the target resource. Specifically, when the target resource includes one audio track data, the first audio data is the audio data corresponding to the audio track data. When the target resource includes multiple audio track data, the first audio data can be the audio data corresponding to any one of the multiple audio track data. For example, taking the example that the target resource includes audio track data 1 and audio track data 2, where audio track data 1 corresponds to Chinese audio data and audio track data 2 corresponds to English audio data, the first audio data can be the audio data corresponding to audio track data 1, that is, Chinese audio data.
[0340] The audio track information of the target resource may include index information, language type information, audio track type information and audio track format information. Among them, the index information is used to indicate the storage location corresponding to the audio track data, that is, the storage location of the audio data corresponding to the audio track data. The language type information is used to indicate the language type of the audio data corresponding to the audio track data. For example, the voice type information of audio track data 1 is Chinese, the voice type information of audio track data 2 is English, and the voice type information of audio track data 3 is French. The audio track type information is used to distinguish between audio track data and subtitle data. The audio track format information is used to indicate the format type of the audio data corresponding to the audio track data.
[0341] A4: The player sends the video data of the target resource to the first application.
[0342] A5. After receiving the video data of the target resource sent by the player, the first application presents the video data of the target resource.
[0343] A6: The first application receives the first operation.
[0344] The first operation is an operation of invoking the track menu. For example, the first operation may be a user pressing a menu key of a control device. For example, the first operation may also be a voice command input by the user to invoke the track menu.
[0345] A7. In response to the first operation, the first application sends an audio track information acquisition instruction to the player.
[0346] A8. After receiving the audio track information acquisition instruction sent by the first application, the player sends the audio track information of the target resource to the first application.
[0347] A9, after receiving the audio track information of the target resource sent by the player, the first application determines the number of audio tracks of the target resource according to the audio track information of the target resource.
[0348] A10, the first application determines whether the number of audio tracks of the target resource is greater than or equal to a first preset number. If the number of audio tracks of the target resource is greater than or equal to the first preset number, execute A11, otherwise, execute A12.
[0349] Exemplarily, the first preset number is 2.
[0350] A11, the first application generates and displays multi-track sharing controls.
[0351] Exemplarily, the multi-track sharing control may be a “multi-language sharing” control.
[0352] A12, the first application does not generate multi-track sharing controls.
[0353] A1-A12 above are the process of displaying multi-track controls.
[0354] A13, the first application receives a selection operation for a multi-track sharing control.
[0355] A14, in response to a selection operation for the multi-track sharing control, if the number of tracks is equal to a second preset number, the first application displays a first interface (i.e., a multi-language sharing page), and the first interface may include a second broadcast control. The second broadcast control is used to trigger the Bluetooth module to send Bluetooth broadcast data to multiple Bluetooth devices.
[0356] After receiving a selection operation for the multi-track sharing control, it is determined whether the number of tracks is equal to a second preset number (such as 2). If the number of tracks is equal to the second preset number (such as 2), the first application presents a first interface (ie, a multilingual sharing interface).
[0357] The first interface may include multiple track identifiers corresponding to multiple track data of the target resource. The second preset number is the number of track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0358] The first interface may also include a first broadcast control, wherein the first broadcast control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, and one Bluetooth broadcast data corresponds to one audio track data among multiple audio track data.
[0359] A15. The first application sends a pause playback instruction to the player.
[0360] A16: After receiving the pause instruction sent by the first application, the player pauses playing the video data of the target resource.
[0361] In some examples, the player may obtain playback progress information of the video data of the target resource.
[0362] A17, in response to a selection operation on a multi-track sharing control, if the number of tracks is greater than a second preset number, the first application displays a second interface (ie, a track selection pop-up window).
[0363] After receiving a selection operation for a multi-track sharing control, it is determined whether the number of tracks is greater than a second preset number (such as 2). If the number of tracks is greater than the second preset number (such as 2), the first application presents a second interface (i.e., a track selection pop-up window). The second interface includes a plurality of third track options, and the plurality of third track options correspond one-to-one to a plurality of track data of the target resource, and the second preset number is the number of track data that the Bluetooth module supports to be broadcast simultaneously.
[0364] A18, in response to the audio track selection operation, the first application displays a third interface (ie, a multilingual sharing page), and the third interface may include a second broadcast control. The second broadcast control is used to trigger the Bluetooth module to send Bluetooth broadcast data to multiple Bluetooth devices.
[0365] Exemplarily, the audio track selection operation may be an operation of selecting two third audio track options among a plurality of third audio track options.
[0366] Exemplarily, the third interface includes two track identifiers, wherein one of the two track identifiers corresponds to the track data corresponding to the selected third track option. The third interface may also include a first broadcast control, wherein the first broadcast control is used to trigger the Bluetooth module to send a first amount of Bluetooth broadcast data, and one Bluetooth broadcast data corresponds to one track data in the first amount of track data.
[0367] A1-A18 above are schematic illustrations of the process of displaying multi-track sharing controls and selecting the track data to be broadcast. Fig. 22 Taking the synchronous broadcasting of two target audio track data as an example, the process of matching audio track data for a Bluetooth device and sending Bluetooth broadcast data corresponding to the audio track data to the Bluetooth device is schematically explained.
[0368] A19, the first application receives a selection operation on the second broadcast control.
[0369] A20, in response to the selection operation on the second broadcast control, the first application sends a start instruction to the Bluetooth setting application, where the start instruction includes the track identifiers (channel names) of the two target track data.
[0370] The target audio track data refers to any audio track data indicated in the association relationship between the audio track index and the device identifier, that is, the audio track data to be shared by multiple audio track data.
[0371] Exemplarily, the track identifier of the target track data can be represented by a track identifier list (channel names). That is to say, the Bluetooth broadcast information may include a track identifier list, and the track identifier list may include the track identifier of each target track data in the multiple target track data. It should be noted that the track identifiers of the multiple target track data can be arranged in a preset order. For example, in the track identifier list, the track identifier of the track data whose decoding type is the first decoding type (i.e., hardware decoding type) is ranked first, and the track identifier of the track data whose decoding type is the second decoding type (i.e., software decoding type) is ranked second.
[0372] A21, the Bluetooth setting application matches the audio track data for the two target Bluetooth devices in response to the start instruction.
[0373] The target Bluetooth device is a Bluetooth device selected by the user to receive the target audio track data.
[0374] Exemplarily, in response to the start instruction, the Bluetooth setting application presents a device management page, which includes two device options. The two device options correspond one-to-one to the two connected Bluetooth devices, and the two Bluetooth devices are Bluetooth devices that support the low-power audio protocol. In response to the selection operation for Bluetooth device 1, the Bluetooth setting application presents a track selection page for Bluetooth device 1, and the track selection page includes at least two track options corresponding to the first track data. In response to the selection operation for track data 1, track data 1 is matched for Bluetooth device 1. Repeating the aforementioned process can match corresponding track data for each target Bluetooth device.
[0375] A22. The Bluetooth settings application establishes an association between the track index and the device identifier (ie, device channelmap).
[0376] Exemplarily, taking the establishment of an association relationship between Bluetooth device 1 and track data 1 as an example, the Bluetooth setting application determines the track identifier corresponding to track data 1, and based on the association relationship between the track identifier and the track index (index), determines the track index of track data 1. The Bluetooth setting application determines the device identifier (mac address) of Bluetooth device 1. Afterwards, the Bluetooth setting application establishes an association relationship between the track index of track data 1 and the device identifier of Bluetooth device 1. Repeating the aforementioned process, an association relationship between each target Bluetooth device and its corresponding track data can be established.
[0377] Specifically, the association between the track index (index) and the device identifier (mac address) is stored in the form of a HashMap. For example, the HashMap definition is as follows:<String,Integer> , where String stores the device mac address and Integer stores the track index. In addition, after generating the HashMap, convert the HashMap into a json object.
[0378] For example, if the Bluetooth device is a Bluetooth headset, the MAC address of the left headset is "14:0a:29:f6:38:52", and the MAC address of the right headset is "14:0a:29:f6:3a:4a", and the track index of the matched track data is 3. For this, the generated HashMap information is as follows:
[0379] HashMap<String,Integer> map = new HashMap<String,Integer> ();
[0380] map.put("14:0a:29:f6:38:52",3)
[0381] map.put("14:0a:29:f6:3a:4a",3)
[0382] The converted json object is {"14:0a:29:f6:38:52":3,"14:0a:29:f6:3a:4a":3}.
[0383] A23, the Bluetooth setting application sends the association relationship between the audio track index and the device identifier (ie, device channel map) to the first application.
[0384] Specifically, the Bluetooth setting application sends a JSON object of the association relationship between the track index and the device identifier (ie, device channel map) to the first application.
[0385] A24, after receiving the association relationship between the audio track index and the device identifier (i.e., device channelmap), the first application sends Bluetooth broadcast information to the Bluetooth protocol stack, where the Bluetooth broadcast information includes the association relationship between the audio track index and the device identifier, and the audio track identifier corresponding to the target audio track data.
[0386] In some examples, the Bluetooth broadcast information may also include a Bluetooth broadcast name (broadcastName) and a Bluetooth broadcast password (broadcastCode). The Bluetooth broadcast name may be, for example, the device name of a display device, such as "Zhang San's" TV.
[0387] Specifically, the first application sends Bluetooth broadcast information to the Bluetooth protocol stack by calling the startMultiTrackBroadcast() function.
[0388] A25, the Bluetooth protocol stack sends a Bluetooth broadcast message to the Bluetooth module.
[0389] Specifically, the Bluetooth protocol stack interacts with the Bluetooth module by calling the Bluetooth driver and sends a Bluetooth broadcast message to the Bluetooth module to control the Bluetooth module to start.
[0390] A26, the first application creates a corresponding Bluetooth broadcast channel for each target audio track data according to the audio track identifier of the target audio track data, and obtains a Bluetooth broadcast channel list (ie, subgroupList).
[0391] Exemplary, the first application loops through the track identification list, and creates a corresponding Bluetooth broadcast channel (subgroup object) for each target track data in the track identification list. Specifically, the track identification (channelname) of the target track data is written to the Bluetooth broadcast channel (subgroup object), and a Bluetooth broadcast channel list (i.e., subgroupList) is obtained, wherein the Bluetooth broadcast channel list includes the Bluetooth broadcast channel (subgroup object) corresponding to each target track data. It is understandable that in the Bluetooth broadcast channel list, the subgroup object of the track data whose decoding type is the first decoding type (i.e., hardware decoding type) ranks first, and the subgroup object of the track data whose decoding type is the second decoding type (i.e., software decoding type) ranks second.
[0392] A27, the first application sends a Bluetooth broadcast channel list to the Bluetooth protocol stack.
[0393] A28, the first application generates a Bluetooth device object (BluetoothDevice object) corresponding to each target Bluetooth device according to the association relationship between the audio track index and the device identifier (ie, device channelmap).
[0394] A29, the first application sends the track index of each target audio track data and the Bluetooth device object of each target Bluetooth device to the Bluetooth protocol stack.
[0395] Specifically, the first application calls the setBuiltinModeSyncBis() function to pass the BluetoothDevice object and the audio track index to the Bluetooth protocol stack.
[0396] A30, the Bluetooth protocol stack sends a Bluetooth broadcast channel list, an audio track index of each target audio track data, and a Bluetooth device object of each target Bluetooth device to the Bluetooth module to configure the audio track data for the Bluetooth module.
[0397] A31, the Bluetooth setting application sends a configuration completion notification to the first application.
[0398] A32, after receiving the configuration completion notification, the first application sends a destroy instruction to the player, where the destroy instruction is used to instruct the player to destroy the original audio and video playback thread.
[0399] A33, after receiving the destruction instruction, the player destroys the original audio and video playback thread.
[0400] A34: The first application sends a restart instruction to the player.
[0401] Exemplarily, the restart instruction may carry playback progress information.
[0402] A35, the first application sends the playback progress information of the video data of the target resource to the player.
[0403] A36, after receiving the playback progress information sent by the first application, the player decodes the audio and video data of the target resource based on the playback progress information to obtain the video data of the target resource and the audio data corresponding to the two target audio track data.
[0404] A37, the player mixes the audio data corresponding to the two target audio track data.
[0405] Exemplarily, in order to realize dual-track broadcasting, it is necessary to distinguish the pcm in the channel, and no longer mix, but assemble different channel data into multi-channel (four-channel for dual-track) data, and write the assembled data into BThal. BT splits the assembled data according to the current mode (dual-track broadcasting), and then splits it into two 2ch pcm data, and sends the data through broadcasting, thus realizing the dual-track broadcasting function. When the BT module parses the data, it reversely parses the 2ch and mch data according to the assembly protocol, and then assembles them into the original sound sources in two independent track broadcasts, thus completing the two tracks being sent out through two broadcast sources respectively.
[0406] A38, the player sends the two target audio track data after mixing to the Bluetooth protocol stack.
[0407] A39, after receiving the two target audio track data after the mixing process, the Bluetooth protocol stack sends the two target audio track data after the mixing process to the Bluetooth module.
[0408] A40, the Bluetooth module sends the Bluetooth broadcast data corresponding to the corresponding target audio track data to the target Bluetooth device based on the Bluetooth broadcast channel list, the audio track index of each target audio track data and the Bluetooth device object of each target Bluetooth device.
[0409] In the audio broadcasting method provided by the embodiment of the present application, when the video data of the target resource is presented on the display, and the sound output device is controlled to output the first audio data of the target resource, in response to the first operation, the track information of the target resource is obtained, and the number of tracks of the target resource is determined according to the track information; when the number of tracks meets the first preset condition, the display is controlled to present a multi-track sharing control; in response to the selection operation for the multi-track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and the multiple Bluetooth broadcast data correspond to the multiple Bluetooth devices one by one, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one track data of the target resource. In this way, the embodiment of the present application can send Bluetooth broadcast data corresponding to different track data for different Bluetooth devices, so as to realize the function of synchronous playback of multiple track data for the same audio and video resource by using audio broadcasting, which can improve the broadcasting efficiency. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource.
[0410] Method 2: Directly broadcast multiple Bluetooth broadcast data
[0411] Fig.23 A flowchart of an audio broadcasting method provided in an embodiment of the present application is shown in FIG. Fig.23 As shown, the method may include the following steps:
[0412] S2310, presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource.
[0413] The target resource (also referred to as the target audio and video resource) may be the audio and video resource currently to be played selected by the user, that is, the audio and video resource currently being played by the display device. Exemplarily, the target audio and video resource may also be any video resource among the audio and video resources to be played.
[0414] Among them, the audio and video resources at least include one or more of audio resources (i.e., audio data) and video resources (i.e., video data). In practical applications, the audio and video resources can be pre-stored in the display device, or can be acquired by the display device according to preset conditions. For example, the target audio and video resources can be audio resources that are downloaded from a multimedia server to the display device according to a specific address and are being played. In an embodiment of the present application, the target resource may include one or more audio track data, and the audio track data is used to indicate the audio data included in the target resource, that is, different audio track data correspond to different audio data.
[0415] The first audio data refers to the audio data corresponding to the audio track data output by the sound output device when the display device plays the video data of the target resource. Specifically, when the target resource includes one audio track data, the first audio data is the audio data corresponding to the audio track data. When the target resource includes multiple audio track data, the first audio data can be the audio data corresponding to any one of the multiple audio track data. For example, taking the example that the target resource includes audio track data 1 and audio track data 2, where audio track data 1 corresponds to Chinese audio data and audio track data 2 corresponds to English audio data, the first audio data can be the audio data corresponding to audio track data 1, that is, Chinese audio data.
[0416] In some examples, the user can select the target resource through a first application, wherein the first application can be the media center APP in the aforementioned embodiment, or a third-party audio and video application installed on the display device.
[0417] The following takes the first application as a media center APP as an example to schematically illustrate the process of a user selecting a target resource. Fig.13 The following is a schematic diagram of the interface for the target resource selection process provided in the embodiment of the present application. Fig.13 As shown in (a) of FIG. 1 , after the user turns on the display device, the display device starts the media center APP and presents the audio and video resource interface 1301 of the media center APP on the display. The audio and video resource interface 1301 includes multiple audio and video resources to be played, such as audio and video resource A, audio and video resource B, and audio and video resource C. In response to the selection operation for audio and video resource B, the media center APP determines audio and video resource B as the target resource and enters Fig.13 The playback interface 1302 of the audio and video resource B shown in (b) of FIG. 1302 , wherein the selection operation for the audio and video resource B may be an operation of the user selecting the audio and video resource B through a control device, or may be a voice command for selecting the audio and video resource B input by the user.
[0418] Of course, the user can also select the target resource through other applications (such as third-party audio and video applications) in the display device other than the media center APP. Specifically, after the display device is started, the user can first open the third-party audio and video application, and then select the target resource to be played from the audio and video resources provided by the third-party audio and video application.
[0419] Optionally, the target resource may be a local audio and video resource stored in the display device, or a network audio and video resource. The embodiment of the present application does not limit the specific type and acquisition method of the target resource.
[0420] Specifically, the specific implementation method of S2310 can refer to the specific implementation method of S1210 mentioned above, and will not be repeated here to avoid repetition.
[0421] S2320: In response to the first operation, obtain audio track information (also referred to as audio information) of the target resource.
[0422] In the process of playing the target audio and video resource (i.e., the target resource), the target resource may also be decoded to obtain the audio information (i.e., the audio track information) of the target resource, i.e., obtaining the audio track information of the target resource. Exemplarily, obtaining the audio track information of the target resource may include: in response to the first operation (i.e., the audio track menu invoking operation), obtaining the audio track information of the target resource.
[0423] The first operation is an operation of invoking the track menu. For example, the first operation may be a user pressing a menu key of a control device. For example, the first operation may also be a voice command input by the user to invoke the track menu.
[0424] The audio track information of the target resource may include index information, language type information, audio track type information and audio track format information. Among them, the index information is used to indicate the storage location corresponding to the audio track data, that is, the storage location of the audio data corresponding to the audio track data. The language type information is used to indicate the language type of the audio data corresponding to the audio track data. For example, the voice type information of audio track data 1 is Chinese, the voice type information of audio track data 2 is English, and the voice type information of audio track data 3 is French. The audio track type information is used to distinguish between audio track data and subtitle data. The audio track format information is used to indicate the format type of the audio data corresponding to the audio track data.
[0425] Specifically, for the specific implementation method of S2320, reference can be made to the specific implementation method of S1220 mentioned above, and to avoid repetition, it will not be repeated here.
[0426] S2330: Determine the number of audio tracks of the target resource according to the audio track information.
[0427] Exemplarily, during the process of playing the target resource, the target resource may also be decoded to obtain audio information (ie, audio track information) of the target resource, and then the number of audio tracks of the target resource may be determined based on the audio information of the target resource.
[0428] The number of audio tracks of the target resource refers to the number of audio track data included in the target resource.
[0429] In some examples, after obtaining the audio track information, that is, the audio track information list, the number of audio tracks of the target resource is determined according to the length of the audio track information list.
[0430] In some examples, the name of the audio track based on the target resource may also be determined based on the audio information of the target resource. The name of the audio track of the target resource refers to the name (channel name) of each audio track data of the target resource.
[0431] Specifically, the specific implementation method of S2330 can refer to the specific implementation method of S1230 mentioned above, and will not be repeated here to avoid repetition.
[0432] S2340: When the number of audio tracks meets a first preset condition, control the display to present a multi-audio track sharing control.
[0433] Among them, the multi-audio track sharing control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, or to trigger the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices. The multiple Bluetooth broadcast data correspond one-to-one to multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource.
[0434] The first preset condition is whether the target resource meets the condition of multi-track sharing. In some examples, the first preset condition may include at least one of the following: the number of tracks is greater than a first preset number (also referred to as a preset number threshold); the number of tracks is equal to the first preset number. Exemplarily, the first preset number is 2.
[0435] In some examples, the length of the track information list can be used to determine whether the number of tracks of the target resource is greater than or equal to a first preset number. Specifically, after obtaining the track information list of the target resource, determine whether the length of the track information list of the target resource is greater than or equal to the preset length. If the length of the track information list of the target resource is greater than or equal to the preset length, it means that the number of tracks of the target resource is greater than or equal to the first preset number, that is, the number of tracks meets the first preset condition. At this time, the control display presents a multi-track sharing control. If the length of the track information list of the target resource is less than the preset length, it means that the number of tracks of the target resource is less than the first preset number, that is, the number of tracks does not meet the first preset condition. At this time, the multi-track sharing control is not displayed.
[0436] For example, see Fig.14 , presenting the video data of the target resource on the display, that is, displaying Fig.14 In response to the audio track menu call-up operation (i.e., the first operation) input by the user, the audio track information of the target resource is obtained, and the number of audio tracks of the target resource is determined according to the audio track information, and then it is determined whether the number of audio tracks of the target resource is greater than or equal to a first preset number (e.g., 2). If the number of audio tracks of the target resource is greater than or equal to the first preset number (e.g., 2), the display is controlled to present the following Fig.14 The track menu page shown in (b) in FIG. The track menu page displays a multi-track sharing control, such as a "bilingual sharing" control. Otherwise, multi-track sharing is not supported, and the "bilingual sharing" control is not displayed.
[0437] In some examples, the display may be controlled to present multiple track selection controls, each of which corresponds to multiple track data of the target resource; in response to a selection operation on a first selection control, the sound output device is controlled to output first audio data of the target resource, wherein the first audio data is audio data of the track data corresponding to the first selection control. The first selection control is any one of the multiple track selection controls.
[0438] In a possible implementation, prompt information is displayed on each audio track selection control, and the prompt information is determined based on language type information of the audio track data corresponding to the audio track selection control.
[0439] For example, the target resource includes three audio track data (i.e., audio track data 1, audio track data 2, and audio track data 3). The language type of the audio data corresponding to audio track data 1 is Chinese (audio track data 1 corresponds to Chinese audio data), the language type of the audio data corresponding to audio track data 2 is English (audio track data 2 corresponds to English audio data), and the language type of the audio data corresponding to audio track data 3 is Japanese (audio track data 2 corresponds to French audio data). For this, Fig.14 As shown in (b), the track menu page may also include a "Chinese" track selection control corresponding to track data 1, an "English" track selection control corresponding to track data 2, and a "Japanese" track selection control corresponding to track data 3.
[0440] In this embodiment, multiple track selection controls can also be presented in the track menu page, so that users can also choose to listen to audio data corresponding to a certain track data, that is, audio data in a certain language, according to actual needs, which can meet the different needs of users.
[0441] Specifically, the specific implementation method of S2340 can refer to the specific implementation method of S1240 mentioned above, and will not be repeated here to avoid repetition.
[0442] S2350: In response to a selection operation on a multi-track sharing control, control the sound output device to stop outputting the first audio data.
[0443] Among them, the triggering operation for the multi-track sharing control may include a click operation on the multi-track sharing control, etc.
[0444] In some examples, in response to a selection operation on a multi-track sharing control, the first application may send a pause instruction to the player to instruct the player to pause playing the video data of the target resource. In this way, after the user enters the multi-track sharing interface, the video data of the target resource is paused to avoid affecting the user's viewing experience. Furthermore, it can be avoided that the sharing of multi-track data cannot operate normally due to the end of the playback of the video data of the target resource.
[0445] Specifically, the specific implementation method of S2350 can refer to the specific implementation method of S1250 mentioned above, and will not be repeated here to avoid repetition.
[0446] S2360, control the Bluetooth module to send multiple Bluetooth broadcast data, the multiple Bluetooth broadcast data correspond one to one with multiple audio track data of the target resource, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data.
[0447] That is to say, each piece of audio track data (ie, target audio track) corresponds to at least one piece of Bluetooth broadcast data, and the Bluetooth broadcast data is used to broadcast the audio data of the corresponding target audio track.
[0448] In some examples, when the number of audio tracks of the target resource is greater than a first preset number (i.e., a preset number threshold), the control display is presented with multiple audio track identifiers, the multiple audio track identifiers correspond one-to-one to the multiple audio track data of the target resource, and in response to a selection operation of a first number of first audio track identifiers among the multiple audio track identifiers, the audio track data corresponding to each first audio track identifier is determined as the first audio track data (i.e., the target audio track), and the Bluetooth module is controlled to send multiple Bluetooth broadcast data.
[0449] That is to say, after acquiring the audio tracks of the target resource, first determine whether the number of audio tracks of the target resource is less than the preset number threshold (i.e., determine whether the number of audio tracks meets the first preset condition); if it is determined that the number of audio tracks of the target resource is not less than the preset number threshold (i.e., meets the first preset condition), monitor the audio broadcast trigger operation for the audio tracks of the target resource; after receiving the audio broadcast trigger operation for at least two of the audio tracks of the target resource (i.e., audio track data), control the Bluetooth module to send multiple Bluetooth broadcast data based on at least two audio track data.
[0450] In some examples, after acquiring the audio tracks of the target resource, the display device can also first control the display to display the multi-track sharing control when it is determined that the number of audio tracks of the target resource is not less than the preset number threshold, and when receiving a trigger operation for the multi-track sharing control (i.e., a selection operation for the multi-track control), determine whether the number of audio tracks of the target resource is greater than the preset number threshold, and when it is determined that the number of audio tracks is greater than the preset number threshold, display the identifiers of at least two audio tracks in the audio tracks of the target resource; then, receive an audio broadcast trigger operation for at least two target audio tracks, and send a Bluetooth broadcast based on the at least two target audio tracks. Among them, the trigger operation for the multi-track sharing control can include a click operation on the multi-track sharing control, etc.
[0451] For example, assuming that the preset number threshold is 2, it means that the display device can support 2 audio tracks that can be shared simultaneously. At this time, if it is determined that the number of audio tracks of the target audio and video resources (for example, 2) is not less than 2, the display is controlled to display a multi-audio track sharing control with the words "bilingual sharing".
[0452] In some embodiments, during the process of the display device controlling the display to display a multi-language sharing control, when a trigger operation for the multi-language sharing control is received, it can also first determine whether the number of audio tracks of the target resource is equal to a preset number threshold, and if it is determined that the number of audio tracks of the target resource is equal to the preset number threshold, display the identifier of the audio track of the target resource; when an audio broadcast trigger operation for the audio track of the target resource is received, multiple Bluetooth broadcast data are sent based on at least two audio track data.
[0453] Since the preset quantity threshold can be used to represent the number of audio tracks that the display device can support for simultaneous sharing, when it is determined that the number of audio tracks of the target resource is equal to the preset quantity threshold, it means that the number of audio tracks of the target resource is exactly the number of audio tracks that the display device can support for simultaneous sharing. At this time, the display device plays all the audio track contents of the target resource, thereby realizing the function of simultaneous multi-language playback of the same audio and video resource by means of audio broadcasting.
[0454] In some embodiments, after obtaining the audio track of the target resource, it is also possible to determine whether the display device is a device that supports the LE audio protocol. Specifically, by obtaining the local configuration information of the display device, it is determined whether the display device supports the LE audio protocol. When it is determined that the display device supports the audio protocol and the number of audio tracks of the target audio and video resource currently being played is not less than the first preset threshold (i.e., the second preset number), the display is controlled to display a multi-audio track sharing control.
[0455] In some examples, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: if the number of audio tracks is not greater than a second preset number, controlling the Bluetooth module to send multiple Bluetooth broadcast data; if the number of audio tracks is greater than the second preset number, determining a first number of first audio track data from the multiple audio track data, and controlling the Bluetooth module to send the first number of Bluetooth broadcast data, one Bluetooth broadcast data being used to broadcast audio data corresponding to one first audio track data in the first number of first audio track data.
[0456] Among them, the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared audio tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0457] The first number is less than or equal to the second preset number, and the first number is greater than or equal to two. For example, the second preset number is 2, and the first number is 2. For example, the second preset number is 3, and the first number can be 2 or 3.
[0458] Exemplarily, after receiving a selection operation for a multi-audio track sharing control, it is determined whether the number of audio tracks of the target resource is not greater than a second preset number. If the number of audio tracks of the target resource is not greater than the second preset number, it indicates that the number of audio tracks of the target resource does not exceed the performance of the hardware chip of the display device. Therefore, the Bluetooth module can be controlled to send multiple Bluetooth broadcast data.
[0459] Optionally, when the number of audio tracks of the target resource is equal to a second preset number, the Bluetooth module is controlled to send multiple Bluetooth broadcast data.
[0460] In addition, when the number of audio tracks of the target resource is not greater than the second preset number, the display can be controlled to present the audio track identifiers of the multiple audio track data of the target resource, and then the Bluetooth module can be controlled to send multiple Bluetooth broadcast data. In this embodiment, by presenting the audio track identifiers of the audio track data on the display, the user can be prompted to share the multiple audio track data and to perform the sharing operation of the multiple audio track data.
[0461] Exemplarily, the track identifier is used to present relevant information of the track data that can be shared by multiple tracks to the user. Exemplarily, the track identifier may include the channel name of the track data, wherein the language type information of the track data can usually be used to represent the track name, such as Chinese, English. Exemplarily, the track identifier may also be a global variable generated based on the track information of the track data. For example, English (ENG-TVAudioShare), Chinese (CHN-TVAudioShare).
[0462] It should be noted that if the language types of two audio track data are the same, a number can be added after the language type to distinguish different audio track data. For example, audio track data 1 is Chinese 1, and audio track data 2 is Chinese 2.
[0463] Of course, when the number of audio tracks of the target resource is equal to the second preset number, the display can also be controlled to present the audio track identifiers of multiple audio track data of the target resource, and then the Bluetooth module can be controlled to send multiple Bluetooth broadcast data.
[0464] For example, taking the second preset number as 2, and the target resource including two track data (track data 1 and track data 2) as an example, please continue to refer to Fig.14 In response to a selection operation on the "bilingual sharing" control, a display device is presented Fig.14 The bilingual sharing page shown in (c) may include the track identifier "Chinese" corresponding to the track data 1 and the track identifier "English" corresponding to the track data 2.
[0465] In some examples, when the number of audio tracks of the target resource is greater than a second preset number, the control display is presented with multiple audio track identifiers, the multiple audio track identifiers correspond one-to-one to the multiple audio track data of the target resource, and in response to a selection operation for a first number of first audio track identifiers among the multiple audio track identifiers, the audio track data corresponding to each first audio track identifier is determined as the first audio track data, and the Bluetooth module is controlled to send a first number of Bluetooth broadcast data, one Bluetooth broadcast data being used to broadcast audio data corresponding to one first audio track data among the first number of first audio track data.
[0466] For example, taking the second preset number being 2 and the first number being 2 as an example, the process of controlling the Bluetooth module to send a plurality of Bluetooth broadcast data is described.
[0467] In response to the selection operation for the multi-track sharing control, it is determined whether the number of tracks of the target resource is not greater than the second preset number (such as 2). If the number of tracks of the target resource is not greater than the second preset number (such as 2), the display is controlled to present the track identification of each track data, and after receiving the trigger operation of multiple Bluetooth broadcast data, the Bluetooth module is controlled to send multiple Bluetooth broadcast data based on at least two track data. If the number of tracks of the target resource is greater than the second preset number (such as 2), two first track data are determined from the multiple track data of the target resource, the display is controlled to present the track identification of the two first track data, and after receiving the trigger operation of multiple Bluetooth broadcast data, the Bluetooth module is controlled to send two Bluetooth broadcast data corresponding to the two first track data.
[0468] For example, taking the second preset number as 2 and the number of audio tracks of the target resource as 3, see Fig.15 , in response to Fig.15 The "Bilingual Sharing" control shown in (a) is selected to determine whether the number of audio tracks of the target resource is not greater than a second preset number (such as 2). If the number of audio tracks of the target resource is greater than the second preset number (such as 2), the display device is displayed. Fig.15 The pop-up window for selecting a track can display multiple track options, such as a "Chinese" track option, an "English" track option, and a "Japanese" track option, and each track option has a corresponding check box. In response to the selection operation for the "Chinese" track option and the "English" track option, the display device presents Fig.15 The multi-language sharing page shown in (c) in FIG. The multi-language sharing page displays the track identifiers of the Chinese track data corresponding to the selected "Chinese" track option and the English track data corresponding to the "English" track option, such as "Chinese" and "English", that is, the Chinese track data corresponding to the "Chinese" track option and the English track data corresponding to the "English" track option are determined as the track data to be shared by multiple tracks.
[0469] In some embodiments, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: controlling the Bluetooth module to switch to a Bluetooth broadcast channel; when determining that the Bluetooth module has switched to the Bluetooth broadcast channel, controlling the Bluetooth module to send multiple Bluetooth broadcasts based on multiple Bluetooth broadcast channels, wherein the multiple Bluetooth broadcast channels correspond one-to-one to multiple audio track data.
[0470] In the embodiment of the present application, the audio channel may include a local speaker output channel, a Universal Serial Bus (USB) audio output channel, a High Definition Multimedia Interface (HDMI) output channel and other more traditional output channels, and may also include an audio output channel established based on a unicast media sender (Broadcast Media Sender, BMS), etc. The current audio channel may be any one of the above audio output channels.
[0471] In actual applications, when the display device controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, it first controls the sound output device to mute, and then switches the current audio channel to the Bluetooth broadcast channel. After the switch is successful, it controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices.
[0472] The display device can also first switch the current audio channel to the Bluetooth broadcast channel when controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, and control the sound output device to mute after the switching is successful, and control the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices.
[0473] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: when determining that the Bluetooth module switches to a Bluetooth broadcast channel, controlling the Bluetooth module to send multiple Bluetooth broadcasts based on multiple Bluetooth broadcast channels, and controlling the player to replay the video data from the start time of the video.
[0474] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data, and obtaining playback progress information of the video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, controlling the player to replay the video data according to the playback progress information, and processing the audio data corresponding to multiple audio track data of the target resource according to the playback progress information, and controlling the Bluetooth module to send multiple Bluetooth broadcast data based on multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
[0475] In actual applications, when the display device controls the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel, there may be a problem that the audio data is inconsistent with the playback progress of the target resource. In order to solve the above technical problems or at least partially solve the above technical problems, the embodiment of the present application can also control the Bluetooth module to switch the current audio channel to the Bluetooth broadcast channel when controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices; then control the player to pause playing the target audio and video resources, and obtain the playback progress information of the target resources; further, when it is determined that the Bluetooth broadcast channel is switched successfully, restart the audio decoder and the video decoder, control the audio decoder to decode the audio data corresponding to the multiple audio track data of the target resource according to the playback progress information, and send the decoded audio data to the Bluetooth protocol stack, so that the Bluetooth protocol stack can call the Bluetooth module through the Bluetooth driver to send multiple Bluetooth broadcast data to multiple Bluetooth devices. And, control the video decoder to decode the video data according to the playback progress information.
[0476] In the embodiment of the present application, the audio decoder is an audio decoder, which is mainly used to decode the compressed audio data into the original digital audio signal. After the audio decoder decodes the target resource to obtain Chinese audio data, English audio data and other data, the decoded audio data can be sent to the audio processor or audio output device for playback. The video decoder is a video decoder, which is used to decode the compressed video data into the original video image sequence. Specifically, it can decode the target audio and video resources and restore the image frame rate, resolution and other video data for subsequent video processing and display. The Bluetooth protocol stack is used to send multiple Bluetooth broadcasts based on the decoded audio data.
[0477] In an embodiment of the present application, the playback progress information of the target resource may include information such as the current playback time of the target resource. After obtaining the playback progress information of the target resource, the audio decoder can be controlled to decode the target resource according to the playback progress information, and the decoded audio data can be sent to the Bluetooth protocol stack, so that the Bluetooth protocol stack can send multiple Bluetooth broadcast data based on the decoded audio data, thereby realizing the function of simultaneously broadcasting multiple audio track data for the same audio and video resources.
[0478] Exemplarily, when an audio broadcast trigger operation for at least two audio track data is received, the player is controlled to pause playing the target resource. Assuming that the target resource is paused at 30 seconds of playback, when it is determined that the Bluetooth broadcast switch is successful, the audio decoder is restarted and the audio decoder is controlled to start decoding the target resource from the 30th second to achieve the effect of keeping the playback progress of the audio data and the target resource consistent.
[0479] In some embodiments, after controlling the Bluetooth module to send a plurality of Bluetooth broadcast data, the method may further include: when a second preset condition is met, controlling the Bluetooth module to stop sending a plurality of Bluetooth broadcast data, controlling the player to pause playing the video data, and obtaining the playing progress information of the video data; based on the playing progress information, controlling the player to replay the video data, and the sound output device to output the first audio data;
[0480] The second preset condition is used to determine whether to exit the sharing of multi-track data. Exemplarily, the second preset condition includes at least one of the following: receiving an instruction to exit the sharing of multi-track data; detecting that the Bluetooth module is switched to the off state; detecting that the player is switched to the background operation; receiving an operation to stop playing the target resource.
[0481] In the audio broadcasting method provided by the embodiment of the present application, when the video data of the target resource is presented on the display, and the sound output device is controlled to output the first audio data of the target resource, in response to the first operation, the track information of the target resource is obtained, and the number of tracks of the target resource is determined according to the track information; when the number of tracks meets the first preset condition, the display is controlled to present a multi-track sharing control; in response to the selection operation for the multi-track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data, and the multiple Bluetooth broadcast data correspond to the multiple track data of the target resource one by one, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one track data. In this way, the embodiment of the present application can send Bluetooth broadcast data corresponding to different track data, so as to realize the function of synchronous playback of multiple track data for the same audio and video resource by using audio broadcasting, which can improve the broadcasting efficiency. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource.
[0482] Fig.24 A flowchart of another audio broadcasting method provided in an embodiment of the present application. Fig.24 As shown, the method may include the following steps:
[0483] S2410, presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource.
[0484] The target resource may be an audio or video resource selected by the user and currently to be played. In the embodiment of the present application, the target resource may include one or more audio track data, and the audio track data is used to indicate the audio data included in the target resource, that is, different audio track data correspond to different audio data.
[0485] The first audio data refers to audio data corresponding to the audio track data output by the sound output device when the display device plays the video data of the target resource.
[0486] Specifically, the specific implementation method of S2410 can refer to the specific implementation method of S2310 mentioned above, and will not be repeated here to avoid repetition.
[0487] S2420: In response to the first operation, obtain audio track information of the target resource.
[0488] Among them, the first operation is the call-up operation of the audio track menu.
[0489] The audio track information of the target resource may include index information, language type information, audio track type information and audio track format information. Among them, the index information is used to indicate the storage location corresponding to the audio track data, that is, the storage location of the audio data corresponding to the audio track data. The language type information is used to indicate the language type of the audio data corresponding to the audio track data. For example, the voice type information of audio track data 1 is Chinese, the voice type information of audio track data 2 is English, and the voice type information of audio track data 3 is French. The audio track type information is used to distinguish between audio track data and subtitle data. The audio track format information is used to indicate the format type of the audio data corresponding to the audio track data.
[0490] Wherein, the audio track format information is used to indicate the format type of the audio data corresponding to the audio track data. Wherein, in some examples, according to the technical characteristics, the format type of the audio data may include a lossy compression format, a lossless compression format and a multi-channel audio format. Wherein, the lossy compression format may include, for example, an MPEG-2 audio coding format, an MPEG-4 audio coding format, an AC-3 audio coding format and an EAC-3 audio coding format. The lossless compression format may include, for example, a DTS-LBR audio coding format and a DTS-HD Master Audio audio coding format. The multi-channel audio format may include, for example, an AC-4 audio coding format, a DTS-HD audio coding format, an AC-3 audio coding format, an EAC-3 audio coding format, a DTS-HD audio coding format and a DTS audio coding format.
[0491] In other examples, according to the application scenario, the format type of audio data may include a home theater system format, a DVD video format, a digital video and streaming media format, and a high-quality audio transmission format. Among them, the home theater system format may include, for example, an AC-4 audio coding format, an AC-3 audio coding format, an EAC-3 audio coding format, a DTS-HD audio coding format, and a DTS-HD Master Audio audio coding format. The DVD video format may include, for example, an MPEG-2 audio coding format and a DTS audio coding format. The digital video and streaming media format may include, for example, an MPEG-4 audio coding format. The high-quality audio transmission format may include, for example, a DTS-LBR audio coding format.
[0492] It should be noted that different formats of audio data correspond to different decoding types. For example, the decoding types of AC-4 audio encoding format, DTS-HD audio encoding format, DTS-LBR audio encoding format, and DTS-True-HD audio encoding format are only hardware decoding types (referred to as hard decoding types). In contrast, the decoding types of MPEG-2 audio encoding format, MPEG-4 audio encoding format, AC-3 audio encoding format, EAC-3 audio encoding format, and DTS audio encoding format can be software decoding types (referred to as soft decoding types) or hardware decoding types.
[0493] Specifically, for the specific implementation method of S2420, reference can be made to the specific implementation method of S2320 mentioned above, and to avoid repetition, it will not be repeated here.
[0494] S2430: Determine the number of audio tracks of the target resource and the decoding type of the audio track data of the target resource according to the audio track information.
[0495] In some embodiments, determining the decoding type of the audio track data of the target resource based on the audio track information may include: determining the decoding type corresponding to each audio track data based on the audio track format information corresponding to each audio track data in the audio track information, that is, determining the decoding type of the audio track data of the target resource.
[0496] Specifically, the specific implementation method of "determining the number of audio tracks of the target resource according to the audio track information" in S2430 can refer to the specific implementation method of the aforementioned S2330, and will not be repeated here to avoid repetition.
[0497] S2440: When the number of audio tracks meets the first preset condition and the decoding type of the audio track data of the target resource meets the third preset condition, control the display to present a multi-audio track sharing control.
[0498] Among them, the multi-audio track sharing control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, or to trigger the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices. The multiple Bluetooth broadcast data correspond one-to-one to multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource.
[0499] The first preset condition is whether the target resource meets the condition of multi-track sharing. In some examples, the first preset condition may include at least one of the following: the number of tracks is greater than a first preset number (also referred to as a preset number threshold); the number of tracks is equal to the first preset number. Exemplarily, the first preset number is 2.
[0500] In some examples, the length of the track information list can be used to determine whether the number of tracks of the target resource is greater than or equal to a first preset number. Specifically, after obtaining the track information list of the target resource, determine whether the length of the track information list of the target resource is greater than or equal to the preset length. If the length of the track information list of the target resource is greater than or equal to the preset length, it means that the number of tracks of the target resource is greater than or equal to the first preset number, that is, the number of tracks meets the first preset condition. At this time, the control display presents a multi-track sharing control. If the length of the track information list of the target resource is less than the preset length, it means that the number of tracks of the target resource is less than the first preset number, that is, the number of tracks does not meet the first preset condition. At this time, the multi-track sharing control is not displayed.
[0501] In some embodiments, when the number of audio tracks meets the first preset condition, it is determined whether the decoding type of the audio track data of the target resource meets the third preset condition. If the decoding type of the audio track data of the target resource meets the third preset condition, the display is controlled to present a multi-audio track sharing control.
[0502] Among them, the third preset condition may include that the multiple track data of the target resource include at least two types of track data. Among them, the decoding type may include a first decoding type, a second decoding type and a third decoding type. The first decoding type indicates that the audio data corresponding to the track data can only be decoded by hardware, that is, a hardware decoding type. The second decoding type indicates that the audio data corresponding to the track data can only be decoded by software, that is, a software decoding type. The third decoding type indicates that the audio data corresponding to the track data can be decoded by software or by software, that is, a hardware-decoding and a software-decoding type.
[0503] Exemplarily, the third preset condition may be that the number of audio tracks of the target resource is not equal to the number of fourth audio track data, and the number of audio tracks is not equal to the number of fifth audio track data, wherein the decoding type of the fourth audio track data is the first decoding type (i.e., hardware decoding type), and the decoding type of the fifth audio track data is the second decoding type (i.e., software decoding type).
[0504] Specifically, for the specific implementation of S2440, reference can be made to the specific implementation of S1940 described above, and to avoid repetition, it will not be repeated here.
[0505] S2450: In response to a selection operation on a multi-track sharing control, control the sound output device to stop outputting the first audio data.
[0506] In some examples, in response to a selection operation on a multi-track sharing control, the first application may send a pause instruction to the player to instruct the player to pause playing the video data of the target resource. In this way, after the user enters the multi-track sharing interface, the video data of the target resource is paused to avoid affecting the user's viewing experience. Furthermore, it can be avoided that the sharing of multi-track data cannot operate normally due to the end of the playback of the video data of the target resource.
[0507] Specifically, for the specific implementation of S2450, reference can be made to the specific implementation of S2350 described above, and to avoid repetition, it will not be repeated here.
[0508] S2460, control the Bluetooth module to send multiple Bluetooth broadcast data, the multiple Bluetooth broadcast data correspond to multiple audio track data of the target resource one by one, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data.
[0509] In some embodiments, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: if the number of audio tracks is not greater than a second preset number, controlling the Bluetooth module to send multiple Bluetooth broadcast numbers; if the number of audio tracks is greater than the second preset number, determining a first number of first audio track data from multiple audio track data of the target resource, and controlling the Bluetooth module to send the first number of Bluetooth broadcast data, one Bluetooth broadcast data being used to broadcast audio data corresponding to one first audio track data in the first number of first audio track data.
[0510] Among them, the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared audio tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0511] Among them, the number of audio track data of the first number of first audio track data whose decoding type belongs to the first decoding type (i.e., hardware decoding type) is less than or equal to the third preset number, and the number of audio track data of the first number of first audio track data whose decoding type belongs to the second decoding type (i.e., software decoding type) is less than or equal to the fourth preset number. And, the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
[0512] Optionally, the third preset number may be determined based on the performance of a hardware chip (such as a Bluetooth module and a player) of the display device. The fourth preset number may be determined based on the performance of a hardware chip (such as a Bluetooth module and a player) of the display device.
[0513] Exemplarily, the second preset number is 2, the first number is 2, the third preset number is 1, and the fourth preset number is 1. That is, the display device supports one hardware decoding and one software decoding at the same time.
[0514] In this regard, the steps of determining a first quantity of first audio track data from multiple audio track data of the target resource, and controlling the Bluetooth module to send a first quantity of Bluetooth broadcast data may include: determining two first audio track data from multiple audio track data, and controlling the Bluetooth module to send two Bluetooth broadcast data; wherein the decoding types of the two first audio track data are different.
[0515] Exemplarily, the decoding type of one of the two first audio track data is the first decoding type (i.e., hardware decoding type), and the decoding type of the other first audio track data is the second decoding type (i.e., software decoding type). Exemplarily, the decoding type of one of the two first audio track data is the first decoding type (i.e., hardware decoding type) or the second decoding type (i.e., software decoding type), and the decoding type of the other first audio track data is the third decoding type (i.e., hardware-decoding type or software-decoding type).
[0516] In addition, when the number of tracks of the target resource is not greater than the second preset number, the display can be controlled to present track identifiers of multiple track data of the target resource, and the multiple track identifiers correspond one-to-one to the multiple track data of the target resource, and then the Bluetooth module can be controlled to send multiple Bluetooth broadcast data. In this embodiment, by presenting the track identifiers of the track data on the display, the user can be prompted to share the multiple track data, and the user can be prompted to share the multiple track data.
[0517] Exemplarily, the track identifier is used to present relevant information of the track data that can be shared by multiple tracks to the user. Exemplarily, the track identifier may include the track name (CHANNEL NAME) of the track data, wherein the track name can usually be represented by the language type information of the track data, such as Chinese, English. Exemplarily, the track identifier may also be a global variable generated based on the track information of the track data. For example, English (ENG-TVAUDIOSHARE), Chinese (CHN-TVAUDIOSHARE).
[0518] More specifically, the step of determining two first audio track data from multiple audio track data of the target resource may include: in response to a selection operation on a second audio track identifier among multiple audio track identifiers, determining the audio track data corresponding to the second audio track identifier as the first audio track data, and controlling the display to present at least one third audio track identifier, wherein the third audio track identifier includes the audio track identifiers of the audio track data among the multiple audio track data except the audio track data corresponding to the second audio track identifier, and the decoding type of the audio track data corresponding to the third audio track identifier is different from the decoding type of the audio track data corresponding to the second audio track identifier; in response to a selection operation on a fourth audio track identifier among the at least one third audio track identifier, determining the audio track data corresponding to the fourth audio track identifier as the first audio track data.
[0519] That is to say, after the user selects an audio track data to be shared, the display device can determine the remaining audio track data available for the user to select based on the decoding type of the selected audio track data, and present the corresponding audio track identifier on the display device to facilitate the user to select other audio track data to be shared, thereby ensuring that the selected audio track data meets the restrictions of the decoding type conditions, thereby realizing the sharing function of multiple audio track data.
[0520] In some embodiments, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: controlling the Bluetooth module to switch to a Bluetooth broadcast channel; when determining that the Bluetooth module has switched to the Bluetooth broadcast channel, controlling the Bluetooth module to send multiple Bluetooth broadcasts based on multiple Bluetooth broadcast channels, wherein the multiple Bluetooth broadcast channels correspond one-to-one to multiple audio track data.
[0521] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: when determining that the Bluetooth module switches to a Bluetooth broadcast channel, controlling the Bluetooth module to send multiple Bluetooth broadcasts based on multiple Bluetooth broadcast channels, and controlling the player to replay the video data from the start time of the video.
[0522] In some embodiments, before controlling the Bluetooth module to send multiple Bluetooth broadcast data, the method may also include: in response to a selection operation on a multi-track sharing control, controlling the player to pause playing video data, and obtaining playback progress information of the video data; wherein, controlling the Bluetooth module to send multiple Bluetooth broadcast data may include: when determining that the Bluetooth module switches to the Bluetooth broadcast channel, controlling the player to replay the video data according to the playback progress information, and processing the audio data corresponding to multiple audio track data of the target resource according to the playback progress information, and controlling the Bluetooth module to send multiple Bluetooth broadcast data based on multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
[0523] In some embodiments, after controlling the Bluetooth module to send a plurality of Bluetooth broadcast data, the method may further include: when a second preset condition is met, controlling the Bluetooth module to stop sending a plurality of Bluetooth broadcast data, controlling the player to pause playing the video data, and obtaining the playing progress information of the video data; based on the playing progress information, controlling the player to replay the video data, and the sound output device to output the first audio data;
[0524] Among them, the second preset condition includes at least one of the following: receiving an instruction to exit multi-track sharing; detecting that the Bluetooth module is switched to the off state; detecting that the player is switched to background operation; receiving an operation to stop playing the target resource.
[0525] Specifically, the above process of the player replaying video data and exiting multi-track data sharing can be referred to the specific implementation method in the aforementioned S1260. To avoid repetition, it will not be repeated here.
[0526] In the audio broadcasting method provided by the embodiment of the present application, when the video data of the target resource is presented on the display, and the first audio data of the target resource is output by the sound output device, in response to the first operation, the track information of the target resource is obtained, and the number of tracks of the target resource and the decoding type of the track data of the target resource are determined according to the track information; when the number of tracks meets the first preset condition and the decoding type of the track data of the target resource meets the third preset condition, the display is controlled to present a multi-track sharing control; in response to the selection operation for the multi-track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data, and the multiple Bluetooth broadcast data correspond to the multiple track data of the target resource one by one, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one track data. In this way, when the number of track data of the target resource meets the condition and the decoding type of the track data meets the condition, the multi-track sharing control can be presented, and then, after receiving the selection operation for the multi-track sharing control, the Bluetooth module is controlled to send the Bluetooth broadcast data corresponding to different track data, so that the function of synchronous playback of multiple track data for the same audio and video resource can be realized by audio broadcasting, which can improve the broadcasting efficiency. Furthermore, it can be applied to display devices with different hardware capabilities. In addition, the embodiment of the present application can realize the function of synchronously playing multiple languages for the same audio and video resources.
[0527] Combine the following Fig.25 , the interaction process between the various modules of the display device during the implementation of the audio broadcasting method provided in the embodiment of the present application is explained.
[0528] Fig.25 The following is a schematic diagram of the interactive process of the audio broadcasting method provided in the embodiment of the present application. Fig.25 As shown, the audio broadcasting method may include the following steps:
[0529] B1. A first application at the application layer receives a selection operation for a target resource among multiple media resources.
[0530] B2. In response to a selection operation on a target resource, the first application sends a storage address of the target resource to a player of the framework layer.
[0531] B3, after receiving the storage address of the target resource sent by the first application, the player parses the target resource based on the storage address of the target resource to obtain the video data of the target resource, the audio data corresponding to one of the audio track data (ie, the first audio data), and the audio track information of the target resource.
[0532] B4, the player sends the video data of the target resource to the first application.
[0533] B5. After receiving the video data of the target resource sent by the player, the first application presents the video data of the target resource.
[0534] B6. The first application receives the first operation.
[0535] The first operation is an operation of invoking the track menu. For example, the first operation may be a user pressing a menu key of a control device. For example, the first operation may also be a voice command input by the user to invoke the track menu.
[0536] B7. In response to the first operation, the first application sends an audio track information acquisition instruction to the player.
[0537] B8. After receiving the audio track information acquisition instruction sent by the first application, the player sends the audio track information of the target resource to the first application.
[0538] B9. After receiving the audio track information of the target resource sent by the player, the first application determines the number of audio tracks of the target resource according to the audio track information of the target resource.
[0539] B10, the first application determines whether the number of audio tracks of the target resource is greater than or equal to a first preset number. If the number of audio tracks of the target resource is greater than or equal to the first preset number, execute B11, otherwise, execute B12.
[0540] Exemplarily, the first preset number is 2.
[0541] B11, the first application generates and displays multi-track sharing controls.
[0542] Exemplarily, the multi-track sharing control may be a “multi-language sharing” control.
[0543] B12, the first application does not generate multi-track sharing controls.
[0544] B1-B12 above are the process of displaying multi-track controls.
[0545] B13, the first application receives a selection operation for a multi-track sharing control.
[0546] B14, in response to the selection operation for the multi-track sharing control, if the number of tracks is equal to the second preset number, the first application displays a first interface (i.e., a multi-language sharing page), and the first interface may include a first broadcast control. The first broadcast control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, and one Bluetooth broadcast data corresponds to one track data among the multiple track data.
[0547] After receiving a selection operation for the multi-track sharing control, it is determined whether the number of tracks is equal to a second preset number (such as 2). If the number of tracks is equal to the second preset number (such as 2), the first application presents a first interface (ie, a multilingual sharing interface).
[0548] The first interface may include multiple track identifiers corresponding to multiple track data of the target resource. The second preset number is the number of track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0549] The first interface may further include a second broadcast control, wherein the second broadcast control is used to trigger the Bluetooth module to send Bluetooth broadcast data to multiple Bluetooth devices.
[0550] B15, the first application sends a pause playback instruction to the player.
[0551] B16, after receiving the pause playback instruction sent by the first application, the player pauses playing the video data of the target resource.
[0552] In some examples, the player may obtain playback progress information of the video data of the target resource.
[0553] B17, in response to a selection operation on a multi-track sharing control, if the number of tracks is greater than a second preset number, the first application displays a second interface (ie, a track selection pop-up window).
[0554] After receiving a selection operation for a multi-track sharing control, it is determined whether the number of tracks is greater than a second preset number (such as 2). If the number of tracks is greater than the second preset number (such as 2), the first application presents a second interface (i.e., a track selection pop-up window). The second interface includes a plurality of third track options, and the plurality of third track options correspond one-to-one to a plurality of track data of the target resource, and the second preset number is the number of track data that the Bluetooth module supports to be broadcast simultaneously.
[0555] B18, in response to the audio track selection operation, the first application displays a third interface (i.e., a multilingual sharing page), and the third interface may include a first broadcast control, wherein the first broadcast control is used to trigger the Bluetooth module to send a first amount of Bluetooth broadcast data, and one Bluetooth broadcast data corresponds to one audio track data in the first amount of audio track data.
[0556] Exemplarily, the audio track selection operation may be an operation of selecting two third audio track options among a plurality of third audio track options.
[0557] Exemplarily, the third interface includes two track identifiers, wherein one of the two track identifiers corresponds to the track data corresponding to the selected third track option. The third interface may also include a second broadcast control. The second broadcast control is used to trigger the Bluetooth module to send Bluetooth broadcast data to multiple Bluetooth devices.
[0558] B19, the first application receives a selection operation on the first broadcast control.
[0559] B20: In response to a selection operation on the first broadcast control, the first application sends the audio track identifier of each target audio track data to the Bluetooth broadcast component.
[0560] Exemplarily, the track identifier of the target track data can be represented by a track identifier list (channel names). That is, the first application can send a track identifier list to the Bluetooth broadcast component, and the track identifier list can include the track identifier of each target track data in the multiple target track data. It should be noted that the track identifiers of the multiple target track data can be arranged in a preset order. For example, in the track identifier list, the track identifier of the track data whose decoding type is the first decoding type (i.e., hardware decoding type) is ranked first, and the track identifier of the track data whose decoding type is the second decoding type (i.e., software decoding type) is ranked second.
[0561] In some examples, the first application may also send a Bluetooth broadcast name (broadcastName) and a Bluetooth broadcast password (broadcastCode) to the Bluetooth broadcast component.
[0562] B21, after receiving the track identifier of the target track data, the Bluetooth broadcast component creates a corresponding Bluetooth broadcast channel for each target track data according to the track identifier of the target track data, and obtains a Bluetooth broadcast channel list (ie, subgroupList).
[0563] Exemplary, the Bluetooth broadcast component loops through the track identification list, and creates a corresponding Bluetooth broadcast channel (subgroup object) for each target track data in the track identification list. Specifically, the track identification (channelname) of the target track data is written to the Bluetooth broadcast channel (subgroup object), and a Bluetooth broadcast channel list (i.e., subgroupList) is obtained, wherein the Bluetooth broadcast channel (subgroup object) corresponding to each target track data is included in the Bluetooth broadcast channel list. It is understandable that in the Bluetooth broadcast channel list, the subgroup object of the track data whose decoding type is the first decoding type (i.e., hardware decoding type) ranks first, and the subgroup object of the track data whose decoding type is the second decoding type (i.e., software decoding type) ranks second.
[0564] B22, the Bluetooth broadcast component sends a Bluetooth broadcast channel list to the Bluetooth protocol stack.
[0565] Exemplarily, after receiving the Bluetooth broadcast channel list sent by the Bluetooth broadcast component, the Bluetooth protocol stack controls the Bluetooth module to start through the Bluetooth driver.
[0566] B23, the Bluetooth broadcast component sends a Bluetooth activation notification to the first application, wherein the Bluetooth activation notification is used to indicate that the Bluetooth module of the display device has been activated.
[0567] In some examples, the Bluetooth broadcast component can also be integrated into the first application (such as a media center APP). That is, in response to the selection operation on the first broadcast control, the first application creates a corresponding Bluetooth broadcast channel for each target track data according to the track identifier of the target track data, obtains a Bluetooth broadcast channel list, and sends the Bluetooth broadcast channel list to the Bluetooth protocol stack.
[0568] B24, after receiving the Bluetooth activation notification sent by the Bluetooth broadcast component, the first application sends a destruction instruction to the player, where the destruction instruction is used to instruct the player to destroy the original audio and video playback thread.
[0569] B25, after receiving the destruction instruction, the player destroys the original audio and video playback thread.
[0570] B26, the first application sends a restart instruction to the player, wherein the restart instruction may carry the audio track information of the target resource.
[0571] B27, the first application sends the playback progress information of the video data of the target resource to the player.
[0572] B28, after receiving the playback progress information sent by the first application, the player decodes the audio and video data of the target resource based on the playback progress information to obtain the video data of the target resource and the audio data corresponding to the two target audio track data.
[0573] B29, the player mixes the audio data corresponding to the two target audio track data.
[0574] Exemplarily, in order to realize dual-track broadcasting, it is necessary to distinguish the pcm in the channel, and no longer mix, but assemble different channel data into multi-channel (four-channel for dual-track) data, and write the assembled data into BThal. BT splits the assembled data according to the current mode (dual-track broadcasting), and then splits it into two 2ch pcm data, and sends the data through broadcasting, thus realizing the dual-track broadcasting function. When the BT module parses the data, it reversely parses the 2ch and mch data according to the assembly protocol, and then assembles them into the original sound sources in two independent track broadcasts, thus completing the two tracks being sent out through two broadcast sources respectively.
[0575] B30, the player sends the two target audio track data after mixing to the Bluetooth protocol stack.
[0576] B31, after receiving the two target audio track data after mixing processing, the Bluetooth protocol stack controls the Bluetooth module to send multiple Bluetooth broadcast data based on the Bluetooth broadcast channel list.
[0577] In the audio broadcasting method provided by the embodiment of the present application, when the video data of the target resource is presented on the display, and the sound output device is controlled to output the first audio data of the target resource, in response to the first operation, the track information of the target resource is obtained, and the number of tracks of the target resource is determined according to the track information; when the number of tracks meets the first preset condition, the display is controlled to present a multi-track sharing control; in response to the selection operation for the multi-track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data, and the multiple Bluetooth broadcast data correspond to the multiple track data of the target resource one by one, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one track data. In this way, the embodiment of the present application can send Bluetooth broadcast data corresponding to different track data, so as to realize the function of synchronous playback of multiple track data for the same audio and video resource by using audio broadcasting, which can improve the broadcasting efficiency. In addition, the embodiment of the present application can realize the function of synchronous playback of multiple languages for the same audio and video resource.
[0578] Fig.26 A flowchart of an audio broadcasting method provided in an embodiment of the present application is shown in FIG. Fig.26 As shown, the method may include the following steps:
[0579] S2610, presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource.
[0580] S2620: In response to the first operation, obtain audio track information of the target resource.
[0581] S2630: Determine the number of audio tracks of the target resource according to the audio track information.
[0582] S2640, when the number of audio tracks meets the first preset condition, the control display presents a multi-audio track sharing control, wherein the multi-audio track sharing control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, or trigger the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast the audio data corresponding to one audio track data of the target resource.
[0583] For example, see Fig. 27 , presenting the video data of the target resource on the display, that is, displaying Fig. 27 In response to the audio track menu call-up operation (i.e., the first operation) input by the user, the audio track information of the target resource is obtained, and the number of audio tracks of the target resource is determined according to the audio track information, and then it is determined whether the number of audio tracks of the target resource is greater than or equal to a first preset number (e.g., 2). If the number of audio tracks of the target resource is greater than or equal to the first preset number (e.g., 2), the display is controlled to present the following Fig. 27 The track menu page shown in (b) in FIG. The track menu page displays a multi-track sharing control, such as a "bilingual sharing" control. Otherwise, multi-track sharing is not supported, and the "bilingual sharing" control is not displayed.
[0584] Among them, the multi-track sharing control can be, for example, Fig. 27 The “Bilingual Sharing” control shown in (b) in FIG.
[0585] In some examples, the audio track information includes language type information of the audio track data in the target resource; controlling the sound output device to output the first audio data of the target resource may include: in response to a first operation, controlling the display to present multiple audio track selection controls, the multiple audio track selection controls corresponding one-to-one to the multiple audio track data of the target resource; in response to a selection operation on the first selection control, controlling the sound output device to output the first audio data of the target resource, the first selection control being any one of the multiple audio track selection controls, and the first audio data being the audio data of the audio track data corresponding to the first selection control.
[0586] In some examples, prompt information is displayed on each of the multiple track selection controls, and the prompt information is determined based on the language type information of the track data corresponding to the track selection control.
[0587] For example, the target resource includes three audio track data (i.e., audio track data 1, audio track data 2, and audio track data 3). The language type of the audio data corresponding to audio track data 1 is Chinese (audio track data 1 corresponds to Chinese audio data), the language type of the audio data corresponding to audio track data 2 is English (audio track data 2 corresponds to English audio data), and the language type of the audio data corresponding to audio track data 3 is Japanese (audio track data 2 corresponds to French audio data). For this, Fig. 27 As shown in (b), the track menu page may also include a "Chinese" track selection control corresponding to track data 1, an "English" track selection control corresponding to track data 2, and a "Japanese" track selection control corresponding to track data 3.
[0588] In this embodiment, multiple track selection controls can also be presented in the track menu page, so that users can also choose to listen to audio data corresponding to a certain track data, that is, audio data in a certain language, according to actual needs, which can meet the different needs of users.
[0589] The first preset condition is whether the target resource meets the condition of multi-track sharing. In some examples, the first preset condition may include at least one of the following: the number of tracks is greater than a first preset number (also referred to as a preset number threshold); the number of tracks is equal to the first preset number. Exemplarily, the first preset number is 2.
[0590] In some embodiments, when the number of audio tracks meets the first preset condition, it is determined whether the decoding type of the audio track data of the target resource meets the third preset condition. If the decoding type of the audio track data of the target resource meets the third preset condition, the display is controlled to present a multi-audio track sharing control.
[0591] Among them, the third preset condition may include that the multiple track data of the target resource include at least two types of track data. Among them, the decoding type may include a first decoding type, a second decoding type and a third decoding type. The first decoding type indicates that the audio data corresponding to the track data can only be decoded by hardware, that is, a hardware decoding type. The second decoding type indicates that the audio data corresponding to the track data can only be decoded by software, that is, a software decoding type. The third decoding type indicates that the audio data corresponding to the track data can be decoded by software or by software, that is, a hardware-decoding and a software-decoding type.
[0592] Exemplarily, the third preset condition may be that the number of audio tracks of the target resource is not equal to the number of fourth audio track data, and the number of audio tracks is not equal to the number of fifth audio track data, wherein the decoding type of the fourth audio track data is the first decoding type (i.e., hardware decoding type), and the decoding type of the fifth audio track data is the second decoding type (i.e., software decoding type).
[0593] In some examples, after controlling the display to present the multi-track sharing control, the method may further include: in response to a selection operation of the multi-track sharing control, if the number of tracks is not greater than a second preset number, controlling the display to present a first interface, the first interface including multiple track identifiers corresponding to multiple track data of the target resource. The first interface is a multi-track sharing interface, such as Fig.28 The bilingual shared page shown in (b) in the figure.
[0594] Among them, the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously. Optionally, the second preset number can be determined based on the performance of the hardware chip (such as the Bluetooth module) of the display device. Specifically, the second preset number can be positively correlated with the performance of the hardware chip. At present, the number of shared audio tracks that the hardware chip can support is 2 (that is, the second preset number is usually set to 2). In practical applications, as the performance of the hardware chip improves, the specific value of the corresponding second preset number can also be set to 3, 4, etc. The embodiment of the present disclosure does not limit the specific value of the second preset number.
[0595] Exemplarily, the first interface also includes a first broadcast control and / or a second broadcast control. The first broadcast control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, and one Bluetooth broadcast data corresponds to one track data among multiple track data. Exemplarily, the first broadcast control can be, for example, Fig.28 The second broadcast control is used to trigger the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices. Exemplarily, the second broadcast control can be, for example, Fig.28 The "Switch audio broadcast only" control shown in (b) in FIG.
[0596] Optionally, in response to a selection operation on a multi-track sharing control, if the number of tracks is equal to a second preset number, the display is controlled to present a first interface, wherein the first interface includes multiple track identifiers corresponding to multiple track data of the target resource.
[0597] For example, when the second preset number is 2 and the number of audio tracks of the target resource is equal to the second preset number, the first interface is presented as an example to illustrate the presentation process of the first interface. Fig.28 , displayed on the display device Fig.28The audio and video playback page shown in (a) of FIG. 1 is displayed, and the audio track menu page is displayed in the audio and video playback page. Among them, the audio track menu page displays multiple audio track sharing controls, such as the "bilingual sharing" control. In response to the selection operation of the "bilingual sharing" control, if the number of audio tracks of the target resource is equal to 2, then the display device presents Fig.28 The bilingual sharing page (i.e., the first interface) shown in (b) of FIG. 1 may include the track identifier "Chinese" corresponding to track data 1 and the track identifier "English" corresponding to track data 2. The multilingual sharing page may also display a "switch audio broadcast only" control (i.e., the first broadcast control) and a "connect Bluetooth device and switch" control (i.e., the second broadcast control).
[0598] In some examples, the first interface also includes a control for canceling multi-track sharing; the method may also include: in response to a selection operation for canceling the multi-track sharing control, exiting the multi-track sharing mode, and controlling the sound output device to output the first audio data of the target resource.
[0599] For example, Fig.28 As shown in (b) in FIG. 1 , the bilingual sharing page (i.e., the first interface) may further include a “cancel” control (i.e., a cancel multi-track sharing control). In response to a selection operation on the “cancel” control, the multi-track sharing mode is exited, and the sound output device is controlled to output the first audio data of the target resource.
[0600] In some examples, after controlling the display to present the multi-track sharing control, the method may further include: in response to a selection operation on the multi-track sharing control, if the number of tracks is greater than a second preset number, controlling the display to present a second interface. The second interface is an interface for selecting the track data to be shared, such as Fig.28 The track selection pop-up window shown in (c) in the figure. Exemplarily, the second interface may include multiple third track options, and the multiple third track options correspond to multiple track data of the target resource one by one. Among them, the third track options are used for the user to select the track data to be shared.
[0601] For example, when the second preset number is 2 and the number of audio tracks of the target resource is greater than the second preset number, the second interface is presented as an example to illustrate the presentation process of the second interface. Fig.28 In response to the selection operation of the "Bilingual Sharing" control, if the number of audio tracks of the target resource is greater than 2, the Fig.28The track selection pop-up window (i.e., the second interface) shown in (c) in the figure. The track selection pop-up window may include multiple track options (i.e., the third track option), such as a "Chinese" track option, an "English" track option, and a "Japanese" track option, and each track option has a corresponding check box. In addition, the track selection pop-up window may also display the words "Please select the shared track, only Bluetooth devices that support the LE audio protocol" to prompt the user to select multiple shared track data.
[0602] In some examples, after the display device presents the second interface, in response to a selection operation of a first number of third audio track options among multiple third audio track options, the display is controlled to present a third interface, and the third interface includes a first number of audio track identifiers corresponding to the first number of third audio track options.
[0603] The first number is less than or equal to the second preset number, and the first number is greater than or equal to two. For example, the second preset number is 2, and the first number is 2. For example, the second preset number is 3, and the first number can be 2 or 3.
[0604] The first interface is the multi-track sharing interface, such as Fig.28 The third interface may also include a first broadcast control and / or a second broadcast control, wherein the first broadcast control is used to trigger the Bluetooth module to send a first amount of Bluetooth broadcast data, where one Bluetooth broadcast data corresponds to one track data in the first amount of track data; and the second broadcast control is used to trigger the Bluetooth module to send Bluetooth broadcast data to the first amount of Bluetooth devices.
[0605] For example, the second preset number is 2 and the first number is 2, and the presentation process of the third interface is described. Fig.28 , upon receiving the Fig.28 After selecting the "Chinese" track option and the "English" track option in the track selection pop-up window shown in (c) in the figure, the Chinese track data corresponding to the "Chinese" track option and the English track data corresponding to the "English" track option are determined as the track data to be shared. Fig.28 As shown in (c) of FIG. 1 , the track selection pop-up window may also include a “confirm sharing” control. After receiving a trigger operation for the “confirm sharing” control, the track selection pop-up window jumps to Fig.28The multi-language sharing page (i.e., the third interface) shown in (d) in the figure. The multi-language sharing page displays the track identifiers of the Chinese track data corresponding to the selected "Chinese" track option and the English track data corresponding to the "English" track option, such as "Chinese" and "English", that is, the Chinese track data corresponding to the "Chinese" track option and the English track data corresponding to the "English" track option are determined as the track data to be shared by multiple tracks. Fig.28 As shown in (d) in FIG. 1 , a “switch audio broadcast only” control (ie, a first broadcast control) and a “connect Bluetooth device and switch” control (ie, a second broadcast control) may also be displayed in the multilingual sharing page.
[0606] In some examples, the second interface also includes a control for canceling multi-track sharing; the method also includes: in response to a selection operation for canceling the multi-track sharing control, exiting the multi-track sharing mode, and controlling the sound output device to output the first audio data of the target resource.
[0607] For example, Fig.28 As shown in (c) in FIG. 1 , the track selection pop-up window may also include a “cancel” control (i.e., cancel the multi-track sharing control). In response to the selection operation of the “cancel” control, the multi-track sharing mode is exited, and the sound output device is controlled to output the first audio data of the target resource.
[0608] Similarly, if Fig.28 As shown in (d) in FIG. 1 , the bilingual sharing page (i.e., the third interface) may further include a “cancel” control (i.e., a cancel multi-track sharing control). In response to a selection operation on the “cancel” control, the multi-track sharing mode is exited, and the sound output device is controlled to output the first audio data of the target resource.
[0609] In some examples, among the first number of audio track data corresponding to the selected first number of third audio track options, the number of audio track data whose decoding type belongs to the first decoding type is less than or equal to the third preset number, and the number of audio track data whose decoding type belongs to the second decoding type is less than or equal to the fourth preset number; the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
[0610] In some examples, the second preset number is two, the first number is two, the third preset number is one, and the fourth preset number is one; the display status of the third audio track option includes an optional state and an unselectable state, the optional state includes a selected state, and when the control display is presented in the second interface, the display status of multiple third audio track options presented in the second interface are all optional states; wherein, in response to a selection operation on a first number of third audio track options among the multiple third audio track options, controlling the display to present the third interface may include: in response to a selection operation on a fourth audio track option among the multiple third audio track options, the display status of the fourth audio track option is updated to a selected state, the display status of a fifth audio track option among the multiple third audio track options is updated to an unselectable state, and the display status of a sixth audio track option among the multiple third audio track options remains in an optional state.
[0611] Among them, the decoding type of the audio track data corresponding to the fourth audio track option is the first decoding type or the second decoding type, the decoding type of the audio track data corresponding to the fifth audio track option is the same as the decoding type of the audio track data corresponding to the fourth audio track option, and the decoding type of the audio track data corresponding to the sixth audio track option is different from the decoding type of the audio track data corresponding to the fourth audio track option.
[0612] For example, if the decoding type of the audio track data corresponding to the fourth audio track option is the hardware decoding type, after selecting the fourth audio track option, the remaining audio track options corresponding to the audio track data that only support hardware decoding (i.e., the fifth audio track option) are all updated to an unselectable state, while the audio track options corresponding to the audio track data that support software decoding and can be decoded by both software and hardware (i.e., the sixth audio track option) remain in an selectable state.
[0613] In an embodiment of the present application, when a user selects the audio track data to be shared, the display status of the remaining audio track options is dynamically adjusted according to the decoding type of the audio track data selected by the user to prompt the user which audio track data is available for selection. The operation is simple and the user experience is better.
[0614] Afterwards, in response to a selection operation for a seventh audio track option among at least one sixth audio track option, the control display presents a third interface, wherein the third interface includes the track identifier of the audio track data corresponding to the fourth audio track option and the track identifier of the audio track data corresponding to the seventh audio track option, and the display status of other audio track options among the multiple third audio track options except the fourth audio track option and the seventh audio track option are all in an unselectable state.
[0615] In an embodiment of the present application, when the number of audio track data selected by the user reaches the upper limit of the number of audio track data supported for simultaneous broadcast, the display status of the remaining audio track options is set to an unselectable state, which can prompt the user to perform subsequent multi-audio track sharing operations, which is convenient to use and provides a better user experience.
[0616] Exemplarily, after the controller updates the display status of the fourth audio track option to a selected status, updates the display status of the fifth audio track option among the multiple third audio track options to an unselectable status, and the display status of the sixth audio track option among the multiple third audio track options remains as an selectable status, the method may further include: in response to a deselection operation on the fourth audio track option, updating the display status of the fifth audio track option from an unselectable status to a selectable status.
[0617] That is to say, when the user cancels the selected audio track option, the display status of the remaining audio track options with the same decoding type as the audio track option will change from unselectable to selectable, so that the user can be prompted to select the audio track data to be shared.
[0618] In other examples, the second preset number is two, the first number is two, the third preset number is one, and the fourth preset number is one; the display state of the third audio track option includes an optional state and an unselectable state, the optional state includes a selected state, and when the control display is presented in the second interface, the display states of the multiple third audio track options presented in the second interface are all optional states; wherein, in response to a selection operation on a first number of third audio track options among the multiple third audio track options, controlling the display to present the third interface may include: in response to a selection operation on a fourth audio track option among the multiple third audio track options, the display state of the fourth audio track option is updated to a selected state, and the display states of the audio track options other than the fourth audio track option among the multiple third audio track options remain in an optional state, wherein the decoding type of the audio track data corresponding to the fourth audio track option is a third decoding type, and the third decoding type is a decoding type that can support both hardware decoding and software decoding.
[0619] In an embodiment of the present application, when a user selects the audio track data to be shared, the display status of the remaining audio track options is dynamically adjusted according to the decoding type of the audio track data selected by the user to prompt the user which audio track data is available for selection. The operation is simple and the user experience is better.
[0620] Afterwards, in response to a selection operation for the seventh track option among the track options other than the fourth track option, the control display presents a third interface, wherein the third interface includes the track identifier of the track data corresponding to the fourth track option and the track identifier of the track data corresponding to the seventh track option, and the display status of other track options among the multiple third track options except the fourth track option and the seventh track option are all in an unselectable state.
[0621] In an embodiment of the present application, when the number of audio track data selected by the user reaches the upper limit of the number of audio track data supported for simultaneous broadcast, the display status of the remaining audio track options is set to an unselectable state, which can prompt the user to perform subsequent multi-audio track sharing operations, which is convenient to use and provides a better user experience.
[0622] In some examples, the method may also include: in response to a selection operation on the first broadcast control, controlling the Bluetooth module to send multiple Bluetooth broadcast data based on different broadcast channels.
[0623] The following is a schematic illustration of the process of triggering the Bluetooth module to send multiple Bluetooth broadcast data through the first broadcast control.
[0624] In some examples, after controlling the display to present the first interface, in response to a selection operation on the first broadcast control, the Bluetooth module is controlled to send multiple Bluetooth broadcast data, and one Bluetooth broadcast data corresponds to one audio track data among multiple audio track data.
[0625] Taking the second preset number as 2, when the number of audio tracks of the target resource is equal to the second preset number, presenting the first interface as an example, the process of triggering the Bluetooth module to send multiple Bluetooth broadcast data through the first broadcast control is described. Fig.29 , which is a schematic diagram of an interface change of an audio broadcast switching provided by an embodiment of the present application. Fig.29 As shown in (a), the bilingual sharing page (i.e., the first interface) can display the track identifiers of the track data to be shared, such as the track identifier "Chinese" corresponding to track data 1 and the track identifier "English" corresponding to track data 2. The "switch audio broadcast only" control (i.e., the first broadcast control) can also be displayed in the multilingual sharing page. When a trigger operation for the "switch audio broadcast only" control (i.e., the first broadcast control) is received, the player is controlled to pause playing the target audio and video resources.
[0626] In actual applications, in order to improve the user experience and make the user have certain expectations about the process of switching to the Bluetooth broadcast channel, it is also possible to display the Fig.29 A prompt pop-up window of “Bluetooth broadcast switching” as shown in (b) in the figure is displayed to prompt the user that the Bluetooth broadcast channel is currently being switched.
[0627] When it is determined that the Bluetooth broadcast channel is switched successfully and the target audio and video resources continue to be played, a prompt message "Bluetooth broadcast has been set" can also be displayed on the playback page of the target audio and video resources, such as Fig.29 As shown in (c), the user is prompted that the Bluetooth broadcast switch is successful and the audio and video resources are being broadcast simultaneously in two or more languages, that is, the Bluetooth module is controlled to send two Bluetooth broadcast data (Bluetooth broadcast data corresponding to audio track data 1 and Bluetooth broadcast data corresponding to audio track data 2).
[0628] Of course, in the embodiment of the present application, after presenting the third interface, the "switch audio broadcast only" control (ie, the first broadcast control) in the third interface can be used to trigger the Bluetooth module to send multiple Bluetooth broadcast data, which will not be repeated here.
[0629] The following is a schematic illustration of the process of triggering the Bluetooth module to send Bluetooth broadcast data to multiple Bluetooth devices through the second broadcast control.
[0630] In some examples, after controlling the display to present the first interface, the method further includes: in response to a selection operation on a second broadcast control, controlling the Bluetooth module to send multiple Bluetooth broadcast data, one Bluetooth broadcast data corresponding to one audio track data among multiple audio track data.
[0631] Specifically, in response to a selection operation on a second broadcast control, the control display presents a fourth interface, the fourth interface includes multiple device options, the multiple device options correspond one-to-one to multiple Bluetooth devices, and the multiple Bluetooth devices are Bluetooth devices that support the low power audio protocol; in response to a selection operation on a first device option among the multiple device options, the control display presents a fifth interface, the fifth interface includes a fourth audio track option and a seventh audio track option; in response to a selection operation on an eighth audio track option, an association relationship between a fifth audio track identification index and a second device identification is established, wherein the fifth audio track identification is the audio track identification of the audio track data corresponding to the eighth audio track option, the second device identification is the device identification of the Bluetooth device corresponding to the second device option, and the eighth audio track option is the fourth audio track option or the seventh audio track option.
[0632] In some examples, the fifth interface also includes a confirmation switch control. After establishing an association relationship between the fifth audio track identifier and the second device identifier, the method also includes: in response to a selection operation of the confirmation switch control, controlling the Bluetooth module to send fifth Bluetooth broadcast data to the Bluetooth device corresponding to the second device option based on the association relationship between the fifth audio track identifier and the second device identifier, and the fifth Bluetooth broadcast data is used to broadcast audio data of the audio track data corresponding to the eighth audio track option.
[0633] For example, see Fig.30 , which is another schematic diagram of the interface change of audio broadcast switching provided by the embodiment of the present application. Fig.30 As shown in (a) in the figure, the bilingual sharing page (i.e., the first interface) can display the track identifiers of the track data to be shared, such as the track identifier "Chinese" corresponding to track data 1 and the track identifier "English" corresponding to track data 2. The "Connect Bluetooth device and switch" control (i.e., the second broadcast control) can also be displayed in the multilingual sharing page. When a trigger operation is received for the "Connect Bluetooth device and switch" control (i.e., the second broadcast control), the display device presents Fig.30The device management page shown in (b) in FIG. 1 is displayed, and the connected LE audio device is dis...
Claims
1. A display device, characterized in that: include: monitor; Sound output device; A Bluetooth module, wherein the Bluetooth module supports a low-power audio protocol; A controller connected to the display, the sound output device and the Bluetooth module respectively, wherein the controller is configured as follows: Presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource; In response to the first operation, obtaining audio track information of the target resource; Determine the number of audio tracks of the target resource according to the audio track information; When the number of audio tracks meets a first preset condition, controlling the display to present a multi-audio track sharing control; In response to a selection operation on the multi-track sharing control, controlling the sound output device to stop outputting the first audio data; The Bluetooth module is controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, wherein the multiple Bluetooth broadcast data correspond to the multiple Bluetooth devices one by one, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data of the target resource.
2. The display device according to claim 1, characterized in that The first preset condition includes at least one of the following: The number of audio tracks is greater than a first preset number; The number of audio tracks is equal to the first preset number.
3. The display device according to claim 1, characterized in that When the controller controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller is specifically configured as follows: If the number of the audio tracks is not greater than a second preset number, controlling the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, where the second preset number is the number of audio track data that the Bluetooth module supports to be broadcast simultaneously; If the number of audio tracks is greater than the second preset number, a first number of first audio track data is determined from multiple audio track data of the target resource, and the Bluetooth module is controlled to send Bluetooth broadcast data to the first number of Bluetooth devices, and the Bluetooth broadcast data corresponding to one of the Bluetooth devices is used to broadcast audio data corresponding to one of the first audio track data in the first number, wherein the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
4. The display device according to claim 3, characterized in that Before determining a first quantity of first audio track data from the plurality of audio track data of the target resource, the controller is further configured to: If the number of the audio tracks is greater than the second preset number, controlling the display to present a plurality of audio track identifiers, wherein the plurality of audio track identifiers correspond one to one to a plurality of audio track data of the target resource; When the controller determines a first quantity of first audio track data from a plurality of audio track data of the target resource, the controller is specifically configured as follows: In response to a selection operation on the first number of first track identifiers among the plurality of track identifiers, the track data corresponding to each of the first track identifiers is determined as the first track data.
5. The display device according to claim 1, characterized in that The multiple audio track data of the target resource include the second audio track data and the third audio track data. When the controller controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the controller is specifically configured as follows: Determine, according to the association relationship between the audio track index and the device identifier, a first Bluetooth device corresponding to the second audio track data; Control the Bluetooth module to send first Bluetooth broadcast data to the first Bluetooth device based on a first Bluetooth broadcast channel corresponding to the second audio track data, where the first Bluetooth broadcast data is used to broadcast the audio data corresponding to the second audio track data; Determining, according to the association relationship, a second Bluetooth device corresponding to the third audio track data; The Bluetooth module is controlled to send second Bluetooth broadcast data to the second Bluetooth device based on a second Bluetooth broadcast channel corresponding to the third audio track data, where the second Bluetooth broadcast data is used to broadcast the audio data corresponding to the third audio track data.
6. The display device according to claim 5, characterized in that The controller is further configured to: Creating the first Bluetooth broadcast channel according to the audio track identifier corresponding to the second audio track data; Create the second Bluetooth broadcast channel according to the audio track identifier corresponding to the third audio track data.
7. The display device according to claim 5, characterized in that The controller is further configured to: In case of receiving the audio track data configuration operation, controlling the display to present a plurality of device options, wherein the plurality of device options correspond one-to-one to the plurality of Bluetooth devices, and the plurality of Bluetooth devices are Bluetooth devices supporting the low power audio protocol; In response to a selection operation on a first device option among the plurality of device options, controlling the display to present the plurality of audio track options, the plurality of audio track options corresponding one-to-one to the plurality of audio track data; In response to a selection operation for a first audio track option among the multiple audio track options, a first audio track index and a first device identifier are associated to obtain an association relationship between the audio track index and the device identifier, wherein the first audio track index is the audio track identifier of the audio track data corresponding to the first audio track option, and the first device identifier is the device identifier of the Bluetooth device corresponding to the first device option.
8. The display device according to any one of claims 1 to 7, characterized in that: Before controlling the Bluetooth module to send a plurality of Bluetooth broadcast data to a plurality of Bluetooth devices, the controller is further configured to: Control the Bluetooth module to switch to the Bluetooth broadcast channel.
9. The display device according to claim 8, characterized in that Before controlling the Bluetooth module to send a plurality of Bluetooth broadcast data to a plurality of Bluetooth devices, the controller is further configured to: In response to a selection operation on the multi-track sharing control, controlling the player to pause playing the video data; Wherein, when the controller controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, it is specifically configured as follows: When it is determined that the Bluetooth module switches to the Bluetooth broadcast channel, the Bluetooth module is controlled to send the multiple Bluetooth broadcast data to the multiple Bluetooth devices, and the player is controlled to replay the video data from the start time of the video.
10. The display device according to claim 8, characterized in that Before controlling the Bluetooth module to send a plurality of Bluetooth broadcast data to a plurality of Bluetooth devices, the controller is further configured to: In response to a selection operation on the multi-track sharing control, controlling the player to pause playing the video data, and obtaining playing progress information of the video data; Wherein, when the controller controls the Bluetooth module to send multiple Bluetooth broadcast data to multiple Bluetooth devices, it is specifically configured as follows: When it is determined that the Bluetooth module switches to the Bluetooth broadcast channel, the player is controlled to replay the video data according to the playback progress information, and the audio data corresponding to the multiple audio track data of the target resource are processed according to the playback progress information, and the Bluetooth module is controlled to send the multiple Bluetooth broadcast data to the multiple Bluetooth devices based on the multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
11. The display device according to any one of claims 1 to 7, characterized in that: After controlling the Bluetooth module to send a plurality of Bluetooth broadcast data to a plurality of Bluetooth devices, the controller is further configured to: When the second preset condition is met, the Bluetooth module is controlled to stop sending multiple Bluetooth broadcast data to multiple Bluetooth devices, the player is controlled to pause playing the video data, and the playing progress information of the video data is obtained; Based on the playback progress information, controlling the player to replay the video data, and the sound output device to output the first audio data; The second preset condition includes at least one of the following: Receive the instruction to exit multi-track sharing; Detecting that the Bluetooth module is switched to an off state; Detecting that the player switches to background operation; An operation to stop playing the target resource is received.
12. A display device, characterized in that: include: monitor; Sound output device; A Bluetooth module, wherein the Bluetooth module supports a low-power audio protocol; A controller connected to the display, the sound output device and the Bluetooth module respectively, wherein the controller is configured as follows: Presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource; In response to the first operation, obtaining audio track information of the target resource; Determine the number of audio tracks of the target resource according to the audio track information; When the number of audio tracks meets a first preset condition, controlling the display to present a multi-audio track sharing control; In response to a selection operation on the multi-track sharing control, controlling the sound output device to stop outputting the first audio data; The Bluetooth module is controlled to send a plurality of Bluetooth broadcast data, wherein the plurality of Bluetooth broadcast data correspond one-to-one to a plurality of audio track data of the target resource, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data.
13. The display device according to claim 12, characterized in that The first preset condition includes at least one of the following: The number of audio tracks is greater than a first preset number; The number of audio tracks is equal to the first preset number.
14. The display device according to claim 12, characterized in that When the controller controls the Bluetooth module to send a plurality of Bluetooth broadcast data, the controller is specifically configured as follows: If the number of the audio tracks is not greater than a second preset number, controlling the Bluetooth module to send the plurality of Bluetooth broadcast data, wherein the second preset number is the number of the audio track data supported by the Bluetooth module for simultaneous broadcasting; If the number of audio tracks is greater than the second preset number, a first number of first audio track data is determined from the multiple audio track data, and the Bluetooth module is controlled to send the first number of Bluetooth broadcast data, one Bluetooth broadcast data is used to broadcast audio data corresponding to one first audio track data in the first number of first audio track data, wherein the first number is less than or equal to the second preset number, and the first number is greater than or equal to two.
15. The display device according to claim 14, characterized in that Before determining a first number of first audio track data from the plurality of audio track data, the controller is further configured to: If the number of the audio tracks is greater than the second preset number, controlling the display to present a plurality of audio track identifiers, wherein the plurality of audio track identifiers correspond one to one to a plurality of audio track data of the target resource; Wherein, when the controller determines a first quantity of first audio track data from the plurality of audio track data, it is specifically configured as follows: In response to a selection operation on the first number of first track identifiers among the plurality of track identifiers, the track data corresponding to each of the first track identifiers is determined as the first track data.
16. The display device according to any one of claims 12 to 15, characterized in that: When the controller controls the Bluetooth module to send a plurality of Bluetooth broadcast data, the controller is specifically configured as follows: Controlling the Bluetooth module to switch to a Bluetooth broadcast channel; When it is determined that the Bluetooth module is switched to the Bluetooth broadcast channel, the Bluetooth module is controlled to send the multiple Bluetooth broadcasts based on the multiple Bluetooth broadcast channels, wherein the multiple Bluetooth broadcast channels correspond to the multiple audio track data one by one.
17. The display device according to claim 16, characterized in that Before controlling the Bluetooth module to send a plurality of Bluetooth broadcast data, the controller is further configured to: In response to a selection operation on the multi-track sharing control, controlling the player to pause playing the video data; Wherein, when the controller controls the Bluetooth module to send multiple Bluetooth broadcast data, it is specifically configured as follows: When it is determined that the Bluetooth module switches to the Bluetooth broadcast channel, the Bluetooth module is controlled to send the multiple Bluetooth broadcasts based on the multiple Bluetooth broadcast channels, and the player is controlled to replay the video data from the start time of the video.
18. The display device according to claim 16, characterized in that Before controlling the Bluetooth module to send a plurality of Bluetooth broadcast data, the controller is further configured to: In response to a selection operation on the multi-track sharing control, controlling the player to pause playing the video data, and obtaining playing progress information of the video data; Wherein, when the controller controls the Bluetooth module to send multiple Bluetooth broadcast data, it is specifically configured as follows: When it is determined that the Bluetooth module switches to the Bluetooth broadcast channel, the player is controlled to replay the video data according to the playback progress information, and the audio data corresponding to the multiple audio track data of the target resource are processed according to the playback progress information, and the Bluetooth module is controlled to send the multiple Bluetooth broadcast data based on the multiple processed audio data, wherein one Bluetooth broadcast data is used to broadcast one processed audio data.
19. The display device according to any one of claims 12 to 15, characterized in that: After controlling the Bluetooth module to send a plurality of Bluetooth broadcast data, the controller is further configured to: When the second preset condition is met, the Bluetooth module is controlled to stop sending the plurality of Bluetooth broadcast data, the player is controlled to pause playing the video data, and playing progress information of the video data is obtained; Based on the playback progress information, controlling the player to replay the video data, and the sound output device to output the first audio data; The second preset condition includes at least one of the following: Receive the instruction to exit multi-track sharing; Detecting that the Bluetooth module is switched to an off state; Detecting that the player switches to background operation; An operation to stop playing the target resource is received.
20. An audio broadcasting method, characterized in that: include: Presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource; In response to the first operation, obtaining audio track information of the target resource; Determine the number of audio tracks of the target resource according to the audio track information; When the number of audio tracks meets a first preset condition, controlling the display to present a multi-audio track sharing control; In response to a selection operation on the multi-audio track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data to multiple Bluetooth devices, the multiple Bluetooth broadcast data correspond one-to-one to the multiple Bluetooth devices, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one audio track data of the target resource.
21. An audio broadcasting method, characterized in that: include: Presenting the video data of the target resource on the display, and controlling the sound output device to output the first audio data of the target resource; In response to the first operation, obtaining audio track information of the target resource; Determine the number of audio tracks of the target resource according to the audio track information; When the number of audio tracks meets a first preset condition, controlling the display to present a multi-audio track sharing control; In response to a selection operation on the multi-track sharing control, the sound output device is controlled to stop outputting the first audio data, and the Bluetooth module is controlled to send multiple Bluetooth broadcast data, wherein the multiple Bluetooth broadcast data correspond one-to-one to the multiple track data of the target resource, and one Bluetooth broadcast data is used to broadcast audio data corresponding to one track data.