Display device and audio playback method

Abstract

The embodiments of the present disclosure provide a display device and an audio playback method. The method comprises: in response to an audio playback instruction, a display device setting a Bluetooth communication mode to a receiving mode, and acquiring an audio signal sent by a mobile terminal; then detecting the current audio output device; if the current audio output device is a native speaker of the display device, switching an audio output path to set the audio output device as an external audio device, and sending the audio signal to the external audio device by means of the audio output path; and if the current audio output device is the external audio device, sending the audio signal to the external audio device by means of the audio output path so as to output the audio signal by means of the external audio device. According to the display device, audio from a mobile terminal can be outputted to the display device, and when connecting to an external audio device, the display device automatically switches an audio output device to the external audio device, thereby simplifying operating steps and improving the user experience.

Description

Display device and audio playback method

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This disclosure claims priority to Chinese application No. 202410164468.8, filed on February 5, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to the technical field of display devices, and in particular to a display device and an audio playback method. Background Art

[0004] A display device is an intelligent device capable of presenting a user interface and supporting user interaction. Taking intelligent display device 200 as an example, it is based on Internet application technology, features an open operating system and chip, and boasts an open application platform. It enables two-way human-computer interaction and integrates multiple functions, including audio, video, entertainment, and data, to meet diverse and personalized user needs. The display device can establish a connection with a mobile terminal via Bluetooth or other communication methods, enabling mutual control between the mobile terminal and the display device, allowing them to utilize each other's hardware to perform data processing or media playback.

[0005] After establishing a connection with a display device, the mobile terminal can send audio and video data to the display device via Bluetooth or other transmission methods. The display device then processes the received audio and video data, converting it into audio and video signals and playing them through the display device's display or speakers. This allows the mobile terminal to leverage the display device's hardware to achieve better media playback quality.

[0006] The display device can also be connected to other signal output devices. For example, the display device is connected to an external audio device through the audio return channel of the high-definition multimedia interface. Since the signal output method of the mobile terminal and / or the display device is changed when the display device establishes a connection relationship with the mobile terminal, the display device or the mobile terminal can use the other party's hardware to output multimedia signals. Therefore, when the display device is connected to an external signal output device and establishes a connection relationship with the mobile terminal, the configuration relationship of the signal output channel of the display device is complex, and it is necessary to select and switch the output channel multiple times, which makes the operation cumbersome and reduces the user experience. Summary of the Invention

[0007] The embodiments of the present disclosure provide a display device and an audio playback method to solve the problem of multiple selections and switching of output channels when the display device is connected to an external signal output device and establishes a connection with a mobile terminal, which makes the operation cumbersome.

[0008] In a first aspect, an embodiment of the present disclosure provides a display device, which may include: a device interface for connecting to an external audio device; a communicator configured to establish a Bluetooth communication connection with a mobile terminal; a processor connected to the display, the device interface and the communicator, respectively, and configured to: in response to an audio playback instruction, set the Bluetooth communication mode of the display device to a receiving mode, and obtain an audio signal sent by the mobile terminal; wherein the audio playback instruction is input by the mobile terminal when performing audio playback, and the mobile terminal communicates with the display device via Bluetooth through the Bluetooth communication mode, and the Bluetooth communication mode is one of a sending mode and a receiving mode; when the current audio output device is set to be a local speaker of the display device and the device interface is connected to an external audio device, switch the audio output path to set the current audio output device to the external audio device, and send the audio signal to the external audio device through the switched audio output path, so that the audio signal is output through the external audio device; when the current audio output device is set to be the local speaker of the display device and the device interface is not connected to an external audio device, send the audio signal to the local speaker.

[0009] In a second aspect, an embodiment of the present disclosure provides an audio playback method, which is applied to the display device described in the first aspect, and the method includes: in response to an audio playback instruction, setting the Bluetooth communication mode of the display device to a receiving mode, and obtaining an audio signal sent by the mobile terminal; wherein the audio playback instruction is input by the mobile terminal when performing audio playback, and the mobile terminal performs Bluetooth communication with the display device through the Bluetooth communication mode, and the Bluetooth communication mode is one of a sending mode and a receiving mode; when the current audio output device is set to be the local speaker of the display device and the device interface is connected to an external audio device, switching the audio output path to set the current audio output device to the external audio device, and sending the audio signal to the external audio device through the switched audio output path to output the audio signal through the external audio device; when the current audio output device is set to be the local speaker of the display device and the device interface is not connected to an external audio device, sending the audio signal to the local speaker. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG1 is a schematic diagram of a usage scenario of a display device according to some embodiments;

[0011] FIG2 is a block diagram of a hardware configuration of a display device according to some embodiments;

[0012] FIG3 is a schematic diagram of a connection relationship among a mobile terminal, a display device, and an external device according to some embodiments;

[0013] FIG4 is a block diagram of a hardware configuration of a control device according to some embodiments;

[0014] FIG5 is a schematic diagram of software configuration in a display device according to some embodiments;

[0015] FIG6 is a schematic diagram of the structure of a music playing system according to some embodiments;

[0016] FIG7 is a schematic diagram of a Bluetooth pairing process according to some embodiments;

[0017] FIG8 is a schematic diagram of a process of pairing triggered based on NFC according to some embodiments;

[0018] FIG9 is a schematic diagram of an audio playback process of a display device according to some embodiments;

[0019] FIG10 is a schematic diagram of data interaction between an audio transmitting end and an audio receiving end according to some embodiments;

[0020] FIG11 is a schematic diagram of a Bluetooth data transmission process according to some embodiments;

[0021] FIG12 is a schematic diagram of an audio output device setting interface according to some embodiments;

[0022] FIG13 is a timing diagram of a mobile terminal, a display device, and an external device performing audio output according to some embodiments;

[0023] FIG14 is a schematic diagram of an audio processing flow of a display device according to some embodiments;

[0024] FIG15 is a schematic diagram of a mobile terminal audio playback process according to some embodiments;

[0025] FIG16 is a flow chart of an audio playback method according to some embodiments. DETAILED DESCRIPTION

[0026] FIG1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments. As shown in FIG1 , a user can operate a display device 200 through a mobile terminal 300 and a control device 100 .

[0027] In some embodiments, the mobile terminal 300 can install software applications on the display device 200 and connect to the display device 200 through a network communication protocol to achieve one-to-one control operations and data communication. It is also possible to transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronous display.

[0028] 1 , the display device 200 also communicates data with the server 400 via various communication methods. The display device 200 may be connected to the server 400 via a local area network (LAN), a wireless local area network (WLAN), or other networks.

[0029] In addition to providing the broadcast receiving display device 200 function, the display device 200 can also provide additional intelligent network display device 200 functions with computer support functions, including but not limited to network display device 200, intelligent display device 200, Internet protocol display device 200 (IPTV), etc.

[0030] Figure 2 is a hardware configuration block diagram of the display device shown in Figure 1. As shown in Figure 2, the display device 200 may include at least one of a tuner and demodulator 210, a communicator 220, a detector 230, a device interface 240, a processor 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0031] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0032] In some embodiments, the display 260 includes a display screen component for presenting images, and a driving component for driving image display, a component for receiving image signals output from a processor, and a component for displaying video content, image content, and a menu control interface, as well as a user control UI interface, etc.

[0033] In some embodiments, the communicator 220 is a component for communicating with an external device or server 400 using various communication protocols. The display device 200 can establish a communication connection with the mobile terminal 300 using the same communication method via the communicator 220. For example, the communicator 220 may include a Bluetooth module, and the mobile terminal 300 may also include a Bluetooth module, enabling the display device 200 to establish a connection with the mobile terminal 300 using Bluetooth communication.

[0034] As shown in Figure 3, data or media signals can be transmitted between the display device 200 and the mobile terminal 300 based on the communicator 220. After the display device 200 and the mobile terminal 300 establish a connection relationship, the display device 200 can send data or media signals to the mobile terminal 300, and the mobile terminal 300 can also send data or media signals to the display device 200. The display device 200 can set a Bluetooth connection mode. For example, the Bluetooth connection mode of the display device 200 can be a sending mode or a receiving mode. In the sending mode, the display device 200 mainly sends data or signals to the mobile terminal 300 via Bluetooth, while in the receiving mode, the display device 200 mainly receives data or signals from the mobile terminal 300 via Bluetooth.

[0035] After the display device 200 establishes a communication connection with the mobile terminal 300, the display device 200 and the mobile terminal 300 can, based on the communication connection relationship, serve as a transmitter (source) and a receiver (sink), respectively, in different forms of data transmission. For example, when the display device 200 plays audio from the mobile terminal 300 via a Bluetooth connection, the mobile terminal 300 can send the audio data to the display device 200 via the Bluetooth transmission path, thereby outputting the sound through the speaker of the display device 200 or an external speaker. In the above-mentioned audio playback process, the display device 200 serves as a receiver, and the mobile terminal 300 serves as a transmitter.

[0036] In some embodiments, the device interface 240 is a component used to establish a communication connection between the display device 200 and the external device 500. The device interface 240 includes, but is not limited to, any one or more interfaces such as a High Definition Multimedia Interface (HDMI), an analog or digital high-definition component input interface (component), a composite video broadcast signal (CVBS) input interface, a Universal Serial Bus (USB) input interface, and an RGB port. Alternatively, the device interface 240 may be a composite input / output interface formed by multiple of the aforementioned interfaces.

[0037] The connection between the display device 200 and the external device 500 refers to establishing a communication connection, wherein the display device 200 and the external device 500 that establish the communication connection serve as a receiving end (Sink) and a sending end (Source), respectively. For example, the external device 500 may be an external audio device. When a user uses the display device 200, the display device 200 may transmit audio data during media playback to the external audio device via the device interface 240, so that the sound of the display device 200 is output through the external audio device. In this case, the display device 200 serves as a sending end, and the external audio device serves as a receiving end.

[0038] A communication connection can be achieved between the transmitting end and the receiving end through a specific interface to transmit data. To this end, a data interface with the same interface specifications and functions should be provided on both the transmitting end and the receiving end. For example, as shown in FIG3 , a High Definition Multimedia Interface (HDMI) is provided on both the display device 200 and the external device 500. During use, the user can plug the two ends of the HDMI interface data cable into the display device 200 and the external device 500 respectively, and after starting the external device 500 and the display device 200, set the signal source of the display device 200 to the HDMI interface, thereby realizing data transmission between the display device 200 and the external device 500.

[0039] It should be noted that, in order to achieve a communication connection between the display device 200 and the external device 500, other connection methods can be used between the display device 200 and the external device 500. The specific connection method can be a wired connection method, such as a digital visual interface (DVI), a video graphics array (VGA), a USB interface, etc.; or it can be a wireless connection method, such as a wireless local area network, a Bluetooth connection, an infrared connection, etc. Different communication connection methods can use different information transmission protocols. For example, when an HDMI interface is used for connection, the HDMI protocol can be used for data transmission.

[0040] In some embodiments, the processor 250 may include a video processor, an audio processor, a graphics processor, RAM, ROM, and first to nth interfaces for input / output. The processor 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The processor 250 controls the overall operation of the display device 200.

[0041] In some embodiments, the processor 250 and the tuner / demodulator 210 may be located in different separate devices, that is, the tuner / demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.

[0042] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0043] In some embodiments, the user interface 280 is an interface that can be used to receive control input.

[0044] Fig. 4 is a block diagram of the hardware configuration of the control device shown in Fig. 1. As shown in Fig. 4, the control device 100 includes a processor 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0045] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0046] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0047] In some embodiments, as shown in FIG. 1 , the mobile terminal 300 or other intelligent electronic device can perform similar functions as the control device 100 after installing an application for controlling the display device 200 .

[0048] The processor 110 includes a RAM 113 and a ROM 114, a communication interface 130, and a communication bus. The processor 110 is used to control the operation and operation of the control device 100, as well as the communication and coordination between internal components and the external and internal data processing functions.

[0049] The communication interface 130 communicates control signals and data signals with the display device 200 under the control of the processor 110. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0050] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0051] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0052] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the processor. The memory 190 can store various control signal instructions input by the user.

[0053] The power supply 180 is used to provide operating power support for various components of the control device 100 under the control of the processor.

[0054] Figure 5 is a schematic diagram of the software configuration of the display device shown in Figure 1. As shown in Figure 5, the software system of the display device can be divided into four layers, from top to bottom: the application layer (referred to as the "application layer"), the application framework layer (referred to as the "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as the "system runtime library layer"), and the kernel layer.

[0055] In some embodiments, at least one application runs in the application layer. These applications can be window programs, system settings programs, clock programs, etc. that come with the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0056] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0057] Continuing with Figure 5, the application framework layer may also include a view system, managers, content providers, and the like. The view system can design and implement the interface and interaction of the application, and includes lists, grids, text boxes, buttons, and the like. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0058] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling the exit, opening, and backing of an application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling display window changes (such as shrinking the display window, shaking the display, distorting the display, etc.).

[0059] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0060] In some embodiments, the kernel layer is a layer between hardware and software. As shown in FIG5 , the kernel layer includes at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a Wi-Fi driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver.

[0061] Based on the above display device 200, a user can simultaneously connect the display device 200 to the external device 500 through the mobile terminal 300 to form a media playback system consisting of the mobile terminal 300, the display device 200, and the external device 500. For example, the display device 200 can be connected to the mobile terminal 300 via Bluetooth and to the external device 500 via an HDMI interface.

[0062] After establishing a connection relationship between the mobile terminal 300, the display device 200, and the external device 500, the display device 200 can interact with the mobile terminal 300 alone, with the external device 500 alone, or with the mobile terminal 300 and the external device 500 at the same time. For example, a terminal device 300 such as a mobile phone is connected to the display device 200 via Bluetooth, while the display device 200 is connected to an external device 500 such as a speaker via an HDMI interface. When the mobile terminal 300 plays audio, the mobile terminal 300 sends audio data to the display device 200, and the display device 200 then forwards the audio data to the external speaker via the audio return channel (ARC) of the HDMI interface, so that the audio signal of the mobile terminal 300 is output through the external speaker.

[0063] In order to implement the above-mentioned media playback system, in some embodiments, a functional module may also be configured in the display device 200. It should be noted that the functional module may be a software module, a hardware module, or a combination of a software module and a hardware module. The functional modules configured in the display device 200 may include a Bluetooth module, a basic service module, and a music application module. Among them, the Bluetooth module is used to control Bluetooth-related logic and communicate messages with the music application module; the service module is used to provide the ability to query and switch sound output devices; and the music application module is used to memorize and save the current sound output device type and call to switch the sound output device.

[0064] The Bluetooth module may include a Bluetooth functional circuit built into the communicator 220 of the display device 200, and the basic service module and the music application module may be respectively provided as Bluetooth functional programs in the software application layer, framework layer, system (native) layer, and driver layer of the display device 200. For example, the system architecture of the display device 200 may include a hardware (HW) Bluetooth chip layer, a Bluetooth protocol stack layer, a language native interface, a Bluetooth system service, a Bluetooth framework, a Bluetooth application, and the like.

[0065] As shown in Figure 6, the Bluetooth chip layer uses the Hardware Interface Definition Language (HIDL) to interact with the Bluetooth protocol stack. It consists of the following components: the Radio Frequency (RF) layer, which transmits local Bluetooth data to remote devices via RF and receives data from remote Bluetooth devices via RF. The Baseband (BB) layer converts RF signals into digital or voice signals, implementing the baseband protocol and other low-level connection procedures. The Link Manager Protocol (LMP) layer manages communication between Bluetooth devices, implementing operations such as link establishment, verification, and configuration. The Host Controller Interface (HCI) layer, at the chip level, processes protocol stack data, converts it into internal chip actions, and reports received remote data to the protocol stack via the HCI. The Bluetooth Low Energy (BLE) physical layer, part of the BLE protocol stack, specifies the wireless frequency band, modulation and demodulation methods, and other aspects of the BLE protocol. The Bluetooth Low Energy Link Layer (BLE LL) is responsible for managing communications between BLE devices.

[0066] The Bluetooth protocol stack layer is provided by default in the Android Open Source Project (AOSP) and is located in system / bt. This stack implements the Bluetooth Hardware Abstraction Layer (HAL) and can be customized through extensions and configuration changes. The Bluetooth protocol stack provides all practical Bluetooth operations, such as turning Bluetooth on and off, managing Bluetooth, searching, managing links, and implementing various protocol profiles.

[0067] The protocol specifications that can be implemented by the Bluetooth protocol stack layer may include: Host Controller Interface (HCI), which is responsible for sending protocol stack data to the Bluetooth chip through transport and receiving data from the Bluetooth chip. Logical Link Control and Adaptation Protocol (L2CAP), which is used to exchange ACL data packets into a data packet format that is convenient for high-level applications, and provides functions such as protocol multiplexing and quality of service exchange. Bluetooth Audio Control Protocol (Audio / Video Remote Control Profile, AVRCP), which is used to remotely control audio and video devices. AVRCP defines how to control the characteristics of streaming media, including remote control operations such as pausing, stopping, starting playback, and volume control. Bluetooth Audio Protocol (Advanced Audio Distribution Profile, A2DP), which is used to transmit stereo audio data. A2DP allows Bluetooth devices to transmit uncompressed audio data over a wireless connection, thereby playing high-quality audio on wireless headphones, speakers, and other devices.

[0068] The Java Native Interface (JNI) is the JNI code associated with android.bluetooth and is located in packages / apps / Bluetooth / jni. When a specific Bluetooth operation occurs (for example, when a device is discovered), the JNI code calls the Bluetooth protocol stack.

[0069] The Bluetooth system service, located in packages / apps / Bluetooth, is packaged as an Android application and implements Bluetooth services and profiles at the Android framework level. This application calls the native Bluetooth protocol stack through JNI. This layer provides all upper-layer services and interacts with the underlying Bluedroid layer. The btAdapter primarily provides basic Bluetooth operations such as enable, disable, discovery, pair, unpair, createRfcomm, and the respective profile services.

[0070] The framework layer provides the Android Bluetooth-related Application Programming Interface (API), including the android.bluetooth API for interacting with Bluetooth hardware. It can internally call Bluetooth processes through the Binder IPC mechanism.

[0071] The application layer, namely the Android Bluetooth application, is a program that uses the Bluetooth API. The display device 200 can call the music application when it needs to play audio. The music application can be set with a corresponding application name based on the developer's settings and system requirements for other modules to call, such as Hi Audio.

[0072] Based on the above functional modules, an embodiment of the present disclosure provides a display device 200. The display device 200 may include a display 260 for displaying a user interface. The display device 200 may also include a communicator 220 for establishing a communication connection with a terminal device 300 via the communicator 220. When the communicator 220 includes a built-in Bluetooth transmission function circuit, the display device 200 can establish a Bluetooth communication connection with the terminal device 300 using a Bluetooth transmission method.

[0073] As shown in FIG7 , in some embodiments, in order to establish a Bluetooth communication connection between the display device 200 and the terminal device 300, the display device 200 can register a monitoring service with the Bluetooth module through the music application in response to a power-on instruction. The monitoring service is used to monitor Bluetooth status change events and sound playback broadcasts of the Bluetooth module.

[0074] If a Bluetooth status change event is detected, a pairing instruction is sent to the mobile terminal 300 via the Bluetooth module. The Bluetooth status change event is triggered by the mobile terminal 300 performing a Bluetooth search. The pairing instruction is used to trigger the mobile terminal 300 to establish a Bluetooth connection with the display device. Furthermore, the display 260 is controlled to display a pairing prompt view, which includes the identification information of the mobile terminal 300.

[0075] For example, when the display device 200 is turned on, the Hi Music application can register with the Bluetooth module to monitor changes in Bluetooth status and whether the sound is playing a broadcast. The Bluetooth transmission mode of the display device 200 can be SINK mode by default. The mobile terminal 300 turns on the Bluetooth search, and the Bluetooth tag of the display device 200 can be searched for and connected. After the mobile terminal 300 and the display device 200 are paired and connected by Bluetooth, the Hi Music application of the display device 200 will monitor the status changes of the Bluetooth module, and a view prompt will pop up on the screen displayed on the display to indicate that the display device 200 has been paired and connected with the mobile terminal 300, such as the prompt text "Bluetooth is connected to my phone 1".

[0076] As shown in Figure 8, the display device 200 may have a built-in near field communication (NFC), and the mobile terminal 300 may have a built-in near field communication (NFC) module. When the mobile terminal 300 touches the preset NFC sticker of the display device 200 through the pre-installed NFC application, the mobile terminal 300 and the display device 200 will be paired via Bluetooth. That is, the display device 200 can obtain a trigger instruction for the Bluetooth connection, wherein the trigger instruction is generated by the connection function application pre-installed in the mobile terminal 300 when the near field communication module senses the near field communicator, or the trigger instruction is generated by the music application when the near field communicator senses the near field communication module.

[0077] After receiving the Bluetooth connection trigger instruction, the display device 200 can respond to the trigger instruction and send a pairing instruction to the mobile terminal 300 according to the trigger instruction, wherein the pairing instruction is used to trigger the mobile terminal 300 to establish a Bluetooth connection with the display device. The display device 200 can then control the display to display a pairing prompt view, which includes the identification information of the mobile terminal 300.

[0078] For example, when the display device 200 is turned on, the Hi Music application can register with the Bluetooth module to monitor changes in Bluetooth status and whether the sound is playing a broadcast. The Bluetooth transmission mode of the display device 200 can be SINK mode by default. When the mobile terminal 300 touches the preset NFC sticker of the display device 200 through the pre-installed NFC application, the mobile terminal 300 and the display device 200 will be paired with Bluetooth. After the mobile terminal 300 and the display device 200 are paired and connected via Bluetooth, the Hi Music application of the display device 200 will monitor the status changes of the Bluetooth module and pop up a visual prompt on the screen displayed on the display to indicate that the display device 200 has been paired and connected with the mobile terminal 300.

[0079] The display device 200 may further include a device interface 240 for connecting to the external device 500 . When the external device 500 is an external audio device with an audio output function, the display device 200 may be connected to the external audio device through the device interface 240 .

[0080] As shown in FIG9 , the display device 200 may further include a processor 250 . The processor 250 may be configured to execute program steps corresponding to an audio playback method, including the following:

[0081] S100: In response to the audio playback instruction, setting the Bluetooth communication mode of the display device to a receiving mode to obtain an audio signal sent by the mobile terminal;

[0082] The audio playback instruction is input by the mobile terminal 300 when performing audio playback. After establishing a Bluetooth connection with the display device 200, the mobile terminal 300 can monitor its own operation events. When an audio playback event is monitored, the mobile terminal 300 can generate an audio playback instruction and send the audio playback instruction to the display device 200 via Bluetooth, so that the display device 200 can receive the audio playback instruction.

[0083] In some embodiments, the mobile terminal 300 may have a built-in monitoring application. After the mobile terminal 300 establishes a Bluetooth connection with the display device 200, the monitoring application starts running and monitors audio playback events of the mobile terminal 300. When the user clicks the play button control in the audio playback interface through an interactive method such as touch, the monitoring application can monitor the audio playback event, generate an audio playback instruction, and then send the audio playback instruction to the display device 200 through the built-in Bluetooth communication module of the mobile terminal 300.

[0084] In some embodiments, the monitoring application can be called by other applications related to audio playback or home systems. That is, during the operation of the relevant application, if the display device 200 needs to play audio data, it can also call the monitoring application to monitor the running events of the mobile terminal 300 and generate audio playback instructions.

[0085] In some embodiments, the audio playback instruction may also be generated by a specific application in the mobile terminal 300. For example, the display device 200 has a "Hi Audio" application installed, and the mobile terminal 300 also has a "Hi Audio" application installed. When the mobile terminal 300 plays audio through the "Hi Audio" application, the "Hi Audio" application will automatically detect the display device 200 that has established a Bluetooth connection with the mobile terminal 300, and after detecting the display device 200, generate an audio playback instruction and send the audio playback instruction to the display device 200 through the "Hi Audio" application.

[0086] In some embodiments, the audio playback instruction can also be sent to the display device 200 via a specific method other than a Bluetooth connection. For example, the display device 200 has a built-in NFC communicator, and the mobile terminal 300 has a built-in NFC module. After the mobile terminal 300 generates an audio playback instruction by monitoring the audio playback event, it can send the audio playback instruction to the display device 200 via the NFC component. In other words, by bringing the NFC component of the mobile terminal 300 close to the NFC sensing area of ​​the display device 200, after the NFC signal is sensed, the display device 200 can obtain the audio playback instruction through the NFC sensing signal.

[0087] Due to the limitations of the signal transmission method of the NFC component, the two NFC components need to be placed together or kept at a close distance to perform NFC data transmission, which will bring inconvenience in operation. Therefore, in some embodiments, the display device 200 and the mobile terminal 300 may have a built-in NFC function application. In the mobile terminal 300, the NFC function application can change the recognition state of the NFC component during sensing. Therefore, when the NFC components of the display device 200 and the mobile terminal 300 are close to each other, the NFC component of the mobile terminal 300 generates an NFC signal of a specific format. After the NFC component of the display device 200 senses the NFC signal of the specific format, the NFC function application of the display device 200 can determine that the mobile terminal 300 is executing audio playback, thereby generating an audio playback instruction.

[0088] It should be noted that the above-mentioned audio playback instructions are merely a general term for instructions for controlling the audio playback process, and do not limit the specific audio content. In this field, the audio playback instructions obtained by the display device 200 can be used to represent the mobile terminal 300 playing audio, and can also be used to represent the mobile terminal 300 playing other types of audio, such as voice audio, prompt audio, etc.

[0089] After obtaining the audio playback instruction, the display device 200 can set the Bluetooth communication mode to the receiving mode in response to the audio playback instruction. Among them, the Bluetooth communication mode is one of the sending mode and the receiving mode. Since the display device 200 and the mobile terminal 300 both have data processing capabilities and signal output capabilities, after the display device 200 establishes a Bluetooth connection relationship with the mobile terminal 300, the display device 200 and the mobile terminal 300 can perform two-way communication based on the Bluetooth connection relationship, that is, the display device 200 can send data to the mobile terminal 300, and the mobile terminal 300 can also send data to the display device 200 at the same time. Therefore, in order to enable the display device 200 to output sound signals as a sink end, the display device 200 needs to set the Bluetooth communication mode to the receiving mode.

[0090] S200: Acquire an audio signal sent by a mobile terminal;

[0091] After setting the Bluetooth communication mode to receive mode, the display device 200 can obtain audio signals from the mobile terminal 300 via the Bluetooth connection. The audio signals are signals obtained by decoding the audio data on the player of the mobile terminal 300. When the user interacts with the mobile terminal 300 to control the mobile terminal 300 to play audio, the mobile terminal 300 can first obtain the audio data, then call the player to decode the audio data to convert it into an audio signal. The audio signal is then transmitted to the display device 200 according to the Bluetooth transmission protocol and Bluetooth transmission rules.

[0092] As shown in FIG10 , in some embodiments, the mobile terminal 300 compresses the sound signal into a preset audio format according to the Bluetooth audio protocol and then sends a data packet to the communicator 220 based on a transmission protocol. The transmission protocol includes the Bluetooth transmission protocol, the logical link control and adaptation protocol, and the host control protocol.

[0093] For example, the mobile terminal 300, as the SOURCE end, can convert the audio data into Pulse Code Modulation (PCM) data through player decoding. After collecting the PCM data, the mobile terminal 300 sends it to the A2DP protocol unit. A2DP is compressed into a specific audio format through codec PCM lib (SBC, MPEG-1, 2Audio MPEG-2, 4AACATRAC family or custom encoder pcm lib, etc.), and then handed over to the AVDTP protocol unit. The AVDTP protocol unit transfers it to the L2CAP protocol unit, and the L2CAP protocol unit transfers it to the HCI protocol unit in the ACL format. Then it reaches the Bluetooth chip (BT chip) and is sent to the display device 200 via RF radio frequency.

[0094] Accordingly, as shown in FIG11 , at the display device 200, after acquiring an audio data packet, the audio data packet can be sent to a parsing thread via an access control list, so that the parsing thread parses the audio data packet according to the host control protocol. The parsing thread is then controlled to parse the audio data packet based on the logical link control and adaptation protocol. Furthermore, the parsing thread is controlled to parse the audio data packet based on the Bluetooth transmission protocol to obtain compressed data. The compressed data is then decompressed into an audio signal according to the Bluetooth audio protocol.

[0095] For example, the display device 200 serving as the sink receives audio signal data through RF, and then passes it to the HCI protocol unit after ACL parsing, and then to the L2CAP protocol unit, the L2CAP protocol unit passes it to the AVDTP protocol unit, and the AVDTP protocol unit passes it to the A2DP protocol unit. The A2DP protocol unit receives the compressed data from the remote, which is then decompressed into PCM data through codec pcm lib (SBC, MPEG-1, 2Audio MPEG-2, 4AACATRAC family or custom encoder pcm lib), and then passed to the audio output interface for playback.

[0096] In some embodiments, when acquiring an audio signal sent by the mobile terminal 300, the display device 200 may receive audio data packets through the communicator and then store the audio data packets in an audio receiving queue. If the number of audio data packets in the audio receiving queue is greater than or equal to a preset packet number threshold, the audio data packets in the data receiving queue may be parsed to obtain an audio signal, and the audio signal may be written to the audio output path.

[0097] For example, after the A2DP audio stream is enabled between the display device 200 and the mobile terminal 300, the SOURCE end sends a packet of audio data to the SINK every 20ms. After receiving the audio data packet, the SINK end does not decode the data immediately. Instead, it stores the data in the audio data receiving queue and starts decoding after the queue reaches 5 packets. The decoded data is finally written to the Audio Track for playback. The SOURCE end continuously transmits audio data, and the SINK also continuously receives data, decodes it, and writes it to the Audio Track. As a result, Bluetooth audio is continuously played from the audio system of the SINK end.

[0098] After acquiring the audio signal, the display device 200 can detect the current audio output device. To detect the current audio output device, in some embodiments, the display device 200 can read the current audio output path and determine the audio output device based on the audio output path. For example, the display device 200 determines that the current audio output device is an external audio device when it reads the current audio output path and determines that the audio output path includes an HDMI interface mark. If the display device 200 determines that the audio output path includes an audio output interface (local speaker) mark, the display device 200 determines that the current audio output device is a local speaker.

[0099] In some embodiments, the display device 200 can also record the audio output device through a setting field in the configuration file. When detecting the current audio output device, the current state value of the setting field in the configuration file can be read. For example, the "audio output device" item can be set in the configuration file of the display device 200. When "audio output device = 0", it means that the current audio output device is the local speaker. When "audio output device" is another value, it means that the current audio output device is the external device 500, that is, an external audio device.

[0100] In some embodiments, the display device 200 can also record the audio output device through the setting status. That is, as shown in Figure 12, the user selects the sound output device through a specific audio setting interface, and the display device 200 records the setting status according to the items selected by the user during the setting process. Therefore, when the display device 200 detects the current audio output device, it can read the recorded setting status and determine the current audio output device based on the setting status. For example, when an external audio device is connected to the display device 200 via an HDMI interface, the "sound output device" menu in the setting interface of the display device 200 is provided with an HDMI ARC option. When the user clicks on this option, it means that the user has set the current audio output device to an external audio device. At this time, the display device 200 can record the "setting: audio output device = HDMI ARC" table item through the setting file. Accordingly, after obtaining the audio signal, the display device 200 can read the corresponding table item in the setting file to determine that the current audio output device is an external audio device connected to the HDMI interface.

[0101] S300: When the current audio output device is set to the local speaker of the display device and an external audio device is connected to the device interface, the audio output path is switched to set the current audio output device to the external audio device, and the audio signal is sent to the external audio device through the switched audio output path to output the audio signal through the external audio device.

[0102] S400: When the currently set audio output device is a local speaker of the display device and the device interface is not connected to an external audio device, the audio signal is sent to the local speaker.

[0103] In some embodiments, the display device 200 can detect the current audio output device and the external device 500 currently connected to the display device 200. When the audio output device is not an external audio device, the audio output path can be switched, that is, the audio output device can be set to an external audio device. For example, when the display device 200 reads the table entry "setting: audio output device = Native speakers", it determines that the current audio output device is the native speakers of the display device 200. At this time, the display device 200 can automatically execute the audio output path setting program, that is, execute "setting: audio output device = HDMI ARC", and switch the audio output device to the external audio device.

[0104] In some embodiments, when the current output device is set to an external audio device and the device interface 240 is not connected to the external audio device, the display device 200 can send the audio signal to the local speaker of the display device 200. The local speaker plays the audio sent by the mobile terminal 300.

[0105] After switching the audio output path, the display device 200 sends the audio signal to the external audio device through the switched audio output path, so as to output the audio signal through the external audio device. For example, since the audio signal data is transmitted from the mobile terminal 300 to the Bluetooth protocol stack of the display device 200 through the Bluetooth protocol stack, the Bluetooth protocol stack of the display device 200 can write the sound data to the Audio Track of the display device 200. If the sound output device is the local speaker of the display device 200, that is, the sound is played through the display device 200, then the sound effect of playing the sound (especially songs, etc.) through the HDMI ARC external audio device is better. Therefore, when playing audio, when the HDMI ARC external audio device is connected to the display device 200, it can be actively switched to the external audio device for sound output.

[0106] When the display device 200 detects that the current audio output device is an external audio device, it can directly send the audio signal to the external audio device so that the sound corresponding to the audio signal can be output through the external audio device. For example, when the display device 200 reads the setting status and determines "setting: audio output device = HDMI ARC", it means that the current audio output device of the display device 200 is an HDMI ARC external audio device. In this case, the display device 200 can directly send the sound signal to the external audio device through the audio transmission path of the external audio device for playback.

[0107] In some embodiments, the display device 200 is configured with a service module and a music application. The display device 200 can register and listen for Bluetooth connection status broadcasts through the music application. In response to the Bluetooth connection status broadcast, the service module's communication interface is initialized. A first thread is then enabled to call the service module to obtain the access status of the external audio device, and a second thread is enabled to call the service module to determine the current audio output device through the service module's communication interface.

[0108] For example, when the user interacts on the mobile terminal 300 and controls the mobile terminal 300 to play audio through local audio or online audio, the Hi Music application of the display device 200 can receive a broadcast sent by the Bluetooth system service, which indicates that the display device 200 is playing Bluetooth audio. At this time, the display device 200 can pull up the view of playing audio in the Hi Music application and initialize the interface for communicating with the service module.

[0109] After initializing the communication interface of the service module, the display device 200 can start the first thread to call the service module to obtain the access status of the external audio device through the service module, and start the second thread to call the service module to obtain the current audio output device information through the communication interface of the service module. At this time, if the audio data is not switched, it is transmitted from the mobile terminal 300 to the Bluetooth protocol stack of the display device 200 through the Bluetooth protocol stack, and the Bluetooth protocol stack of the display device 200 then writes the sound data to the Audio Track of the display device 200. If the sound output device is the local speaker of the display device 200, the sound is played by the local speaker of the display device 200. However, in order to play the sound through the HDMI ARC device to obtain a better audio output effect, when the Hi audio plays the audio, it actively switches to the device by accessing the HDMI ARC device, that is, if the current audio output device is an external audio device, the service module is notified to wake up the external audio device and set the audio output path to the external audio device.

[0110] In order to set the audio output device, in some embodiments, the processor 250 of the display device 200 is further configured with middleware, which includes a device initialization interface. The display device 200 can respond to the startup instruction of the music application and read the access identifier in the connection configuration file through the first thread. The connection configuration file is used to record the device connection status of the device interface; the access identifier is generated when the external device 500 is connected to the device interface. Therefore, when the above embodiment uses the first thread to call the service module to obtain the access status of the external audio device, the connection configuration file can be read through the first thread when the Hi Music application is enabled; if the access identifier indicating that the external device is an external audio device is read in the file, it is determined that the external audio device has been connected.

[0111] In some embodiments, the service module can register a broadcast receiver when the display device 200 is turned on, so that the service module has the ability to receive broadcasts. Specifically, the service module can be controlled to switch the registered broadcast receiver through the audio return channel (Audio Return Channel, arc). Thus, in step S300, the audio output path is switched to set the current audio output device to the external audio device, and the audio signal is sent to the external audio device through the switched audio output path. When the audio signal is output through the external audio device, the device initialization interface of the middleware can be called to wake up the external audio device; and then a wake-up broadcast is sent to the service module, so that the service module calls the middleware based on the specified communication protocol to switch the audio output path to the device interface 240 connected to the external audio device, thereby completing the playback of the audio sent by the mobile terminal 300 through the external audio device.

[0112] For example, when the display device 200 detects the external audio device access device interface 240 (i.e., HDMI ARC interface), the external audio device will generate a General Purpose Input Output (GPIO) change when powered on. At this time, the display device 200 can write an attribute to identify the arc access. After starting the music application, the music application will call the arc initialization interface of the middleware to wake up the external audio device. Then, by reflection, the service module is called to use the "System Manager invoke Tv method" method to call the "hs TV Wake Up Arc Device" interface to wake up the arc device. Then, a broadcast with the action of "com.hi××.single listen.WAKE_UP" is sent to the service module, and the service module calls the framework layer Audio Manage to switch the current Audio output channel to the HDMI ARC channel.

[0113] In addition, if the display device 200 is not currently connected to an HDMI ARC device, the display device 200 can register a monitoring service to monitor the access status of the HDMI ARC device. When the monitoring service detects that an HDMI ARC device is connected, it notifies the service module to wake up the HDMI ARC device and switch the sound output device to the HDMI ARC device. At this time, the sound is played by the mobile terminal 300, and the sound signal data is transmitted to the display device 200 via the Bluetooth protocol. The display device 200 transmits it to the external audio device (SOUND BAR) through the HDMI ARC path for playback.

[0114] It can be seen that in the above embodiment, the display device 200 can send the audio signal generated by the mobile terminal 300 to the external audio device for playback through the interaction between the built-in service module, the Bluetooth module and the music application, so that during the audio playback of the terminal device 300, the external audio device can be used to obtain better audio playback effects.

[0115] When the mobile terminal 300 stops playing audio or the mobile terminal 300 disconnects from the display device 200 via Bluetooth, the display device 200 needs to restore the original audio output mode based on the interaction between the service module, the Bluetooth module, and the music application, and record the state during playback. That is, in some embodiments, the display device 200 can obtain the memory data saved by the music application in response to the stop playback instruction. The stop playback instruction is generated by the mobile terminal 300 when stopping audio playback, or the stop playback instruction is generated by the controller when monitoring the disconnection of the Bluetooth connection between the display device and the mobile terminal.

[0116] For example, when the user controls the mobile terminal 300 to stop playing audio, such as clicking a stop control, exiting a music application, or launching another application that occupies the audio channel, the mobile terminal 300 may generate a stop playback instruction and send the stop playback instruction to the display device 200. For another example, when the mobile terminal 300 leaves the Bluetooth connection range of the display device 200, the Bluetooth connection between the mobile terminal 300 and the display device 200 will be disconnected. At this time, the display device 200 may automatically generate a stop playback instruction to trigger the display device 200 to obtain the memory data saved by the music application.

[0117] After acquiring the memory data stored by the music application, the display device 200 can extract the memory device information and memory status information from the memory data. The memory device information is used to identify the audio output device of the display device before the audio playback instruction is received; the memory status information is used to identify the Bluetooth communication mode and Bluetooth on / off status of the display device before the audio playback instruction is received.

[0118] For example, before receiving the audio playback instruction, the display device 200 can generate a memory file for recording the connection relationship and connection status based on the connection relationship with the mobile terminal 300 and the external device 500. The data recorded in the memory file is called memory data. Then, in the memory data, "audio output device = native speaker" can be used to record that the audio output device of the display device is the native speaker before obtaining the audio playback instruction; "Bluetooth mode = source" can be used to indicate that the Bluetooth communication mode of the display device is the sending mode before obtaining the audio playback instruction; and "Bluetooth switch status = on" can be used to indicate that the Bluetooth switch status of the display device is on before obtaining the audio playback instruction. Based on this. The display device 200 can read the corresponding fields in the memory data to determine the memory device information and memory status information.

[0119] After extracting the memory device information and memory status information, the display device 200 starts a third thread according to the memory device information, and calls the service module through the third thread to set the audio output device to the device corresponding to the memory device information, and sets the Bluetooth communication mode of the display device to the mode corresponding to the memory status information, or sets the Bluetooth switch state of the display device to the switch state corresponding to the memory status information.

[0120] For example, by reading "audio output device = native speaker" in the memory data, it can be determined that the memory device information of the display device 200 is the local speaker. Therefore, when the Hi Music application exits or actively disconnects the Bluetooth connection, the display device 200 can start a third thread to call the service module to switch the sound output device to the local speaker.

[0121] To facilitate understanding of the above process, FIG13 shows a timing flow of the interactive audio playback performed by the display device 200, the mobile terminal 300, and the external device 500, including the following steps:

[0122] Among them, the display device 200 may include an application layer, a framework layer and a middleware layer; as shown in Figure 13, the music application located in the application layer refers to the Hi music application mentioned above, the TV platform service System Manager and TvService located in the framework layer refer to the service module mentioned above, and the HDMI middleware and Audio middleware located in the middleware layer refer to the middleware mentioned above.

[0123] A1. The display device 200 is powered on and the TV platform service TvService registers the arc switch broadcast receiver.

[0124] A2. HDMI middleware detects connected external devices;

[0125] A3. The HDMI middleware enters the access identifier of the external device into the connection configuration file;

[0126] In some embodiments, the service module can register a broadcast receiver when the display device 200 is turned on so that the service module has broadcast receiving capabilities. The HDMI middleware can determine the currently connected external device 500 through the device interface 240 and enter the access identifier representing the external device 500 into the connection profile.

[0127] A4. Open the Hi Music app;

[0128] A5. Initialize Bluetooth service for Hi Music app;

[0129] A6, Hi Music app sets Bluetooth to be discoverable;

[0130] A7, Hi Music app sets Bluetooth to sink A2DP mode;

[0131] A8. The mobile terminal 300 establishes a Bluetooth connection with the display device 200 and sends audio data to the display device 200;

[0132] In some embodiments, after the Hi Music application is enabled, the Bluetooth service is first initialized, Bluetooth is set to discoverable mode, and the sink A2DP mode is enabled. Because A2DP allows Bluetooth devices to transmit uncompressed audio data over a wireless connection, high-quality audio can be played on devices such as wireless headphones and speakers. Thus, a Bluetooth connection can be established with the mobile terminal 300 and audio data sent by the mobile terminal 300 can be received.

[0133] A9. The music app obtains the current audio output device and the currently connected external device;

[0134] In some embodiments, the audio data sent by the mobile terminal 300 can be sent to the Bluetooth protocol stack via the Bluetooth application, and then transmitted back to the Hi Music application by the Bluetooth protocol stack to inform the Hi Music application of the application layer that there is currently newly received audio data waiting to be played. At this time, the Hi Music application can read it by itself, or enable the first thread to read the access identifier of the connection profile entered in step A3 through the service module (the TV platform service TvService shown in Figure 13), and then obtain the currently connected external device 500 based on the access identifier. At the same time, the Hi Music application can also start the second thread to call the service module to determine the current audio output device set by the display device 200 through the communication interface of the service module.

[0135] A10. When the current audio output device is the local speaker and the currently connected external device is an external audio device, the music app wakes up the external audio device through reflection.

[0136] In some embodiments, the Hi Music application can call the "System Manager invoke Tv method" of the service module (the TV platform service System Manager shown in Figure 13) through reflection to call the HDMI middleware through the built-in "hs TV Wake Up Arc Device" interface to wake up the external device 500.

[0137] A11. The music app sends a broadcast message to the TV platform service TvService to switch the audio output path.

[0138] A12. The TV platform service TvService instructs the HDMI middleware to complete the initialization of the CEC protocol amplifier;

[0139] A13, the HDMI middleware establishes a CEC communication channel with the external device 500;

[0140] In some embodiments, the Hi Music application may send a broadcast to the TV platform service TvService to switch the audio output path. After the TV platform service TvService receives the broadcast through the broadcast receiver registered at startup, it instructs the HDMI middleware to complete the initialization function of the CEC protocol so that the HDMID middleware establishes a CEC communication channel with the external device 500.

[0141] A14. The TV platform service TvService switches the audio output path and unmutes the audio.

[0142] A15. The music application switches to the registered avrcp service and plays the control interface through animation playback;

[0143] The TV platform service TvService connects to the device interface 240 of the audio output path of the current audio output device (local speaker) to switch the audio output path to the external device 500 (i.e., external audio device). After the path is switched, the mute mode of the path is released to play the audio sent by the mobile terminal 300 through the external device 500. Furthermore, after completing the switching of the audio output path, the Hi Music application registers the Bluetooth audio control protocol AVRCP and plays the control interface through the animation playback mode, thereby realizing remote control of the external device 500.

[0144] A16. Exit the Hi Music app;

[0145] A17, Hi Music app turns off A2DP, exits avrcp service, and switches to source mode;

[0146] A18, Hi Music app sends a broadcast to the Bluetooth protocol stack to switch the audio output device;

[0147] A19. The Bluetooth protocol stack instructs the Audio middleware to switch back to the original audio output device.

[0148] The user can exit the Hi Music application through the mobile terminal 300. When exiting, the Hi Music application will turn off the current Bluetooth A2DP mode and exit the avrcp service, switching the display device 200 from sink mode back to source mode. At the same time, when exiting, the Hi Music application needs to send an official message to the Bluetooth protocol station to instruct the Audio middleware through the Bluetooth protocol stack to switch the current audio output device (external audio device) back to the original local speaker.

[0149] Based on the above display device 200, the embodiment of the present disclosure further provides an audio playback method, as shown in FIG14 , comprising:

[0150] In response to an audio playback instruction, setting the Bluetooth communication mode of the display device to a receiving mode, and acquiring an audio signal sent by the mobile terminal; wherein the audio playback instruction is input by the mobile terminal when performing audio playback, and the mobile terminal performs Bluetooth communication with the display device via the Bluetooth communication mode, wherein the Bluetooth communication mode is one of a sending mode and a receiving mode;

[0151] When the current audio output device is set to be a local speaker of the display device and an external audio device is connected to the device interface, switching the audio output path to set the current audio output device to the external audio device, and sending the audio signal to the external audio device through the switched audio output path, so that the audio signal is output through the external audio device;

[0152] When the currently set audio output device is a local speaker of the display device and the device interface is not connected to an external audio device, the audio signal is sent to the local speaker.

[0153] The display device and audio playback method provided in the above embodiments can automatically switch the sound output device to the HDMI ARC external audio device when the display device is connected to a high-quality external audio device such as HDMI ARC, thereby simplifying the operation steps and improving the user experience.

[0154] In conjunction with the display device 200 in the above-described embodiment, a mobile terminal 300 is also provided in the present disclosure. The mobile terminal 300 may include a display module for displaying a terminal screen. The mobile terminal 300 may also include a communication module for establishing a Bluetooth communication connection with the display device 200. The device interface 240 of the display device 200 is also connected to an external audio device.

[0155] The mobile terminal 300 may further include a processor, as shown in FIG15 , which is configured to execute an audio playback method applicable to the mobile terminal, comprising the following steps:

[0156] In response to a play operation event instructing to play audio data, calling a player and generating an audio play instruction;

[0157] Decoding the audio data using a player to obtain an audio signal;

[0158] An audio playback instruction and an audio signal are sent to a display device so that the display device detects the current audio output device of the display device; if the current audio output device is a local speaker of the display device, the audio output path is switched to set the audio output device to an external audio device, and the audio signal is sent to the external audio device through the audio output path; if the current audio output device is an external audio device, the audio signal is sent to the external audio device through the audio output path to output the audio signal through the external audio device.

[0159] Based on the mobile terminal 300 provided in the above embodiment, the embodiment of the present disclosure further provides an audio playback method applied to the mobile terminal 300, as shown in FIG16 , the method includes:

[0160] In response to a play operation event instructing to play audio data, calling a player and generating an audio play instruction;

[0161] Decoding the audio data using a player to obtain an audio signal;

[0162] An audio playback instruction and an audio signal are sent to a display device so that the display device detects the current audio output device of the display device; if the current audio output device is a local speaker of the display device, the audio output path is switched to set the audio output device to an external audio device, and the audio signal is sent to the external audio device through the audio output path; if the current audio output device is an external audio device, the audio signal is sent to the external audio device through the audio output path to output the audio signal through the external audio device.

[0163] The mobile terminal 300 and audio playback method provided in the above embodiment can, upon generating a play operation event instructing the playback of audio data, invoke a player to decode the audio data and simultaneously generate an audio playback instruction. The audio playback instruction and audio signal are then transmitted to the display device 200 via the Bluetooth connection between the mobile terminal 300 and the display device 200. When an external audio device is connected to the device interface 240, the display device 200 automatically switches the audio output path and transmits the audio signal to the external audio device for playback, thereby utilizing the high-quality sound output of the external audio device and improving the user experience.

[0164] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be repeated here.

[0165] Those skilled in the art will clearly understand that the technology in the embodiments of the present disclosure can be implemented by means of software plus the necessary general hardware platform. Based on this understanding, the solutions involved in the embodiments of the present disclosure, or the portion that contributes to the existing technology, can be embodied in the form of a software product. The computer software product can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present disclosure or certain parts of the embodiments.

Claims

1. A display device, comprising: a display for displaying a user interface; Device interface, used to connect external audio equipment; a communicator configured to establish a Bluetooth communication connection with a mobile terminal; a processor connected to the display, the device interface, and the communicator, respectively, and configured to: In response to an audio playback instruction, setting the Bluetooth communication mode of the display device to a receiving mode, and acquiring an audio signal sent by the mobile terminal; wherein the audio playback instruction is input by the mobile terminal when performing audio playback, and the mobile terminal performs Bluetooth communication with the display device via the Bluetooth communication mode, wherein the Bluetooth communication mode is one of a sending mode and a receiving mode; When the current audio output device is set to be a local speaker of the display device and an external audio device is connected to the device interface, switching the audio output path to set the current audio output device to the external audio device, and sending the audio signal to the external audio device through the switched audio output path, so that the audio signal is output through the external audio device; When the currently set audio output device is a local speaker of the display device and the device interface is not connected to an external audio device, the audio signal is sent to the local speaker.

2. The display device according to claim 1, wherein The processor is configured with a service module and a music application, and the processor is further configured to: Register and monitor Bluetooth connection status broadcasts through the music application; In response to the Bluetooth connection status broadcast regarding the audio playback instruction, initializing the communication interface of the service module; A first thread is enabled to call the service module to obtain the access status of the external audio device, and a second thread is enabled to call the service module to determine the current audio output device through the communication interface of the service module.

3. The display device according to claim 2, wherein the processor is configured with middleware; the processor is further configured to: In response to a power-on instruction of the display device, detecting, through the middleware, an external device currently connected to the device interface, and entering an access identifier representing the external device into a connection configuration file; The processor executes the step of enabling the first thread to call the service module to obtain the access status of the external audio device, and is specifically configured to: In response to a start instruction for starting a music application, reading the connection configuration file through the first thread; If an access identifier indicating that the external device is the external audio device is read, it is determined that the external audio device has been connected.

4. The display device according to claim 3, wherein the processor is further configured to: In response to a power-on instruction of the display device, registering a broadcast receiver through the service module; The processor executes the switching of the audio output path to set the current audio output device to the external audio device, and sends the audio signal to the external audio device through the switched audio output path, and is specifically configured as follows: Calling the device initialization interface of the middleware to wake up the external audio device; A wake-up broadcast is sent to the service module, so that the service module calls the middleware based on a specified communication protocol to switch the audio output path to the device interface connected to the external audio device.

5. The display device according to claim 1 , wherein the communicator is configured with a Bluetooth module, and the processor is further configured to: In response to a power-on instruction of the display device, registering a monitoring service with the Bluetooth module through the music application, wherein the monitoring service is used to monitor Bluetooth status change events and sound playback broadcasts of the Bluetooth module; If a Bluetooth status change event is monitored, a pairing instruction is sent to the mobile terminal through the Bluetooth module, wherein the Bluetooth status change event is an event triggered by the mobile terminal performing a Bluetooth search, and the pairing instruction is used to trigger the mobile terminal to establish a Bluetooth connection with the display device; The display is controlled to display a pairing prompt view, where the pairing prompt view includes identification information of the mobile terminal.

6. The display device according to claim 1, wherein the display device has a built-in near field communicator, and the processor is further configured to: Obtaining a trigger instruction for a Bluetooth connection, the trigger instruction being generated by a connection function application preinstalled in the mobile terminal when a near field communication module built into the mobile terminal senses the near field communicator, or by the music application when the near field communicator senses the near field communication module; Sending a pairing instruction to the mobile terminal according to the trigger instruction, wherein the pairing instruction is used to trigger the mobile terminal to establish a Bluetooth connection with the display device; The display is controlled to display a pairing prompt view, where the pairing prompt view includes identification information of the mobile terminal.

7. The display device according to claim 1 , wherein the processor is further configured to: Retrieving memory data stored in the music application in response to a stop playback instruction, the stop playback instruction being generated by the mobile terminal when the audio playback is stopped, or the stop playback instruction being generated by the controller when monitoring that the display device is disconnected from the mobile terminal via Bluetooth; extracting memory device information and memory status information from the memory data, wherein the memory device information is used to represent the audio output device of the display device before obtaining the audio playback instruction; The memory status information is used to represent the Bluetooth communication mode and Bluetooth switch status of the display device before obtaining the audio playback instruction; Starting a third thread according to the memory device information, so as to call a service module through the third thread to set the audio output device to the device corresponding to the memory device information; The Bluetooth communication mode of the display device is set to the mode corresponding to the memory status information, or the Bluetooth switch state of the display device is set to the switch state corresponding to the memory status information.

8. The display device according to any one of claims 1 to 7, wherein the processor is configured to obtain the audio signal sent by the mobile terminal: receiving an audio data packet via the communicator; Storing the audio data packet in an audio receiving queue; If the number of audio data packets in the audio receiving queue is greater than or equal to a preset packet number threshold, parsing the audio data packets in the data receiving queue to obtain an audio signal; The audio signal is written to the audio output path.

9. The display device according to claim 8, wherein the processor performs the parsing of the audio data packets in the data receiving queue to obtain the audio signal, and is specifically configured to: Extracting the audio data packet from the receiving queue, the audio data packet being a data packet sent to the communicator based on a transmission protocol after the mobile terminal compresses the sound signal into a preset audio format according to the Bluetooth audio protocol; the transmission protocol includes the Bluetooth transmission protocol, the logical link control and adaptation protocol, and the host control protocol; Sending the audio data packet to a parsing thread through an access control list, so that the parsing thread parses the audio data packet according to the host control protocol; Controlling the parsing thread to parse the audio data packet based on the logical link control and adaptation protocol; Controlling the parsing thread to parse the audio data packet based on the Bluetooth transmission protocol to obtain compressed data; The compressed data is decompressed into the audio signal according to the Bluetooth audio protocol.

10. The display device according to any one of claims 1 to 7, wherein the processor is further configured to: When the currently set output device is the external audio device and the device interface is not connected to the external audio device, the audio signal is sent to the local speaker.

11. An audio playback method, applied to the display device according to any one of claims 1 to 10, the method comprising: In response to an audio playback instruction, setting the Bluetooth communication mode of the display device to a receiving mode, and acquiring an audio signal sent by the mobile terminal; wherein the audio playback instruction is input by the mobile terminal when performing audio playback, and the mobile terminal performs Bluetooth communication with the display device via the Bluetooth communication mode, wherein the Bluetooth communication mode is one of a sending mode and a receiving mode; When the current audio output device is set to be a local speaker of the display device and an external audio device is connected to the device interface, switching the audio output path to set the current audio output device to the external audio device, and sending the audio signal to the external audio device through the switched audio output path, so that the audio signal is output through the external audio device; When the currently set audio output device is a local speaker of the display device and the device interface is not connected to an external audio device, the audio signal is sent to the local speaker.

Images