Display device and audio playing method

Abstract

The invention relates to a display device and an audio playing method, and relates to the technical field of audio playing. The display device includes: a display configured to display content; a communication means configured to communicate with a first external device; the at least one controller is connected with the display and is configured to receive an audio screen projection request of first external equipment under the condition that the display presents the first interface; in response to the audio screen projection request, acquiring audio transmission data of the first external equipment and a background switch state of an audio background playing switch in the display equipment; and when it is determined that the audio transmission data is allowed to be played at the background of the display device according to the background on-off state, keeping the display to present the first interface, and playing the audio transmission data. According to the embodiment of the invention, the received audio transmission data can be played under the condition that the original picture on the display equipment is not shielded.

Description

Technical Field

[0001] This application relates to the technical field of audio playback, and particularly to a display device and an audio playback method. Background Art

[0002] With the continuous development of audio playback technology, in order to expand the audio playback scenarios, screen mirroring technology can be used to play audio. For example, the audio content on a mobile device (such as a mobile phone, tablet) can be transmitted to another device (such as a projector, TV) for playback through wireless or wired screen mirroring.

[0003] However, when using screen mirroring technology to play audio, after the audio receiving end receives the audio, it will automatically start the audio playback interface on the associated display device, thus blocking the original screen on the display device. Summary of the Invention

[0004] This application provides a display device and an audio playback method, which can play the received audio transmission data without blocking the original screen on the display device.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] A display configured to display content;

[0007] A communication device configured to communicate with a first external device;

[0008] And at least one controller, connected to the display and configured to:

[0009] Receive an audio screen mirroring request from the first external device when the display presents a first interface;

[0010] In response to the audio screen mirroring request, obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device;

[0011] When it is determined that the audio transmission data is allowed to be played in the background of the display device according to the background switch state, keep the display presenting the first interface and play the audio transmission data.

[0012] In the above technical solution, compared with the related art when starting the audio playback interface during audio screen mirroring, during the above audio playback process, by introducing an audio background playback switch, when the first interface is already presented on the display, according to the background switch state of the background playback switch, it is determined that when it is allowed to play the audio transmission data in the background of the display device, the background playback method is adopted to play the audio transmission data, that is, while keeping the display continue to present the original picture, the audio transmission data is played, achieving the effect of playing the audio transmission data without blocking the original picture in the display device.

[0013] In some embodiments, the controller is further configured to:

[0014] When it is determined, according to the background switch state, that it is not allowed to play the audio transmission data in the background of the display device, control the display to present a second interface and play the audio transmission data; wherein, the second interface is an audio screen mirroring interface.

[0015] In the above technical solution, on the one hand, when it is determined, according to the background switch state, that it is not allowed to play the audio transmission data in the background of the display device, the foreground playback method is adopted to play the audio transmission data, that is, when the display presents the second interface which is the audio screen mirroring interface, the audio transmission data is played; on the other hand, by combining the background switch state, the playback method of the audio transmission data is flexibly selected, increasing the intelligence level of the display device and improving the user experience.

[0016] In some embodiments, when the controller executes to determine that it is allowed to play the audio transmission data in the background of the display device according to the background switch state, it is configured to:

[0017] When the background switch state is in the on state, determine that it is allowed to play the audio transmission data in the background of the display device;

[0018] When the background switch state is in the off state, determine that it is not allowed to play the audio transmission data in the background of the display device.

[0019] In the above technical solution, by judging whether it is allowed to play the audio transmission data in the background of the display device based on the background switch state, the accuracy of determining the audio transmission data playback method can be ensured.

[0020] In some embodiments, the display device further includes:

[0021] At least one high-definition multimedia interface, configured to be connected to a second external device to receive the multimedia playback content of the second external device;

[0022] Before the controller executes to receive the audio screen mirroring request of the first external device, it is further configured to:

[0023] The control display presents a first interface and plays the audio content data in the multimedia playback content; wherein, the first interface includes the video content data in the multimedia playback content.

[0024] In the above technical solution, in the multimedia playback scenario, based on the background switch state of the background playback switch, when it is determined that the audio transmission data is allowed to be played in the background of the display device, while the display continuously presents the picture corresponding to the video content data in the multimedia playback content, the audio transmission data is played, that is, the continuity of the picture playback of the multimedia playback content and the timeliness of the audio transmission data playback are ensured.

[0025] In some embodiments, when it is determined, according to the background switch state, that the audio transmission data is allowed to be played in the background of the display device, when the controller executes playing the audio transmission data, it is configured to:

[0026] Stop playing the audio content data in the multimedia playback content and play the audio transmission data; or,

[0027] Play the audio transmission data and the audio content data in the multimedia playback content simultaneously.

[0028] In the above technical solution, by providing two different audio playback methods in the case of playing the audio transmission data in the background, the flexibility of audio playback is improved.

[0029] In some embodiments, when it is determined, according to the background switch state, that the audio transmission data is not allowed to be played in the background of the display device, when the controller executes playing the audio transmission data, it is configured to:

[0030] Stop playing the audio content data in the multimedia playback content and play the audio transmission data.

[0031] In the above technical solution, by stopping playing the audio content data in the multimedia playback content when the audio transmission data is not allowed to be played in the background, the playback of the audio transmission data is ensured, thereby enhancing the user experience.

[0032] In some embodiments, when the controller executes playing the audio transmission data, it is configured to:

[0033] When the audio transmission data is audio content data, use an audio player to play the audio transmission data;

[0034] When the audio transmission data is an audio link, use a media player to play the audio transmission data.

[0035] In the above technical solution, by providing two different types of audio playback methods corresponding to audio transmission data on the display device side, that is, the range of audio transmission data received by the display device is widened, and then the audio screen mirroring scenarios of the first external device connected to the display device are widened, thereby improving the user experience.

[0036] In some embodiments, before or at the same time as executing the playback of the audio transmission data, the controller is further configured to:

[0037] Control the display to present an audio off icon associated with the audio transmission data;

[0038] During the process of executing the playback of the audio transmission data, the controller is further configured to:

[0039] In response to a trigger operation on the audio off icon, disconnect the connection with the first external device and stop playing the audio transmission data.

[0040] In the above technical solution, by introducing an audio off icon to disconnect the audio screen mirroring of the first external device, it can ensure the accuracy of the audio screen mirroring disconnection timing and the convenience of audio screen mirroring disconnection when the display device cannot determine the user's operation on the audio transmission data by directly obtaining the focus event.

[0041] In some embodiments, when the controller executes the disconnection of the connection with the first external device, it is configured to:

[0042] Disconnect the connection with the first external device and send a disconnection message to the first external device; wherein, the disconnection message is used to indicate that the display device has disconnected the connection with the first external device; or,

[0043] Send a disconnection instruction to the first external device to instruct the first external device to disconnect the connection with the display device.

[0044] In the above technical solution, by using two different methods of active disconnection and passive disconnection to disconnect the connection between the display device and the first external device, the flexibility and reliability of device disconnection can be improved.

[0045] In a second aspect, some embodiments further provide an audio playback method, including:

[0046] When the display presents the first interface, receive an audio screen mirroring request from the first external device;

[0047] In response to the audio screen mirroring request, obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device;

[0048] When it is determined, according to the background switch state, that audio transmission data is allowed to be played in the background of the display device, the display is maintained to present the first interface, and the audio transmission data is played.

[0049] In the above technical solution, when the display presents the first interface, an audio screen mirroring request from a first external device is received, and in response to the audio screen mirroring request, the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device are obtained. Furthermore, when it is determined, according to the background switch state, that audio transmission data is allowed to be played in the background of the display device, the display is maintained to present the first interface, and the audio transmission data is played. Compared with the related technology that starts an audio playback interface during audio screen mirroring, during the above audio playback process, by introducing an audio background playback switch, when the first interface has already been presented on the display, according to the background switch state of the background playback switch, when it is determined that audio transmission data is allowed to be played in the background of the display device, the audio transmission data is played in the background playback mode, that is, the audio transmission data is played while maintaining the display to continue presenting the original screen, achieving the effect of playing the audio transmission data without blocking the original screen in the display device.

[0050] In a third aspect, some embodiments further provide an audio playback device configured in a display device, including:

[0051] A request receiving module, configured to receive an audio screen mirroring request from a first external device when the display presents the first interface;

[0052] An information obtaining module, configured to obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device in response to the audio screen mirroring request;

[0053] An audio playback module, configured to maintain the display to present the first interface and play the audio transmission data when it is determined, according to the background switch state, that audio transmission data is allowed to be played in the background of the display device.

[0054] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is run by an audio playback device, the audio playback device is caused to execute an audio playback method in the first aspect.

[0055] In a fifth aspect, a computer program product is provided. The computer program product includes a computer program, and when the computer program is run by an audio playback device, the audio playback device is caused to execute an audio playback method in the first aspect. Description of the Drawings

[0056] To more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the following will briefly introduce the drawings required for use in the description of the embodiments of the present application or the related art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other related drawings can also be obtained based on these drawings.

[0057] Figure 1 Schematic diagram of the operation scenario between the display device and the control device provided by some embodiments of the present application;

[0058] Figure 2 Schematic diagram of the hardware configuration of the display device provided by some embodiments of the present application;

[0059] Figure 3 Schematic diagram of the hardware configuration of the control device provided by some embodiments of the present application;

[0060] Figure 4 Schematic diagram of the software configuration of the display device provided by some embodiments of the present application;

[0061] Figure 5 Schematic diagram of the process flow of the audio playback method provided by some embodiments of the present application;

[0062] Figure 6 Schematic diagram of adjusting the background playback switch provided by some embodiments of the present application;

[0063] Figure 7 Schematic diagram of playing audio transmission data provided by some embodiments of the present application;

[0064] Figure 8 Schematic diagram of playing audio transmission data provided by some embodiments of the present application;

[0065] Figure 9 Schematic diagram of the audio off icon provided by some embodiments of the present application;

[0066] Figure 10 Schematic diagram of the process flow of the audio playback method provided by some other embodiments of the present application;

[0067] Figure 11 Timing diagram of the audio playback method provided by some embodiments of the present application;

[0068] Figure 12 Block diagram of the structure of the audio playback device provided by some embodiments of the present application;

[0069] Figure 13 Internal structure diagram of a computer device in one embodiment. Detailed implementation manners

[0070] Embodiments will be described in detail below, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following examples do not represent all embodiments consistent with the present application. They are merely examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0071] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described next, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0072] The terms "first", "second", "third", etc. in the specification, claims and above-mentioned drawings of the present application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0073] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclude inclusion. For example, a product or device comprising a series of components does not have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0074] The term "module" refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code that can perform functions related to that element.

[0075] In some embodiments, the first external device may be a mobile terminal 300 having an audio data sending function, and the display device 200 generally refers to a device having audio data receiving, screen display, and data processing capabilities. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0076] Figure 1 It is a schematic diagram of an operation scenario between a display device and a control device provided for some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, the mobile terminal 300, and the control device 100. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0077] The mobile terminal 300 can be used as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 to perform data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and they can be connected and communicate through a network communication protocol to achieve the purpose of one-to-one control operations and data communication. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the display device 200 to achieve the synchronous display function.

[0078] As Figure 1 also shown in the figure, the display device 200 also performs data communication with the server 400 through various communication methods. Among them, the server 400 can be an independent server or a server cluster. The display device 200 is allowed to establish a communication connection through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0079] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet Protocol Television (IPTV), etc.

[0080] Figure 2 For some embodiments of the present application Figure 1 is the hardware configuration block diagram of the display device 200 in the figure.

[0081] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0082] In some embodiments, the detector 230 is used to collect signals from the external environment or interact with the outside. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of environmental light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0083] In some embodiments, the display 260 includes a display function component for presenting a picture and a driving component for driving image display. The display 260 is used to receive the image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu manipulation interface, and a user manipulation UI interface, etc.

[0084] In some embodiments, the communication device 220 is a component for communicating with external devices or a server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0085] The communication device 220 may enable the display device 200 to communicate with an external device or a server 400 through a wireless or wired connection. Among them, the wired connection may connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection may connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 may directly establish a connection relationship with an external device, or may indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0086] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to n interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0087] In some embodiments, the controller 250 and the tuner demodulator 210 may be located in different split devices, that is, the tuner demodulator 210 may also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0088] In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0089] In some embodiments, the audio output device 270 may be a built-in speaker of the display device 200, or may be an external audio output device connected to the display device 200. Among them, for the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0090] In some embodiments, the user input interface 280 may be used to receive instructions input by the user.

[0091] Figure 3 For some embodiments of the present application Figure 1 is a hardware configuration block diagram of the control device in. As Figure 3 shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0092] The control device 100 is configured to control the display device 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions recognizable and responsive by the display device 200, playing the role of an interaction intermediary between the user and the display device 200.

[0093] In some embodiments, the control device 100 may be an intelligent device. For example: the control device 100 can install various applications for controlling the display device 200 according to user needs.

[0094] In some embodiments, as Figure 1 shown, the mobile terminal 300 or other intelligent electronic devices, after installing the application for controlling the display device 200, can perform functions similar to those of the control device 100.

[0095] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the data processing functions inside and outside.

[0096] Under the control of the controller 110, the communication interface 130 realizes the communication of control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, and other near-field communication modules.

[0097] The user input / output interface 140, where the input interface includes at least one of a microphone 141, a touchpad 142, a sensor 143, a button 144, and other input interfaces.

[0098] In some embodiments, the control device 100 includes at least one of the communication interface 130 and the input / output interface 140. The communication interface 130 is configured in the control device 100. For example: modules such as WiFi, Bluetooth, and NFC can encode user input instructions through the WiFi protocol, or the Bluetooth protocol, or the NFC protocol, and send them to the display device 200.

[0099] The memory 190 is used to store various operating programs, data, and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0100] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0101] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0102] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0103] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications layer) (referred to as "application layer"), the application framework layer (Application Framework layer) (referred to as "framework layer"), the system library layer and the kernel layer.

[0104] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0105] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions of applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0106] like Figure 4As shown, in the embodiment of the present application, the application framework layer includes a view system (View System), managers, content providers, etc. Among them, the view system can design and implement the interfaces and interactions of application programs. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The Activity Manager is used to interact with all the activities running in the system; the Location Manager is used to provide access to the system location service for system services or applications; the Package Manager is used to retrieve various information related to the application program packages currently installed on the device; the Notification Manager is used to control the display and clearing of notification messages; the Window Manager is used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0107] In some embodiments, the Activity Manager is used to manage the life cycles of various application programs and the usual navigation back functions, such as controlling the exit, opening, and backward movement of application programs. The Window Manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling the changes of the display window. For example, shrinking the display window, jittering the display, and distorting the display, etc.

[0108] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is to achieve.

[0109] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 4 shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, High-Definition Multimedia Interface (HDMI) driver, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers, etc.

[0110] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. Depending on factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system may be in other forms.

[0111] With the continuous development of audio playback technology, in order to expand the audio playback scenarios, screen mirroring technology can be used to play audio. For example, the audio content on a mobile device (such as a mobile phone, tablet) can be transmitted to another device (such as a projector, TV) for playback through wireless screen mirroring or wired screen mirroring. However, when using screen mirroring technology to play audio, after the audio receiver receives the audio, it will automatically start the audio playback interface on the associated display device, thus blocking the original picture on the display device.

[0112] Based on this, in some embodiments, an audio playback method is provided. Among them, the audio playback method can be implemented in cooperation with a display device and a first external device.

[0113] In an alternative embodiment, taking the audio playback method applied to the controller in the display device as an example. The display device includes a display, a communication device, and at least one controller; the display performs content display, the communication device communicates with the first external device, and the controller is connected to the display. The first external device can be a device with audio screen mirroring function or integrated with an application supporting audio screen mirroring function, such as a mobile phone, a tablet computer, a smart watch, etc.

[0114] As Figure 5 shown, it specifically includes the following steps:

[0115] S510, when the first interface is presented on the display, receive an audio screen mirroring request from the first external device.

[0116] Among them, the first interface is the display interface of the display device before receiving the audio screen mirroring request. Optionally, the first interface can be an interface for displaying picture data, or an interface for displaying video content data, etc. In some embodiments, the data displayed on the first interface can be from the local of the display device, or from other external devices, etc.

[0117] The audio screen mirroring request is used to instruct the display device to perform an audio playback operation. Optionally, the presentation manner of the audio screen mirroring request can be determined according to the communication protocol between the first external device and the display device.

[0118] Optionally, there can be various scenarios where the display device 200 presents the first interface. For example, in one example, the display device 200 can control the display to show any picture selected by the user in the picture gallery of the display device 200. In another example, when the display device 200 receives multimedia data, the display can be used to show the video data or picture data in the multimedia data on the first interface, and the audio output device 270 can be used to play the audio data in the multimedia data.

[0119] On this basis, if the user has a need to perform audio screen mirroring to the display device 200, the first external device and the display device 200 can first be communicatively connected. Subsequently, the first external device is used to send an audio screen mirroring request to the display device 200 based on the audio transmission data to be screen mirrored. Among them, the first external device can send the audio screen mirroring request to the display device 200 in a way of Socket socket communication or Bluetooth communication.

[0120] For example, when the first external device is a mobile phone and the display device is a smart TV, if the user wants to screen mirror the music A in the music APP on the mobile phone to the smart TV, the mobile phone and the smart TV can first be Bluetooth connected. After the Bluetooth connection is successful, by triggering the screen mirroring control in the music APP, a music screen mirroring request for music A is sent to the smart TV.

[0121] S520, in response to the audio screen mirroring request, obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device.

[0122] Among them, the audio background playback switch is a control that can control whether the received audio can be played in the background of the display, and the background switch state is the state of the audio background playback switch, which can be an on state or an off state. In one example, before performing audio screen mirroring, the user can use the control device 100 to pre-adjust the state of the audio background playback switch in the display. Exemplarily, refer to the schematic diagram of adjusting the background playback switch as shown in Figure 6 The display device will show the user a screen mirroring guidance page. After the user triggers the control 6 marked with "Screen Mirroring Settings" in the screen mirroring guidance page through the control device 100, the display device will show the user the settings page of the audio background playback switch. At this time, the user can set the switch state of the audio background playback switch based on actual needs. For example, the switch state can be set to the on state.

[0123] The audio transmission data is the audio-related data that the first external device wants to play in the display device. Optionally, the audio transmission data can be carried in the audio screen mirroring request.

[0124] Furthermore, the communication device 220 in the display device 200 can receive an audio screen mirroring request sent by the first external device and transmit it to the controller in the display device. After obtaining the audio screen mirroring request, the controller can parse and process the audio screen mirroring request to obtain audio transmission data.

[0125] In addition, the controller can obtain the background switch state of the audio background playback switch based on the user's configuration of the audio background playback switch.

[0126] S530, when it is determined that the audio transmission data is allowed to be played in the background of the display device according to the background switch state, keep the display presenting the first interface and play the audio transmission data.

[0127] Optionally, before playing the audio transmission data, based on the background switch state, determine whether the display device is allowed to play the audio transmission data in the background. Exemplarily, when the background switch state is on, it is determined that the audio transmission data is allowed to be played in the background of the display device; when the background switch state is off, it is determined that the audio transmission data is not allowed to be played in the background of the display device.

[0128] Specifically, when the background switch state is on, it proves that the display device can play the audio transmission data in the background at this time, that is, it is determined that the audio transmission data is allowed to be played in the background of the display device at the current moment; when the background switch state is off, it proves that the display device cannot play the audio transmission data in the background at this time, that is, it is determined that the audio transmission data is not allowed to be played in the background of the display device at the current moment.

[0129] When it is determined that the audio transmission data is allowed to be played in the background of the display device, keep the display 260 continue to present the first interface. Use the audio parsing device in the display device 200 to parse the audio transmission data, and use the audio output device 270 to play the data stream obtained after parsing. For example, the audio transmission data can be played by starting an Audio Track. Among them, Audio Track is a class provided by the Android system for playing audio data and is usually used to play raw audio data.

[0130] When playing the audio transmission data in the background, if the user wants to adjust the playback volume of the audio, they can directly adjust the output volume of the audio stream itself, or control the overall volume of the display device to adjust the output volume of the audio stream.

[0131] In the above technical solution, when the first interface is presented on the display, an audio screen mirroring request from the first external device is received, and in response to the audio screen mirroring request, the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device are obtained. Then, when it is determined that the audio transmission data is allowed to be played in the background of the display device according to the background switch state, the display is maintained to present the first interface, and the audio transmission data is played. Compared with the related art that starts the audio playback interface when performing audio screen mirroring, during the above audio playback process, by introducing the audio background playback switch, when the first interface is already presented on the display, according to the background switch state of the background playback switch, when it is determined that the audio transmission data is allowed to be played in the background of the display device, the background playback method is used to play the audio transmission data, that is, the audio transmission data is played while maintaining the display to continue presenting the original picture, achieving the effect of playing the audio transmission data without blocking the original picture in the display device.

[0132] Based on the technical solutions of the above embodiments, in some optional embodiments, the audio data playback process is further refined when the background playback of the audio transmission data by the display device is not allowed. Specifically, when it is determined that the background playback of the audio transmission data by the display device is not allowed according to the background switch state, the display is controlled to present the second interface, and the audio transmission data is played. The second interface is an audio screen mirroring interface, that is, the interface that is automatically started when the display device receives the screen-mirrored audio data.

[0133] Optionally, when it is determined that the background playback of the audio transmission data by the display device is not allowed, the display can be controlled to automatically start the pre-configured audio screen mirroring interface, that is, the second interface, and directly play the audio transmission data in the foreground. For example, when a user casts the music in a music APP from a mobile phone to a smart TV, the smart TV will automatically start the audio screen mirroring interface associated with the music APP and play the music in the audio screen mirroring interface.

[0134] In the above technical solution, on the one hand, when it is determined that the background playback of the audio transmission data by the display device is not allowed according to the background switch state, the foreground playback method is used to play the audio transmission data, that is, the audio transmission data is played when the display presents the second interface, which is the audio screen mirroring interface; on the other hand, by combining the background switch state, the playback method of the audio transmission data is flexibly selected, increasing the intelligence level of the display device and improving the user experience.

[0135] It should be noted that in practical applications, whether the multimedia playback content in the first interface contains audio content data and the different background switch states of the audio background playback switch both affect the logic of the display device for playing the audio transmission data.

[0136] Exemplarily, when the multimedia playback content does not contain audio content data, that is, there is no sound on the first interface, refer to Figure 7 the schematic diagram of the played audio transmission data shown. When the audio background playback switch is turned on, the display device can play the multimedia data using the first interface and start playing the Audio Track when receiving an audio screen mirroring request. At this time, based on the pre-set audio parameters, the audio transmission data can be written into the Audio Track (write the audio transmission data), and the audio output device 270 is used to play the audio transmission data. Among them, the audio parameters can include but are not limited to audio format, sampling rate, number of channels, etc., and these parameters determine the encoding method and sound quality effect of the audio file.

[0137] Subsequently, after the audio playback is completed, the Audio Track can be destroyed. It should be noted that the destruction here can refer to deleting the audio track from the playback task, but the audio transmission data may still be saved in the display device. Or, while deleting the audio track, the audio transmission data is also deleted.

[0138] When the audio background playback switch is turned off, the display device first plays the multimedia data using the first interface. When receiving an audio screen mirroring request, it uses startActivity to start playing the second interface (audio screen mirroring interface) and starts playing the Audio Track. Among them, startActivity refers to a method of starting a new Activity in Android development.

[0139] After starting to play the second interface, the first interface will be destroyed. It should be noted that the destruction here can mean that the first interface is removed, or it can mean that the first interface is covered by the second interface, and there is no limit to this. Subsequently, based on the pre-set audio parameters, the audio transmission data is written into the Audio Track, and the audio output device 270 is used to play the audio transmission data. After the audio transmission data is played, the first interface will be returned.

[0140] Based on this, a scenario is provided where the multimedia playback content in the first interface includes audio content data. On the basis of the above embodiments, in some alternative embodiments, the display device further includes at least one High-Definition Multimedia Interface (HDMI). Among them, the HDMI interface in the display device is connected to a second external device to receive the multimedia playback content of the second external device. Among them, the second external device can be any device with multimedia data receiving and transmitting functions, and is used to send multimedia playback content to the display device. For example, the second external device can be a Set Top Box (STB) connected to a TV, that is, a TV set-top box; or it can be a Network Set-Top Box.

[0141] Furthermore, before receiving the audio screen mirroring request from the first external device, an alternative way to present the first interface is provided. Specifically, the display is controlled to present the first interface and play the audio content data in the multimedia playback content. Among them, the first interface includes the video content data in the multimedia playback content.

[0142] Optionally, the second external device can send the received multimedia playback content to the display device through the HDMI interface, so that the display device can control the display to present the first interface including the video content data, and play the audio content data through the audio output device 270. For example, when the second external device is a digital video set-top box, it can receive digital TV signals from different transmission media through a built-in tuner, extract the digital TV signals from the carrier through an internal demodulator, and finally, convert these digital TV signals into multimedia playback content recognizable by the TV through an internal decoder.

[0143] In the above technical solution, in the multimedia playback scenario, based on the background switch state of the background playback switch, when it is determined that audio transmission data is allowed to be played in the background of the display device, while the display continuously presents the picture corresponding to the video content data in the multimedia playback content, the audio transmission data is played, that is, the continuity of the picture playback of the multimedia playback content and the timeliness of the audio transmission data playback are ensured.

[0144] Furthermore, in some alternative embodiments, when it is determined that audio transmission data is allowed to be played in the background of the display device, the process of playing the audio transmission data is refined. Specifically, the playback of the audio content data in the multimedia playback content is stopped, and the audio transmission data is played; or the audio transmission data and the audio content data in the multimedia playback content are played simultaneously.

[0145] Among them, the audio content data is the original audio data in the first interface played by the display device.

[0146] The display device 200 can present a configuration interface for the screen mirroring audio playback mode to the user. In the configuration interface, the user can set the screen mirroring audio playback mode to stop playing the audio content data in the multimedia playback content and play the audio transmission data by selecting the interruption handling method. For example, the first interface is playing movie B and its original audio B'. When the screen mirroring audio playback mode in the smart TV is interruption handling, if music C sent from the mobile phone is received, the playback of the original audio B' will be interrupted and music C will be played in the background.

[0147] Exemplarily, when the multimedia playback content includes audio content data, that is, when there is sound on the first interface, refer to Figure 8 the schematic diagram of playing the audio transmission data as shown. When the audio background playback switch is turned on, the display device first plays the multimedia data on the first interface, and the audio output device 270 plays the original audio (i.e., the audio in the multimedia data). When an audio screen mirroring request is received, start playing the Audio Track. At this time, based on the pre-set audio parameters, write the audio transmission data in the Audio Track, and use the audio output device 270 to play the audio transmission data. After the audio playback is completed, destroy the Audio Track.

[0148] It should be noted that when stopping playing the audio content data in the multimedia playback content, it is necessary to record the time node when the audio playback is aborted, so as to resume the playback of the audio content data in the multimedia playback content after playing the audio transmission data.

[0149] Correspondingly, the user can set the screen mirroring audio playback mode to play the audio transmission data and the audio content data in the multimedia playback content simultaneously by selecting the parallel playback method. For example, when the screen mirroring audio playback mode in the smart TV is parallel playback, if music C sent from the mobile phone is received, the original audio B' and music C will be played simultaneously in the background.

[0150] It should be noted that when playing the audio transmission data and the audio content data simultaneously, in order to avoid audio chaos, the two audio data can be played by audio output devices configured at different positions respectively. For example, the original audio B' can be played by the playback device on the left side of the smart TV, and music C can be played by the playback device on the right side of the smart TV. Or, a music playback device connected to the display device can be configured again. For example, the original audio B' can be played by the original playback device of the smart TV, and music C can be played by the Bluetooth speaker connected to the smart TV.

[0151] Further, in the case where it is determined that audio transmission data is not allowed to be played in the background of the display device, based on the technical solutions of the above embodiments, in some alternative embodiments, the process of playing audio transmission data is refined. Specifically, the audio content data in the multimedia playback content is stopped from being played, and the audio transmission data is played.

[0152] Exemplarily, when the multimedia playback content includes audio content data, that is, when there is sound on the first interface, continue to refer to Figure 8 the schematic diagram of playing audio transmission data shown. When the audio background playback switch is turned off, the display device first plays multimedia data on the first interface, and the audio output device 270 plays the original audio (i.e., the audio in the multimedia data). When an audio screen mirroring request is received, startActivity is used to launch the second interface and start playing AudioTrack. After launching the second interface, both the first interface and the original audio will be destroyed. It should be noted that the destruction here can mean that the first interface is completely destroyed, or that the first interface is covered by the second interface, and also means that the original audio is paused.

[0153] Subsequently, based on the pre-set audio parameters, the audio transmission data is written in Audio Track, and the audio output device 270 is used to play the audio transmission data. After the audio transmission data is played, Audio Track will be destroyed, and the first interface will be returned.

[0154] It can be understood that in the case where audio transmission data is not allowed to be played in the background of the display device, it means that when an audio screen mirroring request is received, an audio screen mirroring interface needs to be automatically launched to block the video content data in the multimedia playback content on the first interface. Since the display device no longer plays the video content data, therefore, the audio content data in the associated multimedia playback content can also be stopped from being played.

[0155] After stopping the playback of the audio content data, the audio output device of the display device or a music playback device connected to the display device can be used to play the audio transmission data.

[0156] Based on the technical solutions of the above embodiments, in some alternative embodiments, the process of playing audio transmission data is refined. Specifically, when the audio transmission data is audio content data, an audio player is used to play the audio transmission data; when the audio transmission data is an audio link, a media player is used to play the audio transmission data.

[0157] Among them, the audio player is only used to play audio data. For example, it can be an Audio Track; the media player can locate the audio file based on the audio link. For example, it can be a media player.

[0158] The audio content data is the data stream corresponding to the cast screen audio and can be directly played for audio. The audio link is the network address (Uniform Resource Locator, URL) pointing to the audio file. After the audio file is located according to the network address, the audio data can be played.

[0159] In practical applications, generally two methods are used for audio data transmission. One is to directly transmit the data stream corresponding to the audio (audio content data), and the other is to transmit the network address of the audio file (audio link). For these two different audio transmission methods, the corresponding audio playback methods are also different.

[0160] When the audio transmission data is audio content data, the audio transmission data can be directly written into the audio player, and the audio output device 270 configured in the display device 200 is used to play the audio transmission data. For example, when the audio transmission data is audio content data, the audio transmission data can be directly written frame by frame in the Audio Track, and the audio is played while writing the audio transmission data.

[0161] Exemplarily, when the audio transmission data is audio content data, it is necessary to determine whether the audio content data is an uncompressed or unencoded original audio stream. If the audio transmission data is not the original audio stream, then the audio transmission data needs to be converted to obtain the original audio stream corresponding to the audio transmission data.

[0162] Start the Audio Track in the display device and execute the play() action. Subsequently, call Audio Track.write() to insert the original audio stream data and decode the original audio stream. At this time, the display device 200 can play the audio sound. After the playback is completed, destroy the Audio Track. Among them, the play() action is used to start or continue playing the audio. Audio Track.write() is a method in Android audio development and is used to write audio data into AudioTrack to achieve audio playback.

[0163] When the audio transmission data is an audio link, it is necessary to use the media player configured in the display device 200 to locate the audio file to be played according to the audio link and download it; subsequently, after downloading the audio file to be played, play the audio file. For example, when the audio transmission data is an audio link, the media player media player can be used to play the media asset URL.

[0164] Exemplarily, when the audio transmission data is an audio link, the display device will start the media Player to set the audio link to the setDataSource() in the player, so that the media Player can obtain the audio file at the corresponding position. After obtaining the audio file, it is necessary to transmit the audio file to the corresponding audio decoder for decoding and play the decoded audio file. Among them, setDataSource() is an important method in the Android media framework, mainly used to set the data source for the media player, that is, to specify the position of the media file or stream to be played.

[0165] The above technical solution provides two different types of audio playback methods corresponding to audio transmission data on the display device side, that is, it broadens the range of audio transmission data received by the display device, and then broadens the audio screen mirroring scenarios of the first external device connected to the display device, thereby improving the user experience.

[0166] Based on the technical solutions of the above embodiments, in some alternative embodiments, an alternative way to control audio playback is provided. Specifically, before or while playing the audio transmission data, control the display to present an audio off icon associated with the audio transmission data. And, during the playback of the audio transmission data, in response to a trigger operation on the audio off icon, disconnect the connection with the first external device and stop playing the audio transmission data. Among them, the control associated with the audio off icon can stop the playback of the audio transmission data.

[0167] When the display device plays the audio transmission data in the background, it is impossible to determine the user's operation on the audio transmission data by directly obtaining the focus event. Therefore, it is possible to determine the user's operation on the audio transmission data by listening to the user's operation on the control device 100.

[0168] In order to more accurately determine whether the user's operation on the control device 100 is directed at the audio transmission data, an audio off icon associated with the audio transmission data can be presented in the first interface when it is determined that the background switch state of the audio background playback switch is on.

[0169] During the process of playing audio transmission data, when a trigger operation for the audio off icon is detected, the display device 200 will disconnect from the first external device and stop playing the audio transmission data at the same time. At this time, the audio off icon will also disappear.

[0170] To avoid key conflicts, the trigger operation for the audio off icon can be a combination key on the control device 100. For example, double-clicking a certain key or long-pressing a certain key, etc. To facilitate the user to know the trigger method of the audio off icon, icon annotation information can be displayed near the audio off icon.

[0171] For example, referring to Figure 9 the schematic diagram of the audio off icon shown, when it is determined that the audio background playback switch is in the on state, the audio off icon 9 can be displayed in the upper right corner of the TV interface, and the icon annotation information "Double-click the menu key to exit audio" associated with the icon 9. When the TV is playing the music D cast from the mobile phone in the background, if the TV detects that the user double-clicks the menu key on the remote control, it will disconnect from the mobile phone and stop playing the music D.

[0172] It should be noted that when the display device plays the audio transmission data through the audio start-up screen mirroring interface, the audio off icon can also be displayed. At this time, the audio can be stopped by obtaining the focus event, or the audio can be stopped by triggering the audio off icon.

[0173] The above technical solution can disconnect the audio screen mirroring of the first external device by introducing the audio off icon, and can ensure the accuracy of the audio screen mirroring disconnection timing and the convenience of the audio screen mirroring disconnection when the display device cannot determine the user's operation on the audio transmission data by directly obtaining the focus event.

[0174] Further, based on the technical solutions of the above embodiments, in some optional embodiments, the process of disconnecting from the first external device is refined. Specifically, it is to disconnect from the first external device and send a disconnection message to the first external device; wherein, the disconnection message is used to indicate that the display device has disconnected from the first external device; or, send a disconnection instruction to the first external device to instruct the first external device to disconnect from the display device.

[0175] When a trigger operation for the audio off icon is detected, the display device can actively disconnect from the first external device. At this time, it is necessary to send a disconnection message to the first external device to prompt the first external device that the audio screen mirroring has been disconnected. For example, after the TV detects that the user double-clicks the menu key on the remote control, it can directly disconnect the TV from the mobile phone and send an audio disconnection message to the mobile phone.

[0176] Alternatively, in the case where the display device cannot actively disconnect from the first external device, a disconnection instruction can be sent to the first external device to instruct the user to operate the first external device to disconnect the first external device from the display device. For example, after the TV detects that the user double-clicks the menu key on the remote control, a disconnection instruction can be sent to the mobile phone. The disconnection instruction can be displayed in the form of a floating layer on the music player software of the mobile phone. The user can click the disconnection control in the disconnection instruction to disconnect the TV from the mobile phone.

[0177] Based on the technical solutions of the above embodiments, in some optional implementation manners, refer to Figure 10 , Figure 10 A flowchart of another audio playback method is provided, which specifically includes the following steps:

[0178] S1010, Receive the multimedia playback content of the second external device, and control the display to present a first interface including the video content data in the multimedia playback content, and play the audio content data in the multimedia playback content.

[0179] S1020, When the display presents the first interface, receive the audio projection request of the first external device, and control the display to present an audio off icon associated with the audio transmission data.

[0180] S1030, In response to the audio projection request, obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device.

[0181] S1040, Determine whether the background switch state is on. If so, execute S1005; if not, execute S1006.

[0182] S1050, Keep the display presenting the first interface, stop playing the audio content data in the multimedia playback content, and play the audio transmission data; or, keep the display presenting the first interface, and play the audio transmission data and the audio content data in the multimedia playback content at the same time.

[0183] Exemplarily, when the audio transmission data is audio content data, an audio player is used to play the audio transmission data; when the audio transmission data is an audio link, a media player is used to play the audio transmission data.

[0184] S1060, Control the display to present an audio projection interface, stop playing the audio content data in the multimedia playback content, and play the audio transmission data.

[0185] S1070, in response to a triggering operation on the audio off icon, disconnect from the first external device and send a disconnection message to the first external device; or, send a disconnection instruction to the first external device to instruct the first external device to disconnect from the display device.

[0186] Wherein, the disconnection message is used to indicate that the display device has disconnected from the first external device.

[0187] S1080, stop playing the audio transmission data.

[0188] For the specific processes of the above S1010 - S1080, reference can be made to the descriptions in the above method embodiments. Their implementation principles and technical effects are similar and will not be elaborated here.

[0189] Based on the technical solutions of the above embodiments, the present application also provides an alternative embodiment. Refer to Figure 11 the schematic diagram of audio playback among devices in the audio playback process shown, including:

[0190] S1110, the second external device sends multimedia playback content to the display device to control the display device to present a first interface including video content data and play audio content data.

[0191] S1120, the first external device sends an audio screen mirroring request to the display device.

[0192] S1130, the display device obtains the audio transmission data and the background switch state of the audio background playback switch in the display device, and controls the display to present an audio off icon associated with the audio transmission data.

[0193] S1140, when the display device determines, according to the background switch state, that it is allowed to play the audio transmission data in the background of the display device, the display device maintains the display of the first interface and plays the audio transmission data; or, when the display device determines, according to the background switch state, that it is not allowed to play the audio transmission data in the background of the display device, the display device controls the display to present a second interface and plays the audio transmission data.

[0194] S1150, the control device sends a triggering operation on the audio off icon to the display device to control the display device to disconnect from the first external device and stop playing the audio transmission data.

[0195] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown according to the indications of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless there is a clear indication in this document, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0196] Based on the same inventive concept, an embodiment of the present application further provides an audio playback device for implementing the above-mentioned audio playback method. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the audio playback device provided below can refer to the limitations on the audio playback method in the above text, and will not be repeated here.

[0197] In an exemplary embodiment, as Figure 12 shown, an audio playback device 1 is provided, configured in a display device, including: a request receiving module 10, an information acquisition module 20, and an audio playback module 30, where:

[0198] The request receiving module 10 is configured to receive an audio screen mirroring request from a first external device when the display presents a first interface.

[0199] The information acquisition module 20 is configured to, in response to the audio screen mirroring request, acquire audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device.

[0200] The audio playback module 30 is configured to, when it is determined according to the background switch state that audio transmission data is allowed to be played back in the background of the display device, keep the display presenting the first interface and play the audio transmission data.

[0201] In an exemplary embodiment, the audio playback module 30 is further configured to: when it is determined according to the background switch state that the display device is not allowed to play back audio transmission data in the background, control the display to present a second interface and play the audio transmission data; where the second interface is an audio screen mirroring interface.

[0202] In an exemplary embodiment, the audio playback module 30 is further configured to: when the background switch is in the on state, determine that audio transmission data is allowed to be played in the background of the display device; when the background switch is in the off state, determine that audio transmission data is not allowed to be played in the background of the display device.

[0203] In an exemplary embodiment, it further includes: at least one high-definition multimedia interface configured to connect to a second external device to receive multimedia playback content of the second external device; the audio playback device 1 further includes a multimedia receiving module, wherein the multimedia receiving module is configured to: control the display to present a first interface and play the audio content data in the multimedia playback content; wherein, the first interface includes the video content data in the multimedia playback content.

[0204] In an exemplary embodiment, when it is determined that audio transmission data is allowed to be played in the background of the display device according to the background switch state, the audio playback module 30 is further configured to: stop playing the audio content data in the multimedia playback content and play the audio transmission data; or, play the audio transmission data and the audio content data in the multimedia playback content simultaneously.

[0205] In an exemplary embodiment, when it is determined that audio transmission data is not allowed to be played in the background of the display device according to the background switch state, the audio playback module 30 is further configured to: stop playing the audio content data in the multimedia playback content and play the audio transmission data.

[0206] In an exemplary embodiment, the audio playback module 30 is further configured to: when the audio transmission data is audio content data, play the audio transmission data using an audio player; when the audio transmission data is an audio link, play the audio transmission data using a media player.

[0207] In an exemplary embodiment, before or while playing the audio transmission data, control the display to present an audio off icon associated with the audio transmission data; the audio playback device 1 further includes a connection disconnection module, wherein the connection disconnection module is configured to: in response to a trigger operation on the audio off icon, disconnect the connection with the first external device and stop playing the audio transmission data.

[0208] In an exemplary embodiment, the connection disconnection module is further configured to: disconnect the connection with the first external device and send a disconnection message to the first external device; wherein, the disconnection message is used to indicate that the display device has disconnected from the first external device; or, send a disconnection instruction to the first external device to instruct the first external device to disconnect from the display device.

[0209] Each module in the above audio playback device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so that the processor can call and execute the operations corresponding to each of the above modules.

[0210] In an exemplary embodiment, a computer device is provided. The computer device can be a terminal, and its internal structural diagram can be as Figure 13 shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used for exchanging information between the processor and external devices. The communication interface of the computer device is used for communicating with external terminals in a wired or wireless manner. The wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC), or other technologies. The computer program, when executed by the processor, implements an audio playback method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0211] Those skilled in the art can understand that Figure 13 the structure shown in

[0212] is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.

[0212] In an alternative embodiment, Figure 13 the computer device shown in

[0213] In an embodiment, a computer device is further provided, including a memory and a processor. A computer program is stored in the memory, and when the processor executes the computer program, the steps in the above method embodiments are implemented.

[0214] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the foregoing method embodiments are implemented.

[0215] In one embodiment, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the steps in the foregoing method embodiments are implemented.

[0216] It should be noted that the data involved in this application (including but not limited to audio transmission data, etc.) are all information and data authorized by users or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.

[0217] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, artificial intelligence (AI) processors, etc., without limitation.

[0218] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered to be within the scope recorded in the present application.

[0219] The above-described embodiments merely represent several implementation manners of the present application. The description thereof is relatively specific and detailed, but it should not be construed as a limitation to the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all fall within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims

1. A display device, characterized in that, Comprising: A display configured to display content; A communication device configured to communicate with a first external device; And at least one controller, connected to the display, configured to: When the display presents a first interface, receive an audio screen mirroring request from the first external device; In response to the audio screen mirroring request, obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device; When it is determined according to the background switch state that it is allowed to play the audio transmission data in the background of the display device, keep the display presenting the first interface and play the audio transmission data.

2. The display device according to claim 1, wherein The controller is further configured to: When it is determined according to the background switch state that it is not allowed to play the audio transmission data in the background of the display device, control the display to present a second interface and play the audio transmission data; wherein, the second interface is an audio screen mirroring interface.

3. The display device according to claim 1 or 2, characterized in that, When the controller executes to determine that it is allowed to play the audio transmission data in the background of the display device according to the background switch state, it is configured to: When the background switch state is in the on state, determine that it is allowed to play the audio transmission data in the background of the display device; When the background switch state is in the off state, determine that it is not allowed to play the audio transmission data in the background of the display device.

4. The display device according to any one of claims 1 to 3, characterized in that, The display device further includes: At least one high-definition multimedia interface configured to connect to a second external device to receive multimedia playback content of the second external device; Before the controller executes to receive the audio screen mirroring request from the first external device, it is further configured to: Control the display to present a first interface and play the audio content data in the multimedia playback content; wherein, the first interface includes the video content data in the multimedia playback content.

5. The display device according to claim 4, wherein When it is determined according to the background switch state that it is allowed to play the audio transmission data in the background of the display device, when the controller executes to play the audio transmission data, it is configured to: Stop playing the audio content data in the multimedia playback content and play the audio transmission data; or, Play the audio transmission data and the audio content data in the multimedia playback content simultaneously.

6. The display device according to claim 4, wherein, When it is determined according to the background switch state that it is not allowed to play the audio transmission data in the background of the display device, when the controller executes to play the audio transmission data, it is configured to: Stop playing the audio content data in the multimedia playback content and play the audio transmission data.

7. The display device according to any one of claims 1 to 3, characterized in that, When the controller executes to play the audio transmission data, it is configured to: When the audio transmission data is audio content data, use an audio player to play the audio transmission data; When the audio transmission data is an audio link, use a media player to play the audio transmission data.

8. The display device according to any one of claims 1 to 3, characterized in that, Before or simultaneously with executing to play the audio transmission data, the controller is further configured to: Control the display to present an audio off icon associated with the audio transmission data; During the process of playing the audio transmission data, the controller is further configured to: In response to a trigger operation on the audio off icon, disconnect from the first external device and stop playing the audio transmission data.

9. The display device according to claim 8, wherein, When the controller executes disconnecting from the first external device, it is configured to: Disconnect from the first external device and send a disconnection message to the first external device; wherein, the disconnection message is used to indicate that the display device has disconnected from the first external device; or, Send a disconnection instruction to the first external device to instruct the first external device to disconnect from the display device.

10. An audio playback method, characterized in that, Include: Receive an audio screen mirroring request from a first external device when the display presents a first interface; In response to the audio screen mirroring request, obtain the audio transmission data of the first external device and the background switch state of the audio background playback switch in the display device; When it is determined that the audio transmission data is allowed to be played in the background of the display device according to the background switch state, keep the display presenting the first interface and play the audio transmission data.

Images