Display device and screen projection playing method

Abstract

The invention provides a display device and a screen projection playing method, and the method comprises the steps: obtaining screen projection data in response to a screen projection instruction; detecting a data type of the screen projection data, and if the data type is an audio type, controlling a display to display playing prompt information used for selecting a playing mode in a user interface; in response to a selection instruction for the target mode option, when the target mode option is the first mode option, controlling the audio output device to play the screen projection data, and displaying a screen projection interface corresponding to the screen projection data in the user interface; and when the target mode option is the second mode option, keeping displaying the current display interface and controlling the audio output device to play the screen projection data. By displaying the playing prompt interface, the user can select the corresponding mode option and play the screen projection data in the playing prompt interface, so that the problem that the current display interface is directly interrupted when the display equipment responds to the screen projection request is solved, and the flexibility of screen projection playing is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a screen projection and playback method. Background Art

[0002] The screen projection transmission protocol is a protocol for wirelessly transmitting and playing multimedia information, which can be applied to display devices and terminal devices. For example, a user can select the media data to be played through the terminal device, and send the media data to the display device through the screen projection transmission protocol, so that the media data can be played through the display device to achieve screen projection playback.

[0003] However, when the display device is displaying media content, if the screen projection command sent by the terminal device is accepted, the display device will directly interrupt the display of the current media content and display the screen corresponding to the media data instead. For example, when the display device is displaying a picture, the user wants to watch the picture while listening to the music media projected by the terminal device. However, when the display device responds to the screen projection command, the display device will directly display the media interface corresponding to the music media, thereby directly interrupting the display of the picture and affecting the user experience. Summary of the invention

[0004] The present application provides a display device and a screen projection playback method to solve the problem of directly interrupting the current display interface when the display device responds to a screen projection request.

[0005] In a first aspect, some embodiments of the present application provide a display device, the display device comprising a display, an audio output device and a controller. The display is configured to display a user interface; the audio output device is configured to play audio data; the controller is configured to:

[0006] In response to a screen projection instruction, acquiring screen projection data, and detecting a data type of the screen projection data;

[0007] If the data type is an audio type, controlling the display to display the play prompt information in the user interface, the play prompt information including a first mode option and a second mode option;

[0008] In response to a selection instruction for a target mode option, when the target mode option is a first mode option, controlling the audio output device to play the projection data, and displaying a projection interface corresponding to the projection data in a user interface;

[0009] When the target mode option is the second mode option, the current display interface is kept displayed and the audio output device is controlled to play the projection data.

[0010] In some embodiments, before the controller executes the step of responding to the selection instruction of the target mode option, it is further configured to:

[0011] Obtaining the current playback scene of the display device;

[0012] If the current playback scene is the same as the preset playback scene, detecting a memory mode corresponding to the preset playback scene from the scene memory information, the memory mode being the first mode or the second mode;

[0013] The projection data is played according to the memory mode.

[0014] In some embodiments, after executing the step of responding to the selection instruction of the target mode option, the controller is further configured to:

[0015] Displaying scene prompt information, wherein the scene prompt information includes setting options for updating the scene memory information;

[0016] In response to a user's operation instruction based on the setting option, the target mode is updated to the memory mode.

[0017] In some embodiments, a communication device is further included, the communication device is configured to communicate with the server, the controller controls the audio output device to play the screen projection data, and is further configured to:

[0018] Acquire audio information of the projection data, and generate a recommendation data request according to the audio information, wherein the recommendation data request is used to request audio recommendation data;

[0019] sending the recommendation data request to the server;

[0020] receiving audio recommendation data from the server;

[0021] In response to the audio selection instruction, target audio data is selected and played from the audio recommendation data and the local audio data.

[0022] In some embodiments, the controller performs selecting and playing target audio data from the audio recommendation data and the local audio data, and is specifically configured to:

[0023] generating an audio selection interface according to the audio recommendation data and the local audio data;

[0024] In response to an audio selection instruction for the target audio data in the audio selection interface, the audio output device is controlled to stop playing the projection data and play the target audio data.

[0025] In some embodiments, if the data type is a video type, the controller is further configured to:

[0026] Cache the projection data and the advertisement data, and obtain a play flag of the projection data, wherein the play flag includes a first mark, and the first mark is used to indicate that the projection data cannot be played;

[0027] In the process of caching the screen projection data, controlling the display to display an advertisement picture corresponding to the advertisement data on the user interface;

[0028] During the process of the display playing the advertising screen in the user interface, if the first mark included in the play flag is switched to the second mark, the display is controlled to display the projection screen corresponding to the projection data in the user interface; the second mark is used to indicate that the projection data can be played.

[0029] In some embodiments, in the process of caching the screen projection data, after controlling the display to display the advertisement screen corresponding to the advertisement data on the user interface, the controller is further configured to:

[0030] Obtaining the cache progress of the screen projection data;

[0031] When the cache progress is greater than or equal to a preset progress threshold, the first mark of the play flag is switched to a second mark.

[0032] In some embodiments, the controller controls the display to display an advertisement screen corresponding to the advertisement data on the user interface, and is specifically configured as follows:

[0033] When the display finishes displaying all the advertisement pictures corresponding to the advertisement data, if the first mark included in the play flag has not been switched to the second mark, the display is controlled to redisplay the advertisement pictures corresponding to the advertisement data.

[0034] In some embodiments, the controller performs detection of the data type of the projection data, and is specifically configured as follows:

[0035] Parsing the projection data to obtain a data address link of the projection data;

[0036] The data type is determined according to the suffix information of the data address link.

[0037] In a second aspect, some embodiments of the present application provide a screen projection playback method, which is applied to the display device described in the first aspect, wherein the display device includes a display, an audio output device, and a controller, wherein the display is configured to display a user interface, and the audio output device is configured to play audio data, and the method includes:

[0038] In response to a screen projection instruction, acquiring screen projection data, and detecting a data type of the screen projection data;

[0039] If the data type is an audio type, controlling the display to display the play prompt information in the user interface, the play prompt information including a first mode option and a second mode option;

[0040] In response to a selection instruction for a target mode option, when the target mode option is a first mode option, controlling the audio output device to play the projection data, and displaying a projection interface corresponding to the projection data in a user interface;

[0041] When the target mode option is the second mode option, the current display interface is kept displayed and the audio output device is controlled to play the projection data.

[0042] It can be seen from the above technical solutions that the present application provides a display device and a screen projection playback method, which obtains the projection data by responding to the projection instruction; detects the data type of the projection data, and if the data type is an audio type, controls the display to display the playback prompt information for selecting the playback mode in the user interface; responds to the selection instruction of the target mode option, when the target mode option is the first mode option, controls the audio output device to play the projection data, and displays the projection interface corresponding to the projection data in the user interface; when the target mode option is the second mode option, keeps displaying the current display interface and controls the audio output device to play the projection data. The present application displays the playback prompt interface, so that the user can select the corresponding mode option according to their own needs in the playback prompt interface to play the projection data, thereby avoiding the problem that the display device directly interrupts the current display interface when responding to the projection request, and improving the flexibility of screen projection playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0045] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0046] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0047] Figure 4A flowchart of a display device performing screen projection playback provided in some embodiments of the present application;

[0048] Figure 5 A timing diagram of a display device performing screen projection playback provided in some embodiments of the present application;

[0049] Figure 6 A flowchart of a display device receiving a screen projection instruction provided in some embodiments of the present application;

[0050] Figure 7 A flowchart of a display device playing screen projection data according to a first mode provided in some embodiments of the present application;

[0051] Figure 8 A flowchart of a display device playing screen projection data according to a second mode provided in some embodiments of the present application;

[0052] Fig. 9 A flowchart of a first embodiment of a display device outputting audio provided in some embodiments of the present application;

[0053] Fig.10 A flowchart of a second embodiment of a display device outputting audio provided in some embodiments of the present application;

[0054] Fig.11 A flowchart of a display device playing projection data according to a memory mode provided in some embodiments of the present application;

[0055] Fig.12 A flowchart of a display device updating a memory mode according to a setting option provided in some embodiments of the present application;

[0056] Fig.13 A flowchart of a display device displaying an audio selection interface provided in some embodiments of the present application;

[0057] Fig.14 A flowchart of a display device obtaining recommended audio data and local audio data provided in some embodiments of the present application;

[0058] Fig.15 A flowchart of a display device playing projection data according to a play mark position provided in some embodiments of the present application. DETAILED DESCRIPTION

[0059] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0060] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0061] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0062] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0063] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0064] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0065] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0066] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0067] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0068] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0069] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0070] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0071] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0072] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0073] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0074] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0075] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0076] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0077] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0078] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0079] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0080] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0081] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may control the display device 200 to provide a user interface, for example, the operating system may directly control the display device 200 to provide a user interface, or may provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0082] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200 .

[0083] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0084] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0085] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0086] like Figure 3As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0087] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0088] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0089] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0090] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device 200 and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0091] In some embodiments, the display device 200 may also receive the projection data sent by the terminal device 300 through the projection transmission protocol, and perform projection playback or projection display. The projection transmission protocol is a protocol for wireless transmission and playback of multimedia information. The display device 200 may send a projection instruction to the terminal device 300 through the projection transmission protocol, or the display device 200 may also receive a projection instruction sent from the terminal device 300.

[0092] For ease of description, the device end that receives the screen projection instruction can be called the receiving device, and the device end that sends the screen projection instruction can be called the sending device. After responding to the screen projection instruction, the receiving device can determine the screen projection type according to the screen projection instruction. The screen projection type can include mirror projection and URL projection, wherein, when the screen projection type is mirror projection, the receiving device can receive the projection data sent by the sending device to play or display it through the receiving device. For example, when the display device 200 is the receiving device and the terminal device is the sending device, after the display device 200 responds to the screen projection instruction, it can receive the video media sent by the terminal device, and play the video media projected by the terminal device through the display device 200 to achieve the screen projection effect. When the screen projection type is URL projection, the receiving device can receive the URL link sent by the sender, and request the projection data through the URL link, so as to play or display it through the receiving device.

[0093] When the transmitting device sends a screen projection instruction, the display device 200 as the receiving device can be in two states. Among them, the first state is the standby state, that is, the state in which the display device 200 does not play or display the media data. The display device 200 can respond to the screen projection instruction and play the screen projection data. At this time, the controller 250 controls the display 260 to display the media screen corresponding to the screen projection data in the user interface, and controls the audio output device 270 to play the audio data in the screen projection data.

[0094] The second state is the playing state, that is, the state in which the display device 200 is playing or displaying media data. At this time, the display device 200 is displaying the media screen corresponding to the media data. After the display device 200 responds to the screen projection instruction, the playback of the projection data will conflict with the playback of the media data, causing the display device 200 to cancel the display of the media screen and instead display the projection screen corresponding to the projection data, interrupting the display of the media screen. For example, when the display device 200 is displaying a picture media, it receives audio media projected by the terminal device 300, so that the audio media can be listened to while watching the picture media. However, when the display device 200 responds to the screen projection instruction, the display device 200 will directly display the media interface corresponding to the music media, thereby interrupting the display of the picture media and affecting the user experience.

[0095] In order to solve the problem that the display device directly interrupts the current display interface when responding to a screen projection request, some embodiments of the present application provide a display device 200, which includes a display 260, an audio output device 270, and a controller 250. The display 260 is configured to display a user interface; the audio output device 270 is configured to play audio data; the controller 250 is coupled to the display 260 and the audio output device 270 to control the display 260 to display the user interface, and to control the audio output device 270 to play audio data. The controller 250 is configured to perform a screen projection playback method. Figure 4 A flowchart of the display device performing screen projection playback provided in an embodiment of the present application. Figure 5 The timing diagram of the display device 200 performing screen projection playback according to the embodiment of the present application is as follows. Figure 5 The timing relationship shown in the figure is used to perform screen casting. Figure 4 and Figure 5 , the method includes the following contents:

[0096] S100: In response to a screen projection instruction, obtaining screen projection data, and detecting a data type of the screen projection data.

[0097] After receiving the screen projection instruction sent by the transmitting device, the display device 200 can generate a screen projection pop-up window according to the screen projection instruction. Figure 6As shown, the screen projection pop-up window includes options for agreeing to screen projection and rejecting screen projection. The user can input feedback instructions based on the options for agreeing to screen projection and rejecting screen projection to respond to the screen projection instructions. Corresponding to the options for agreeing to screen projection and rejecting screen projection, the feedback instructions may include instructions for agreeing to screen projection and instructions for rejecting screen projection. When an instruction for agreeing to screen projection is input based on the option for agreeing to screen projection, the controller 250 can receive the screen projection data sent from the sending device in response to the instruction for agreeing to screen projection; when an instruction for rejecting screen projection is input based on the option for rejecting screen projection, the controller 250 can generate a prompt message in response to the instruction for rejecting screen projection, and send the prompt message to the sending device to prompt the sending device that the current display device 200 rejects the screen projection from the sending device.

[0098] When the display device 200 and multiple terminal devices 300 with the screen projection sending function are in the same area, in order to facilitate the determination of the source of the screen projection, the screen projection pop-up window may also include the screen projection end information. For example, the screen projection end information may be "music data currently received for projection from the first terminal device", so that the user can determine the screen projection instruction to be responded to according to the screen projection end information.

[0099] After receiving the projection data, the controller 250 can detect the data type of the projection data. The data type may include audio data, video data, picture data, or text data. The controller 250 can control the corresponding device component to play the projection data according to the data type. For example, for audio data, the controller 250 controls the audio output device 270 to play the audio data, and for video data, the controller 250 controls the audio output device 270 to play the audio part of the video data, and controls the display 260 to display the video screen corresponding to the video data.

[0100] It should be noted that when the display device 200 is in standby mode, when the controller 250 receives audio data sent by the receiving device, the controller 250 can also start the player control of the display device 200 according to the audio data, and generate an audio interface according to the audio data and the player interface; while the controller 250 controls the audio output device 270 to play the audio data, it controls the display 260 to display the corresponding audio interface.

[0101] S200: If the data type is an audio type, controlling the display to display a play prompt message in the user interface.

[0102] The playback prompt information includes a first mode option and a second mode option, and the user can determine the playback mode of the projection data based on the first mode option and the second mode option. Among them, the first mode option is a full-screen playback option, and the controller 250 can control the display 260 to display the projection interface corresponding to the projection data in full screen according to the first mode option, and control the audio output device 270 to play the projection data. The second mode option is a background playback option, and the controller 250 can keep displaying the current display interface according to the second mode option, and control the audio output device 270 to play the projection data.

[0103] In some embodiments, the controller 250 may also detect the operating state of the display device 200, and determine the mode option for playing the projection data according to the operating state of the display device 200. For example, when the display device 200 is in standby mode and receives projection data, the controller 250 may directly play the projection data in full screen according to the first mode option; when the display device is in playback mode and receives projection data, the controller 250 may directly keep displaying the current display interface according to the second mode option, and control the audio output device 270 to play the projection data, so as to alleviate the interference of the projection data on the display interface currently being played, and improve the playback fluency of the current data.

[0104] S300: In response to a selection instruction for a target mode option, when the target mode option is a first mode option, controlling the audio output device to play the projection data, and displaying a projection interface corresponding to the projection data in the user interface.

[0105] The user can also input a selection instruction according to the playback prompt information to select a target mode option for playing the projection data in the first mode option and the second mode option. When the target mode option is the first mode option, the controller 250 can control the audio output device to play the projection data and display the projection interface corresponding to the projection data in the user interface. When the display device 200 controls the display 260 to display the media screen, the controller 250 can also cancel the display of the media screen according to the first mode option and control the display 260 to display the projection interface.

[0106] For example, Figure 7 As shown, the display device 200 is displaying a picture, and the display 260 displays the picture interface. At this time, the controller 250 responds to the screen projection instruction and obtains a segment of audio data uploaded by the terminal device 300. When the target mode option is the first mode option, the controller 250 can control the display 260 to cancel the display of the picture interface. At the same time, the controller 250 starts the audio playback program, generates an audio interface according to the uploaded audio data, and controls the display 260 to display the audio interface in the user interface after canceling the display of the picture interface.

[0107] In some embodiments, following the above example, when the target mode option is the first mode option, the controller 250 can also keep the picture displayed and generate an audio interface based on the uploaded audio. After the audio interface is generated, the controller 250 can control the display 260 to display the audio interface on the upper layer of the picture interface, that is, to block the interface for displaying the picture through the audio interface so that the audio interface is located in the display area of ​​the user interface. The controller 250 can also control the audio interface and the interface for displaying the picture to switch according to the control instruction to adjust the display of different interfaces.

[0108] S400: When the target mode option is the second mode option, keep displaying the current display interface and control the audio output device to play the projection data.

[0109] When the target mode option is the second mode option, the controller 250 may keep displaying the current display interface according to the second mode option. Figure 8 As shown, the display device 200 is displaying a picture, and the user wants to listen to audio data while watching the picture interface, then the controller 250 can keep the display 260 displaying the picture interface according to the second mode option. Since the display 260 keeps displaying the picture interface, the controller 250 does not need to generate an audio interface based on the audio data of the screen projection. The controller 250 can control the audio output device 270 to play the audio data, so that the display device 200 plays the audio data while displaying the picture interface.

[0110] It can be seen from the above technical solution that the present application provides two mode options to the user by playing prompt information. The user can select the first mode option by inputting a selection instruction to display the projection interface corresponding to the projection data in the user interface. Alternatively, select the second mode option to control the audio output device to play the projection data while maintaining the display of the current interface. This alleviates the problem of interface interruption caused by the direct conflict between the projection interface and the current display interface.

[0111] In some embodiments, the play prompt information can also be a prompt sound, that is, when the controller 250 detects that the screen projection data is of audio type, the audio output device 270 is controlled to output the play prompt information. The user can interact with the display device 200 by voice based on the play prompt information to select the instruction by voice input. After receiving the selection instruction in voice format, the controller 250 can input the audio data corresponding to the selection instruction into the voice conversion model to output the selection instruction in text format, and obtain the target mode option according to the selection instruction in text format.

[0112] In some embodiments, before the display device 200 responds to the screen casting instruction, if the video media is being played, the display 260 displays the media screen corresponding to the video media, and the audio output device 270 plays the audio data of the video media. At this time, if the target mode option is the first option mode, the controller 250 can respond to the screen casting instruction, control the display 260 to cancel the display of the media screen in the media interface, and display the screen casting interface corresponding to the screen casting data in the user interface. At the same time, the controller 250 can also control the audio output device 270 to cancel the audio data of the video media and play the screen casting data instead.

[0113] If the target mode option is the second option mode, the controller 250 maintains the current display interface. At this time, since the audio output device 270 is playing the audio data of the video media, the controller 250 can generate audio prompt information to determine the playback mode of the projection data and the audio data of the video media through the audio prompt information. The audio prompt information includes the first audio option and the second audio option. Fig. 9 As shown, when the user generates an audio playback instruction based on the first audio option, the controller 250 responds to the audio playback instruction and controls the audio output device 270 to play the projection data and the audio data of the video media together; Fig.10 As shown, when the user generates an audio playback instruction based on the second audio option, the controller 250 responds to the audio playback instruction and controls the audio output device 270 to cancel playing the audio data of the video media asset and instead play the projection data.

[0114] For example, when the display device 200 is playing a movie, the controller 250 controls the display 260 to display the movie screen in the user interface, and controls the audio output device 270 to play the audio data of the movie. At this time, the controller 250 can respond to the screen projection instruction for projecting music B, display the playback prompt information in the user interface, and select the mode option for playing music B according to the playback prompt information. If the target mode option is the first mode option, the controller 250 controls the display 260 to cancel the display of the movie screen, and displays the audio interface corresponding to music B in the user interface; the controller 250 controls the audio output device 270 to cancel the audio data of the movie and play the audio data of music B instead.

[0115] If the target mode option is the second mode option, the controller 250 controls the display 260 to keep displaying the movie screen, and determines the playing mode of the music B according to the audio prompt information. The controller 250 can respond to the audio playing instruction generated according to the first audio option and control the audio output device 270 to play the audio data of the movie and the music B at the same time, so that the music B is played along with the audio data of the movie. The controller 250 can respond to the audio playing instruction generated according to the second audio option and control the audio output device 270 to cancel playing the audio data of the movie and play only the music B instead.

[0116] The display device 200 can receive multiple screen projection instructions sequentially or simultaneously, and the user needs to provide feedback on the playback prompt information generated by each screen projection instruction to select a mode option for playing the screen projection data. However, in the same playback scenario, providing feedback on multiple playback prompt information is very cumbersome and affects the user experience.

[0117] Based on the above scenarios, in some embodiments, the controller 250 can also obtain the current playback scene of the display device 200 before responding to the selection instruction of the target mode option. The display device 200 can include multiple playback scenes, such as video playback scenes, audio playback scenes, game scenes, standby scenes, etc. Fig.11 A flowchart of a display device according to an embodiment of the present application determining a memory mode according to a playback scene. Fig.11If the current playback scene is the same as the preset playback scene, the controller 250 can detect the memory mode corresponding to the preset playback scene from the scene memory information. Therefore, the scene memory information may include a memory mode option, which is a mode option selected by the display device 200 from the first mode option or the second mode option in the preset playback scene. Correspondingly, the memory mode may be the first mode or the second mode, wherein the first mode is the playback mode corresponding to the first mode option, that is, the audio output device 270 is controlled to play the projection data, and the projection interface corresponding to the projection data is displayed in the user interface. The second mode is the playback mode corresponding to the second mode option, that is, the current display interface is kept displayed and the audio output device 270 is controlled to play the projection data. The memory mode information is used to record the memory mode. For example, when the display device 200 is in a game scene, the user hopes to play the game while listening to the music data projected through the terminal device 300. Since the display device 200 is displaying the game interface, in the game scene, the user can input a setting instruction for setting the memory mode option to the display device 200. The controller 250 can respond to the setting instruction and set the second mode to the memory mode in the game scene. When the controller 250 detects that the display device 200 is in the game scene and receives the screen projection instruction, the screen projection data can be played directly according to the memory mode. If the current playback scene is different from the preset playback scene, and the memory mode corresponding to the current playback scene is not detected in the memory scene information, the controller 250 can control the display 260 to display the playback prompt information.

[0118] When the display device 200 switches the playback scene, the memory mode will change based on the change of the playback scene. Therefore, the controller 250 can detect the memory mode in the scene memory information according to the switched playback scene. For example, when the display device 200 ends the game program and starts playing video media, the current scene of the display device 200 switches from the game scene to the video playback scene. The controller 250 can detect the memory mode according to the video playback scene in the memory scene information, and play the projection data according to the memory mode in the video playback scene. For example, when the memory mode in the video playback scene is the first mode, the controller 250 can control the display 260 to cancel the display of the video interface according to the memory mode, and display the projection interface corresponding to the projection data.

[0119] If the controller 250 does not detect a memory mode corresponding to a preset playback scene in the scene memory information in the current playback scene, the controller 250 may control the display 260 to display playback prompt information in the current playback scene to select a corresponding mode option to play the projection data.

[0120] In some embodiments, Fig.12As shown, after responding to the selection instruction of the target mode option, the controller 250 can also display scene prompt information, and the scene prompt information includes a setting option for updating the scene memory information. When the setting option is triggered, the controller 250 is used to set the target mode option selected by the selection instruction as the memory mode option. The controller 250 can set the target mode option to the memory mode option under the current playback scene in response to the operation instruction input by the user based on the setting option, and complete the update of the memory mode according to the target mode corresponding to the target mode option.

[0121] Based on the above scenario, when the memory mode has been set for the current playing scene, if the user wants to modify the memory mode of the current playing scene, the user can also input a modification option instruction when the display device 200 displays the scene prompt information. The controller 250 can modify the memory mode option in response to the modification option instruction. After modifying the memory mode option, the controller 250 can respond to the user's operation instruction based on the setting option and update the memory mode information according to the modified memory mode.

[0122] In some embodiments, the controller 250 can also display media information corresponding to other playable media data on the user interface while controlling the audio output device 270 to play the projection data. The media data may include audio recommendation data recommended according to the projection data, as well as local audio data stored locally by the display device 200. In order to obtain audio recommendation data, the display device 200 may also include a communication device 220, which is configured to communicate with the server 400. The controller 250 can obtain audio information of the projection data and generate a recommendation data request based on the audio information, wherein the recommendation data request is used to request audio recommendation data. The audio information is information related to the projection data. For example, the projection data is a song A, and the audio information can be information related to song A, such as song information such as the singer, lyricist, composer, or album of song A. The controller 250 can generate a recommendation data request based on the audio information. The server 400 may respond to the recommendation data request and retrieve recommended songs related to song A according to the audio information, for example, song B sung by the same singer as song A, song C from the same album as song A, or song D written by the same lyricist or composer as song A. The server 400 may send the audio data corresponding to the recommended song to the display device 200 as audio recommendation data.

[0123] like Fig.13 and Fig.14As shown, after receiving the audio recommendation data, the controller 250 can traverse the local audio data in the memory of the display device 200, and generate an audio selection interface based on the local audio data and the audio recommendation data, and the audio selection interface includes audio recommendation information to provide the user with currently selectable recommended audio data. The audio recommendation information may include audio information of the local audio data and audio information of the audio recommendation data.

[0124] The controller 250 can control the display 260 to display an audio selection interface in the user interface when controlling the audio output device 270 to play the projection data. When the audio selection interface is displayed, the user can input an audio selection instruction for selecting audio information of target audio data in the audio recommendation information to the display device 200, and control the audio output device 270 to stop playing the projection data and play the target audio data.

[0125] In some embodiments, the controller 250 may also set a preset sorting rule when generating the audio selection interface. The controller 250 may sort the local audio data and the audio recommendation data according to the preset sorting rule, and display the sorting results of the local audio data (specifically, the audio information of the local audio data) and the audio recommendation data (specifically, the audio information of the audio recommendation data) in the audio selection interface.

[0126] If the display device 200 does not receive a new screen projection instruction, the controller 250 can mark the audio data at the top of the sorting results of the local audio data and the audio recommendation data as the target audio data after the screen projection data is played, and control the audio output device 270 to play the target audio data. If the target audio data is played and no new screen projection instruction is received, the other local audio data and audio recommendation data are played in sequence according to the sorting results.

[0127] In some embodiments, if the data type of the projection data is a video type, the display device 200 needs to cache the projection data. At this time, the user needs to wait for the caching process of the projection data. After the projection data is cached, the projection interface of the projection data can be seen. In order to reduce the waiting time, the controller 250 can also cache the projection data and the advertising data at the same time. The controller 250 can obtain the play flag of the projection data, and the play flag is used to characterize the cache status of the projection data. The play flag includes a first mark, which is used to indicate that the projection data has not been cached and cannot be played.

[0128] Since the amount of advertising data is much smaller than the screen projection data, the caching process of advertising data is faster. Fig.15As shown, when the caching of the advertising data is completed, the controller 250 can control the display 260 to display the advertising screen corresponding to the advertising data. At this time, the controller 250 can continue to execute the caching of the projection data. After the projection data is cached, the play flag can switch the first mark to the second mark, and the second mark is used to indicate that the projection data has completed caching. At this time, the projection data can be played. To this end, the controller 250 can also monitor the play flag in the process of caching the projection data. In the process of the display 260 playing the advertising screen in the user interface, if the first mark included in the play flag is switched to the second mark, the display 260 is controlled to cancel the display of the advertising screen, and the projection screen corresponding to the projection data is displayed in the user interface.

[0129] The advertising data may be a dynamic image or video of a preset length. To facilitate caching of the advertising data, the controller 250 may cache the advertising data locally before receiving the projection data, for example, after the display device 200 is turned on.

[0130] In some embodiments, the advertising data may also include advertising audio. To this end, in the process of controlling the display 260 to display the advertising screen corresponding to the advertising data in the user interface, the controller 250 may also control the audio output device 270 to play the advertising audio. Correspondingly, when the first mark included in the flag is switched to the second mark, the controller 250 may also control the audio output device 270 to stop playing the advertising audio and play the audio part of the screen projection data.

[0131] In some embodiments, the controller 250 may also obtain the cache progress of the projection data during the process of caching the projection data. In order to facilitate the switching of the play flag according to the cache progress, the controller 250 may set a preset progress threshold. When the cache progress is greater than or equal to the preset progress threshold, the controller 250 may switch the first mark of the play flag to the second mark to control the display 260 to display the projection interface in the user interface.

[0132] In order to save caching time and allow users to see the projection data as soon as possible, the preset progress threshold can be a non-complete caching progress. For example, the preset progress threshold can be 50%. That is, when the cache progress is greater than or equal to 50%, the controller 250 can switch the first mark of the play flag to the second mark to play the cached projection data first, and at the same time, continue to cache the remaining projection data.

[0133] In some embodiments, when playing cached projection data, if the cache progress is less than the playback progress, the controller 250 can also switch the second mark of the play flag back to the first mark when the cached projection data is about to finish playing, and control the display 260 to cancel the display of the projection screen of the cached projection data and display the advertising screen.

[0134] In some embodiments, when the display 260 has completed displaying all the advertising screens corresponding to the advertising data, if the first mark included in the play mark has not been switched to the second mark, it means that after the advertising data is played, the screen projection data has not been cached and cannot be played. At this time, the controller 250 can control the display 260 to re-display the advertising data corresponding to the advertising data, so as to control the display device 200 to play the advertising data in a loop.

[0135] In some embodiments, when the transmitting device sends a screen projection instruction to the display device 200, it can also synchronously send a data address link of the screen projection data. Therefore, the controller 250 can obtain the data address link of the screen projection data by parsing the screen projection data. The suffix information of the data address link contains the data format of the screen projection data. For example, for audio data, the data format of the data address link can be mp3, wma, ogg, etc. For video format, the data format of the data address link can be mp4, avi, etc. Taking the following data address link as an example, in the data address link "uri->http: / / 192.168.1.113:57645 / external / audio / media / 1000000040.mp3", the suffix information is mp3. The controller 250 can determine the data type of the screen projection data based on the suffix information of the data address link.

[0136] Some embodiments of the present application provide a screen projection and playback method, which is applied to a display device 200, and the display device 200 should at least include a display 260, an audio output device 270, and a controller 250. The display 260 is configured to display a user interface, and the audio output device 270 is configured to play audio data. The method includes:

[0137] S100: In response to a screen projection instruction, obtaining screen projection data, and detecting a data type of the screen projection data.

[0138] S200: If the data type is an audio type, controlling the display to display a play prompt message in the user interface.

[0139] The play prompt information includes a first mode option and a second mode option.

[0140] S300: In response to a selection instruction for a target mode option, when the target mode option is a first mode option, controlling the audio output device to play the projection data, and displaying a projection interface corresponding to the projection data in the user interface.

[0141] S400: When the target mode option is the second mode option, keep displaying the current display interface and control the audio output device to play the projection data.

[0142] It can be seen from the above technical solutions that the present application provides a display device and a screen projection playback method, wherein the method obtains the projection data by responding to the projection instruction; detects the data type of the projection data, and if the data type is an audio type, controls the display to display the playback prompt information for selecting the playback mode in the user interface; responds to the selection instruction of the target mode option, when the target mode option is the first mode option, controls the audio output device to play the projection data, and displays the projection interface corresponding to the projection data in the user interface; when the target mode option is the second mode option, keeps displaying the current display interface and controls the audio output device to play the projection data. The present application displays the playback prompt interface, so that the user can play the projection data according to the corresponding mode option in the playback prompt interface, alleviates the problem of the display device directly interrupting the current display interface when responding to the projection request, and improves the flexibility of the projection playback.

[0143] The specific implementations of the same or similar parts between the various embodiments in this specification can refer to the relevant descriptions, which will not be repeated here.

[0144] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0145] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0146] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; an audio output device configured to play audio data; A controller is coupled to the display and the audio output device and is configured to: In response to a screen projection instruction, acquiring screen projection data, and detecting a data type of the screen projection data; If the data type is an audio type, controlling the display to display the play prompt information in the user interface, the play prompt information including a first mode option and a second mode option; In response to a selection instruction for a target mode option, when the target mode option is a first mode option, controlling the audio output device to play the projection data, and displaying a projection interface corresponding to the projection data in a user interface; When the target mode option is the second mode option, the current display interface is kept displayed and the audio output device is controlled to play the projection data.

2. The display device according to claim 1, characterized in that Before the controller executes the step of responding to the selection instruction of the target mode option, the controller is further configured to: Obtaining the current playback scene of the display device; If the current playback scene is the same as the preset playback scene, detecting a memory mode corresponding to the preset playback scene from the scene memory information, the memory mode being the first mode or the second mode; The projection data is played according to the memory mode.

3. The display device according to claim 2, characterized in that After executing the step of responding to the selection instruction of the target mode option, the controller is further configured to: Displaying scene prompt information, wherein the scene prompt information includes setting options for updating the scene memory information; In response to a user's operation instruction based on the setting option, the target mode is updated to the memory mode.

4. The display device according to claim 1, characterized in that The system further includes a communication device, wherein the communication device is configured to communicate with the server, and the controller controls the audio output device to play the projection data, and is further configured to: Acquire audio information of the projection data, and generate a recommendation data request according to the audio information, wherein the recommendation data request is used to request audio recommendation data; sending the recommendation data request to the server; receiving audio recommendation data from the server; In response to the audio selection instruction, target audio data is selected and played from the audio recommendation data and the local audio data.

5. The display device according to claim 4, characterized in that The controller executes, in response to the audio selection instruction, selecting and playing target audio data from the audio recommendation data and the local audio data, and is specifically configured as follows: generating an audio selection interface according to the audio recommendation data and the local audio data; In response to the audio selection instruction for the target audio data in the audio selection interface, the audio output device is controlled to stop playing the projection data and play the target audio data.

6. The display device according to claim 1, characterized in that If the data type is a video type, the controller is further configured to: Cache the projection data and the advertisement data, and obtain a play flag of the projection data, wherein the play flag includes a first mark, and the first mark is used to indicate that the projection data cannot be played; In the process of caching the screen projection data, controlling the display to display an advertisement picture corresponding to the advertisement data on the user interface; During the process of the display playing the advertising screen in the user interface, if the first mark included in the play flag is switched to the second mark, the display is controlled to display the projection screen corresponding to the projection data in the user interface; the second mark is used to indicate that the projection data can be played.

7. The display device according to claim 6, characterized in that In the process of caching the screen projection data, after controlling the display to display the advertisement picture corresponding to the advertisement data on the user interface, the controller is further configured to: Obtaining the cache progress of the screen projection data; When the cache progress is greater than or equal to a preset progress threshold, the first mark of the play flag is switched to a second mark.

8. The display device according to claim 6, characterized in that The controller controls the display to display an advertisement picture corresponding to the advertisement data on the user interface, and is specifically configured as follows: When the display finishes displaying all the advertisement pictures corresponding to the advertisement data, if the first mark included in the play flag has not been switched to the second mark, the display is controlled to redisplay the advertisement pictures corresponding to the advertisement data.

9. The display device according to claim 1, characterized in that: The controller performs detection of the data type of the projection data, and is specifically configured as follows: Parsing the projection data to obtain a data address link of the projection data; The data type is determined according to the suffix information of the data address link.

10. A screen projection playback method, characterized in that: Applied to a display device according to any one of claims 1 to 9, the display device comprising a display, an audio output device and a controller, the display being configured to display a user interface, the audio output device being configured to play audio data, the method comprising: In response to a screen projection instruction, acquiring screen projection data, and detecting a data type of the screen projection data; If the data type is an audio type, controlling the display to display the play prompt information in the user interface, the play prompt information including a first mode option and a second mode option; In response to a selection instruction for a target mode option, when the target mode option is a first mode option, controlling the audio output device to play the projection data, and displaying a projection interface corresponding to the projection data in a user interface; When the target mode option is the second mode option, the current display interface is kept displayed and the audio output device is controlled to play the projection data.

Images