Display device and screen projection playing method

Abstract

The application provides a display device and a screen projection playing method. The method acquires screen projection data in response to a screen projection instruction, detects the data type of the screen projection data, controls the display to display playing prompt information for selecting a playing mode in a user interface if the data type is an audio type, responds to a selection instruction for a target mode option, controls an audio output device to play the screen projection data and displays a screen projection interface corresponding to the screen projection data in the user interface if the target mode option is a first mode option, and keeps displaying a current display interface and controls the audio output device to play the screen projection data if the target mode option is a second mode option. The application displays a playing prompt interface, so that the user can select a corresponding mode option in the playing prompt interface to play the screen projection data, solves the problem that the display device directly interrupts a current display interface when responding to a screen projection request, and improves the flexibility of screen projection playing.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a screen projection playing method. BACKGROUND

[0002] A screen projection transmission protocol is a protocol for wirelessly transmitting and playing multimedia information, and can be applied to display devices and terminal devices. For example, a user can select media data to be projected by a terminal device, and send the media data to a display device by the screen projection transmission protocol, so as to play the media data by the display device and realize screen projection playing.

[0003] However, when the display device is displaying media content, if the screen projection instruction sent by the terminal device is agreed, the display device will directly interrupt the display of the current media content and display the screen corresponding to the media data. For example, when the display device is displaying a picture, the user wants to watch the picture while listening to the music media projected by the terminal device. However, when the display device responds to the screen projection instruction, the display device will directly display the media interface corresponding to the music media, thereby directly interrupting the display of the picture and affecting the user experience. SUMMARY

[0004] The present application provides a display device and a screen projection playing method to solve the problem of directly interrupting the current display interface when the display device responds to the screen projection request.

[0005] In a first aspect, some embodiments of the present application provide a display device, which includes a display, an audio output device, and a controller. The display is configured to display a user interface; the audio output device is configured to play audio data; and the controller is configured to:

[0006] In response to a screen projection instruction, obtain screen projection data, and detect the data type of the screen projection data;

[0007] If the data type is an audio type, control the display to display a playing prompt information in the user interface, the playing prompt information including a first mode option and a second mode option;

[0008] In response to a selection instruction of a target mode option, when the target mode option is the first mode option, control the audio output device to play the screen projection data and display a screen projection interface corresponding to the screen projection data in the user interface;

[0009] When the target mode option is the second mode option, maintain the display of the current display interface and control the audio output device to play the screen projection data.

[0010] In some embodiments, before the controller performs the step of responding to the selection instruction of the target mode option, the controller is further configured to:

[0011] obtaining a current playing scene of the display device;

[0012] if the current playing scene is same as a preset playing scene, detecting a memory mode corresponding to the preset playing scene from scene memory information, the memory mode being a first mode or a second mode;

[0013] playing the screen projection data according to the memory mode.

[0014] In some embodiments, after the controller performs the step of responding to the selection instruction of the target mode option, the controller is further configured to:

[0015] display scene prompt information, the scene prompt information including a setting option for updating the scene memory information;

[0016] in response to an operation instruction of a user based on the setting option, update the target mode to the memory mode.

[0017] In some embodiments, further comprising a communication device configured to be communicatively connected with a server, the controller performing the control of the audio output device to play the screen projection data is further configured to:

[0018] obtain audio information of the screen projection data, and generate a recommendation data request according to the audio information, the recommendation data request being used to request audio recommendation data;

[0019] send the recommendation data request to the server;

[0020] receive audio recommendation data from the server;

[0021] in response to an audio selection instruction, select and play target audio data from the audio recommendation data and local audio data.

[0022] In some embodiments, the controller performing the selection and playing of the target audio data from the audio recommendation data and the local audio data is specifically configured to:

[0023] generate an audio selection interface according to the audio recommendation data and the local audio data;

[0024] in response to an audio selection instruction of target audio data in the audio selection interface, control the audio output device to stop playing the screen projection data and play the target audio data.

[0025] In some embodiments, if the data type is a video type, the controller is further configured to:

[0026] cache the screen projection data and the advertisement data, and acquire a playing flag bit of the screen projection data, the playing flag bit comprising a first mark, the first mark being used to indicate that the screen projection data is not playable;

[0027] In the process of caching the screen projection data, the display is controlled to display an advertisement picture corresponding to the advertisement data on the user interface;

[0028] In the process of playing the advertisement picture on the user interface by the display, if the first mark comprised in the playing flag bit is switched to a second mark, the display is controlled to display a screen projection picture corresponding to the screen projection data on the user interface; the second mark is used to indicate that the screen projection data is playable.

[0029] In some embodiments, in the process of caching the screen projection data, after the display is controlled to display the advertisement picture corresponding to the advertisement data on the user interface, the controller is further configured to:

[0030] acquire a caching progress of the screen projection data;

[0031] switch the first mark of the playing flag bit to the second mark when the caching progress is greater than or equal to a preset progress threshold.

[0032] In some embodiments, the controller performing the control of the display to display the advertisement picture corresponding to the advertisement data on the user interface is specifically configured to:

[0033] if the first mark comprised in the playing flag bit is not switched to the second mark when the display finishes displaying all the advertisement pictures corresponding to the advertisement data, the display is controlled to redisplay the advertisement picture corresponding to the advertisement data.

[0034] In some embodiments, the controller performing the detection of the data type of the screen projection data is specifically configured to:

[0035] parse the screen projection data to obtain a data address link of the screen projection data;

[0036] determine the data type according to suffix information of the data address link.

[0037] In a second aspect, some embodiments of the present application provide a screen projection playing method, applied to the display device of the first aspect, the display device comprising a display, an audio output device and a controller, the display being configured to display a user interface, the audio output device being configured to play audio data, the method comprising:

[0038] in response to a screen projection instruction, acquiring screen projection data, and detecting a data type of the screen projection data;

[0039] If the data type is an audio type, the display is controlled to display the playing prompt information in the user interface, the playing prompt information including a first mode option and a second mode option;

[0040] In response to a selection instruction of a target mode option, if the target mode option is the first mode option, the audio output device is controlled to play the screen projection data, and a screen projection interface corresponding to the screen projection data is displayed in the user interface;

[0041] If the target mode option is the second mode option, the current display interface is maintained, and the audio output device is controlled to play the screen projection data.

[0042] According to the above technical solution, the application provides a display device and a screen projection playing method. The method acquires screen projection data in response to a screen projection instruction, detects a data type of the screen projection data, controls a display to display playing prompt information for selecting a playing mode in a user interface if the data type is an audio type, controls an audio output device to play the screen projection data and displays a screen projection interface corresponding to the screen projection data in the user interface in response to a selection instruction of a target mode option if the target mode option is a first mode option, and maintains the current display interface and controls the audio output device to play the screen projection data if the target mode option is a second mode option. The application displays a playing prompt interface, so that a user can select a corresponding mode option according to a demand and play the screen projection data in the playing prompt interface, thereby avoiding the problem that the display device directly interrupts the current display interface when responding to a screen projection request, and improving the flexibility of screen projection playing. BRIEF DESCRIPTION OF DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or the prior art description. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of these drawings.

[0044] Figure 1 The schematic diagram of the operation scene between the display device and the control device provided by some embodiments of the present application;

[0045] Figure 2 The hardware configuration schematic diagram of the display device provided by some embodiments of the present application;

[0046] Figure 3 The software configuration schematic diagram of the display device provided by some embodiments of the present application;

[0047] Figure 4The flowchart of the display device provided by some embodiments of the present application performing screen projection playing;

[0048] Figure 5 The timing diagram of the display device provided by some embodiments of the present application performing screen projection playing;

[0049] Figure 6 The flowchart of the display device provided by some embodiments of the present application receiving screen projection instruction;

[0050] Figure 7 The flowchart of the display device provided by some embodiments of the present application playing screen projection data according to the first mode;

[0051] Figure 8 The flowchart of the display device provided by some embodiments of the present application playing screen projection data according to the second mode;

[0052] Figure 9 The first embodiment flowchart of the display device provided by some embodiments of the present application outputting audio;

[0053] Figure 10 The second embodiment flowchart of the display device provided by some embodiments of the present application outputting audio;

[0054] Figure 11 The flowchart of the display device provided by some embodiments of the present application playing screen projection data according to the memory mode;

[0055] Figure 12 The flowchart of the display device provided by some embodiments of the present application updating the memory mode according to the setting option;

[0056] Figure 13 The flowchart of the display device provided by some embodiments of the present application displaying the audio selection interface;

[0057] Figure 14 The flowchart of the display device provided by some embodiments of the present application obtaining recommended audio data and local audio data;

[0058] Figure 15 The flowchart of the display device provided by some embodiments of the present application playing screen projection data according to the playing mark bit. DETAILED DESCRIPTION

[0059] The embodiments will be described in detail below with reference to the drawings. The following description is with reference to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following embodiments do not represent all the embodiments consistent with the present application. They are only examples of the system and method consistent with some aspects of the present application as detailed in the claims.

[0060] It should be noted that the brief description of the terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of the application. Unless otherwise specified, these terms should be understood in accordance with their ordinary and general meanings.

[0061] The terms "first", "second", "third" and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar or like objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances.

[0062] The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not have to be limited to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices.

[0063] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware or / and software code capable of performing functions associated with the element.

[0064] In the embodiments of the present application, the display device 200 generally refers to a device with picture display and data processing capability. For example, the display device 200 includes but is not limited to smart TV, mobile terminal, computer, monitor, advertising screen, wearable device, virtual reality device, augmented reality device, etc.

[0065] Figure 1 The schematic diagram of the operation scenario between the display device and the control device provided by some embodiments of the present application is shown in FIG. 1. Figure 1 As shown in FIG. 1, the user can operate the display device 200 through touch operation, mobile terminal 300 and control device 100. Among them, the control device 100 is used to receive the operation instruction input by the user, and convert the operation instruction into a control instruction that can be recognized and responded by the display device 200. For example, the control device 100 can be a remote controller, a stylus, a handle, etc.

[0066] The mobile terminal 300 can be used as a kind of control device to perform human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a kind of communication device to establish a communication connection with the display device 200 and perform data interaction. In some embodiments, the mobile terminal 300 can install a software application with the display device 200, realize connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The mobile terminal 300 can also display audio and video content on the display device 200 to realize the function of synchronous display.

[0067] In some embodiments, the mobile terminal 300 or other electronic device can also simulate the functions of the control device 100 by running an application program that controls the display device 200.

[0068] As shown in Figure 1 It is also shown in the figure that the display device 200 is also in data communication with the server 400 through various communication means. The display device 200 can be allowed to be connected in communication through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0069] The display device 200 can provide a broadcast receiving television function, and can also provide an intelligent network television function with computer support function, including but not limited to, a network television, a smart television, an Internet protocol television (IPTV), etc.

[0070] Figure 2 The hardware configuration of the display device 200 is shown in the figure for some embodiments of the present application. Figure 1

[0071] In some embodiments, the display device 200 can include at least one of a tuning demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0072] In some embodiments, the detector 230 is used to collect signals of the external environment or interaction. For example, the detector 230 includes a light receiver for collecting ambient light intensity, or an image collector such as a camera for collecting external environmental scenes, user attributes or user interaction gestures, or a sound collector such as a microphone for receiving external sounds.

[0073] In some embodiments, the display 260 includes a display functional component for presenting a picture, and a driving component for driving image display. The display 260 is used to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu control interface, and a user control UI interface, etc.

[0074] In some embodiments, the communication device 220 is a component for communicating with external devices or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication means. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 containing WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 containing Bluetooth function.​

[0075] The communication device 220 can make the display device 200 and the external device or the server 400 in communication connection through wireless or wired connection. The wired connection can connect the display device 200 and the external device through a data line, an interface, and the like. The wireless connection can connect the display device 200 and the external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with the external device, or indirectly establish a connection relationship through a gateway, a router, a connection device, and the like.

[0076] In some embodiments, the controller 250 can include at least one of a central processor, a video processor, an audio processor, a graphics processor, a power processor, a first interface to an n-th interface for input / output, and the like. The controller 250 controls the operation of the display device 200 and responds to the user's operation by controlling various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0077] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, i.e., the tuner demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, and the like.

[0078] In some embodiments, the user can input a user command in a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).

[0079] In some embodiments, the audio output device 270 can be a native speaker of the display device 200, or an audio output device connected to the display device 200. For the audio output device connected to the display device 200, the display device 200 can also be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0080] In some embodiments, the user input interface 280 can be used to receive instructions from the user input.

[0081] In order to perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device 200 to provide a user interface, for example, the operating system can directly control the display device 200 to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0082] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for the display device 200.

[0083] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0084] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0085] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0086] like Figure 3As shown, the application framework layer in the embodiments of the present application includes a view system, managers, a content provider, etc., wherein the view system can design and implement the interface and interaction of the application program, and the view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system location services to system services or applications; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers and desktop components on the user interface.

[0087] In some embodiments, the activity manager is used to manage the life cycle of each application program and the general navigation back function, such as controlling the exit, opening, back, etc. of the application program. The window manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, intercepting the screen, controlling the display window change, for example, reducing the display window, shaking the display, twisting the display, etc.

[0088] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to realize the functions to be realized by the framework layer.

[0089] In some embodiments, the kernel layer is a functional layer between the hardware and the software of the display device 200. The kernel layer can realize functions such as hardware abstraction, multitasking, memory management, etc. For example, as shown, the kernel layer can be configured with a hardware driver, and the kernel layer contains at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power supply driver, etc. Figure 3

[0090] ​It should be noted that the above examples are only a simple division of the operating system functions, and do not constitute a limitation on the specific operating system form of the display device 200 in the embodiments of the present application. According to the function of the display device 200, the type of the operating system, and other factors, the number and specific type of the levels contained in the operating system can be in other forms.

[0091] In some embodiments, the display device 200 can also receive the screen projection data sent by the terminal device 300 through the screen projection transmission protocol, and perform screen projection playing or screen projection display. The screen projection transmission protocol is a protocol for wirelessly transmitting and playing multimedia information. The display device 200 can send a screen projection instruction to the terminal device 300 through the screen projection transmission protocol, or the display device 200 can also receive a screen projection instruction sent by the terminal device 300.

[0092] For ease of description, the device end receiving the screen projection instruction can be referred to as a receiving end device, and the device end sending the screen projection instruction can be referred to as a sending end device. After responding to the screen projection instruction, the receiving end device can determine the screen projection type according to the screen projection instruction. The screen projection type can include mirror screen projection and URL screen projection. When the screen projection type is mirror screen projection, the receiving end device can receive the screen projection data sent by the sending end device to play or display through the receiving end device. For example, when the display device 200 is the receiving end device and the terminal device is the sending end device, after the display device 200 responds to the screen projection instruction, the display device 200 can receive the video media asset sent by the terminal device and play the video media asset projected by the terminal device through the display device 200 to achieve the screen projection effect. When the screen projection type is URL screen projection, the receiving end device can receive the URL link sent by the sending end device and request the screen projection data through the URL link, so as to play or display through the receiving end device.

[0093] When the sending end device sends the screen projection instruction, the display device 200 as the receiving end device can be in two states. The first state is a standby state, that is, a state in which the display device 200 does not play or display media data. The display device 200 can respond to the screen projection instruction to play the screen projection data. At this time, the controller 250 controls the display 260 to display the media picture corresponding to the screen projection data in the user interface, and controls the audio output device 270 to play the audio data in the screen projection data.

[0094] The second state is a playing state, i.e., a state in which the display device 200 is playing or displaying the media data. At this time, the display device 200 is displaying a media picture corresponding to the media data. After the display device 200 responds to the screen projection instruction, the playing of the screen projection data conflicts with the playing of the media data, causing the display device 200 to cancel the display of the media picture and display a screen projection picture corresponding to the screen projection data instead, so that the display of the media picture is interrupted. For example, when the display device 200 is displaying a picture media, an audio media projected by the terminal device 300 is received, so that the picture media is watched and the audio media is listened to at the same time. However, when the display device 200 responds to the screen projection instruction, the display device 200 directly displays a media interface corresponding to the audio media, so that the display of the picture media is interrupted, and the experience of the user is affected.

[0095] To solve the problem that the display device directly interrupts the current display interface when responding to the screen projection request, some embodiments of the present application provide a display device 200. The display device 200 includes a display 260, an audio output device 270, and a controller 250. The display 260 is configured to display a user interface. The audio output device 270 is configured to play audio data. The controller 250 is coupled to the display 260 and the audio output device 270 to control the display 260 to display the user interface and control the audio output device 270 to play the audio data. The controller 250 is configured to perform a screen projection playing method. Figure 4 A flowchart of the display device provided by the embodiments of the present application performing screen projection playing is provided. Figure 5 A timing diagram of the display device provided by the embodiments of the present application performing screen projection playing is provided. The display device 200 performs screen projection playing according to the timing relationship as shown in Figure 5 Figure 4 Figure 5 The method includes the following contents:

[0096] S100: In response to a screen projection instruction, screen projection data is acquired, and a data type of the screen projection data is detected.

[0097] After the display device 200 receives the screen projection instruction sent by the sending terminal device, the display device 200 can generate a screen projection pop-up window according to the screen projection instruction. As shown in Figure 6 ​​As shown, the screen projection pop-up window includes an agree screen projection option and a reject screen projection option. A user can input a feedback instruction based on the agree screen projection option and the reject screen projection option in response to the screen projection instruction. The feedback instruction can include an agree screen projection instruction and a reject screen projection instruction corresponding to the agree screen projection option and the reject screen projection option. When the agree screen projection instruction is input based on the agree screen projection option, the controller 250 can receive the screen projection data sent from the sending terminal device in response to the agree screen projection instruction; when the reject screen projection instruction is input based on the reject screen projection option, the controller 250 can generate prompt information in response to the reject screen projection instruction and send the prompt information to the sending terminal device to prompt the sending terminal device that the current display device 200 rejects the screen projection from the sending terminal device.

[0098] When the display device 200 is in the same area as a plurality of terminal devices 300 with a screen projection sending function, in order to facilitate the determination of the screen projection source, the screen projection pop-up window can further include screen projection end information, for example, the screen projection end information can be "currently receiving music data from the first terminal device for screen projection", so as to facilitate the user to determine the screen projection instruction to be responded according to the screen projection end information.

[0099] After receiving the screen projection data, the controller 250 can detect the data type of the screen projection data. The data type can include audio data, video data, picture data, or text data, etc. The controller 250 can control the corresponding device components to play the screen projection data according to the data type, for example, for audio data, the audio output device 270 is controlled to play the audio data, for video data, the audio output device 270 is controlled to play the audio part in the video data, and the display 260 is controlled to display the video screen corresponding to the video data.

[0100] It should be noted that when the display device 200 is in standby mode, the controller 250 receives audio data sent by the receiving terminal device, and the controller 250 can further start the player control of the display device 200 according to the audio data, and generate an audio interface according to the audio data and the player interface; while the controller 250 controls the audio output device 270 to play the audio data, the display 260 displays the corresponding audio interface.

[0101] S200: If the data type is an audio type, the display is controlled to display a play prompt information in the user interface.

[0102] The playback prompts include a first mode option and a second mode option, allowing the user to determine the playback mode for the projected data. The first mode option is full-screen playback; the controller 250 can control the display 260 to display the projected interface corresponding to the projected data in full screen, and control the audio output device 270 to play the projected data. The second mode option is background playback; the controller 250 can maintain the current display interface and control the audio output device 270 to play the projected data.

[0103] In some embodiments, the controller 250 can also detect the operating status of the display device 200 and determine the mode option for playing the projected data based on the operating status of the display device 200. For example, when the display device 200 is in standby mode and receives projected data, the controller 250 can directly play the projected data in full screen according to the first mode option; when the display device is in playback mode and receives projected data, the controller 250 can directly maintain the display of the current display interface according to the second mode option and control the audio output device 270 to play the projected data, so as to alleviate the interference of the projected data on the currently playing display interface and improve the playback smoothness of the current data.

[0104] S300: In response to the command to select the target mode option, when the target mode option is the first mode option, control the audio output device to play the screen projection data and display the screen projection interface corresponding to the screen projection data in the user interface.

[0105] Users can also input selection commands based on playback prompts to choose the target mode option for playing the screen-cast data from the first mode option and the second mode option. When the target mode option is the first mode option, the controller 250 can control the audio output device to play the screen-cast data and display the corresponding screen-cast interface in the user interface. When the display device 200 is controlling the monitor 260 to display media assets, the controller 250 can also cancel the display of media assets and control the monitor 260 to display the screen-cast interface according to the first mode option.

[0106] For example, such as Figure 7 As shown, display device 200 is displaying an image, and monitor 260 displays the image interface. At this time, controller 250 responds to the screen mirroring command and obtains a segment of audio data uploaded by terminal device 300. When the target mode option is the first mode option, controller 250 can control monitor 260 to cancel the display of the image interface. Simultaneously, controller 250 starts the audio playback program, generates an audio interface based on the uploaded audio data, and controls monitor 260 to display the audio interface in the user interface after canceling the display of the image interface.

[0107] In some embodiments, along with the above example, when the target mode option is the first mode option, the controller 250 can also maintain the display of the picture and generate an audio interface according to the uploaded audio. After the audio interface is generated, the controller 250 can control the display 260 to display the audio interface on the upper layer of the picture interface, that is, to shield the display of the picture interface by the audio interface, so that the audio interface is located in the display area of the user interface. The controller 250 can also control the audio interface and the interface displaying the picture to switch according to the control instruction, so as to display different interfaces.

[0108] S400: When the target mode option is the second mode option, maintain the display of the current display interface and control the audio output device to play the screen projection data.

[0109] When the target mode option is the second mode option, the controller 250 can maintain the display of the current display interface according to the second mode option. For example, as shown in FIG. 6, the display device 200 is displaying a picture, and the user wants to watch the picture interface while listening to the audio data. The controller 250 can maintain the display of the picture interface by the display 260 according to the second mode option. Since the display 260 maintains the display of the picture interface, the controller 250 does not need to generate an audio interface according to the screen projection audio data. The controller 250 can control the audio output device 270 to play the audio data, so that the display device 200 plays the audio data while displaying the picture interface. Figure 8

[0110] From the above technical solutions, it can be seen that the present application provides two mode options to the user by playing the prompt information. The user can select the first mode option by inputting a selection instruction to display a screen projection interface corresponding to the screen projection data in the user interface. Alternatively, the second mode option is selected to maintain the display of the current interface while controlling the audio output device to play the screen projection data. Thus, the problem of interface interruption caused by the conflict between the screen projection interface and the current display interface is solved.

[0111] In some embodiments, the prompt information can also be a prompt sound, that is, when the controller 250 detects that the screen projection data is of an audio type, the audio output device 270 outputs the prompt information. The user can perform voice interaction with the display device 200 based on the prompt information to input a selection instruction by voice. After receiving the selection instruction in the voice format, the controller 250 can input the audio data corresponding to the selection instruction into a voice conversion model to output a selection instruction in a text format, and obtain the target mode option according to the selection instruction in the text format.

[0112] ​In some embodiments, before responding to the screen projection instruction, if the video media is being played, the display 260 displays the media picture corresponding to the video media, and the audio output device 270 plays the audio data of the video media. At this time, if the target mode option is the first option mode, the controller 250 can respond to the screen projection instruction to control the display 260 to cancel the display of the media picture in the media interface and display the screen projection interface corresponding to the screen projection data in the user interface. At the same time, the controller 250 can also control the audio output device 270 to cancel the playing of the audio data of the video media and play the screen projection data instead.

[0113] If the target mode option is the second option mode, the controller 250 keeps the current display interface. At this time, since the audio output device 270 is playing the audio data of the video media. Therefore, the controller 250 can generate audio prompt information to determine the playing mode of the screen projection data and the audio data of the video media through the audio prompt information. The audio prompt information includes a first audio option and a second audio option. As shown in Figure 9 When the user generates an audio playing instruction based on the first audio option, the controller 250 responds to the audio playing instruction to control the audio output device 270 to jointly play the screen projection data and the audio data of the video media; as shown in Figure 10 When the user generates an audio playing instruction based on the second audio option, the controller 250 responds to the audio playing instruction to control the audio output device 270 to cancel the playing of the audio data of the video media and play the screen projection data instead.

[0114] For example, when the display device 200 is playing a movie, the controller 250 controls the display 260 to display the movie picture in the user interface and controls the audio output device 270 to play the audio data of the movie. At this time, the controller 250 can respond to the screen projection instruction of the screen projection music B to display the playing prompt information in the user interface and select the mode option of playing the music B according to the playing prompt information. If the target mode option is the first mode option, the controller 250 controls the display 260 to cancel the display of the movie picture and displays the audio interface corresponding to the music B in the user interface; the controller 250 controls the audio output device 270 to cancel the playing of the audio data of the movie and play the audio data of the music B instead.

[0115] When the target mode option is the second mode option, the controller 250 controls the display 260 to keep displaying the movie picture, and determines the playing mode of the music B according to the audio prompt information. The controller 250 can control the audio output device 270 to simultaneously play the audio data of the movie and the music B in response to the audio playing instruction generated according to the first audio option, so that the music B is played along with the audio data of the movie. The controller 250 can control the audio output device 270 to cancel playing the audio data of the movie and play only the music B in response to the audio playing instruction generated according to the second audio option.

[0116] The display device 200 can receive multiple screen projection instructions in sequence or simultaneously, and the user needs to feed back the playing prompt information generated for each screen projection instruction to select the mode option of playing the screen projection data. However, it is very cumbersome to feed back multiple pieces of playing prompt information in the same playing scenario, which affects the user experience.

[0117] Based on the above scenario, in some embodiments, the controller 250 can further obtain the current playing scenario of the display device 200 before responding to the selection instruction of the target mode option. The display device 200 can include multiple playing scenarios, such as a video playing scenario, an audio playing scenario, a game scenario, a standby scenario, and the like. Figure 11 The flowchart of the display device provided by the embodiments of the present application for determining the memory mode according to the playing scenario. Referring to Figure 11If the current playing scene is the same as the preset playing scene, the controller 250 can detect the memory mode corresponding to the preset playing scene from the scene memory information. Therefore, the scene memory information can include a memory mode option, which is the mode option selected by the display device 200 from the first mode option or the second mode option in the preset playing scene, and the memory mode can be the first mode or the second mode accordingly, where the first mode is the playing mode corresponding to the first mode option, i.e., the audio output device 270 plays the screen mirroring data and the display device 200 displays the screen mirroring interface corresponding to the screen mirroring data in the user interface. The second mode is the playing mode corresponding to the second mode option, i.e., the current display interface is kept displayed and the audio output device 270 plays the screen mirroring data. The memory mode information is used to record the memory mode. For example, when the display device 200 is in the game scene, the user wants to play the game while listening to the music data screen mirrored by the terminal device 300. Since the display device 200 is displaying the game interface, the user can input a setting instruction for setting the memory mode option to the display device 200 in the game scene. The controller 250 can set the second mode as the memory mode in the game scene in response to the setting instruction, and directly play the screen mirroring data according to the memory mode when the controller 250 detects that the display device 200 is in the game scene and receives the screen mirroring instruction. If the current playing scene is different from the preset playing scene and no memory mode corresponding to the current playing scene is detected in the memory scene information, the controller 250 can control the display 260 to display the playing prompt information.

[0118] When the display device 200 switches the playing scene, the memory mode changes based on the change of the playing scene, and therefore the controller 250 can detect the memory mode in the scene memory information according to the switched playing scene. For example, when the display device 200 ends the game program and starts to play the video media asset, the current scene of the display device 200 is switched from the game scene to the video playing scene. The controller 250 can detect the memory mode in the memory scene information according to the video playing scene, and play the screen mirroring data according to the memory mode in the video playing scene. For example, when the memory mode in the video playing scene is the first mode, the controller 250 can control the display 260 to cancel the display of the video interface and display the screen mirroring interface corresponding to the screen mirroring data according to the memory mode.

[0119] If the controller 250 does not detect the memory mode corresponding to the preset playing scene in the scene memory information in the current playing scene, the controller 250 can control the display 260 to display the playing prompt information in the current playing scene to select the corresponding mode option to play the screen mirroring data.

[0120] In some embodiments, as Figure 12As shown, the controller 250 can also display scene prompt information in response to the selection instruction of the target mode option, the scene prompt information including a setting option for updating the scene memory information, and the setting option being triggered to set the target mode option selected by the selection instruction as the memory mode option. The controller 250 can set the target mode option as the memory mode option in the current playing scene in response to an operation instruction input by the user based on the setting option, and complete the update of the memory mode according to the target mode corresponding to the target mode option.

[0121] Based on the above scene, when the memory mode in the current playing scene has been set, if the user wants to modify the memory mode in the current playing scene, the user can also input a modification option instruction when the display device 200 displays the scene prompt information. The controller 250 can modify the memory mode option in response to the modification option instruction. After modifying the memory mode option, the controller 250 can update the memory mode information according to the modified memory mode in response to an operation instruction input by the user based on the setting option.

[0122] In some embodiments, the controller 250 can also display, on the user interface, media information corresponding to other playable media data while controlling the audio output device 270 to play the screen projection data. The media data can include audio recommendation data recommended according to the screen projection data, and local audio data stored locally by the display device 200. To obtain the audio recommendation data, the display device 200 can further include a communication device 220 configured to be communicatively connected with a server 400. The controller 250 can obtain audio information of the screen projection data, and generate a recommendation data request according to the audio information, wherein the recommendation data request is used to request the audio recommendation data. The audio information is information related to the screen projection data, for example, the screen projection data is a song A, and the audio information can be information related to the song A, such as singer, lyricist, composer or album information of the song A. The controller 250 can generate the recommendation data request according to the audio information. The server 400 can respond to the recommendation data request, and search for recommended songs related to the song A according to the audio information, for example, a song B with the same singer as the song A, a song C in the same album as the song A, or a song D with the same lyricist or composer as the song A. The server 400 can send audio data corresponding to the recommended songs as the audio recommendation data to the display device 200.

[0123] As shown, the controller 250 can also display scene prompt information in response to the selection instruction of the target mode option, the scene prompt information including a setting option for updating the scene memory information, and the setting option being triggered to set the target mode option selected by the selection instruction as the memory mode option. The controller 250 can set the target mode option as the memory mode option in the current playing scene in response to an operation instruction input by the user based on the setting option, and complete the update of the memory mode according to the target mode corresponding to the target mode option. Figure 13 and Figure 14As shown, after receiving the audio recommendation data, the controller 250 can traverse the local audio data in the memory of the display device 200, and generate an audio selection interface according to the local audio data and the audio recommendation data, the audio selection interface including audio recommendation information to provide the user with currently selectable recommended audio data. The audio recommendation information can include audio information of the local audio data and audio information of the audio recommendation data.

[0124] The controller 250 can control the display 260 to display the audio selection interface in the user interface when controlling the audio output apparatus 270 to play the screen projection data. When the audio selection interface is displayed, the user can input an audio selection instruction for selecting audio information of target audio data in the audio recommendation information to the display device 200, and control the audio output apparatus 270 to stop playing the screen projection data and play the target audio data.

[0125] In some embodiments, the controller 250 can also set a preset sorting rule when generating the audio selection interface. The controller 250 can perform sorting on the local audio data and the audio recommendation data according to the preset sorting rule, and display the sorting result of the local audio data (specifically, audio information of the local audio data) and the audio recommendation data (specifically, audio information of the audio recommendation data) in the audio selection interface.

[0126] If the display device 200 does not receive a new screen projection instruction, the controller 250 can mark the audio data at the top in the sorting result of the local audio data and the audio recommendation data as the target audio data after the screen projection data is played, and control the audio output apparatus 270 to play the target audio data. If the target audio data is played and a new screen projection instruction is still not received, the other local audio data and audio recommendation data are played in sequence according to the sorting result.

[0127] In some embodiments, if the data type of the screen projection data is a video type, the display device 200 needs to cache the screen projection data, at this time, the user needs to wait for the caching process of the screen projection data, and after the caching of the screen projection data is completed, the screen projection interface of the screen projection data can be seen. In order to reduce the waiting time, the controller 250 can also cache the screen projection data and the advertising data at the same time. The controller 250 can obtain a play flag of the screen projection data, and the play flag is used to represent the caching state of the screen projection data. The play flag includes a first mark, and the first mark is used to indicate that the screen projection data is not cached and cannot be played.

[0128] Since the data amount of the advertising data is much smaller than that of the screen projection data, the caching process of the advertising data is faster. For example, the advertising data can be cached in a few seconds. Figure 15As shown, after the advertisement data is cached, the controller 250 can control the display 260 to display an advertisement picture corresponding to the advertisement data, at this time, the controller 250 can continue to perform the caching of the screen projection data. After the screen projection data is cached, the first mark of the playing flag can be switched to the second mark, and the second mark is used to indicate that the screen projection data is cached, at this time, the screen projection data can be played. For this purpose, the controller 250 can also monitor the playing flag in the process of caching the screen projection data. In the process of displaying the advertisement picture on the user interface by the display 260, if the first mark included in the playing flag is switched to the second mark, the display 260 is controlled to cancel the display of the advertisement picture and display a screen projection picture corresponding to the screen projection data on the user interface.

[0129] The advertisement data can be a dynamic picture or a video with a preset time length, in order to facilitate the caching of the advertisement data, the controller 250 can also cache the advertisement data locally before accepting the screen projection data, for example, after the display device 200 is powered on.

[0130] In some embodiments, the advertisement data can also include advertisement audio, for this purpose, in the process of displaying the advertisement picture corresponding to the advertisement data on the user interface by the display 260, the controller 250 can also control the audio output device 270 to play the advertisement audio. Correspondingly, when the first mark included in the playing flag is switched to the second mark, the controller 250 can also control the audio output device 270 to stop playing the advertisement audio and play the audio part of the screen projection data.

[0131] In some embodiments, the controller 250 can also obtain a caching progress of the screen projection data in the process of caching the screen projection data. In order to facilitate the switching of the mark of the playing flag according to the caching progress, the controller 250 can set a preset progress threshold. When the caching progress is greater than or equal to the preset progress threshold, the controller 250 can switch the first mark of the playing flag to the second mark to control the display 260 to display a screen projection interface on the user interface.

[0132] In order to save the caching time and enable the user to see the screen projection data as soon as possible, the preset progress threshold can be an incomplete caching progress, for example, the preset progress threshold can be 50%, that is, when the caching progress is greater than or equal to 50%, the controller 250 can switch the first mark of the playing flag to the second mark to play the cached screen projection data first, and at the same time, continue to cache the remaining screen projection data.

[0133] In some embodiments, when the cached screen projection data is played, if the caching progress is less than the playing progress, the controller 250 can also switch the second mark of the playing flag back to the first mark when the cached screen projection data is about to be played, and control the display 260 to cancel the display of the screen projection picture of the cached screen projection data and display the advertisement picture.

[0134] In some embodiments, when the display 260 finishes displaying all the advertisement pictures corresponding to the advertisement data, if the first mark included in the playing flag is not switched to the second mark, it indicates that the casting data is not cached and cannot be played after the playing of the advertisement data is completed. At this time, the controller 250 can control the display 260 to redisplay the advertisement data corresponding to the advertisement data, so as to control the display device 200 to cyclically play the advertisement data.

[0135] In some embodiments, the sending end device can also synchronously send a data address link of the casting data when sending the casting instruction to the display device 200. Therefore, the controller 250 can obtain the data address link of the casting data by analyzing the casting data. The suffix information in the data address link includes the data format of the casting data. For example, for audio data, the data format of the data address link can be mp3, wma, ogg, etc., and for video format, the data format of the data address link can be mp4, avi, etc. Taking the following data address link as an example, in the data address link “uri->http: / / 192.168.1.113:57645 / external / audio / media / 1000000040.mp3”, the suffix information is mp3, and the controller 250 can determine the data type of the casting data according to the suffix information of the data address link.

[0136] Some embodiments of the present application provide a casting playing method, which is applied to a display device 200. The display device 200 should at least include a display 260, an audio output device 270, and a controller 250. The display 260 is configured to display a user interface, and the audio output device 270 is configured to play audio data. The method includes the following steps.

[0137] S100: In response to a casting instruction, obtaining casting data, and detecting a data type of the casting data.

[0138] S200: If the data type is an audio type, controlling the display to display playing prompt information in the user interface.

[0139] The playing prompt information includes a first mode option and a second mode option.

[0140] S300: In response to a selection instruction on a target mode option, if the target mode option is the first mode option, controlling the audio output device to play the casting data, and displaying a casting interface corresponding to the casting data in the user interface.

[0141] S400: If the target mode option is the second mode option, maintaining the display of the current display interface and controlling the audio output device to play the casting data.

[0142] According to the technical scheme, the display device and the screen projection playing method are provided. The method acquires the screen projection data in response to a screen projection instruction. The data type of the screen projection data is detected. If the data type is an audio type, the display device displays playing prompt information for selecting a playing mode in a user interface. In response to a selection instruction of a target mode option, if the target mode option is a first mode option, the audio output device plays the screen projection data, and the screen projection interface corresponding to the screen projection data is displayed in the user interface. If the target mode option is a second mode option, the current display interface is kept displayed, and the audio output device plays the screen projection data. The playing prompt interface is displayed, so that the user can select the corresponding mode option in the playing prompt interface to play the screen projection data. The problem that the display device directly interrupts the current display interface when responding to the screen projection request is solved, and the flexibility of the screen projection playing is improved.

[0143] The specific implementation of the same and similar parts between various embodiments in the specification can be mutually referred to the related description, which will not be described here.

[0144] Those skilled in the art can clearly understand that the technology in the embodiments of the present application can be realized by means of software and necessary general hardware platforms. Based on such understanding, the technical solutions in the embodiments of the present application can be embodied in the form of a software product, which can be stored in a storage medium, such as a ROM / RAM, a magnetic disk, an optical disk, etc., and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the method of various embodiments or some parts of the embodiments of the present application.

[0145] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0146] In order to facilitate explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A display device, characterized by comprising: The application relates to a display device, comprising: a display configured to display a user interface; an audio output device configured to play audio data; a controller coupled with the display and the audio output device, and configured to: in response to a screen projection instruction, acquire screen projection data, and detect a data type of the screen projection data; if the data type is an audio type, control the display to display playing prompt information in the user interface, the playing prompt information comprising a first mode option and a second mode option; in response to a selection instruction for a target mode option, if the target mode option is the first mode option, control the audio output device to play the screen projection data, and display a screen projection interface corresponding to the screen projection data in the user interface; if the target mode option is the second mode option, keep displaying a current display interface and control the audio output device to play the screen projection data.

2. The display device of claim 1, wherein, Before the controller performs the step of responding to the selection instruction for the target mode option, the controller is further configured to: acquire a current playing scene of the display device; if the current playing scene is the same as a preset playing scene, detect a memory mode corresponding to the preset playing scene from scene memory information, the memory mode being the first mode or the second mode; play the screen projection data according to the memory mode.

3. The display device of claim 2, wherein, After the controller performs the step of responding to the selection instruction for the target mode option, the controller is further configured to: display scene prompt information, the scene prompt information comprising a setting option for updating the scene memory information; in response to a user operation instruction based on the setting option, update the target mode to the memory mode.

4. The display device of claim 1, wherein, Further comprising a communication device configured to be communicatively connected with a server, and the controller, when performing the control of the audio output device to play the screen projection data, is further configured to: acquire audio information of the screen projection data, and generate a recommendation data request according to the audio information, the recommendation data request being used for requesting audio recommendation data; send the recommendation data request to the server; receive audio recommendation data from the server; in response to an audio selection instruction, select and play target audio data from the audio recommendation data and local audio data.

5. The display device of claim 4, wherein, The controller, when performing the step of selecting and playing target audio data from the audio recommendation data and local audio data in response to an audio selection instruction, is specifically configured to: generate an audio selection interface according to the audio recommendation data and the local audio data; in response to the audio selection instruction for target audio data in the audio selection interface, control the audio output device to stop playing the screen projection data and play the target audio data.

6. The display device of claim 1, wherein, If the data type is a video type, the controller is further configured to: cache the screen projection data and advertisement data, and acquire a playing flag bit of the screen projection data, the playing flag bit comprising a first mark used for indicating that the screen projection data is unplayable; in the process of caching the screen projection data, control the display to display an advertisement picture corresponding to the advertisement data in the user interface. In a process in which the display plays the advertisement picture on the user interface, if the first mark included in the playing flag bit is switched to a second mark, the display is controlled to display a screen mirroring picture corresponding to the screen mirroring data on the user interface; the second mark is used to indicate that the screen mirroring data can be played.

7. The display device of claim 6, wherein, In a process in which the screen mirroring data is cached, after the display displays the advertisement picture corresponding to the advertisement data on the user interface, the controller is further configured to: obtain a caching progress of the screen mirroring data; when the caching progress is greater than or equal to a preset progress threshold, switch the first mark of the playing flag bit to the second mark.

8. The display device of claim 6, wherein, The controller performing the control of the display to display the advertisement picture corresponding to the advertisement data on the user interface is specifically configured to: when the display finishes displaying all the advertisement pictures corresponding to the advertisement data, if the first mark included in the playing flag bit is not switched to the second mark, the display is controlled to display the advertisement picture corresponding to the advertisement data again.

9. The display device of claim 1, wherein, The controller performing the detection of the data type of the screen mirroring data is specifically configured to: analyze the screen mirroring data to obtain a data address link of the screen mirroring data; determine the data type according to suffix information of the data address link.

10. A screen projection playing method, characterized in that, The method is applied to the display device as claimed in any one of claims 1-9, the display device comprising a display, an audio output device and a controller, the display is configured to display a user interface, the audio output device is configured to play audio data, the method comprising: in response to a screen mirroring instruction, obtaining screen mirroring data, and detecting a data type of the screen mirroring data; if the data type is an audio type, controlling the display to display the playing prompt information in the user interface, the playing prompt information comprising a first mode option and a second mode option; in response to a selection instruction of a target mode option, when the target mode option is the first mode option, controlling the audio output device to play the screen mirroring data, and displaying a screen mirroring interface corresponding to the screen mirroring data in the user interface; when the target mode option is the second mode option, keeping displaying a current display interface and controlling the audio output device to play the screen mirroring data.

Images