Display device, storage server and projection screen content continuous playing method

Abstract

The invention provides a display device, a storage server and a projection screen content continuous playing method, and the method comprises the steps: responding to a projection screen request of a mobile terminal, and transmitting projection screen information to the storage server; receiving a feedback result returned by the storage server based on the screen projection information; under the condition that the storage server does not store the media asset resources, generating a downloading request and sending the downloading request to the storage server, receiving returned screen projection link information, and controlling a display to play screen projection content corresponding to the screen projection request; and under the condition that the projection content is not played completely and the user exits, sending the playing information corresponding to the projection content to the storage server in response to a storage instruction of the user to the projection content, and when the user plays the projection content again, continuously playing the projection content according to the progress information in the playing information in the storage server. According to the method, when the user projects the same media asset again, the stored playing information is acquired from the storage server and is continuously played from the interrupted position, so that the problem that the projection content cannot be continuously played is solved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and particularly to a display device, a storage server, and a method for continuous playback of screen-cast content. Background Art

[0002] In order to enhance the visual effect, screen mirroring can be performed through a display device. For example, a user can transmit video, pictures, or other multimedia content in a mobile terminal to a display device (such as a TV, a projector, a shopping mall large screen, etc.) through the screen mirroring function for display or viewing, enabling the user to view various media assets on a larger screen and enhancing the visual effect.

[0003] During the screen mirroring process, a connection can be established between the mobile terminal and the display device through a wired or wireless network. The mobile terminal can transmit media data such as video data to the display device in real time, and the display device decodes the received data and displays the corresponding content.

[0004] In the existing screen mirroring application scenarios, both the mobile terminal and the display device have the problem of being unable to remember the playback progress of the screen-cast content. For example, when a user uses certain apps on the mobile phone for screen mirroring, once the screen mirroring ends, when screen mirroring again, the playback progress will start from the beginning, and the user needs to manually slide the progress bar to return to the previous viewing position. Similarly, when playing a screen-cast video on the large screen side, the previous playback progress cannot be remembered when screen mirroring again, and the user needs to use the remote control to drag the progress bar to find the previous viewing position. This not only requires the user to spend extra time and effort for operation, but also may cause the user to be unable to accurately return to the previous playback progress, thus affecting the user experience. Therefore, in the scenario of media screen mirroring, when the user screens the media content to the display device again, there is a problem that the display device cannot continue to play the previously unfinished screen-cast content, that is, there is a problem of being unable to continuously play the screen-cast content, affecting the user experience. Summary of the Invention

[0005] Some embodiments of the present application provide a display device, a storage server, and a method for continuous playback of screen-cast content to solve the problem of being unable to continuously play the screen-cast content in the screen mirroring scenario.

[0006] In a first aspect, some embodiments of the present application provide a display device, including:

[0007] A display, configured to display a user interface;

[0008] A communication device, configured to establish communication connections with a mobile terminal, a storage server, and a cloud server; the storage server is used to store media resources downloaded from the cloud server;

[0009] A controller, configured to:

[0010] In response to a screen mirroring request from a mobile terminal, send the screen mirroring information of the mobile terminal to a storage server;

[0011] Receive a feedback result returned by the storage server based on the screen mirroring information; the feedback result is used to indicate whether the media resources corresponding to the screen mirroring information have been saved in the storage server;

[0012] In the case where the feedback result is that the media resources are not saved in the storage server, generate a download request according to the screen mirroring information, and send the download request to the storage server, so that the storage server requests the media resources corresponding to the screen mirroring information from a cloud server according to the download request;

[0013] Receive the screen mirroring link information returned by the storage server according to the download request, and control the display to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information;

[0014] In the case where the screen mirroring content is not finished playing and the user exits, in response to the user's save instruction for the screen mirroring content, send the play information corresponding to the screen mirroring content to the storage server, so that when the screen mirroring content is played again, continue to play the screen mirroring content according to the progress information in the play information.

[0015] The above technical solution has the following advantages or beneficial effects: In the case where the media resources are not saved in the storage server, the display device generates a download request, so that the storage server downloads the media resources from the cloud server according to the download request and generates screen mirroring link information, and the display device plays the screen mirroring content according to the screen mirroring link information. When the screen mirroring content is not finished playing and the user exits the screen mirroring, the display device responds to the user's save instruction and sends the current play progress to the storage server for saving. When the user screens the same media resources again, the display device obtains the previously saved play information from the storage server and continues to play from the interrupted position, thereby solving the problem that the screen mirroring content cannot be continued in the screen mirroring scenario.

[0016] In some embodiments, after the step where the controller is in the case where the screen mirroring content is not finished playing and the user exits, it is further configured to:

[0017] In response to the save instruction, request the play information corresponding to the screen mirroring content from the storage server, where the play information at least includes the name information of the media resources corresponding to the screen mirroring content, the media URL information, and the progress information;

[0018] Receive the play information returned by the storage server;

[0019] Generate a thumbnail corresponding to the media resource according to the playback information;

[0020] Control the display to display the thumbnail on the playback page corresponding to the media resource.

[0021] The above technical solution has the following advantages or beneficial effects: By timely requesting the playback information corresponding to the screen mirroring content from the storage server and ensuring the accurate acquisition of this information, the key data during the screen mirroring process can be completely recorded, providing data support for the handling of possible subsequent abnormal situations. By displaying a thumbnail on the playback page corresponding to the media resource, an intuitive visual guide can be provided for the user. The user can quickly identify the media content being played by observing the thumbnail, enhancing the user's viewing experience.

[0022] In some embodiments, the controller sends the playback information corresponding to the screen mirroring content to the storage server so that when the screen mirroring content is played again, the screen mirroring content is continued to be played according to the progress information in the playback information, and is specifically configured as:

[0023] Obtain the media title of the media resource corresponding to the screen mirroring content to be screen mirrored;

[0024] When the media title is consistent with the name information in the playback information, request the playback progress corresponding to the media resource from the storage server;

[0025] Control the display to continue playing the screen mirroring content according to the playback progress.

[0026] The above technical solution has the following advantages or beneficial effects: By requesting the playback progress from the storage server, the display device can accurately continue playing the screen mirroring content from the interrupted position according to the user's previous viewing record, without the user having to manually find the playback position.

[0027] In some embodiments, before the step of the controller sending the playback information corresponding to the screen mirroring content to the storage server, it is also configured as:

[0028] Obtain all media resources saved or played by users;

[0029] Classify the media resources according to the playback information to form classified media information;

[0030] When the current screen mirroring content is played to completion, search for the next episode of the media resource corresponding to the screen mirroring content in the classified media information;

[0031] Control the display to automatically play the next episode of the media.

[0032] The above technical solution has the following advantages or beneficial effects: by obtaining and classifying all media resources that have been saved or played by users, the display device can manage media resources more efficiently, allowing users to browse and find media resources of interest more conveniently. At the same time, it is also convenient for the display device to uniformly maintain and manage media resources. By automatically playing the next episode of media, users do not need to manually search for and play the next episode when watching continuous media content such as series, thereby improving the continuity and convenience of viewing.

[0033] In some embodiments, the controller sends the projection information of the mobile terminal to the storage server, and is specifically configured as follows:

[0034] Obtaining a device identifier corresponding to the mobile terminal that initiated the screen projection request;

[0035] The screen projection information of the mobile terminal is sent to the storage server based on the device identification.

[0036] The above technical solution has the following advantages or beneficial effects: the display device sends the projection information of the mobile terminal to the storage server. On the one hand, it can realize centralized storage and management of data; on the other hand, it can compare the projection information with previously stored media resources to realize the resume broadcast function of the same media resources.

[0037] In some embodiments, before the step of receiving the screen projection link information returned by the storage server according to the download request, the controller is further configured to:

[0038] When the feedback result is that the media resource is stored in the storage server, receiving the screen casting link information returned by the storage server;

[0039] Control the display to play the projection content corresponding to the projection request according to the projection link information;

[0040] Receive a control instruction sent by the mobile terminal based on the projection content, and execute an operation corresponding to the control instruction.

[0041] The above technical solution has the following advantages or beneficial effects: by obtaining detailed projection link information, the display device can accurately locate the media resources in the storage server, avoid playback errors caused by unclear resource paths or identifiers, and improve the accuracy and reliability of projection content playback. After receiving the control command, the display device can adjust the playback of the projection content in real time according to the user's operation to ensure the smoothness and controllability of the playback.

[0042] In some embodiments, before the step of the controller generating a download request according to the screen mirroring information and sending the download request to the storage server, the controller is further configured to:

[0043] Detect the terminal playback progress information in the media resources pushed in the mobile terminal;

[0044] In the case where there is the terminal playback progress information, control the display to continue playing the screen mirroring content corresponding to the media resources according to the terminal playback progress information;

[0045] In the case where there is no terminal playback progress information, execute the step of generating a download request according to the screen mirroring information and sending the download request to the storage server.

[0046] The above technical solution has the following advantages or beneficial effects: This application can continue the original screen mirroring logic and further improve it on the original basis. Even without the terminal playback progress information, by generating a download request according to the screen mirroring information, it is still possible to ensure the smooth playback of the screen mirroring content, making the screen mirroring system have high compatibility and reliability, and expanding the usage range and scenario adaptability of the screen mirroring function.

[0047] In some embodiments, after the step where the controller controls the display to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information, the controller is further configured to:

[0048] In the case where the user exits after the screen mirroring content is played, or in the case where the user does not select to save the screen mirroring content when exiting the screen mirroring content, generate a deletion instruction;

[0049] Send the deletion instruction to the storage server, so that after receiving the deletion instruction, the storage server deletes the media resources corresponding to the screen mirroring content.

[0050] The above technical solution has the following advantages or beneficial effects: By generating a deletion instruction and sending the deletion instruction to the storage server, the deletion operation can have a clear target and an accurate execution basis. The storage server can timely clean up the unsaved screen mirroring content, which can effectively prevent the accumulation of invalid data and avoid performance degradation caused by a large amount of redundant data occupying storage space and system resources.

[0051] In a second aspect, some embodiments of the present application provide a storage server, including:

[0052] A communication module, configured to establish a communication connection with a display device and a cloud server;

[0053] A control module, configured to:

[0054] Receive the screen mirroring information sent by the display device;

[0055] Confirm the media resources corresponding to the screen mirroring information according to the screen mirroring information, generate a feedback result, and send the feedback result to the display device; the feedback result is used to indicate whether the media resources corresponding to the screen mirroring information have been saved in the storage server;

[0056] In the case where the media resources have not been saved, receive the download request sent by the display device, request the media resources corresponding to the screen mirroring information from the cloud server according to the download request, and generate screen mirroring link information according to the media resources;

[0057] Send the screen mirroring link information to the display device, so that the display device plays the screen mirroring content corresponding to the screen mirroring request of the mobile terminal according to the screen mirroring link information;

[0058] Receive the play information corresponding to the screen mirroring content sent by the display device, so that when the display device plays the screen mirroring content again, continue to play the screen mirroring content according to the progress information in the play information.

[0059] The above technical solution has the following advantages or beneficial effects: The storage server can download media resources from the cloud server based on the download request of the display device, generate screen mirroring link information, and send the screen mirroring link information to the display device. When the screen mirroring content is not finished playing, in response to the user's save instruction, receive the play information sent by the display device, so that when the user screens the same media resources again, send the saved play information to the display device, so that the display device continues to play from the interrupted position, thereby solving the problem that the screen mirroring content cannot be continued in the screen mirroring scenario.

[0060] In a third aspect, some embodiments of the present application provide a method for continuing to play screen mirroring content, which can be applied to the display device in the first aspect. The method includes:

[0061] In response to the screen mirroring request of the mobile terminal, send the screen mirroring information of the mobile terminal to the storage server;

[0062] Receive the feedback result returned by the storage server based on the screen mirroring information; the feedback result is used to indicate whether the media resources corresponding to the screen mirroring information have been saved in the storage server;

[0063] In the case where the feedback result is that the media resources have not been saved in the storage server, generate a download request according to the screen mirroring information, and send the download request to the storage server, so that the storage server requests the media resources corresponding to the screen mirroring information from the cloud server according to the download request;

[0064] Receive the screen mirroring link information returned by the storage server according to the download request, and control the display to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information;

[0065] In the case where the screen mirroring content playback is not completed and the user exits, in response to the user's save instruction for the screen mirroring content, send the playback information corresponding to the screen mirroring content to the storage server, so that when the screen mirroring content is played again, continue playing the screen mirroring content according to the progress information in the playback information.

[0066] The above technical solution has the following advantages or beneficial effects: In the case where the media resource is not saved in the storage server, a download request is generated, so that the storage server downloads the media resource from the cloud server according to the download request and generates screen mirroring link information, and the display device plays the screen mirroring content according to the screen mirroring link information. When the screen mirroring content playback is not completed and the user exits the screen mirroring, the display device responds to the user's save instruction and sends the current playback progress to the storage server for saving. When the user screens the same media resource again, the display device obtains the previously saved playback information from the storage server and continues playing from the interrupted position, thereby solving the problem that the screen mirroring content cannot be continued in the screen mirroring scenario.

[0067] As can be seen from the above technical solutions, some embodiments of the present application provide a display device, a storage server, and a method for continuing to play screen mirroring content. The method includes: in response to a screen mirroring request from a mobile terminal, send the screen mirroring information of the mobile terminal to the storage server; receive the feedback result returned by the storage server based on the screen mirroring information; in the case where the storage server does not save the media resource, generate a download request and send it to the storage server, receive the screen mirroring link information returned by the storage server, and control the display to play the screen mirroring content corresponding to the screen mirroring request; in the case where the screen mirroring content playback is not completed and the user exits, in response to the user's save instruction for the screen mirroring content, send the playback information corresponding to the screen mirroring content to the storage server. When the user plays the screen mirroring content again, continue playing the screen mirroring content according to the progress information in the playback information in the storage server. The method generates a download request in the case where the storage server does not save the media resource, so that the storage server downloads the media resource from the cloud server according to the download request and generates screen mirroring link information, and the display device plays the screen mirroring content according to the screen mirroring link information. When the screen mirroring content playback is not completed and the user exits the screen mirroring, the display device responds to the user's save instruction and sends the current playback progress to the storage server for saving. When the user screens the same media resource again, the display device obtains the previously saved playback information from the storage server and continues playing from the interrupted position, thereby solving the problem that the screen mirroring content cannot be continued in the screen mirroring scenario. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] To more clearly illustrate the technical solutions in some embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0069] Figure 1 Schematic diagram of an operation scenario between a display device and a control device provided for some embodiments of the present application;

[0070] Figure 2 Schematic diagram of the hardware configuration of a display device provided for some embodiments of the present application;

[0071] Figure 3 Schematic diagram of the software configuration of a display device provided for some embodiments of the present application;

[0072] Figure 4 Schematic diagram of the method flow for a display device to execute continuous playback of screen mirroring content provided for some embodiments of the present application;

[0073] Figure 5 Schematic diagram of a processing logic for screen mirroring of existing media resources shown in some embodiments of the present application;

[0074] Figure 6 Schematic diagram of another processing logic for screen mirroring of existing media resources shown in some embodiments of the present application;

[0075] Figure 7 Schematic diagram of the method timing for a display device to execute continuous playback of screen mirroring content provided for some embodiments of the present application;

[0076] Figure 8 Schematic diagram of a scenario where a display device prompts a user whether to save the current playback information provided for some embodiments of the present application;

[0077] Figure 9 Schematic diagram of a scenario where a display device displays a thumbnail on a playback page provided for some embodiments of the present application;

[0078] Figure 10 Schematic diagram of the method flow for a storage server to execute continuous playback of screen mirroring content provided for some embodiments of the present application. Detailed implementation manners

[0079] Embodiments will be described in detail below, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following examples do not represent all embodiments consistent with the present application. They are merely examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0080] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described next, rather than intending to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood in their ordinary and common meanings.

[0081] The terms "first", "second", "third", etc. in the specification, claims and the above-mentioned drawings of this application are used to distinguish similar or like objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that such terms can be interchanged under appropriate circumstances.

[0082] The terms "comprising" and "having" and any variations thereof are intended to cover but not exclusively include. For example, a product or device comprising a series of components does not have to be limited to all the components clearly listed, but may include other components not clearly listed or inherent to these products or devices.

[0083] The term "module" refers to any known or later-developed hardware, software, firmware, artificial intelligence, fuzzy logic, or a combination of hardware and / or software code that can perform functions related to that element.

[0084] In the embodiments of the present application, the display device 200 generally refers to a device having the capabilities of displaying images and processing data. For example, the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0085] Figure 1 It is a schematic diagram of an operation scenario between a display device and a control device provided for some embodiments of the present application. As Figure 1 shown, the user can operate the display device 200 through touch operations, a mobile terminal 300, and a control device 100. Among them, the control device 100 is used to receive the operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0086] The mobile terminal 300 can be used as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 to perform data interaction. In some embodiments, software applications can be installed on the mobile terminal 300 and the display device 200, and the connection communication can be achieved through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve the synchronous display function.

[0087] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program for controlling the display device 200.

[0088] As Figure 1 also shown in, the display device 200 also performs data communication with the cloud server 400 through various communication methods. The display device 200 is allowed to establish a communication connection through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0089] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with computer support functions, including but not limited to, network television, smart television, Internet Protocol Television (IPTV), etc.

[0090] Figure 2 For some embodiments of this application Figure 1 The hardware configuration block diagram of the display device 200 in

[0091] In some embodiments, the display device 200 may include at least one of a tuner demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0092] In some embodiments, the detector 230 is used to collect signals from the external environment or for external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures. Or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0093] In some embodiments, the display 260 includes a display functional component for presenting a picture and a driving component for driving image display. The display 260 is configured to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, components of a menu control interface, and a user control UI interface, etc.

[0094] In some embodiments, the communication device 220 is a component for communicating with an external device or the cloud server 400 according to various communication protocol types. The display device 200 can be provided with a plurality of communication devices 220 according to different supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0095] The communication device 220 can enable the display device 200 to communicate with an external device or the cloud server 400 in a wired or wireless connection manner. Among them, the wired connection can connect the display device 200 with an external device through components such as a data cable and an interface. The wireless connection can connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with an external device or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0096] In some embodiments, the controller 250 can include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0097] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, that is, the tuner demodulator 210 can also be in an external device of the main device where the controller 250 is located, such as an external set-top box, etc.

[0098] In some embodiments, the user can input a user command on the graphical user interface (GUI) displayed on the display 260, and then the user input interface receives the user input command through the graphical user interface (GUI).

[0099] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0100] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0101] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0102] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0103] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0104] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0105] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions of the applications in the application layer. Applications can access the resources in the system and obtain system services during execution through the API interface.

[0106] As Figure 3 shown, in the embodiments of the present application, the application framework layer includes a view system, managers, content providers, etc. Among them, the view system can design and implement the interfaces and interactions of applications. The view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: The activity manager is used to interact with all the activities running in the system; the location manager is used to provide access to the system location service for system services or applications; the package manager is used to retrieve various information related to the application packages currently installed on the device; the notification manager is used to control the display and clearing of notification messages; the window manager is used to manage the icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0107] In some embodiments, the activity manager is used to manage the life cycles of various applications and the general navigation back function, such as controlling the exit, opening, and backward movement of applications. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the changes in the display window. For example, shrinking the display window, jittering the display, distorting the display, etc.

[0108] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction libraries included in the system runtime layer, such as C / C++ instruction libraries, to implement the functions that the framework layer is to achieve.

[0109] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as Figure 3As shown in the figure, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0110] It should be noted that the above examples are only simple divisions of the functions of the operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiments of the present application. According to factors such as the functions of the display device and the type of the operating system, the number of levels and the specific level types included in the operating system can be in other forms.

[0111] The above embodiments illustrate the hardware / software architecture and function implementation of a display device 200 and other contents. In order to improve the visual effect, screen mirroring can be performed through the above display device 200. For example, a user can transmit video, pictures or other multimedia contents in the mobile terminal 300 to the display device 200 (such as a TV, a projector, a shopping mall large screen, etc.) through the screen mirroring function for display or viewing, so that the user can view various media resources on a larger screen and improve the visual effect.

[0112] That is to say, the user can project media content to the large screen of the display device 200 for playing through an application (App) on the mobile terminal 300. During the screen mirroring process, a connection can be established between the mobile terminal 300 and the display device 200 through a wired or wireless network. The mobile terminal 300 can transmit media data such as video data to the display device 200 in real time, and the display device 200 decodes and displays the corresponding content according to the received data.

[0113] In the existing screen mirroring application scenarios, both the mobile terminal 300 and the display device 200 have the problem of being unable to remember the playback progress of the screen mirroring content. For example, when a user uses certain Apps on the mobile phone for screen mirroring, once the screen mirroring ends, when screen mirroring again, the playback progress will start from the beginning, and the user needs to manually slide the progress bar to return to the position where they watched before. Similarly, when playing a screen mirroring video on the large screen side, the previous playback progress cannot be remembered when screen mirroring next time, and the user needs to drag the progress bar with the remote control to find the position where they watched last time. This problem not only requires the user to spend extra time and effort for operation, but also may cause the user to be unable to accurately return to the previous playback progress, thus affecting the user experience. Therefore, in the scenario of media screen mirroring, when the user projects media content to the display device 200 again, there is a problem that the display device 200 cannot continue to play the previously unfinished screen mirroring content, that is, there is a problem of being unable to resume playing the screen mirroring content, which affects the user experience.

[0114] To solve the problem that the cast content cannot be resumed in the screen mirroring scenario, some embodiments of the present application provide a display device 200, which includes a display 260, a communication device 220, and a controller 250. Among them, the display 260 is configured to display a user interface, and the communication device 220 is configured to establish communication connections with a mobile terminal 300, a storage server 500, and a cloud server 400; the controller 250 runs an application program to enable the display device 200 to execute a method for resuming the cast content. When the display device 200 plays the cast content, the user can determine whether to save media-related information (such as the playback progress, the URL address of the storage server 500, the media title, etc.) according to the current playback progress. If the user saves it, the relevant information of the media resource is stored in the storage server 500, or some attribute information can be saved in the display device 200 for the user to resume playing the media when watching again.

[0115] To facilitate the understanding of the technical solutions in some embodiments of the present application, the following describes each step in detail with reference to some specific embodiments and drawings. Figure 4 It is a schematic flowchart of a method for a display device provided by some embodiments of the present application to resume the cast content, as Figure 4 shown. In some embodiments, when the display device 200 executes the method for resuming the cast content, it may include the following steps:

[0116] Step S1: In response to a screen mirroring request from the mobile terminal 300, send the screen mirroring information of the mobile terminal 300 to the storage server 500.

[0117] The following describes the proposed scenario of the solution of the present application with reference to the drawings. Figure 5 It is a schematic diagram of the existing media resource screen mirroring processing logic shown in some embodiments of the present application, as Figure 5 shown. In some embodiments, the media resources are from the cloud server 500, and various media resources can be stored in the cloud server 500. A sending end such as the mobile terminal 300 can send a video request to a receiving end such as the display device 200. For example, media information such as a video URL (including but not limited to the video URL, video title, playback progress, etc.) can be saved locally on the large screen (that is, saved in the storage space of the display device 200). When pushing a certain media again, the newly pushed media information can be compared with the media information saved on the large screen end. If the URL and video title of the video playback are the same, the original video can be played continuously with the saved video progress. However, the problem with this is that since the storage space of the large screen end of the display device 200 is limited, as the storage space is written cyclically, the writing will be gradually restricted. Therefore, the feasibility of this solution in the actual scenario is poor.

[0118] Figure 6Another schematic diagram of the existing media resource screen mirroring processing logic shown in some embodiments of the present application is as follows Figure 6 As shown, in some embodiments, the media resources also come from the cloud server 500, and various media resources can be stored in the cloud server 500. In this scenario, the playback progress completely depends on the sending end. For example, the mobile terminal 300 can send a seek, where seek means to find or jump to a specific position in the video. In this way, when the large screen terminal displays the screen mirroring content corresponding to the video, it can resume playback according to the jumped position. However, in the actual usage scenario, whether to send a seek depends on the processing logic of the mobile terminal APP. For example, application A may jump to the corresponding progress, but application B may not jump to the corresponding progress. Therefore, for some applications, there is still a problem that the video will start playing from the beginning and the resume playback function will not be realized.

[0119] Based on this, in the technical solution of the present application, a storage server 500 is added. In some embodiments, various media resources can be stored through the storage server 500. The storage server 500 can communicate with both the cloud server 400 and the display device 200. For example, the storage server 500 can communicate with the display device 200 and forward messages. When playing a certain media resource for the first time, in response to the screen mirroring request sent by the mobile terminal 300, the display device 200 can request the media resource from the storage server 500. Before that, the storage server 500 can request the media resource corresponding to the screen mirroring request from the cloud server 400 and store the media resource in the storage server 500. In this way, after receiving the user's screen mirroring request, the display device 200 can directly request the media resource from the storage server 500 without relying on the cloud server 400 anymore.

[0120] Figure 7 A timing schematic diagram of the method for the display device to execute resume playback of the screen mirroring content provided in some embodiments of the present application is as follows Figure 7 As shown, in some embodiments, in response to the screen mirroring request of the mobile terminal 300, the display device 200 can send the screen mirroring information of the mobile terminal 300 to the storage server 500. Specifically, when implementing, the user can first start the screen mirroring function through the mobile terminal 300 (such as a smart phone or a tablet computer) and select the content to be screen mirrored. At this time, the mobile terminal 300 will generate a screen mirroring request, which may include detailed information of the screen mirroring content, such as but not limited to the identifier of the screen mirroring content (such as video ID or file path), the identifier of the screen mirroring device (such as device model or user account), the screen mirroring type, the metadata of the screen mirroring content (such as video duration, resolution, etc.), and the required playback parameters. After that, the display device 200 can encapsulate the screen mirroring information into a data packet and send it to the storage server 500.

[0121] Exemplarily, after receiving the screen projection request from the mobile phone, the large screen terminal can submit the media resource link and related information to the storage server 500. In some embodiments, after receiving the screen projection information, the storage server 500 confirms the media resource corresponding to the screen projection information according to the screen projection information, generates a feedback result, and sends the feedback result to the display device 200, wherein the feedback result is used to characterize whether the media resource corresponding to the screen projection information has been saved in the storage server 500. For example, if the media resource to be projected has been stored in the storage server 500, a positive feedback result can be generated, and the feedback result can be returned to the display device 200, so that the display device 200 can call the previously stored media resource (including progress) to continue broadcasting the media. If the media resource has not been stored in the storage server 500 before, the resource can be downloaded through the cloud server 400, and the feedback result can be sent to the display device 200.

[0122] In some embodiments, the display device 200 can send the screen projection information of the mobile terminal to the storage server 500 in the following manner: first, the display device 200 can obtain the device identifier corresponding to the mobile terminal 300 that initiates the screen projection request, and then send the screen projection information of the mobile terminal to the storage server 500 based on the device identifier.

[0123] Exemplarily, after the display device 200 receives a screen projection request (such as video push, such as DLNA video push, AirPlay video push, and other self-developed or third-party video push, etc.), by obtaining the device identification corresponding to the mobile terminal 300 that initiated the screen projection request, it can be clear which device initiated the screen projection, thereby establishing a corresponding relationship between the two. Based on the device identification, the display device 200 can provide personalized screen projection services and management according to the characteristics of different mobile terminals and user preferences. Different mobile terminals may have different screen resolutions, display ratios, system settings, etc. The display device 200 can adapt and optimize the screen projection content according to this information corresponding to the device identification to provide a better visual experience. The display device 200 sends the screen projection information of the mobile terminal to the storage server 500. On the one hand, it can realize centralized storage and management of data. On the other hand, the screen projection information can be compared with previously stored media resources to realize the continued broadcast function of the same media resources. After step S1 is executed, the following step S2 may be included.

[0124] Step S2: The display device 200 receives the feedback result returned by the storage server 500 based on the screen projection information.

[0125] In some embodiments, the display device 200 may receive the feedback result returned by the storage server 500 based on the screen mirroring information, and thus can know whether the corresponding media resources have been saved in the storage server 500, providing the user with an instant feedback on the resource status. In this way, if the content requested by the user for screen mirroring already exists in the storage server 500, the playback process can be directly entered without additional resource downloading, avoiding repeated downloading of the saved content, thereby saving network bandwidth and storage space. After step S2 is completed, the following step S3 may be included.

[0126] Step S3: In the case where the feedback result is that the media resources are not saved in the storage server 500, generate a download request according to the screen mirroring information, and send the download request to the storage server 500, so that the storage server 500 requests the media resources corresponding to the screen mirroring information from the cloud server 400 according to the download request.

[0127] In some embodiments, in the case where the media resources are not saved in the storage server 500, the storage server 500 may receive the download request sent by the display device 200, request the media resources corresponding to the screen mirroring information from the cloud server 400 according to the download request, generate screen mirroring link information according to the media resources, and send the screen mirroring link information to the display device 200, so that the display device 200 plays the screen mirroring content corresponding to the screen mirroring request of the mobile terminal according to the screen mirroring link information.

[0128] Exemplarily, when the content requested by the user for screen mirroring is not found in the storage server 500, the display device 200 may generate a download request according to the screen mirroring information to request the resource. The download request may include detailed location information of the screen mirroring content (such as the URL of the cloud server), parameters such as the required resource format and resolution. Then, the download request is sent to the storage server 500 to instruct it to initiate a resource download request to the cloud server 400. In this way, the display device 200 can achieve on-demand downloading of resources. When the content that the user needs to screen mirror is not stored in the local storage server 500, the resource download process can be triggered to ensure that the user can smoothly view the required content. After step S3 is completed, the following step S4 may be executed.

[0129] Step S4: Receive the screen mirroring link information returned by the storage server 500 according to the download request, and control the display 260 to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information.

[0130] In the case where the feedback result is that the media resources are not saved in the storage server 500, the display device 200 may receive the screen mirroring link information returned by the storage server 500 according to the download request, and control the display 260 to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information.

[0131] Exemplarily, the key parameters such as the unique identifier, storage path, file format, resolution, bit rate, etc. of the media resource may be included in the screen mirroring link information received by the display device 200. After that, the display device 200 may control the large screen display 260 to play the content according to the screen mirroring link information. In this way, through the screen mirroring link information generated by the storage server 500, it can be ensured that the display device 200 accurately accesses the required media resource for playing, without relying on the cloud server 400 any more.

[0132] In some embodiments, when the feedback result is that the media resource is saved in the storage server 500, the display device 200 may receive the screen mirroring link information returned by the storage server 500, control the display 260 to play the screen mirroring content corresponding to the screen mirroring request, receive the control instruction sent by the mobile terminal 300 based on the screen mirroring content, and execute the operation corresponding to the control instruction.

[0133] Exemplarily, when the media resource is clearly stored in the storage server 500, the storage server 500 can perform a quick search and match in the database to find the screen mirroring link information corresponding to the media resource related to the screen mirroring request. The screen mirroring link information can also include key parameters such as the unique identifier, storage path, file format, resolution, bit rate, etc. of the media resource. The storage server 500 can transmit the screen mirroring link information back to the display device 200 through the network channel. The display device 200 can receive it through the network communication module and perform preliminary parsing and verification to ensure the integrity and accuracy of the information. For example, the display device 200 can obtain the screen mirroring link information through a pre-set network protocol and communication port. By obtaining the detailed screen mirroring link information, the display device 200 can accurately locate the media resource in the storage server 500, avoid playback errors caused by unclear resource paths or identifiers, and improve the accuracy and reliability of the screen mirroring content playback. After successfully receiving and verifying the screen mirroring link information, the display device 200 can control the display 260 to play the screen mirroring content corresponding to the screen mirroring request. During the playback of the screen mirroring content, the mobile terminal 300 can monitor the user's interaction operations in real time. When the user performs control operations such as pausing, fast-forwarding, rewinding, adjusting the volume, etc. on the mobile terminal 300, the mobile terminal 300 will obtain the user's operation instructions, generate corresponding control instructions according to the playback state and relevant parameters of the current screen mirroring content, and send the generated control instructions to the display device 200. After receiving the control instructions, the display device 200 can adjust the playback of the screen mirroring content in real time according to the user's operations to ensure the smoothness and controllability of the playback. At the same time, the display device 200 can execute corresponding operations according to the operation type and parameters in the instructions. For example, if the control instruction is to pause the playback, the display device 200 will send a signal to stop refreshing the frame to the display 260 to pause the playback function and achieve the pause of the screen mirroring content; if the control instruction is to fast-forward or rewind, the display device 200 will calculate the specific frame position to jump to according to the playback position parameter in the instruction, and then adjust the reading position of the decoder to start decoding and playing from the new position, etc. After step S4 is executed, the following step S5 can be included.

[0134] Step S5: When the screen mirroring content has not finished playing and the user exits, in response to the user's save instruction for the screen mirroring content, send the playback information corresponding to the screen mirroring content to the storage server 500. When the user plays the screen mirroring content again, resume playing the screen mirroring content according to the progress information in the playback information in the storage server.

[0135] During the playback of the screen mirroring content, if the screen mirroring content has not finished playing and the user chooses to exit, it can be determined whether to save the current media playback information according to the user's choice. For example, Figure 8As shown, the display device 200 can prompt the user whether to save the current playback progress. If the user selects "Save", the display device 200 can generate a save instruction, and then extract the playback information of the current screen projection content (such as playback progress, pause time, played content identifier, etc.), and send this information to the storage server 500 for saving. The storage server 500 receives the playback information corresponding to the screen projection content sent by the display device 200, so that when the display device 200 plays the screen projection content again, it can continue to play the screen projection content according to the progress information in the playback information. In this way, by saving the playback information of the screen projection content, the display device 200 can ensure that when the user watches the same media asset again later, it can seamlessly continue to play from the place where it was interrupted last time, without having to search again or fast forward to the required position, which not only saves the user's time, but also improves the continuity and convenience of viewing.

[0136] In some embodiments, the default save mode during the screen projection process can also be set in advance. For example, the save item regarding the user closing the screen projection content can be set in the background in advance, and the default mode of this save item can be set to the save mode. In this way, in response to the closing of the screen projection content, the display device 200 can automatically save the relevant playback information and send the saved playback information to the storage server 500, without the need for the user to make a manual selection. On the one hand, when continuing to play this media asset next time, it can continue to play this media asset according to the progress information in the playback information. On the other hand, there is no need for the user to perform additional manual operations, improving the user experience.

[0137] In some embodiments, when the display device 200 sends the playback information corresponding to the screen projection content to the storage server 500, and when the user plays the screen projection content again and continues to play the screen projection content according to the progress information in the playback information in the storage server, it can be executed according to the following process. Specifically, the display device 200 can obtain the media title of the media resource corresponding to the screen projection content to be projected. When the media title is consistent with the name information in the playback information stored in the storage server 500, it requests the playback progress corresponding to the media resource from the storage server 500, and then controls the display 260 to continue to play the screen projection content according to the playback progress.

[0138] Exemplarily, the display device 200 can obtain the detailed information of the media resource corresponding to the screen mirroring content to be screen mirrored from the screen mirroring source device, including the media title. By obtaining the media title, the display device 200 can accurately identify the specific content to be screen mirrored. After obtaining the media title, the display device 200 can compare the obtained media title with the name information in the playback information pre-stored in the storage server 500. For example, through a string matching algorithm, it can compare whether the two name information are exactly the same character by character. If they are exactly the same, it is determined to be consistent; if there are any differences, it is determined to be inconsistent. When the media title is consistent with the name information in the playback information stored in the storage server 500, the display device 200 can send a request for the playback progress corresponding to the media resource to the storage server 500 according to a predetermined communication protocol and data format. The storage server 500 can encapsulate and return information such as the playback progress to the display device 200. After receiving the playback information returned by the storage server 500, the display device 200 can parse to obtain the playback progress value and start displaying the screen mirroring content from the specified playback progress. In this way, by requesting the playback progress from the storage server 500, the display device 200 can accurately continue playing the screen mirroring content from the interrupted position according to the user's previous viewing records without the user manually searching for the playback position.

[0139] That is to say, in the embodiment of the present application, during the video playback process of the screen mirroring content, when the video exits, if the playback is not completed, the current video link, video title, playback progress, etc. can be submitted to the storage server 500. After receiving it, the storage server 500 can determine whether it is consistent with the previously saved media (such as being considered consistent if the video titles are the same). When they are consistent, the playback information can be recorded. The next time a certain media is pushed from the mobile terminal 300, the display device 200 can compare whether it is the media resource that has been previously saved in the storage server 500. If so, it can continue playing from the previous playback progress without manual operation by the user, solving the problem of being unable to resume playing the screen mirroring content in the screen mirroring scenario and improving the user experience.

[0140] In some embodiments, in the case where the screen mirroring content playback is not completed and the user exits, in response to the save instruction, the display device 200 requests the playback information corresponding to the screen mirroring content from the storage server 500. The playback information at least includes the name information, media URL information, and progress information of the media resource corresponding to the screen mirroring content, receives the playback information returned by the storage server 500, generates a thumbnail corresponding to the media resource according to the playback information, and controls the display 260 to display the thumbnail on the playback page corresponding to the media resource.

[0141] Exemplarily, Figure 9 Schematic diagram of the scenario where the display device provided in some embodiments of the present application displays a thumbnail on the playback page, such asFigure 9 As shown, taking the display device 200 as a TV for example, when the TV end receives a screen mirroring request in the screen mirroring scenario, the media resources that have been saved or are being saved are stored in the storage server 500, and the screen mirroring link information is sent to the TV end through the storage server 500. After receiving the screen mirroring link information, the TV end can present the screen mirroring content. In this way, by timely requesting the playback information corresponding to the screen mirroring content from the storage server 500 and ensuring the accurate acquisition of this information, the key data during the screen mirroring process can be completely recorded, providing data support for the handling of possible abnormal situations in the future. For example, if a network fluctuation or device failure occurs during the screen mirroring process and causes the screen mirroring to be interrupted, when the screen mirroring is restored, the saved playback information can be used to accurately locate the position before the interruption and continue playing, avoiding playback chaos or incoherence caused by data loss. After receiving the playback information returned by the storage server 500, the display device 200 can extract content such as the name information of the media resource, the media URL information, and the progress information. After obtaining these key information, the display device 200 can call or download relevant image files from the corresponding media resource library as the original materials for the thumbnail according to the name information and URL information of the media resource. After generating the thumbnail, the display device 200 can send a control instruction to the display 260, notifying it to display the generated thumbnail on the playback page corresponding to the media resource. By displaying the thumbnail on the playback page corresponding to the media resource, an intuitive visual guidance can be provided for the user. The user can quickly identify the media content being played by observing the thumbnail, enhancing the user viewing experience.

[0142] In some embodiments, in the original screen mirroring processing logic of the media resource, whether to play the next episode depends on the manual control of the user in the mobile terminal 300. For example, the user needs to manually trigger the playback of the next episode, and then the display device 200 will change accordingly, that is, the display device 200 cannot automatically match the subsequent episodes.

[0143] Based on this, in some embodiments of the present application, the display device 200 can obtain all the media resources saved or played by the user, classify the media resources according to the playback information to form classified media information; in the case where the current screen mirroring content has finished playing, search for the next episode of the media resource corresponding to the screen mirroring content in the classified media information, and control the display 260 to automatically play the next episode of the media resource.

[0144] ​Exemplarily, the display device 200 can obtain information related to all media resources saved or played by the user from the storage server 500. This information may include the unique identifier, name, type (such as movies, TV series, etc.), playing duration, playing status (saved or played), and corresponding playing information (such as playing progress, playing time, etc.) of the media resources. After receiving the request from the display device 200, the storage server 500 can organize the eligible media resource information into a data list and transmit it back to the display device 200. After receiving this data, the display device 200 can further analyze and process the data list. For example, the media resources can be carefully classified based on playing information such as the type of media resources, the series they belong to (such as seasons and episodes of TV series), themes, etc. For media resources of the TV series type, they may first be classified according to different TV drama titles, and then further subdivided in the order of seasons and episodes under each title. During the classification process, various information of the media resources can be checked and sorted to ensure the accuracy and integrity of the classification. By obtaining and classifying all media resources saved or played by users, the display device 200 can manage media resources more efficiently, enabling users to browse and find media resources they are interested in more conveniently. At the same time, it is also convenient for the display device 200 to uniformly maintain and manage media resources, such as deleting duplicate or invalid resources to improve the utilization rate of storage space.

[0145] When the playing progress of the screen mirroring content reaches 100%, it indicates that the content of this episode has been played. At this time, the display device 200 can immediately detect this state and trigger the process of searching for the next episode of media resources. For example, the display device 200 can first accurately locate in the already formed classified media information according to the identification information of the current screen mirroring content (such as the drama title, season number, episode number, etc.). By quickly searching and matching in the classified media information, the next episode of media resources consecutive to the current screen mirroring content can be found. If the next episode of media resources exists, the display device 200 can send a request to the storage server 500 to obtain the data file of this episode of media resources. After receiving the request, the storage server 500 will send the data file of the next episode of media resources to the display device 200. After receiving the complete data of the next episode of media resources, the display device 200 can cache it in the local memory and perform decoding and initialization operations to ensure smooth playback. Through the function of automatically playing the next episode of media resources, when users watch continuous media content such as series of TV dramas, they do not need to manually operate to find and play the next episode, improving the coherence and convenience of viewing.

[0146] In some embodiments, before the display device 200 generates a download request according to the screen mirroring information and sends the download request to the storage server 500, it may also detect the terminal playback progress information in the media resources pushed by the mobile terminal 300. In the case where there is terminal playback progress information, it controls the display 260 to resume playing the screen mirroring content corresponding to the media resources according to the terminal playback progress information; in the case where there is no terminal playback progress information, it executes the steps of generating a download request according to the screen mirroring information and sending the download request to the storage server 500.

[0147] Exemplarily, after receiving the screen mirroring request from the mobile terminal 300, the display device 200 may detect whether the corresponding APP in the mobile terminal has a seek function. If it has, it may directly resume playing according to the seek progress. The display device 200 can quickly respond and directly enter the mode of resuming playing according to this progress, reducing unnecessary data transmission and processing time. If it does not have, it then executes the steps of generating a download request according to the screen mirroring information and sending the download request to the storage server 500. In this way, the present application can continue the original screen mirroring logic and further improve on the original logic. Even if there is no terminal playback progress information, by generating a download request according to the screen mirroring information, it can still ensure the smooth playback of the screen mirroring content, making the screen mirroring system have high compatibility and reliability, and expanding the usage range and scenario adaptability of the screen mirroring function.

[0148] In some embodiments, when the user exits after the screen mirroring content is played, or when the user does not select to save the screen mirroring content when exiting the screen mirroring content, the display device 200 may generate a deletion instruction and send the deletion instruction to the storage server 500, so that after receiving the deletion instruction, the storage server 500 deletes the media resources corresponding to the screen mirroring content. By generating a deletion instruction and sending the deletion instruction to the storage server 500, the deletion operation can have a clear target and an accurate execution basis. After receiving the instruction, the storage server 500 can quickly locate and delete the corresponding media resources, timely clean up the unsaved screen mirroring content, effectively prevent the accumulation of invalid data on the storage server 500, and avoid performance degradation caused by a large amount of redundant data occupying storage space and system resources.

[0149] In some embodiments, the display device 200 may be compatible with all protocols, such as DLNA, AirPlay, and other screen mirroring protocols, etc. To improve the compatibility of media resource playback, in some embodiments, after the storage server 500 downloads the media resources from the cloud server 400, it may transcode the media resources to be compatible with different media formats.

[0150] Exemplarily, for media resources with low format adaptability downloaded from the cloud server 400, the storage server 500 can convert their formats to media resources with high format adaptability. In this way, the success rate of playing the converted media resources on the display device 200 can be improved.

[0151] As can be seen from the above technical solutions, the above embodiment provides a display device 200. In response to a screen mirroring request from a mobile terminal, the display device 200 sends the screen mirroring information of the mobile terminal to the storage server; receives a feedback result returned by the storage server based on the screen mirroring information; the feedback result is used to indicate whether the media resources corresponding to the screen mirroring information have been saved in the storage server; in the case where the feedback result is that the media resources are not saved in the storage server, a download request is generated according to the screen mirroring information and sent to the storage server, and the storage server requests the media resources corresponding to the screen mirroring information from the cloud server according to the download request; receives the screen mirroring link information returned by the storage server according to the download request, and controls the display to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information; in the case where the screen mirroring content is not finished playing and the user exits, in response to the user's save instruction for the screen mirroring content, the playing information corresponding to the screen mirroring content is sent to the storage server, and when the user plays the screen mirroring content again, the screen mirroring content is continuously played according to the progress information in the playing information in the storage server. When the media resources are not saved in the storage server, the display device 200 generates a download request, so that the storage server downloads the media resources from the cloud server according to the download request and generates screen mirroring link information, and the display device plays the screen mirroring content according to the screen mirroring link information. When the screen mirroring content is not finished playing and the user exits the screen mirroring, the display device responds to the user's save instruction and sends the current playing information to the storage server for saving. When the user mirrors the same media resources again, the display device obtains the previously saved playing information from the storage server and continues to play from the interrupted position, thereby solving the problem that the screen mirroring content cannot be continuously played in the screen mirroring scenario.

[0152] Some embodiments of the present application further provide a storage server 500, and the storage server 500 includes a communication module 510 and a control module 520. Among them, the communication module 510 is configured to establish a communication connection with the display device 200 and the cloud server 400, and the control module 520 is configured to execute the programs and instructions corresponding to the storage server 500, etc. Figure 10 It is a schematic flowchart of a method for the storage server provided by some embodiments of the present application to continuously play the screen mirroring content, as Figure 10As shown, the storage server 500 can receive the screen mirroring information sent by the display device 200; confirm the media resources corresponding to the screen mirroring information according to the screen mirroring information, generate a feedback result, and send the feedback result to the display device 200; the feedback result is used to indicate whether the media resources corresponding to the screen mirroring information have been saved in the storage server 500; in the case where the media resources have not been saved, receive the download request sent by the display device 200, request the media resources corresponding to the screen mirroring information from the cloud server 400 according to the download request, and generate screen mirroring link information according to the media resources; send the screen mirroring link information to the display device 200, so that the display device 200 plays the screen mirroring content corresponding to the screen mirroring request of the mobile terminal according to the screen mirroring link information; receive the playing information corresponding to the screen mirroring content sent by the display device 200, so that when the display device 200 plays the screen mirroring content again, continue to play the screen mirroring content according to the progress information in the playing information.

[0153] The storage server 500 can download media resources from the cloud server based on the download request of the display device 200, generate screen mirroring link information, and send the screen mirroring link information to the display device 200. When the playing of the screen mirroring content is not completed, in response to the user's save instruction, receive the playing information sent by the display device 200, so that when the user screens the same media resources again, send the saved playing information to the display device 200, so that the display device 200 continues to play from the interrupted position, thereby solving the problem that the screen mirroring content cannot be continued in the screen mirroring scenario.

[0154] Based on the above display device 200, some embodiments of the present application further provide a method for continuing to play screen mirroring content, and the method can be applied to the display device 200 in the above embodiments. In some embodiments, the method may include the following content:

[0155] In response to the screen mirroring request of the mobile terminal, send the screen mirroring information of the mobile terminal to the storage server;

[0156] Receive the feedback result returned by the storage server based on the screen mirroring information; the feedback result is used to indicate whether the media resources corresponding to the screen mirroring information have been saved in the storage server;

[0157] In the case where the feedback result is that the media resources have not been saved in the storage server, generate a download request according to the screen mirroring information, and send the download request to the storage server, so that the storage server requests the media resources corresponding to the screen mirroring information from the cloud server according to the download request;

[0158] Receive the screen mirroring link information returned by the storage server according to the download request, and control the display to play the screen mirroring content corresponding to the screen mirroring request according to the screen mirroring link information;

[0159] In the case where the casting content playback is not completed and the user exits, in response to the user's save instruction for the casting content, send the playback information corresponding to the casting content to the storage server, so that when the casting content is played again, the casting content can be resumed according to the progress information in the playback information.

[0160] As can be seen from the above technical solutions, the above embodiments provide a method for resuming the playback of casting content. When the media resource is not saved in the storage server, a download request is generated, so that the storage server downloads the media resource from the cloud server according to the download request and generates casting link information. The display device plays the casting content according to the casting link information. When the casting content playback is not completed and the user exits the casting, the display device responds to the user's save instruction and sends the current playback progress to the storage server for saving. When the user casts the same media resource again, the display device obtains the previously saved playback information from the storage server and resumes playing from the interrupted position, thereby solving the problem that the casting content cannot be resumed in the casting scenario.

[0161] The same or similar parts among the various embodiments in this specification can be referred to each other, and will not be repeated here.

[0162] Those skilled in the art can clearly understand that the technologies in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solutions in the embodiments of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods in the various embodiments or some parts of the embodiments of the present invention.

[0163] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the various embodiments of the present application.

[0164] For the sake of convenience in explanation, the above description has been made in connection with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are for better explaining the principles and practical applications, so that those skilled in the art can better use the embodiments and various different modified embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: a display configured to display a user interface; a communication device configured to establish a communication connection with the mobile terminal, the storage server, and the cloud server; The storage server is used to store the media resources downloaded from the cloud server; The controller is configured as: In response to a screen projection request from a mobile terminal, sending the screen projection information of the mobile terminal to a storage server; Receiving a feedback result returned by the storage server based on the screen projection information; the feedback result is used to indicate whether the media resource corresponding to the screen projection information has been saved in the storage server; When the feedback result is that the media resource is not stored in the storage server, a download request is generated according to the screen projection information, and the download request is sent to the storage server, so that the storage server requests the media resource corresponding to the screen projection information from the cloud server according to the download request; Receive the screen projection link information returned by the storage server according to the download request, and control the display to play the screen projection content corresponding to the screen projection request according to the screen projection link information; In the case that the playback of the projected content is not completed and the user exits, in response to the user's instruction to save the projected content, the playback information corresponding to the projected content is sent to the storage server, so that when the projected content is played again, the projected content is resumed according to the progress information in the playback information.

2. The display device according to claim 1, characterized in that After the step of incomplete playback of the projection content and user exiting, the controller is further configured to: In response to the save instruction, request the storage server for the playback information corresponding to the projection content, wherein the playback information includes at least the name information of the media resource corresponding to the projection content, the media resource URL information and the progress information; Receiving the playback information returned by the storage server; Generate a thumbnail corresponding to the media resource according to the playback information; The display is controlled to display the thumbnail on a playback page corresponding to the media resource.

3. The display device according to claim 2, characterized in that The controller sends the playback information corresponding to the projection content to the storage server, so that when the projection content is played again, the projection content is continued to be played according to the progress information in the playback information, and is specifically configured as follows: Get the media resource title of the media resource corresponding to the screen content to be projected; When the media resource title is consistent with the name information in the playback information, requesting the storage server for the playback progress corresponding to the media resource; Control the display to continue playing the projected content according to the playback progress.

4. The display device according to claim 2, characterized in that Before the step of sending the playback information corresponding to the projection content to the storage server, the controller is further configured to: Get all media resources that the user has saved or played. Classifying the media resource according to the playback information to form classified media resource information; When the current projection content is played, searching the classified media resource information for the next set of media resources corresponding to the projection content; The display is controlled to automatically play the next episode of the media asset.

5. The display device according to claim 1, characterized in that The controller sends the projection information of the mobile terminal to the storage server, and is specifically configured as follows: Obtaining a device identifier corresponding to the mobile terminal that initiated the screen projection request; The screen projection information of the mobile terminal is sent to the storage server based on the device identification.

6. The display device according to claim 1, characterized in that Before the step of receiving the screen projection link information returned by the storage server according to the download request, the controller is further configured to: When the feedback result is that the media resource is stored in the storage server, receiving the screen casting link information returned by the storage server; Control the display to play the projection content corresponding to the projection request according to the projection link information; Receive a control instruction sent by the mobile terminal based on the projection content, and execute an operation corresponding to the control instruction.

7. The display device according to claim 1, characterized in that Before the step of generating a download request according to the screen projection information and sending the download request to the storage server, the controller is further configured to: Detecting terminal playback progress information in the media resource pushed in the mobile terminal; In the case where the terminal playback progress information exists, controlling the display to continue playing the projection content corresponding to the media resource according to the terminal playback progress information; In the absence of the terminal playback progress information, the steps of generating a download request according to the screen projection information and sending the download request to the storage server are performed.

8. The display device according to claim 1, characterized in that After the step of controlling the display to play the projection content corresponding to the projection request according to the projection link information, the controller is further configured to: When the user exits after playing the projected content, or when the user does not choose to save the projected content when exiting the projected content, generating a deletion instruction; The deletion instruction is sent to the storage server, so that the storage server deletes the media resources corresponding to the projection content after receiving the deletion instruction.

9. A storage server, characterized in that: include: A communication module is configured to establish a communication connection with a display device and a cloud server; The control module is configured as follows: Receive screen projection information sent by the display device; Confirming the media resource corresponding to the projection information according to the projection information, generating a feedback result, and sending the feedback result to the display device; The feedback result is used to indicate whether the media resource corresponding to the screen projection information has been saved in the storage server; In the case where the media resource is not saved, receiving a download request sent by the display device, and requesting the media resource corresponding to the screen projection information from the cloud server according to the download request, and generating screen projection link information according to the media resource; Sending the screen projection link information to the display device, so that the display device plays the screen projection content corresponding to the screen projection request of the mobile terminal according to the screen projection link information; Receive playback information corresponding to the projected screen content sent by the display device, so that when the display device plays the projected screen content again, it continues to play the projected screen content according to the progress information in the playback information.

10. A method for continuing to broadcast screen content, applied to the display device according to any one of claims 1 to 8, wherein the display device comprises a display, a communication device and a controller, characterized in that: The method comprises: In response to a screen projection request from a mobile terminal, sending the screen projection information of the mobile terminal to a storage server; Receiving a feedback result returned by the storage server based on the screen projection information; the feedback result is used to indicate whether the media resource corresponding to the screen projection information has been saved in the storage server; When the feedback result is that the media resource is not stored in the storage server, a download request is generated according to the screen projection information, and the download request is sent to the storage server, so that the storage server requests the media resource corresponding to the screen projection information from the cloud server according to the download request; Receive the screen projection link information returned by the storage server according to the download request, and control the display to play the screen projection content corresponding to the screen projection request according to the screen projection link information; In the case that the playback of the projected content is not completed and the user exits, in response to the user's instruction to save the projected content, the playback information corresponding to the projected content is sent to the storage server, so that when the projected content is played again, the projected content is resumed according to the progress information in the playback information.

Images