Screen-casting mode processing method and display device

Abstract

Disclosed in the embodiments of the present application are a screen-casting mode processing method and a display device. The method comprises: in response to having received a screen-casting instruction which is used for playing a target video source and which is sent by a screen-casting device, and on the basis of a resource address included in the screen-casting instruction, acquiring, from a server corresponding to the resource address, the target video source and playing same; acquiring resume-playing time data; during the process of playing the target video source, acquiring playing time data; if it is determined on the basis of the playing time data and the resume-playing time data that a resume-playing end condition is met, executing a target operation, wherein the target operation includes a screen-casting disconnection operation or a pause-playing operation for the target video source; and if it is determined on the basis of the playing time data and the resume-playing time data that the resume-playing end condition is not met, continuing to play the target video source. In this way, the accuracy of screen-casting mode processing can be increased, and mode interventions manually performed by a user can be reduced, thereby improving the screen-casting processing efficiency and human-computer interaction efficiency, and realizing intelligent and accurate control of screen-casting playing.

Description

Screen projection mode processing method and display device

[0001] The present application claims priority from the Chinese patent application No. 202411377219.3 filed on September 29, 2024 in the China Patent Office and entitled "Screen projection mode processing method and display device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of screen projection, and in particular to a screen projection mode processing method and a display device. BACKGROUND

[0003] When displaying a screen projection content, the display device may need to disconnect the screen projection if certain preset conditions are triggered, or take a break before continuing to play the screen projection. For example, when the display device displays a screen projection program of the movie and television type, if a timing mode is started, the user can disconnect the screen projection when the screen projection broadcast time reaches a preset time a, so as to avoid exceeding the user's set healthy viewing time. For another example, when the display device displays a program of the children's education type, the user can start an eye protection mode or a break mode every interval of a preset time b to avoid eye fatigue, lack of concentration and other problems caused by long-time uninterrupted learning of children.

[0004] In view of these user scenarios, when the preset triggering condition is reached, the user needs to manually intervene in the mode to adjust the screen projection state. For example, the user can terminate the screen projection at the sending end or the receiving end at the time node when the screen projection needs to be disconnected by observing the screen projection broadcast time or setting an alarm reminder, etc. For another example, in the eye protection mode, the user needs to pause the screen projection first and then resume the screen projection play when the eye protection mode ends. In this way, on the one hand, it will lead to low operation efficiency, and on the other hand, it cannot intelligently and accurately control different screen projection modes. TECHNICAL PROBLEM

[0005] The embodiments of the present application provide a screen projection mode processing method and a display device, which can improve the accuracy of screen projection mode processing, reduce user manual mode intervention, improve screen projection processing efficiency and human-computer interaction efficiency, and realize intelligent and accurate control of screen projection play. TECHNICAL SOLUTION

[0006] In a first aspect, the embodiments of the present application provide a display device, comprising:

[0007] a display, configured to display a user interface;

[0008] a communication device, configured to communicate data with a server;

[0009] a controller, configured to perform:

[0010] in response to receiving the screen projection instruction for playing the target video source sent by the screen projection device, obtaining and playing the target video source from a server corresponding to a resource address included in the screen projection instruction according to the resource address;

[0011] obtaining continuation time data;

[0012] obtaining playing time data in the process of playing the target video source;

[0013] if it is determined that the continuation end condition is met based on the playing time data and the continuation time data, performing a target operation; wherein the target operation includes a screen projection disconnection operation or a pause playing operation on the target video source;

[0014] if it is determined that the continuation end condition is not met based on the playing time data and the continuation time data, continuing to play the target video source.

[0015] The technical scheme provided by the first aspect embodiment has the following beneficial effects: when the screen projection device projects a video source to the display device, the screen projection device can include a resource address in the screen projection instruction, so that the display device can request data of the target video source from a server according to the resource address, and then play the target video source; the display device can obtain continuation time data, which includes time parameters related to trigger conditions of different screen projection modes; the display device can also obtain playing time data, which is related to relevant time parameters in the process of establishing a screen projection connection and playing a screen projection video source, so that whether the continuation end condition of the target video source is met can be determined by comparing the playing time data and the continuation time data; if the continuation end condition is met, a screen projection disconnection operation or a pause playing operation of the video source can be performed based on the settings of different screen projection modes, and otherwise, if the continuation end condition is not met, the video source is continued to be played; in this way, after the video source is started, the continuation end condition of the video source is determined by using the playing time data and the continuation time data, so that the screen projection connection is automatically disconnected or the video source is automatically paused when the continuation end condition is met, the display device is prevented from continuously playing the screen projection content, intelligent control of screen projection playing based on a time management mechanism is realized, the accuracy of screen projection mode processing is improved, manual mode intervention of the user is reduced, and the screen projection processing efficiency and the human-computer interaction efficiency are improved.

[0016] In a second aspect, the embodiments of the present application also provide a screen projection mode processing method, comprising:

[0017] in response to receiving the screen projection instruction for playing the target video source sent by the screen projection device, obtaining and playing the target video source from a server corresponding to a resource address included in the screen projection instruction according to the resource address;

[0018] obtaining continuation time data;

[0019] In the process of playing the target video source, obtaining playing time data;

[0020] If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, performing a target operation; wherein the target operation comprises a disconnection of the screen projection operation or a pause playing operation of the target video source;

[0021] If it is determined that the resuming end condition is not met based on the playing time data and the resuming time data, continuing to play the target video source.

[0022] The technical solution provided by the second aspect of the above embodiment has the following beneficial effects: when the screen projection device projects a video source to the display device, the resource address can be included in the screen projection instruction, so that the display device can request the data of the target video source from the server according to the resource address, and then play the target video source; the display device can obtain the resuming time data, which includes time parameters related to the triggering conditions of different screen projection modes; the display device can also obtain the playing time data, which is related to the relevant time parameters in the process of establishing the screen projection connection and playing the screen projection video source, so that the playing time data and the resuming time data can be compared to determine whether the resuming end condition of the target video source is met; if the resuming end condition is met, the disconnection of the screen projection operation or the pause playing operation of the video source can be performed based on the settings of different screen projection modes, and otherwise if the resuming end condition is not met, the video source is continued to be played; in this way, after the video source is played, the resuming end condition of the video source is determined by using the playing time data and the resuming time data, so that the screen projection connection is automatically disconnected or the video source is automatically paused when the resuming end condition is met, thereby avoiding the display device from continuously playing the screen projection content, realizing the intelligent control of the screen projection playing based on the time management mechanism, improving the accuracy of the screen projection mode processing, reducing the manual mode intervention of the user, and improving the screen projection processing efficiency and the human-computer interaction efficiency. BRIEF DESCRIPTION OF DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0024] Fig. 1 is a schematic diagram of the operation scene between the display device and the control device according to some embodiments of the present application;

[0025] Fig. 2 is a schematic diagram of the hardware configuration of the display device according to some embodiments of the present application;

[0026] FIG. 3A is a schematic diagram of a software configuration of a display device according to some embodiments of the present application;

[0027] FIG. 3B is a schematic diagram of a software architecture of a mode application according to some embodiments of the present application;

[0028] FIG. 4A is a schematic diagram of a timing mode setting method according to some embodiments of the present application;

[0029] FIG. 4B is a schematic diagram of an interval mode setting method according to some embodiments of the present application;

[0030] FIG. 4C is a schematic diagram of a timing mode setting method according to some embodiments of the present application;

[0031] FIG. 4D is a schematic diagram of a screen projection mode setting page according to some embodiments of the present application;

[0032] FIG. 5A is a schematic diagram of a user interface change when a trigger condition of a timing mode is met according to some embodiments of the present application;

[0033] FIG. 5B is a schematic diagram of a user interface change when a trigger condition of a timing mode is met according to some embodiments of the present application;

[0034] FIG. 5C is a schematic diagram of a user interface change when a trigger condition of a timing mode is met according to some embodiments of the present application;

[0035] FIG. 6 is a schematic diagram of a user interface change when a trigger condition of a timing mode is met according to some embodiments of the present application;

[0036] FIG. 7 is a schematic diagram of a user interface change when a trigger condition of a timing mode is met according to some embodiments of the present application;

[0037] FIG. 8 is a schematic diagram of a user interface change when a trigger condition of a timing mode is met according to some embodiments of the present application;

[0038] FIG. 9 is a schematic diagram of a trigger time distribution of an interval mode in a screen projection play process according to some embodiments of the present application;

[0039] FIG. 10 is a schematic diagram of a user interface change in an interval mode when a VideoURL pushed film source (non-live) type screen projection is played according to some embodiments of the present application;

[0040] FIG. 11 is a schematic diagram of a user interface change in an interval mode when a VideoURL pushed film source (non-live) type screen projection is played according to some embodiments of the present application;

[0041] FIG. 12 is a schematic diagram of a user interface in a timing mode when playing a VideoURL pushed piece source (non-live) type screen projection according to some embodiments of the present application;

[0042] FIG. 13 is a schematic diagram of a user interface in a timing mode when playing a VideoURL pushed piece source (non-live) type screen projection according to some embodiments of the present application;

[0043] FIG. 14 is a schematic diagram of a user interface in a timing mode when playing a VideoURL pushed piece source (non-live) type screen projection according to some embodiments of the present application;

[0044] FIG. 15 is a schematic diagram of a user interface in a timing mode when playing a VideoURL pushed piece source (non-live) type screen projection according to some embodiments of the present application;

[0045] FIG. 16 is a schematic diagram of a user interface in a timing mode when playing a VideoURL pushed piece source (non-live) type screen projection according to some embodiments of the present application;

[0046] FIG. 17 is a timing sequence interaction diagram of a screen projection mode processing method according to some embodiments of the present application;

[0047] FIG. 18 is a timing sequence interaction diagram of a screen projection mode processing method (timing mode) according to some embodiments of the present application;

[0048] FIG. 19 is a timing sequence interaction diagram of a screen projection mode processing method (interval mode) according to some embodiments of the present application;

[0049] FIG. 20 is a timing sequence interaction diagram of a screen projection mode processing method (interval mode) according to some embodiments of the present application;

[0050] FIG. 21 is a timing sequence interaction diagram of a screen projection mode processing method (timing mode) according to some embodiments of the present application. Embodiments of the present application

[0051] The embodiments will be described in detail below with reference to examples thereof as illustrated in the accompanying drawings. In the following description, same numbers refer to same or similar elements throughout the drawings. The embodiments described in the following examples do not represent all of the embodiments consistent with the present application. Rather, they are merely examples of systems and methods consistent with some aspects of the present application as detailed in the appended claims.

[0052] It should be noted that the brief description of terms in the present application is only for the convenience of understanding the following described embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0053] The terms "first", "second", "third", and the like in the description and in the claims of the present application and above drawings are used for distinguishing between similar or identical objects and do not necessarily have a specific temporal or chronological order, unless otherwise noted. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

[0054] The terms "comprises", "comprising", "includes", "including", "has", "having", and their variants are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of components does not necessarily comprise only those components, but can include other components not expressly listed or inherent to such product or apparatus.

[0055] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software codes that can perform the functions described with respect to such element.

[0056] In the embodiments of the present application, the display device refers to a device with picture display and data processing capabilities. For example, the display device includes, but is not limited to, a smart television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, and the like.

[0057] FIG. 1 is a schematic diagram of an operating scenario between a display device and a control device according to some embodiments of the present application.

[0058] As shown in FIG. 1, a user can operate the display device 200 through a touch operation, a mobile terminal 300, and a control device 100. The control device 100 is configured to receive an operation instruction input by the user and convert the operation instruction into a control instruction that can be recognized and responded by the display device 200. For example, the control device 100 can be a remote controller, a stylus, a handle, or the like.

[0059] The mobile terminal 300 can be used as a control device to perform human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 and perform data interaction. In some embodiments, the mobile terminal 300 can install a software application on the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The mobile terminal 300 can also transmit audio and video content displayed thereon to the display device 200 to achieve a synchronous display function.

[0060] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the function of the control device 100 by running an application program for controlling the display device 200.

[0061] As also shown in FIG. 1, the display device 200 is also in data communication with the server 400 through various communication means. The display device 200 can be allowed to be communicatively connected through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0062] The display device 200 can provide a broadcast receiving television function, and can additionally provide a smart network television function with computer support, including but not limited to a network television, a smart television, an Internet protocol television (IPTV), and the like.

[0063] FIG. 2 is a schematic diagram of a hardware configuration of a display device according to some embodiments of the present application.

[0064] In some embodiments, referring to FIG. 2, the display device 200 can include at least one of a tuning demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0065] In some embodiments, the tuning demodulator 210 can receive a broadcast television signal through a wired or wireless manner, and can perform amplification, mixing, and resonance, and the like, for modulation and demodulation processing, for demodulating an audio and video signal carried in a frequency of a selected television channel selected by a user from among a plurality of wireless or wired broadcast television signals, as well as additional information (e.g., EPG data).

[0066] In some embodiments, the tuning demodulator 210 can demodulate a broadcast television signal according to a frequency of a selected television channel selected by a user and controlled by the controller 250.

[0067] In some embodiments, the tuning demodulator 210 can receive a signal in various ways according to a broadcast standard of a broadcast television signal, including but not limited to terrestrial broadcasting, cable broadcasting, satellite broadcasting, or Internet broadcasting, and the like, and can implement a digital modulation method or an analog modulation method according to a modulation type, and can demodulate an analog signal and a digital signal according to a type of a received broadcast television signal.

[0068] In some embodiments, the tuning demodulator 210 can also be in an external device, such as an external set-top box, and the like. In this case, the set-top box outputs a broadcast television signal after modulation and demodulation, and the signal is transmitted to the display device 200 through the device interface 240.

[0069] In some embodiments, the detector 230 is configured to collect signals of the external environment or the external interaction. For example, the detector 230 includes a light receiver configured to collect ambient light intensity; or the detector 230 includes an image collector, such as a camera, configured to collect an external environment scene, a user attribute, or a user interaction gesture; or the detector 230 includes a sound collector, such as a microphone, configured to receive external sound.

[0070] In some embodiments, the display 260 includes a display functional component configured to present a picture, and a driving component configured to drive the image display. The display 260 is configured to receive an image signal output from the controller 250 for display. For example, the display 260 can be configured to display video content, image content, and components of a menu control interface, and a user control UI interface.

[0071] In some embodiments, the communication device 220 is a component configured to communicate with the external device or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication manners. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0072] The communication device 220 can be configured to connect the display device 200 to the external device or the server 400 in a wireless or wired manner. The wired connection can be achieved by connecting the display device 200 to the external device through a data line, an interface, or the like. The wireless connection can be achieved by connecting the display device 200 to the external device through a wireless signal or a wireless network. The display device 200 can be directly connected to the external device, or can be indirectly connected to the external device through a gateway, a router, a connection device, or the like. The display device 200 can be connected to the external device (for example, a terminal device) through different screen projection protocols.

[0073] In some embodiments, the controller 250 can include at least one of a central processor, a video processor, an audio processor, a graphics processor, a power processor, a first interface to an n-th interface for input / output, and the controller 250 controls the operation of the display device and responds to the user's operation by controlling various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0074] In some embodiments, the controller 250 and the tuner demodulator 210 can be located in different split devices, that is, the tuner demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box or the like.

[0075] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI).

[0076] In some embodiments, the audio output device 270 can be a native loudspeaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 can further be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0077] In some embodiments, the user input interface 280 can be used to receive instructions from the user input.

[0078] In order to perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program used to manage and control hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0079] It should be noted that the operating system can be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0080] FIG. 3A is a schematic diagram of the software configuration of the display device according to some embodiments of the present application.

[0081] The operating system can be divided into different modules or levels according to the functions implemented, for example, as shown in FIG. 3A, in some embodiments, the system is divided into four layers, from top to bottom, the application layer (referred to as "application layer" for short), the application framework layer (referred to as "framework layer" for short), the system library layer and the kernel layer.

[0082] In some embodiments, the application layer is configured to provide services and interfaces for applications so that the display device 200 can run the applications and interact with the user based on the applications. At least one application can be run in the application layer, which can be a Window program, a system setting program, a clock program, or the like provided by the operating system, or an application developed by a third-party developer. In practice, the application package in the application layer is not limited to the above examples.

[0083] In some embodiments, referring to FIG. 3A, the application layer can run a plurality of applications, such as application 1, application 2, application 3, and the like. To solve the problems mentioned in the background, the application embodiments provide an application, which is exemplarily named as a mode application. The mode application runs in the application layer, and the controller (including at least one processor) can run the mode application to implement the screen projection mode processing method provided by the application embodiments.

[0084] In some embodiments, the controller can configure and display control the screen projection mode by running the mode application. The mode application can configure a trigger condition (also referred to as an end-of-continuation condition) and a mode action (also referred to as a mode operation, a target operation, or the like) of at least one screen projection mode. In this way, when the trigger condition is met, the mode application can switch to the corresponding screen projection mode and perform the mode action corresponding to the screen projection mode (for example, disconnecting the screen projection or pausing the playing of the content, or the like). The screen projection mode includes but is not limited to a timing mode, a timing mode, an interval mode, and the like. The timing mode refers to disconnecting the screen projection connection when the system time of the display device reaches a preset time. The interval mode refers to pausing the playing of the screen projection content every first preset time interval of the user's screen projection viewing time (or the played time), and continuing to play the screen projection content after a second preset time of rest transition. The interval mode in different use scenarios, for example, presents an eye protection mode, a halftime break mode, and the like. The timing mode refers to disconnecting the screen projection connection when the played time of the screen projection reaches a third preset time. The purpose of these screen projection modes is to restrict the user's screen projection viewing behavior, avoid the user's long and uncontrolled viewing of the screen projection content, and cause eye fatigue and staying up late.

[0085] In some embodiments, when the display device displays at least one screen projection content, the controller can run the mode application. Through the interaction and information flow between the modules in the mode application, the trigger condition of the screen projection mode is monitored, the mode action of the screen projection mode is performed, and the content and template / layout displayed on the user interface are refreshed to adapt to the screen projection mode.

[0086] In some embodiments, the mode application can preset interface templates corresponding to mode actions of a plurality of different screen projection modes. For example, in the timing mode, if it is detected that the system time reaches the preset time (i.e., the trigger condition of the timing mode is met), the interface template can be exemplarily configured to display prompt information on the user interface to prompt that the preset time is reached and ask the user whether to agree to disconnect the screen projection. For another example, in the interval mode, when the playing time of the screen projection reaches the first preset time (i.e., the trigger condition of the interval mode is met), the interface template can be exemplarily configured to display a preset template page on the upper layer of the screen projection playing interface, which can be specifically a preset blocking page to block / shield the display of the screen projection content, and the preset template page is also used to prompt that the screen projection content will be played subsequently after the second preset time. In this way, the mode application can monitor the trigger conditions of a plurality of screen projection modes, when the trigger condition of any first screen projection mode is met, dynamically update the View and UI elements in the user interface that are changed due to entering the first screen projection mode according to the interface template preset for the first screen projection mode, and realize the trigger condition monitoring, display control and action execution of the screen projection modes in the same application.

[0087] The framework layer provides application programming interfaces (APIs) and programming frameworks for the application programs. The application program framework layer includes some pre-defined functions. The application program framework layer is equivalent to a processing center that decides which application program in the application layer to act. The application program can access the resources in the system and obtain the services of the system in the execution through the API interface. The application program (including the mode application) can access the resources in the system and obtain the services and required information of the system through the API interface. For example, the mode application can obtain the screen projection route, screen projection device information, device connection state, current signal source category and the like from the lower layer (e.g., the kernel layer) through the API interface (e.g., the Flow interface, etc.).

[0088] Referring to FIG. 3A, the application framework layer in the embodiments of the present application includes a view system, managers, a content provider, etc. The view system can be designed and implemented to interface and interact with the application, and the view system includes lists, grids, text boxes, buttons, etc. The managers include at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing access to system location services for system services or applications; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0089] In some embodiments, the activity manager is used to manage the life cycle of each application and general navigation back function, such as controlling the exit, opening, back, etc. of the application. The window manager is used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, intercepting the screen, controlling the display window change, for example, reducing the display window, shaking the display, twisting the display, etc.

[0090] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions implemented by the framework layer.

[0091] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement hardware abstraction, multitasking, memory management, etc. For example, as shown in FIG. 3A, the kernel layer can be configured with a hardware driver, and the kernel layer contains at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power supply driver, etc.

[0092] It should be noted that the above examples are only a simple division of the operating system functions, and do not constitute a limitation on the specific operating system form of the display device 200 in the embodiments of the present application. According to the function of the display device, the type of the operating system, and other factors, the number and specific type of the levels contained in the operating system can be in other forms.

[0093] After the display device establishes the screen projection connection with the screen projection device, if the display device end and the screen projection device end do not disconnect the screen projection connection, the screen projection device can continuously and uninterruptedly push the screen projection content to the display device based on the screen projection connection, and the display device continuously and uninterruptedly plays the screen projection content.

[0094] In some embodiments, the user can manually disconnect the screen projection connection through any one of the display device and the screen projection device, so that the screen projection device cannot push the screen projection content to the display device, and the display device end stops the continuous playing of the screen projection content.

[0095] In some embodiments, a play button can be set on the screen projection playing interface, which can be used to switch the playing state of the screen projection content when triggered. In this way, the user can click the play button to switch the screen projection content to the pause playing state, so as to stop the continuous playing of the screen projection content.

[0096] The above embodiments stop the continuous playing of the screen projection content through manual operation of the user, which requires the user to input manual operation multiple times, affecting the control efficiency of the screen projection playing. In addition, the user may stop the screen projection continuous playing in different scenarios, for example, the user generally sleeps before 22:00, so the user needs to pay attention to the time, or set an alarm to remind, etc., to know the night rest time, so as to manually disconnect the screen projection connection. In this way, on the one hand, the human-computer interaction efficiency is low, and the user needs to manually execute the corresponding operation (such as disconnecting the screen projection, pausing playing, etc.) for different scenarios, on the other hand, the user needs to artificially judge the continuous playing end condition, and once the user forgets the time, the screen projection may be continuously and uninterruptedly played, affecting the user's rest.

[0097] The following embodiments of the application provide a scheme for judging the end condition of screen projection continuation based on a time management mechanism and controlling screen projection playback. The principle of the scheme is as follows: after establishing a screen projection connection and starting to play a screen projection content, the controller can determine whether the end condition of screen projection continuation for a target video source is met according to the obtained playback time data and continuation time data; if the end condition of screen projection continuation is met, the controller can perform a screen projection disconnection operation or a screen projection content playback suspension operation based on the settings of different screen projection modes; otherwise, if the end condition of screen projection continuation is not met, the screen projection content continues to be played. In this way, after the screen projection content is started to play, the end condition of screen projection continuation for the video source is judged by using the playback time data and the continuation time data, so that the controller automatically disconnects the screen projection connection or suspends the playback of the video source when the end condition of screen projection continuation is met, thereby avoiding the continuous pushing of the screen projection content by the screen projection device and the continuous playing of the screen projection content by the display device, realizing intelligent control of screen projection playback based on a time management mechanism, improving the accuracy of screen projection mode processing, reducing manual mode intervention by the user, and improving the screen projection processing efficiency and the human-computer interaction efficiency. FIG. 3B is a software architecture diagram of a mode application provided by some embodiments of the application. The controller can realize the screen projection mode processing scheme based on the time management mechanism of the application by running the mode application.

[0098] Referring to FIG. 3B, the software architecture of mode switching includes but is not limited to: a screen projection management module 201, a data management module 202, a message processing module 203, a View management module 204, a mode management module 205, a sound management module 206, a location management module 207, an algorithm processing module 208, an application interaction processing module 209, a service management module 210, a replacement management module 211, a broadcast control management module 212, a time management module 213, a focus management module 214, a screen projection source analysis module 215, and the like.

[0099] In some embodiments, the screen projection management module 201 is configured to interact with the screen projection device through a screen projection service, manage the connection and disconnection of screen projection, manage the state and list of the screen projection device, and the like. The screen projection protocol is not limited, for example, Miracast, AirPlay, DLNA, and the like can be used.

[0100] In some embodiments, the data management module 202 is configured to manage information and data involved in different modes in the mode application, and synchronously update the related information and data.

[0101] In some embodiments, the message processing module 203 is configured to realize the message transmission and flow between the modules in the mode application.

[0102] In some embodiments, the View management module 204 is configured to control the interface display and update of different screen projection modes contained in the mode application.

[0103] In some embodiments, the mode management module 205 can be configured to store mode information of at least one casting mode, the mode information comprising a trigger condition and a mode action. In this way, when the display device displays the casting content, the mode management module 205 can monitor the trigger condition of each casting mode, and if the trigger condition (or the end-of-continuation condition) of the first casting mode is met, the first casting mode is switched to, and the other related modules are notified to perform the matching mode action (or target operation) according to the casting source information provided by the casting source analysis module 215. The casting source information includes a casting source type, which includes but is not limited to mirror casting and VideoURL (video link casting) and the like. The mirror casting refers to a process in which the casting device records the screen content of the local end by screen recording or the like and synchronously pushes it to the display device. The VideoURL refers to a process in which the casting device pushes the URL (i.e., resource link, also referred to as resource address) of the media asset to the display device, so that the display device accesses the URL to obtain the casting data from the server. The VideoURL can be further classified into live (real-time streaming) and non-live (e.g., movie, episode, and other piece source media assets pushed by URL).

[0104] In some embodiments, the mode management module 205 can also be configured to configure an interface template (hereinafter referred to as a mode template) corresponding to different casting modes and casting source types, which is used to specify the interface content and layout characteristics under different modes and casting source types, thereby providing a basis for the View management module 204 to display and update the user interface when the mode application performs the mode action.

[0105] In some embodiments, for the timing mode, the mode management module 205 sets the mode template as follows: a prompt page is displayed on the upper layer of the casting play interface, and the prompt page includes countdown information and prompt information a. The countdown information displays the countdown starting from a first threshold time (e.g., 5 seconds). An exemplary prompt information a is used to prompt that the preset time has been reached and the casting will be disconnected before the countdown is cleared, and to ask the user whether to agree to disconnect the casting. In this way, before the countdown is cleared, the user can agree or refuse to disconnect the casting.

[0106] In some embodiments, another exemplary prompt information a is related to the casting source information. If the casting source is a piece source type casting (non-live type) pushed by VideoURL, the prompt content of the prompt information e can be decided according to the length of the remaining play time of the piece source. For example, one prompt information e is “whether to agree to disconnect the casting immediately, as the casting content has 15 minutes left?”.

[0107] In some embodiments, assuming that the time interval corresponding to the interval mode is [T m ,T n ], where T mis the start time node (or starting moment) of the interval mode, T n is the end time node (or ending moment) of the interval mode, T n = T m + T0, T0 is the duration of the interval mode. For the interval mode, the mode template set by the mode management module 205 is, for example, to display prompt information b and a preset blocking page in sequence at T m , and to display prompt information c at T n . The prompt information b is used to prompt entering the interval mode. The preset blocking page is used to block the underlying screen mirroring playing interface, so that the user cannot continue to watch the screen mirroring content. The preset blocking page can prompt subsequent screen mirroring content after T0 duration. The prompt information c exemplarily prompts "interval mode ends, please continue to watch".

[0108] In some embodiments, for the timing mode, the timing mode is entered when the screen mirroring content starts playing, and a timer is started to start timing. The timer can be used to time the duration of the played screen mirroring content. The mode template set by the mode management module 205 is, for example, to display prompt information d on the upper layer of the screen mirroring playing interface when the starting moment T1 of the screen mirroring content is reached; and to display countdown information and prompt information e on the upper layer of the screen mirroring playing interface when the timing time reaches a preset duration T2, that is, when the system time reaches T1+T2. The prompt information d exemplarily prompts "screen mirroring watching duration timing starts".

[0109] In some embodiments, the text content of the prompt information e is related to the screen mirroring source information. If the screen mirroring source type is mirror screen mirroring, the prompt information e is used to prompt that the specified screen mirroring watching duration has been reached, and to ask whether the user agrees to disconnect the screen mirroring. If the screen mirroring source is a VideoURL pushed film source type screen mirroring (non-live type), the prompt content of the prompt information e can be decided according to the length of the remaining playing duration of the film source. For example, one kind of prompt information e exemplarily is "whether to delay to disconnect the screen mirroring when the film source playing ends, since the current film source has 3 minutes left?".

[0110] It should be noted that the mode management module 205 can adaptively configure the mode information and the mode template corresponding to each screen mirroring mode according to the characteristics and scene requirements of different modes, and is not limited to the examples of the embodiments of the present application.

[0111] In some embodiments, the sound management module 206 is used to process the sound of the screen mirroring source in different modes, such as muting, unmuting, volume control, etc.

[0112] In some embodiments, it is assumed that in the interval mode, the screen mirroring source type is mirror screen mirroring or VideoURL live type screen mirroring. The sound management module 206 can mute the sound of the screen mirroring source at T mThe current screen projection at the node is set to setMute(true), and in the time interval [T n The current screen projection at the node is set to setMute(false). Wherein, setMute() is used to control whether the sound is mute, setMute(false) is to set non-mute / sound, and setMute(true) is to set mute / no sound. In this way, in the time interval [T m ,T n ] interval, the screen projection picture is shielded by the preset shielding page, and the screen projection sound is also muted, so as to shield the user's audio-visual of the screen projection media, so that the user cannot watch the screen projection content in the interval mode, thereby realizing the purpose of eye protection and intermission.

[0113] In some embodiments, the position management module 207 is configured to set the display position distribution of the plurality of screen projection windows according to the connection state of the plurality of screen projection sources and the interface focus, etc. in a multi-screen projection scene. Taking the access of three screen projections to the display device as an example, which are A screen projection, B screen projection and C screen projection, the position management module 207 can set the relative positions of A screen projection, B screen projection and C screen projection in the interface. Assuming that A screen projection is earlier than B screen projection, and C screen projection is the latest to access, the three screen projections can be arranged in the order of access time, for example, A screen projection is set on the left side of the upper area of the interface, B screen projection is set on the right side of the upper area of the interface, and C screen projection is set in the center of the lower area of the interface.

[0114] In some embodiments, if A screen projection is disconnected, and D screen projection is newly accessed, the position management module 207 can keep the positions of B screen projection and C screen projection in the interface unchanged, and set D screen projection in the position of the original A screen projection, so as to avoid the problem that the screen projection watching effect is poor due to the moving and shaking of the screen projection content. For another example, if the focus falls on the window of B screen projection when D screen projection is accessed, D screen projection can be used to replace B screen projection at the focus position, and the positions of original A screen projection and C screen projection remain unchanged.

[0115] It should be noted that the position management module 207 can configure the positioning rules of multi-screen projection according to the mode category and the number of screen projections. When any screen projection source is connected or disconnected, the position management module 207 can reconfigure the display position distribution of each screen projection window in the user interface based on the change of the number of screen projections.

[0116] In some embodiments, the algorithm processing module 208 is configured to adaptively and dynamically match the UI layout and layout under different screen projection modes and the number of screen projections, including matching the size (including width and height) and display position (for example, the position coordinates of the key points of the screen projection window) of different Views and screen projection windows in the user interface, so as to provide data basis for the user interface update of the View management module 204.

[0117] In some embodiments, the application interaction processing module 209 is configured to implement interaction with other external applications during mode switching, for example, the mode setting / switching can set multiple starting entrances, including but not limited to mode options presented after the mode menu is called out, voice entrances, etc. These starting entrances can interact with the application interaction processing module 209, and different customized management can be performed according to the differences and categories of the starting entrances.

[0118] In some embodiments, the service management module 210 is configured to start the mode application, manage the opening and closing of related services involved in the mode application, and customize specific services in specific scenarios and modes, etc.

[0119] In some embodiments, the replacement management module 211 is configured to replace a certain screen projection according to replacement rules when the number of screen projections exceeds the upper limit of the bearing capacity of the display device, so that the most recently accessed screen projection can be displayed. For example, the display device can support a maximum of three screen projections, at this time, the display device has accessed A screen projection, B screen projection and C screen projection, if D screen projection is received, the replacement management module 211 can make D screen projection replace A screen projection accessed earliest, so that B screen projection, C screen projection and D screen projection are updated. For another example, when the display device receives D screen projection, if the interface focus falls on the window of B screen projection, the replacement management module 211 can make D screen projection replace B screen projection where the focus is located, so as to ensure that the latest screen projection can be accessed and displayed. It should be noted that the replacement rules configured by the replacement management module 211 are not limited to the embodiments of the present application, and the replacement rules can be adapted according to different scenarios and different modes.

[0120] In some embodiments, the broadcast control management module 212 is configured to perform play control on the media content of the screen projection source in different modes, for example, when the focus falls on A screen projection, the broadcast control management module 212 can perform fast forward, fast backward, speed control, pause play, resume play, etc. on A screen projection. It should be noted that the broadcast control management module 212 can perform different broadcast control processing according to the media type of the play content, for example, video content can be processed by fast forward, fast backward, speed control, pause, volume, etc., and text content can be processed by scaling, font adjustment, annotation, marking, etc.

[0121] In some embodiments, the time management module 213 is configured to process time events involved in the running process of different modes. For example, the screen projection window can be configured with some additional content such as controls, icons or prompt information, which will be automatically hidden after a preset time length. Therefore, the time management module 213 can start positive counting or countdown when the additional content starts to be displayed, and when the counting time reaches the preset time length, the View management module 204 is notified by the message processing module 203 to hide or cancel the display of the additional content.

[0122] In some embodiments, for example, when the prompt information a is displayed in the timing mode, the time management module 213 starts a timer (Timer) and controls the timer (Timer) to start counting down from a first threshold time (for example, 5 seconds) to facilitate the user to select whether to disconnect the screen projection during the countdown. When the countdown is zero, the View management module 204 cancels the prompt information a.

[0123] In some embodiments, for example, in the interval mode, if the screen projection source is a VideoURL pushed film source type screen projection (non-live type), the time management module 213 can start a timer (Timer) when the film source starts playing, and control the timer (Timer) to count up to record the played time length of the film source. When the played time length of the film source reaches a first preset time length, the interval mode is started, and the mode application can pause playing the film source (sound and picture synchronization pause playing, and the playing progress is stagnant at the pause node). When the played time length reaches the first preset time length and a second preset time length, which is the duration of the interval mode, the film source continues to play from the pause node (sound and picture synchronization resume playing, and the playing progress continues to change).

[0124] In some embodiments, for example, in the interval mode, if the screen projection source is a VideoURL pushed film source type screen projection (non-live type), the time management module 213 can start a timer (Timer) when the film source starts playing, and control the timer (Timer) to count up to record the played time length of the film source. When the played time length of the film source reaches a first preset time length, the interval mode is started, and the mode application can pause playing the film source (sound and picture synchronization pause playing, and the playing progress is stagnant at the pause node). When the played time length reaches the first preset time length and a second preset time length, which is the duration of the interval mode, the film source continues to play from the pause node (sound and picture synchronization resume playing, and the playing progress continues to change).

[0125] In some embodiments, for example, in the timing mode, the time management module 213 can start a timer (Timer) when the screen projection starts playing, and control the timer (Timer) to start counting up to record the played time length of the screen projection. The time management module 213 can also set the upper limit of the timer (Timer) to a third preset time length. In this way, when the counting time of the timer (Timer) reaches the third preset time length, the View management module 204 displays the prompt information e. Counting up means that the time starts from 0 and increases by one second every second until the upper limit of the timer is reached. The upper limit of the timer is related to the resume time data. Counting down means that the time starts from the threshold time and decreases by one second every second until the counting time of the timer is zero.

[0126] In some embodiments, the time to resume data includes, but is not limited to, at least one of the following parameters: a preset time for a timing mode setting, a first preset time length and a second preset time length for an interval mode setting, and a third preset time length for a timing mode setting.

[0127] In some embodiments, when the time management module 213 controls the timer (Timer) to count (count up or count down), the View management module 204 can also synchronously display the counting information. For example, when the View management module 204 displays the prompt information a or the prompt message e, the counting information is synchronously updated following the timer (Timer), and when the time management module 213 detects that the counting down is zero, the View management module 204 is notified to cancel the display of the counting down information and the prompt information a or the prompt message e.

[0128] In some embodiments, the focus management module 214 is configured to process the focus involved in the running of the mode application, such as controlling the display, hiding and moving of the focus, recording the focus information, etc., wherein the focus information includes, but is not limited to, the focus position, the focus display state, etc., and the focus information can be synchronized to other related modules through the message processing module 203.

[0129] In some embodiments, the focus management module 214 can synchronize the focus information to the position management module 207 through the message processing module 203, so that the position management module 207 decides the position arrangement of the multiple screen projection windows according to the focus information. The focus management module 214 can also synchronize the focus information to the play control management 212 through the message processing module 203, so that the play control management 212 controls the play of the screen projection source with the focus according to the focus information. The focus management module 214 can also synchronize the focus information to the View management module 204 through the message processing module 203, so that the View management module 204 controls the display of the focus, etc.

[0130] In some embodiments, the screen projection source analysis module 215 is configured to analyze the screen projection source Session maintained by the screen projection management module 201 to obtain screen projection source information. The screen projection source information includes, but is not limited to, the screen projection source type and the media asset play type, etc. The screen projection source type includes, but is not limited to, mirror projection (Mirror), video link projection (VideoURL), etc. The media asset play type includes, but is not limited to, two categories, live broadcast (real-time stream) and clip source (non-live broadcast), wherein the clip source includes, but is not limited to, episodes, movies, entertainment, news, cartoons, education, etc.

[0131] In some embodiments, the screen projection source analysis module 215 can obtain the screen projection source type from the Session object of the screen projection source through the screen projection protocol.

[0132] In some embodiments, if the screen projection source type is VideoURL, the screen projection source analysis module 215 can obtain the duration, Seek state, MIME (Multipurpose Internet Mail Extensions), and other information of the media pushed by the screen projection protocol to determine whether the screen projection source pushes live media.

[0133] In some embodiments, if the duration of the media is equal to zero and the media cannot perform Seek action, the screen projection source analysis module 215 determines that the media pushed by the screen projection source is live.

[0134] In some embodiments, if the MIME is configured as “application / x-mpegURL” or “video / MP2T”, etc., the screen projection source analysis module 215 determines that the media pushed by the screen projection source is live.

[0135] In some embodiments, the screen projection source analysis module 215 can obtain the media information of the Session object of the screen projection source through the screen projection protocol, which can include the metadata of the media source. The metadata includes but is not limited to the title, actors, director, release date, style label (such as action, comedy, suspense, etc.), duration, and other information of the media source.

[0136] In some embodiments, the screen projection source analysis module 215 can determine whether the screen projection source is a VideoURL pushed media source type according to the metadata. For example, if the media information indicates a non-live resource such as a movie or an episode, the duration is greater than 0, the screen projection content can perform Seek action, or the MIME is not configured as live, the screen projection source analysis module 215 can determine that the screen projection source type is VideoURL and the media playback type is media source.

[0137] The above describes the function configuration of each module in the mode application. The specific execution procedures of each module in the mode application and the interaction and flow of information data between modules will be described below in combination with specific mode application scenarios to realize the automatic monitoring of the trigger condition of the screen projection mode in the mode application. When the trigger condition of any mode is met, the mode action matched with the screen projection source information is executed. It should be noted that the modules in the mode application can be added, deleted, or replaced according to the function configuration and playback scenario of the screen projection mode.

[0138] In some embodiments, after establishing the screen projection connection with the screen projection device, the screen projection content pushed by the screen projection device to the display device is a piece source type screen projection pushed through a resource address (URL), and the controller can be configured to perform: in response to receiving the screen projection instruction sent by the screen projection device for playing the target piece source, obtaining and playing the target piece source from a server corresponding to the resource address according to the resource address contained in the screen projection instruction; obtaining the continuation time data; obtaining the playing time data in the process of playing the target piece source; if it is determined that the continuation end condition is met based on the playing time data and the continuation time data, performing a target operation; wherein the target operation includes a screen projection disconnection operation or a pause playing operation on the target piece source; if it is determined that the continuation end condition is not met based on the playing time data and the continuation time data, continuing to play the target piece source.

[0139] After the controller executes the scheme of the above-mentioned embodiments, the following beneficial effects can be achieved: when the screen projection device pushes the piece source to the display device, the resource address can be contained in the screen projection instruction, so that the display device can request the data of the target piece source from the server according to the resource address, and then play the target piece source; the display device can obtain the continuation time data, which includes time parameters related to the trigger conditions of different screen projection modes; the display device can also obtain the playing time data, which is related to the relevant time parameters in the process of establishing the screen projection connection and playing the screen projection piece source, so that by comparing the playing time data and the continuation time data, it can be determined whether the continuation end condition of the target piece source is met; if the continuation end condition is met, the screen projection disconnection operation or the pause playing operation of the piece source can be performed based on the settings of different screen projection modes, and otherwise if the continuation end condition is not met, the piece source is continued to be played; in this way, after the piece source is started, the continuation end condition of the piece source is determined by using the playing time data and the continuation time data, so that the controller automatically disconnects the screen projection connection or pauses the playing of the piece source when the continuation end condition is met, avoiding the display device continuously playing the screen projection content, realizing intelligent control of screen projection playing based on the time management mechanism, improving the accuracy of screen projection mode processing, reducing manual mode intervention of the user, and improving the screen projection processing efficiency and the human-computer interaction efficiency.

[0140] In some embodiments, after the display device is powered on, the controller can start the mode application provided in FIG. 3B, and by running the mode application, it can be determined whether the continuation end condition is met according to the playing time data and the continuation time data, so as to decide whether to perform a target operation or continue to play the target piece source.

[0141] In some embodiments, the controller can control the mode application to perform source management of screen projection, and obtain mode information when screen projection is started, which can include resume time data and mode actions. According to the resume time data and the play time data obtained during the playing of the screen projection content, it can be determined whether the trigger condition (or resume end condition) is met. When the resume end condition is met, the mode actions configured according to the mode category are executed to perform corresponding operations. For example, in the timing mode and the timing mode, the operation of disconnecting the screen projection connection can be performed, and in the interval mode, the operation of pausing the playing of the video source can be performed.

[0142] In some embodiments, the above-mentioned mode information can be preset before the start of screen projection, for example, set by the user according to his own viewing needs and preferences. That is, in this scenario, the mode management module 205 can directly read the mode information preset and stored in the local computer in advance.

[0143] In some embodiments, when the screen projection is started, the View management module 204 can display a related mode setting page, and the user can set the mode information based on the mode setting page. That is, in this scenario, the mode information is obtained by the mode management module 205 in real time according to the user's setting operation based on the mode setting page when the screen projection is started.

[0144] In some embodiments, after the mode application is started and runs, the service management module 210 can perform initialization tasks, which include but are not limited to: the service management module 210 starts the screen projection service to listen to the screen projection request (connection) and / or the exit screen projection request (disconnection) initiated by other electronic devices, controls the View management module 204 to initialize the configuration of the View displayed by the application layer, and controls the data management module 202 to create some preparation data.

[0145] In some embodiments, after the initialization task is completed, the mode application can control the screen projection management module 201 to register the listening logic of UsessionConnectionListener, UsessionPrepareListener, USessionDisplayListener and UsessionEventListener. Wherein, Session represents a session between a client and a server, and can record client information (also known as: device information), for example, configured as {id=,type=,protocol=,…}, wherein id represents the device id of the client for identifying the client, type represents the type of the client, and protocol represents the screen projection protocol used by the client.

[0146] In some embodiments, the UsessionConnectionListener is used to monitor changes in the client's connection status within the Session, including connected and disconnected (or disconnected) states. The UsessionPrepareListener is used for preparation work related to screen mirroring interaction with the client. The UsessionDisplayListener is used to monitor changes in interface playback information, including but not limited to playback content information and playback status. The UsessionEventListener is used to monitor client control events. Thus, the screen mirroring management module 201 can monitor relevant information about the screen mirroring signal source (hereinafter referred to as: screen mirroring signal source information) through the screen mirroring service. This information includes, but is not limited to, device information and connection status of the screen mirroring device.

[0147] In some embodiments, the screen projection management module 201 can send screen projection signal source information to the message processing module 203, which then forwards the information to the data management module 202. The data management module 202 can create and store a screen projection device list based on the screen projection signal source information. This list includes relevant information about electronic devices that have established a screen projection connection with the display device 200 (hereinafter referred to as: screen projection devices). An embodiment of this application provides an exemplary underlying structure for a screen projection device list as follows:

[0148] [{mInputName = Screen mirroring device 1,

[0149] mIsConnected = true,

[0150] mInputSourceId =,

[0151] mVisible = true,

[0152] mSourceType =,

[0153] mSession=SessionBase{id=Client 1, type=, protocol=}…}]

[0154] mInputName is a device name set by the data management module 202 for the screen projection device, for example, screen projection device 1, and the numerical suffix of the screen projection device does not exceed the real-time number of screen projection paths of the display device. mIsConnected represents the connection state of the screen projection device, mIsConnected=true represents the connected state, and mIsConnected=false represents the unconnected state or disconnected state. If the screen projection device 1 is disconnected, the information of the screen projection device 1 can be deleted from the screen projection device list, or the mIsConnected state value corresponding to the screen projection device 1 can be changed to false. mInputSourceId is used to indicate the signal source ID of the screen projection device. mSourceType is used to indicate the signal source type; mVisible=true is used to indicate the display state of the signal source, and if mVisible=true, it means that the screen projection content pushed by the screen projection device is in a visible state, and if mVisible=false, it means that the screen projection content is in an invisible state or hidden state. mSession=SessionBase{id=Client 1,type=,protocol=}…} is used to record the device information of the screen projection device, for example, the id of the screen projection device 1 is Client 1. The display device can have an upper limit of screen projection capability, for example, a maximum of K screen projection paths are supported, and then the screen projection device list can include a maximum of K pieces of information of screen projection devices with mIsConnected=true.

[0155] In some embodiments, when the screen projection service receives the screen projection request sent by the first screen projection device (Client 1), the screen projection management module 201 obtains the device information of the screen projection device contained in the screen projection request (hereinafter referred to as: first screen projection device information), and the structure of the first screen projection device information is, for example, {id=, type=, protocol=, …}. The first screen projection device information is synchronized to the data management module 202 through the message processing module 203, so that the data management module 202 manages the first screen projection device information. One example structure of the screen projection request is {"cmd":"REQUEST","data":"{\"info\":{\"id\":\"\",\"name\":\"\"},\"version\":,\"type\":}"}.

[0156] In some embodiments, if the user agrees to the casting request of the first casting device, or the number of casting paths does not reach the upper limit of the casting capability of the display device (up to K casting paths, K is a positive integer greater than 1), indicating that the display device can receive the casting path, the casting service can send an agreement casting message to the first casting device through the casting protocol layer. An exemplary structure of the agreement casting message is {"cmd":"ACK","data":"{\"version\":,\"ack\":,\"status\":\"\",\"reason\":\"\",\"type\":0}"}.

[0157] In this way, when the first casting device receives the agreement casting message, it can perform tasks related to preparing casting, such as establishing a casting connection with the display device, and then starting screen recording. After the screen recording is ready, the first casting device can send a casting ready message to the casting service through the casting protocol layer. An exemplary structure of the casting ready message can be configured as {"cmd":"REQUEST_DATA_OK","data":"{\"info\":{\"id\":\"\",\"name\":\"\"},\"version\":,\"type\":}"}.

[0158] In some embodiments, when the casting service receives the casting ready message, it can feed back an ACK message to the first casting device, so that the first casting device pushes the casting data of the second content to the display device when it receives the ACK message. An exemplary structure of the ACK message is {"cmd":"DATA_ACK","data":"{\"version\":,\"ack\":,\"status\":\"\",\"type\":0}"}.

[0159] In some embodiments, when the casting service receives the casting ready message, the casting management module 201 sends the first casting device information to the data management module 202 through the message processing module 203; the data management module 202 can insert the first casting device information into the casting device list, and set the device name (such as casting device 1), connection state value (mIsConnected) and visibility state value (mVisible) of the first casting device, etc.

[0160] According to the above processing flow, the mode application can listen to more electronic device screen projection requests, and complete screen projection connection and reception, until the number of screen projection reaches the upper limit K of the display device screen projection capability. If the K+1 screen projection is received again, the replacement management module 211 can select the first screen projection (hereinafter referred to as Z screen projection) as the replacement object, and notify the screen projection management module 201 to disconnect the connection of the Z screen projection through the message processing module 203. In this way, the number of screen projection is reduced by one and is less than K value. The screen projection management module 201 can access the newly received K+1 screen projection.

[0161] In some embodiments, the first screen projection device receives the ACK message, and can push the screen projection data and Session information to the display device. The Session information includes configuration information related to the screen projection data pushed by the first screen projection device. If the screen projection source type is VideoURL, the exemplary structure of the Session information includes but is not limited to:

[0162] {Session: SessionClient1,

[0163] View: SurfaceView / TextureView,

[0164] / / VideoURL video,

[0165] type: VideoURL,

[0166] metadata:…,

[0167] duration: 45min,

[0168] Ratio: 16:9,

[0169] …}

[0170] Among them, SessionClient1 is used to indicate that the ID of the first screen projection device associated with the Session (session) is Client1.

[0171] View: SurfaceView / TextureView indicates that the screen projection content pushed by Client1 is displayed on the SurfaceView / TextureView of the display device.

[0172] type: VideoURL indicates that the screen mirroring source pushed by Client 1 is a video link screen mirroring (VideoURL). The metadata is the metadata of the video source, including the title, actors, directors, release date, style tags (such as action, comedy, suspense, etc.) and other information of the video source. The duration indicates the duration of the video source, that is, the total length of the video source. The ratio is the width-to-height ratio of the screen mirroring content pushed by Client 1, that is, the ratio of the width to the height.

[0173] In some embodiments, after the screen mirroring service receives the screen mirroring data and the Session information, the screen mirroring management module 201 can forward the Session information to the data management module 202 through the message processing module 203, so that the data management module 202 stores the Session information, and forward the screen mirroring data to the screen mirroring source analysis module 215 through the message processing module 203, so that the screen mirroring source analysis module 215 obtains the screen mirroring source information according to the Session information of the screen mirroring device.

[0174] In some embodiments, the screen mirroring source analysis module 215 can read the type attribute value configured in the Session information. If the type is mirror, the screen mirroring source information indicates that the screen mirroring source is a mirror screen mirroring.

[0175] In some embodiments, the screen mirroring source analysis module 215 can read the type attribute value configured in the Session information. If the type is VideoURL, the screen mirroring source analysis module 215 further queries the metadata, duration, Seek state, etc. of the video source to determine whether the screen mirroring content is a live type or a video source type, so as to give more accurate screen mirroring source information.

[0176] In some embodiments, if the metadata indicates that the screen mirroring content is a movie, a series, etc., the duration is greater than 0 (for example, 45 min), and the Seek action can be performed, the screen mirroring source analysis module 215 gives the screen mirroring source information to indicate that the screen mirroring source pushes a video source (non-live) type screen mirroring through a video link (also known as a resource address).

[0177] In some embodiments, the screen projection source analysis module 215 can forward the screen projection source information to the mode management module 205 through the message processing module 203. The mode management module 205 acquires the play time data in the screen projection play process according to the mode information of at least one screen projection mode obtained, and determines whether the continuation play end condition is met through the play time data and the continuation play time data contained in the mode information. Determining whether the continuation play end condition is met is actually determining whether the trigger condition of a certain screen projection mode is met. When the trigger condition of any first screen projection mode is met, the matching target mode action (also referred to as target operation) to be executed can be determined according to the screen projection source information and the mode type, and the mode application executes the target mode action and controls the display and refresh of the user interface through the flow between other modules.

[0178] In some embodiments, the play time data includes but is not limited to at least one of the following parameters: system time of the display device, played time length of the piece source, etc.

[0179] In some embodiments, the algorithm processing module 208 can obtain the Session information of the first screen projection device (Client1) from the data management module 202, and obtain the width-height ratio Ratio of the screen projection content from the Session information.

[0180] In some embodiments, the algorithm processing module 208 can calculate the layout data according to the screen resolution (such as 1920*1080) and the Ratio and the like, and the layout data includes the size (width Width1*height Height1) and the display position (x1, y1) of the SurfaceView / TextureView, and the SurfaceView / TextureView is used to display the screen projection content pushed by the Client1. An example of the data structure of the layout data generated by the algorithm processing module 208 is as follows:

[0181] {Session:SessionClient1,

[0182] View:SurfaceView / TextureView,

[0183] Position:(x1,y1),

[0184] width:Width1,

[0185] height:Height1,

[0186] …}

[0187] In some embodiments, the algorithm processing module 208 can send the layout data to the data processing module 202 and the View management module 204 respectively through the message processing module 203, so that the data processing module 202 sorts and registers the layout data, and the View management module 204 displays the screen projection content according to the layout data on the SurfaceView / TextureView.

[0188] In some embodiments, after receiving the layout data, the View management module 204 can set the display data information through the LayoutParams interface, and the display data information includes data that can be recognized and set by the display according to the layout data. An example of the data structure of the display data information is as follows:

[0189] In this way, the View management module 204 sets the size and display position of the SurfaceView / TextureView according to the display data information, and loads the screen projection data pushed by the Client1 into the SurfaceView / TextureView, thereby completing the display of the screen projection content.

[0190] FIG. 4A is a schematic diagram of a timing mode setting method provided by some embodiments of the present application. The user can open a screen projection mode setting page through a system setting, a mode application or other access entry to predefine the mode information. Alternatively, the View management module 204 can display the screen projection mode setting page when the screen projection starts to play, so that the mode management module 205 obtains the mode information in real time.

[0191] In some embodiments, referring to subgraph (a) of FIG. 4A, the screen projection mode setting page 40 includes a plurality of blocks corresponding to N screen projection modes (referred to as screen projection mode blocks for short). For example, the screen projection mode blocks include a timing mode block 41, an interval mode block 42 and a timing mode block 43. The timing mode block 41 is used to set and manage the timing mode, the interval mode block 42 is used to set and manage the interval mode, and the timing mode block 43 is used to set and manage the timing mode.

[0192] In some embodiments, referring to subgraph (a) of FIG. 4A, each screen projection mode block includes an add button (represented as "+" in the example of FIG. 4).

[0193] When the user clicks the add button of the timing mode block 41, referring to subgraph (b) of FIG. 4A, the display displays a timing mode setting page, and the timing mode setting page includes a first mode name setting control 41a. The first mode name setting control 41a is used for the user to input the name of the timing mode, for example, "Timing Mode A".

[0194] In some embodiments, referring to subfigure (b) of FIG. 4A, the timing mode setting page further includes a first trigger condition setting control 41b. The timing mode can be configured to perform a corresponding mode action when the system time of the display device reaches a fixed preset time T y . The first trigger condition setting control 41b is used to enable the user to set the preset time T y , for example, to 21:30. In this way, the time to continue playing data can include the preset time T y .

[0195] In some embodiments, referring to subfigure (b) of FIG. 4A, the timing mode setting page further includes a first mode action setting control 41c. The timing mode can be configured to perform a corresponding mode action when the system time of the display device reaches a preset time T y . The first mode action setting control 41c is used to enable the user to set the mode action of the timing mode, for example, to “disconnect screen projection” or “shutdown” and the like.

[0196] In some embodiments, referring to subfigure (b) of FIG. 4A, the timing mode setting page further includes a first cancel button 41d and a first save button 41e. The first cancel button 41d is used to cancel the setting of the timing mode, and when the first cancel button 41d is triggered, the display closes the timing mode setting page. The first save button 41e is used to save the timing mode, and when the first save button 41e is triggered, the mode application can save the obtained timing mode information to the mode management module 205. An example of the timing mode information is {mode name: timing mode A, trigger condition: preset time T y = 21:30, mode action: disconnect screen projection}.

[0197] FIG. 4B is a schematic diagram of an interval mode setting method provided by some embodiments of the present application. Referring to subfigure (a) of FIG. 4B, the controller responds to the operation of the user triggering the add button of the interval mode block 42, and referring to subfigure (b) of FIG. 4B, the controller controls the display to display an interval mode setting page. The interval mode setting page includes a second mode name setting control 42a. The second mode name setting control 42a is used to enable the user to input the name of the interval mode, for example, “interval mode A”.

[0198] In some embodiments, referring to subgraph (b) of FIG. 4B, the interval mode setting page further includes a second trigger condition setting control 42b. The interval mode is used to make the user watch the screen projection every interval of a first preset time t1, and rest for a second preset time t2, so as to achieve the purpose of interval rest, and avoid problems such as user eye fatigue and lack of concentration. The second trigger condition setting control 42b is used to make the user set the first preset time t1 and the second preset time t2, for example, the first preset time t1 is 60 min, and the second preset time t2 is 10 min. In this way, the resume time data can include the first preset time t1 and the second preset time t2.

[0199] In some embodiments, referring to subgraph (b) of FIG. 4B, the timing mode setting page further includes a second mode action setting control 42c. The second mode action setting control 42c is used to make the user set the mode action of the interval mode (that is, set the working state of the screen projection during the interval rest), for example, set to “pause screen projection”.

[0200] In some embodiments, referring to subgraph (b) of FIG. 4B, the timing mode setting page further includes a second cancel button 42d and a second save button 42e. The second cancel button 42d is used to cancel the setting of the interval mode, and the display closes the interval mode setting page when the second cancel button 42d is triggered. The second save button 42e is used to save the interval mode, and the mode application can save the obtained interval mode information to the mode management module 205 when the second save button 42e is triggered. An example of the interval mode information is {mode name: interval mode A; trigger condition: t1=60min, t2=10min; mode action: pause screen projection}.

[0201] FIG. 4C is a schematic diagram of a timing mode setting method provided by some embodiments of the present application. Referring to subgraph (a) of FIG. 4C, the controller responds to the operation of the user triggering the add button of the timing mode block 43, and referring to subgraph (b) of FIG. 4C, the display displays a timing mode setting page. The interval mode setting page includes a third mode name setting control 43a. The third mode name setting control 43a is used to make the user input the name of the timing mode, for example, “timing mode A”.

[0202] In some embodiments, referring to subgraph (b) of FIG. 4C, the timing mode setting page further includes a third trigger condition setting control 43b. The timing mode can be configured to start timing from the start of the screen projection, and the timing duration represents the cumulative play time (referred to as the played duration) of the screen projection content. When the timing duration reaches a third preset time t3, the corresponding mode action is executed. The third trigger condition setting control 43b is used to make the user set the third preset time t3, for example, the third preset time t3 is 2h. In this way, the resume time data can include the third preset time t3.

[0203] In some embodiments, referring to subfigure (b) of FIG. 4C, the timing mode setting page further includes a third mode action setting control 43c. The third mode action setting control 43c is used to enable the user to set the mode action of the timing mode, for example, set to “turn off screen projection”.

[0204] In some embodiments, referring to subfigure (b) of FIG. 4C, the timing mode setting page further includes a third cancel button 43d and a third save button 43e. The third cancel button 43d is used to cancel the setting of the timing mode, and when the third cancel button 43d is triggered, the display closes the timing mode setting page. The third save button 43e is used to save the timing mode, and when the third save button 43e is triggered, the mode application can save the obtained timing mode information to the mode management module 205. An example of the timing mode information is {mode name: timing mode A, trigger condition: t3=2h, mode action: turn off screen projection}.

[0205] As can be seen from FIGS. 4A-4C, the user can add the required type of screen projection mode by clicking the add button of any screen projection mode block, and set the mode information of the screen projection mode. The mode information can include at least one of the timing mode information, the interval mode information, and the timing mode information.

[0206] FIG. 4D is a schematic diagram of a screen projection mode setting page provided by some embodiments of the present application. As shown in FIG. 4D, after the user has added a certain screen projection mode, the mode information corresponding to the screen projection mode is displayed in the associated screen projection mode block. Based on the examples of FIGS. 4A-4C, the timing mode information corresponding to the timing mode A is displayed in the timing mode block 41, the interval mode information corresponding to the interval mode A is displayed in the interval mode block 42, and the timing mode information corresponding to the timing mode A is displayed in the timing mode block 43.

[0207] In some embodiments, as shown in FIG. 4D, each block can further configure an associated switch button, an edit button, and a delete button, etc. for the added mode information. The switch button is used to turn on or off the mode, the edit button is used to edit and modify the mode information, and the delete button is used to delete the mode.

[0208] In this way, the mode management module 205 can store the mode information pre-set by the user through the screen projection mode setting page 40, or obtain and store the mode information based on the setting operation of the user on the screen projection mode setting page 40 at the start of the screen projection, and control and manage the display device according to the mode information. The mode information includes at least one trigger condition and mode action of the screen projection mode. For example, the trigger condition of the timing mode A is'system time reaches 21:30', and the mode action performed is 'disconnect the screen projection'; the trigger condition of the interval mode A is 'viewing time interval of 1h', and the mode action performed is 'pause the screen projection for 10min (i.e., 10min break)'; the trigger condition of the timing mode A is 'cumulative viewing time reaches 2h', and the mode action performed is 'disconnect the screen projection'.

[0209] For the timing mode described above, the play time data includes the system time of the display device, and the resume time data includes the preset time. In this way, the controller can be configured to determine that the resume end condition is met if the system time reaches the preset time, stop playing the target video source, and disconnect the screen projection connection with the screen projection device. The technical solution provided in this embodiment has the following beneficial effects: a scheme based on the first time management mechanism for determining the resume end condition and controlling the screen projection is provided (i.e., the timing mode). When the system time reaches the fixed preset time, it is determined that the resume end condition is met, and then the controller disconnects the screen projection connection, so that the target video source stops playing. In this way, the screen projection device is prevented from continuing to push the screen projection content to the display device based on the screen projection connection when the preset time is reached, and the display device is also prevented from continuing to play the screen projection content after the preset time, so that the user's rest is not affected by the late play time of the screen projection content.

[0210] FIG. 5A is a schematic diagram of the change of the user interface when the trigger condition of the timing mode is met according to some embodiments of the present application.

[0211] After the controller runs the mode application, the timing mode can be processed in the following manner, and the resume end condition of the target video source is determined to decide whether to disconnect the screen projection connection. As shown in subgraph (a) of FIG. 5A, it is assumed that the display device plays the screen projection content 1 pushed by the screen projection device 1 in full screen, and the mode application can control the screen projection source analysis module 215 to analyze the Session information of the screen projection device 1 to obtain the screen projection source information, and forward the screen projection source information to the mode management module 205 through the message processing module 203, so that the mode management module 205 stores the screen projection source information corresponding to the screen projection content 1. In the example of FIG. 5A, the screen projection source type is VideoURL, and the media content play type is a video source type media content (hereinafter referred to as: target video source).

[0212] In some embodiments, the mode management module 205 can acquire the time-to-continue data according to the mode information, acquire the play time data during the playing of the target video source, determine whether the time-to-continue end condition is met by comparing the time-to-continue data and the play time data, and determine whether the triggering condition of a certain screen projection mode is met. If the mode management module 205 detects that the current system time reaches the preset time T y , the timing mode is triggered, and the timing mode can be associated with a mode action A, which is to disconnect the screen projection connection. In this way, the mode management module 205 can send a screen projection disconnection message to the screen projection management module 201 through the message processing module 203; and the screen projection management module 201 responds to the screen projection disconnection message by disconnecting the communication connection (referred to as: screen projection connection) between the display device and the screen projection device 1 through the screen projection service.

[0213] In some embodiments, the controller stops playing the target video source and disconnects the screen projection connection with the screen projection device when the system time reaches the preset time. Specifically, when the system time reaches the preset time, the controller controls the display to display first prompt information, the first prompt information being used to prompt the user whether to agree to disconnect the screen projection connection; if an operation of the user agreeing to disconnect the screen projection connection is received, the controller stops playing the target video source and disconnects the screen projection connection with the screen projection device; and if an operation of the user refusing to disconnect the screen projection connection is received, the controller continues to play the target video source. The technical solution provided in this embodiment has the following beneficial effects: for the timing mode, when the system time reaches the fixed preset time, the user can be asked whether to agree to disconnect the screen projection connection through the prompt information, and thus, on the basis of the time condition of the timing mode, the factor of the user's viewing demand is added to decide whether to disconnect the screen projection connection, the screen projection connection is disconnected if the user agrees, and the target video source is continued to be played if the user refuses, so as to meet the user's viewing demand and preference.

[0214] When the mode management module 205 switches to the timing mode A, the View management module 204 can display a prompt page, as shown in subgraph (b) of FIG. 5A, the prompt page being used to prompt that the preset time of the timing mode A has been reached, and ask the user whether to disconnect the screen projection connection. If the user inputs a click operation on the agree button, the mode management module 205 can send a screen projection disconnection message to the screen projection management module 201 through the message processing module 203, and the screen projection management module 201 responds to the screen projection disconnection message by disconnecting the screen projection connection with the screen projection device 1 through the screen projection service. If the user inputs a click operation on the refuse button, the target video source is continued to be played without disconnecting the screen projection connection. In this way, when the system time reaches the preset time of the timing mode, the user's viewing demand can be considered to decide whether to disconnect the screen projection connection.

[0215] In some embodiments, the timing mode is used to disconnect the screen projection connection when the system time reaches the fixed preset time T ydisconnect the screen projection to avoid exceeding the preset time T y The post user still watches the screen projection content without restraint, which can be applied to scenarios such as night reminders. However, for the screen projection of the VideoURL pushed film source (non-live), when the preset time T y is reached, the screen projection film source may not have ended (i.e., the played duration of the film source is less than the total duration duration), at which time if the screen projection is directly disconnected, the user will miss the screen projection content after the preset time T y , and will not be able to watch the complete film source.

[0216] In some embodiments, the controller is specifically configured to: when the system time reaches the preset time, determine the remaining playing duration of the target film source according to the playing progress of the target film source and the total duration of the target film source; if the remaining playing duration is greater than a preset threshold, stop playing the target film source and disconnect the screen projection connection with the screen projection device. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches the fixed preset time, the film source may not have ended, so the film source has a time parameter of the remaining playing duration, the remaining playing duration is calculated through the playing progress and the total duration of the film source, and the length of the remaining playing duration is measured through the preset threshold, so that the controller decides whether to disconnect the screen projection connection when the system time reaches the fixed preset time; if the remaining playing duration is large, if the screen projection connection is not disconnected, the display device will continuously play the screen projection content pushed by the screen projection device, which may affect the user's plan for timing rest, so in this scenario, the controller can disconnect the screen projection connection and stop playing the film source, so that the user cannot continue to watch the film source content.

[0217] In some embodiments, the controller is specifically configured to: when the remaining playing duration is greater than the preset threshold, control the display to display the remaining playing duration and first prompt information, the first prompt information being used to prompt the user whether to agree to disconnect the screen projection connection; if an operation of the user agreeing to disconnect the screen projection connection is received, stop playing the target film source and disconnect the screen projection connection with the screen projection device; if an operation of the user refusing to disconnect the screen projection connection is received, continue playing the target film source. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches the fixed preset time, the remaining playing duration of the film source is taken as a playing time parameter, if the remaining playing duration is large, if the screen projection connection is not disconnected, the display device will continuously play the screen projection content pushed by the screen projection device, which will affect the user's plan for timing rest, so the controller can control the display to display the prompt information to inform the user of the remaining playing duration of the film source and ask the user whether to disconnect the screen projection connection, so that the user can refer to the remaining playing duration and the user's viewing demand to decide whether to perform an immediate disconnection operation or a delayed disconnection operation. The delayed disconnection operation refers to disconnecting the screen projection connection when the target film source ends.

[0218] In some embodiments, the controller is further configured to continue playing the target video source if the remaining playing duration is not greater than the preset threshold, and disconnect the screen projection connection with the screen projection device when the playing of the target video source ends. The technical solution provided by this embodiment has the following beneficial effects: if the screen projection connection is not disconnected when the system time reaches the fixed preset time, the display device will continue to play the video source until the playing of the video source ends. Therefore, if the remaining playing duration of the video source is relatively short when the preset time is reached, the influence on the user's rest may be relatively small, the screen projection connection can be disconnected when the playing of the video source ends, the integrity of the user's watching of the video source is ensured, the screen projection device is prevented from continuing to push the screen projection content to the display device based on the screen projection connection after the preset time is reached, and the display device is prevented from continuing to play the screen projection content after the preset time is exceeded.

[0219] In some embodiments, the controller is configured to control the display to display the remaining playing duration and second prompt information if the remaining playing duration is not greater than the preset threshold, the second prompt information is used to prompt the user whether to agree to delay the disconnection of the screen projection connection until the playing of the target video source ends, continue playing the target video source if an operation of the user agreeing to delay the disconnection of the screen projection connection is received, and stop playing the target video source and disconnect the screen projection connection with the screen projection device if an operation of the user refusing to delay the disconnection of the screen projection connection is received. The technical solution provided by this embodiment has the following beneficial effects: if the remaining playing duration is relatively short when the system time reaches the fixed preset time, the controller can control the display to display prompt information to inform the user of the remaining playing duration of the video source and ask the user whether to agree to delay the disconnection of the screen projection connection until the playing of the video source ends. In this way, the user can refer to the remaining playing duration and the viewing demand to decide whether to immediately disconnect the screen projection or delay the disconnection of the screen projection.

[0220] In some embodiments, after the controller runs the mode application, the mode application can also control the screen projection playing according to the remaining playing duration of the video source after the trigger timing mode is implemented through the following embodiments. The mode management module 205 can obtain the total duration duration of the target video source through the metadata of the target video source when it is detected that the system time reaches the preset time T y , and query the current playing progress of the target video source pushed by the VideoURL by calling the getposition() interface of the VideoURL, and calculate the remaining playing duration restDuration of the target video source according to the duration and the playing progress of the target video source, so that restDuration = duration-T now . Wherein, the duration is the total duration of the target video source, representing the total playing duration (total duration for short) of the target video source; T nowIn relation to the progress of the video source playback, the played duration represents the current played duration of the target video source; the restDuration represents the duration of the unplayed content of the video source. For example, the total duration of the video source is 45 minutes, and the current played duration is 40 minutes, and then the remaining 5 minutes of content is unplayed.

[0221] In some embodiments, in order to measure the length of the restDuration, the mode management module 205 can set at least one preset threshold. If the preset threshold is one, and the restDuration≤ the preset threshold, it indicates that the remaining playback duration of the target video source is short, and then the delayed disconnection of the screen projection operation can be preferentially performed, that is, the screen projection connection is disconnected at the end of the playback of the target video source, so as to ensure the integrity of the video source playback and avoid missing the subsequent wonderful content of the user in the case of not affecting the user's rest as much as possible. If the restDuration> the preset threshold, it indicates that the remaining playback duration of the target video source is long, and the user's rest is affected to a large extent, and then the immediate disconnection of the screen projection operation is preferentially performed.

[0222] In some embodiments, if the preset threshold is multiple, for example, a first threshold and a second threshold are set, and the second threshold is greater than the first threshold, then the restDuration can be analyzed in a more fine range. For example, if the restDuration≤ the first threshold, it indicates that the remaining playback duration of the target video source is short, and then the delayed disconnection of the screen projection operation can be preferentially performed, that is, the screen projection connection is disconnected at the end of the playback of the target video source. If the first threshold< the restDuration≤ the second threshold, it indicates that the remaining playback duration of the target video source is moderate, and then the user is asked whether to disconnect the screen projection connection immediately or to disconnect the screen projection connection with delay. If the restDuration> the second threshold, it indicates that the remaining playback duration of the target video source is long, and then the immediate disconnection of the screen projection operation is preferentially performed. The values of the first threshold and the second threshold are not limited, for example, the first threshold is set to 5 minutes, and the second threshold is set to 30 minutes.

[0223] In some embodiments, taking the implementation of the double preset threshold as an example, if the restDuration is not greater than the first threshold, it indicates that the time left of the video source is short, and the influence of the short time on the user's rest can be ignored, and then the mode management module 205 can set the priority of the mode action as: the delayed disconnection of the screen projection operation is prior to the immediate disconnection of the screen projection operation. In this way, the mode management module 205 can execute the mode action B1, which is configured to: send a first prompt instruction to the View management module 204 through the message processing module 203, and disconnect the screen projection connection at the end of the playback of the target video source (mode action A), that is, the operation of disconnecting the screen projection connection is delayed for a time length of the restDuration.

[0224] FIG. 5B is a schematic view of a change of the user interface when the trigger condition of the timing mode is met, according to some embodiments of the present application. As shown in subfigure (b) of FIG. 5B, if the restDuration of the target video source is not greater than the first threshold, the View management module 204 displays a prompt information 51 on the screen mirroring playing interface in response to the first prompt instruction, and the prompt information 51 is used to prompt the restDuration of the target video source and prompt that the screen mirroring will be automatically disconnected after the playing of the target video source ends. An example of the prompt content of the prompt information 51 in FIG. 5B is "The preset time of the timing mode A has been reached, and there are 3 minutes left. The screen mirroring will be automatically disconnected after the playing of the current video source ends".

[0225] In some embodiments, when the playing of the target video source ends, i.e., the restDuration is cleared, the mode management module 205 performs the mode action A: sends a screen mirroring disconnection instruction to the screen mirroring management module 201 through the message processing module 203, so that the screen mirroring management module 201 calls the finish() interface of the Session object corresponding to the screen mirroring device 1 in response to the screen mirroring disconnection instruction, and the screen mirroring service sends a screen mirroring disconnection request to the screen mirroring device 1 through the protocol. The screen mirroring device 1 disconnects the screen mirroring connection with the display device in response to the screen mirroring disconnection request, and feeds back a disconnection message to the display device. Thus, the screen mirroring management module 201 receives the disconnection message, can release the resources (such as the player) occupied by the screen mirroring, and notifies the View management module 204 to cancel the display of the video source content pushed by the screen mirroring device 1 on the SurfaceView / TextureView through the message processing module 203, so as to stop playing the target video source.

[0226] In some embodiments, if the restDuration is not greater than the first threshold, the mode management module 205 can set the priority of the mode action as: the delayed screen mirroring disconnection operation is prior to the immediate screen mirroring disconnection operation. Thus, the mode management module 205 can also perform the mode action B2, which is configured to send a second prompt instruction to the View management module 204 through the message processing module 203.

[0227] FIG. 5C is a schematic view of a change of the user interface when the trigger condition of the timing mode is met, according to some embodiments of the present application. As shown in subfigure (b) of FIG. 5C, if the restDuration of the target video source is not greater than the first threshold, the View management module 204 can display a prompt pop-up window 52 on the screen mirroring playing interface in response to the second prompt instruction, and the prompt pop-up window 52 is used to prompt the restDuration of the target video source and inquire whether to delay the disconnection of the screen mirroring connection until the playing of the target video source ends. The prompt pop-up window 52 further includes a first agree button 52a and a first refuse button 52b.

[0228] In some embodiments, referring to subgraph (b) of FIG. 5C, if the user inputs a click operation on the first agree button 52a, the View management module 204 can send an agree delay disconnection casting message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the agree delay disconnection casting message, and executes mode action A to disconnect the casting connection with the casting device 1 when the restDuration is zero (i.e., the target video source playback ends).

[0229] In some embodiments, referring to subgraph (b) of FIG. 5C, if the user inputs a click operation on the first refuse button 52b, the View management module 204 can send a refuse delay disconnection casting message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the refuse delay disconnection casting message, and executes mode action A to disconnect the casting connection with the casting device 1.

[0230] In some embodiments, if the restDuration is greater than the first threshold value and not greater than the second threshold value, it indicates that the remaining time of the video source is not very short but also not long (moderate), so the timing mode can add an associated mode action C1, which is to prompt the restDuration of the video source at the node at the preset time T y and ask the user whether to agree to disconnect the casting, to decide whether to execute immediate disconnection of the casting connection.

[0231] In some embodiments, when the system time reaches the preset time T y , if the restDuration is greater than the first threshold value and not greater than the second threshold value, the mode management module 205 executes mode action C1 after triggering the timing mode, and mode action C1 is configured to send a first inquiry instruction to the View management module 204 through the message processing module 203, so that the View management module 204 displays first inquiry content in response to the first inquiry instruction, to inquire whether to disconnect the casting after triggering the timing mode. The first inquiry content can be in the form of a pop-up window, a prompt message, etc., presented to the user for browsing.

[0232] FIG. 6 is a schematic diagram of the change of the user interface when the triggering condition of the timing mode is met, according to some embodiments of the present application. As shown in subgraph (b) of FIG. 6, the View management module 204 can display an inquiry pop-up window 60 through the display in response to the first inquiry instruction, which is used to prompt the preset time of the timing mode and the restDuration (e.g., 17 minutes) of the target video source, and inquire whether to agree to disconnect the casting. The inquiry pop-up window 60 includes a second agree button 61 and a second refuse button 62.

[0233] In some embodiments, when the View management module 204 starts to display the inquiry pop-up window 60, the time management module 213 can control the timer Timerl to start counting up and determine whether the counting time of the Timerl reaches a first threshold time (e.g., 5 seconds). If the counting time of the Timerl reaches the first threshold time, the time management module 213 can send a first counting reaching message to the View management module 204 through the message processing module 203, and after the sending of the first counting reaching message is successful, control the Timerl to stop counting and clear the counting time.

[0234] In some embodiments, if the user agrees to disconnect the screen projection in the timing mode, the second agreement button 61 can be clicked within the first threshold time. The View management module 204 responds to the operation of the user clicking the second agreement button 61 and does not receive the first counting reaching message, closes the inquiry pop-up window 60, sends an agreement to disconnect the screen projection message to the mode management module 205 through the message processing module 203, and sends a stop counting message to the time management module 213 through the message processing module 203. The time management module 213 receives the stop counting message, controls the Timerl to stop counting, and clears the counting time.

[0235] In some embodiments, the mode management module 205 receives the agreement to disconnect the screen projection message and performs mode action A: sends a disconnect screen projection instruction to the screen projection management module 201 through the message processing module 203, so that the screen projection management module 201 responds to the disconnect screen projection instruction, calls the finish() interface of the Session object corresponding to the screen projection device 1, and sends a disconnect screen projection request to the screen projection device 1 through the protocol by the screen projection service. The screen projection device 1 responds to the disconnect screen projection request, disconnects the screen projection connection with the display device, and feeds back a disconnected message to the display device, so that the screen projection management module 201 receives the disconnected message, releases the related resources (such as the player, etc.) occupied by the screen projection, and notifies the View management module 204 to cancel the display of the target film source content pushed by the Video URL through the SurfaceView / TextureView, so as to stop playing the target film source.

[0236] In some embodiments, the execution sequence of the stop playing the target film source operation and the disconnect screen projection connection operation is not limited, and the two operations can be executed synchronously, or the target film source can be stopped playing first and then the screen projection connection is disconnected, or the screen projection connection can be disconnected first and then the target film source is stopped playing.

[0237] In some embodiments, if the user wants to continue to watch the screen projection content and refuses to disconnect the screen projection immediately in the timing mode, the second refusal button 62 can be clicked within the first threshold time. The View management module 204 responds to the operation of the user clicking the second refusal button 62 and does not receive the first timing reaching message, closes the inquiry pop-up window 60, sends a refusal to disconnect the screen projection message to the mode management module 205 through the message processing module 203, and sends a stop timing message to the time management module 213 through the message processing module 203. The mode management module 205 receives the refusal to disconnect the screen projection message and temporarily does not perform the operation of disconnecting the screen projection connection, and continues to monitor the restDuration of the current clip source. When the restDuration is detected to change to be not greater than the first threshold, the mode action B1 or the mode action B2 can be performed. The time management module 213 receives the stop timing message, controls the Timer 1 to stop timing, and clears the timing time.

[0238] In some embodiments, if the user does not click the second agreement button 61 and does not click the second refusal button 62 within the first threshold time, that is, a timeout non-response event occurs. The View management module 204 closes the inquiry pop-up window 60 when receiving the first timing reaching message sent by the time management module 213, and does not receive the operation of the user clicking the second agreement button 61 or the second refusal button 62, and sends a timeout non-response message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the timeout non-response message and can default to perform the mode action A, that is, immediately disconnect the screen projection connection. The first threshold time is data configured in a timing mechanism. Through the timing mechanism, on the one hand, the user's intention to disconnect / keep the screen projection in a specific mode is inquired, and on the other hand, the situation that the inquiry pop-up window 60 is always displayed due to the user's long-time non-operation can be avoided, the content displayed on the user interface is prevented from being blocked by the inquiry pop-up window 60, and the screen projection disconnection waiting and delay caused by the timeout non-response event are avoided.

[0239] FIG. 7 is a schematic diagram of the change of the user interface when the trigger condition of the timing mode is met according to some embodiments of the present application. Referring to subgraph (a) of FIG. 7, when the display device displays the target clip source pushed by the screen projection device 1 through the VideoURL, the mode management module 205 detects that the system time reaches the preset time T y, after triggering the timing mode, if it is determined that the restDuration is greater than the first threshold value and is not greater than the second threshold value, the mode management module 205 can set the priority of the mode action as: immediately disconnecting the screen projection operation is prior to delaying disconnecting the screen projection operation. In this way, the mode management module 205 can execute the mode action C2, which is configured to send a second inquiry instruction to the View management module 204 through the message processing module 203, and send a countdown instruction to the time management module 213 through the message processing module 203.

[0240] In some embodiments, referring to subgraph (b) of FIG. 7, the View management module 204 can display the first prompt information 71 and the countdown control 72 on the display in response to the second inquiry instruction. An example of the prompt content of the first prompt information 71 is: “The preset time of the timing mode A has been reached, the remaining time of the video source is 17 minutes, and the screen projection will be disconnected. If you refuse, please press any key”. The countdown control 72 is used to display the remaining operation time of the user refusing to disconnect the screen projection in a countdown manner.

[0241] In some embodiments, the time management module 213 starts the countdown of the timer (Timer1) when the View management module 204 starts displaying the first prompt information 71 in response to the countdown instruction, and determines whether the countdown is zero (i.e., becomes 0S). When the countdown is zero, the time management module 213 can send a time zero message to the View management module 204 through the message processing module 203.

[0242] In some embodiments, the countdown manner implemented by the time management module 213 is to start from the first threshold time, and count down by one second at a time until the countdown is zero, and then the countdown mechanism is terminated. Taking the first threshold time as 5S (seconds) as an example, the remaining time of the countdown is 5S, 4S, 3S, 3S, 1S, and 0S in turn. The countdown control 72 should be synchronized with the countdown of the time management module 213, that is, the countdown control 72 dynamically presents the jump time change of 5S, 4S, 3S, 3S, 1S, and 0S.

[0243] In some embodiments, if the user wants to continue to watch the screen projection video source content and refuses to disconnect the screen projection immediately in the timing mode, the user can input a refusal to disconnect the screen projection operation before the countdown is zero. The input manner of the refusal to disconnect the screen projection operation is not limited, for example, the user can click any key on the control device 100 (such as a remote controller), or click a preset key. The preset key is not limited, for example, it is a back key, an exit key, etc.

[0244] In some embodiments, the View management module 204 responds to the user input of the rejection of the disconnection of the screen projection operation, and does not receive the time zero message sent by the time management module 213, cancels the display of the first prompt information 71 and the countdown control 72, and sends a rejection of the disconnection of the screen projection message to the mode management module 205 through the message processing module 203; the mode management module 205 receives the rejection of the disconnection of the screen projection message, does not execute the mode action A temporarily, and continues to monitor the restDuration of the current piece source. When detecting that the restDuration changes to be not greater than the first threshold value, the mode action B1 or the mode action B2 can be executed.

[0245] In some embodiments, if the user agrees to disconnect the screen projection immediately in the timing mode, no operation needs to be input, and the countdown is waited to be zero. When the View management module 204 receives the time zero message, if the rejection of the disconnection of the screen projection operation is not received, the display of the first prompt information 71 and the countdown control 72 is cancelled, and an agreement of the disconnection of the screen projection message is sent to the mode management module 205 through the message processing module 203. The mode management module 205 receives the agreement of the disconnection of the screen projection message, and executes the mode action A: a disconnection of the screen projection instruction is sent to the screen projection management module 201 through the message processing module 203. In this way, through the countdown mechanism, on the one hand, the willingness of the user to disconnect / keep the screen projection in a specific mode is inquired, and on the other hand, the first prompt information 71 is prevented from being displayed for a long time, and the waiting time and the delay of the disconnection of the screen projection are reduced.

[0246] In some embodiments, when the system time reaches the preset time T y , if the restDuration is greater than the second threshold value, it indicates that the remaining time of the piece source is long, which will affect the user to rest. In this scenario, the mode management module 205 can set the priority of the mode action as: the immediate disconnection of the screen projection operation is prior to the delayed disconnection of the screen projection operation.

[0247] In some embodiments, when the system time reaches the preset time T y , if the restDuration is greater than the second threshold value, the mode management module 205 can execute the mode action A, so that the screen projection management module 201 immediately disconnects the screen projection connection with the screen projection device 1.

[0248] In some embodiments, when the system time reaches the preset time T yWhen the restDuration is greater than the second threshold, the mode management module 205 can perform a mode action D of the timing mode, which is configured to send a third query instruction to the View management module 204 through the message processing module 203, and send a countdown instruction to the time management module 213 through the message processing module 203. In this way, during the countdown, it is queried whether to disconnect the screen projection after triggering the timing mode, and based on the operation instruction of the user's consent or refusal to disconnect the screen projection, the mode management module 205 can decide whether to immediately perform the mode action A or to delay the execution of the mode action A, and if the mode action A is delayed, the user can disconnect the screen projection at any time before the end of the target video source.

[0249] In some embodiments, for the timing mode, several cases are included: (1) the system time reaches the preset time; (2) the restDuration of the target video source is greater than the preset threshold; (3) the restDuration of the target video source is not greater than the preset threshold; (4) the user agrees to disconnect the screen projection connection; (5) the user refuses to delay to disconnect the screen projection connection until the end of the target video source; (6) the user agrees to delay to disconnect the screen projection connection until the end of the target video source; (7) the target video source ends.

[0250] Based on the above several cases, when at least case (1) is reached, it is determined that the continuation end condition is met, the target video source is stopped, and the screen projection connection is disconnected. Other cases can further expand the possibility of the continuation end condition by appropriately combining with case (1).

[0251] In some embodiments, when case (1) occurs, the user can be further queried whether to agree to disconnect the screen projection connection, and if case (4) is reached, it is determined that the continuation end condition is met, the target video source is stopped, and the screen projection connection is disconnected.

[0252] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated, and if case (2) occurs, it is determined that the continuation end condition is met, the target video source is stopped, and the screen projection connection is disconnected.

[0253] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated, and if case (2) occurs, the user can be further queried whether to agree to disconnect the screen projection connection, and if case (4) is reached, it is determined that the continuation end condition is met, the target video source is stopped, and the screen projection connection is disconnected.

[0254] In some embodiments, when condition (1) occurs, the restDuration of the target piece source can be further calculated, if condition (3) occurs, the target piece source continues to be played, until condition (7) occurs, it is determined that the continuation playing end condition is met, the target piece source is stopped playing, and the screen projection connection is disconnected.

[0255] In some embodiments, when condition (1) occurs, the restDuration of the target piece source can be further calculated, if condition (3) occurs, the target piece source continues to be played, until condition (7) occurs, it is determined that the continuation playing end condition is met, the target piece source is stopped playing, and the screen projection connection is disconnected.

[0256] In some embodiments, when condition (1) occurs, the restDuration of the target piece source can be further calculated, if condition (3) occurs, the target piece source continues to be played, until condition (7) occurs, it is determined that the continuation playing end condition is met, the target piece source is stopped playing, and the screen projection connection is disconnected.

[0257] In some embodiments, before the system time reaches the preset time T y If the mode management module 205 does not trigger other screen projection modes (such as interval mode and timing mode) before the system time reaches the preset time T, it is determined that the continuation playing end condition is not met, the display device continues to play the target piece source, and the screen projection connection is not disconnected.

[0258] FIG. 8 is a schematic diagram of the change of the user interface when the triggering condition of the timing mode is met according to some embodiments of the present application. The View management module 204 responds to the third inquiry instruction, and displays the second prompt information 81 and the countdown control 82 as shown in subgraph (b) of FIG. 8. An example of the prompt content of the second prompt information 81 is “The preset time of the timing mode A has been reached, the piece source remaining time is 35 minutes, the screen projection will be disconnected, please press any key if you refuse”. The countdown control 82 is used to display the remaining operable time of the user refusing to disconnect the screen projection in a countdown manner.

[0259] In some embodiments, the time management module 213 responds to the countdown instruction, controls the Timer 1 to start the countdown when the View management module 204 starts to display the second prompt information 81, and judges whether the countdown is zero. When the countdown is zero, the time management module 213 can send a time zero message to the View management module 204 through the message processing module 203. The countdown control 72 should be synchronized with the countdown of the time management module 213.

[0260] In some embodiments, upon receiving the time zero message, if the disconnect screen projection operation is not rejected, the View management module 204 cancels the display of the second prompt information 81 and the countdown control 82, and sends an agree disconnect screen projection message to the mode management module 205 through the message processing module 203. Upon receiving the agree disconnect screen projection message, the mode management module 205 immediately performs mode action A to make the target video source stop playing and disconnect the screen projection connection.

[0261] In some embodiments, in response to the user input of the reject disconnect screen projection operation and without receiving the time zero message sent by the time management module 213, the View management module 204 cancels the display of the second prompt information 81 and the countdown control 82, and sends a reject disconnect screen projection message to the mode management module 205 through the message processing module 203. Upon receiving the reject disconnect screen projection message, the mode management module 205 can perform mode action D1, which is configured to send a third prompt instruction to the View management module 204 through the message processing module 203.

[0262] In some embodiments, in response to the third prompt instruction, the View management module 204 displays third prompt information 83 on the screen projection playing interface as shown in subgraph (c) of FIG. 8. An example of the prompt content of the third prompt information 83 is “disconnect screen projection has been delayed, input a preset operation to disconnect screen projection at any time”.

[0263] In some embodiments, if the restDuration is greater than the second threshold value, it indicates that the remaining time of the video source is relatively long. In this case, if the user rejects to disconnect the screen projection at the preset time T y , the user may want to rest due to fatigue but do not want to wait until the video source finishes playing before disconnecting the screen projection. In this case, the user can input a preset operation to disconnect the screen projection at any time after the preset time T y and before the restDuration is cleared.

[0264] In some embodiments, the input method of the preset operation is not limited. For example, the preset operation examples include pressing (short pressing or long pressing) a preset key (such as a back key, etc.) on the control device 100, clicking a disconnect screen projection button set on the screen projection playing interface, inputting a voice instruction containing a disconnect screen projection intention, inputting a hand gesture operation indicating to disconnect the screen projection, etc.

[0265] In some embodiments, the View management module 204 sends a disconnection screen projection message to the mode management module 205 through the message processing module 203 in response to a preset operation input by the user. The mode management module 205 receives the disconnection screen projection message and immediately performs mode action A to make the screen projection management module 201 disconnect the screen projection connection with the screen projection device 1 by calling the finish() interface of the SessionClientl.

[0266] In some embodiments, for the interval mode, the play time data includes the played duration of the target video source, and the continuation time data includes a first preset duration. The controller can be configured to pause the playing of the target video source if the played duration of the target video source reaches the first preset duration. The technical solution provided by this embodiment has the following beneficial effects: a scheme based on a second time management mechanism for continuation end condition judgment and screen projection control operation (which can be referred to as an interval mode) is provided. After the video source is started, the played duration of the video source can be recorded, and the played duration and the first preset duration are used as parameters for judging whether the continuation end condition is met. When the played duration reaches the first preset duration, the user may need to take a break. Therefore, the controller can pause the playing of the video source, so that the playing progress of the video source is stopped at a pause node, the display device no longer continues to play the video source, and the user stops watching the video source, thereby achieving the purpose of taking a break.

[0267] In some embodiments, for the interval mode, the continuation time data further includes a second preset duration. The controller is further configured to continue playing the target video source from the pause node when the played duration of the target video source reaches the sum of the first preset duration and the second preset duration. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, the playing of the video source is paused when the played duration of the video source reaches the first preset duration. If the display device always pauses the video source, the playing progress of the video source will be stopped, which leads to the inability of the video source to continue playing continuously. Therefore, the parameter of the second preset duration is added. When the played duration reaches the sum of the first preset duration and the second preset duration, that is, the pause playing duration of the video source reaches the second preset duration, the video source can be continued from the pause node, thereby achieving the purpose of taking a break during the playing of the video source and avoiding the continuous pause playing of the video source.

[0268] In some embodiments, the controller can be configured to start the first round of the interval mode and pause the playing of the target video source if the played duration of the target video source reaches the first preset duration. The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be executed in a single round. Therefore, when the played duration of the video source reaches the first preset duration, that is, the starting time of the first round of the interval mode, the playing of the video source is paused. In this way, the number of rounds and the frequency of the execution of the interval mode by the controller can be limited, thereby avoiding the frequent pause playing of the video source during the playing of the video source.

[0269] In some embodiments, the controller is further configured to: when the played duration of the target video source reaches a sum of the first preset duration and the second preset duration, exit the interval mode of the first round, and continue playing the target video source from the pause node. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode of a single round / first round, the target video source is paused when the played duration of the target video source reaches the first preset duration, and the duration of the pause of the target video source is the second preset duration. Thus, when the played duration of the target video source reaches the sum of the first preset duration and the second preset duration, the first round of the interval mode is exited, and the target video source is continued from the pause node. In this way, the number of rounds and the frequency of the interval mode performed by the controller can be limited, and the target video source is prevented from being frequently paused during the playing of the target video source.

[0270] In some embodiments, after the controller performs the exit of the interval mode of the first round and the continuation of the playing of the target video source from the pause node, the controller is further configured to: if the played duration of the target video source reaches a start time T mi of the interval mode of the i-th round, start the interval mode of the i-th round and pause the playing of the target video source; wherein T mi = i*t1+ (i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number of the interval mode, and i is greater than 1. If the played duration of the target video source reaches an end time T ni of the interval mode of the i-th round, exit the interval mode of the i-th round and continue the playing of the target video source from the pause node; wherein T ni =T mi +t2 = i*(t1+t2). The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be performed for multiple rounds. In particular, for a scenario in which the total duration of the target video source is long, if only one round of the interval mode is performed, the display device will play the target video source continuously after the exit of the first round of the interval mode. Therefore, multiple rounds of the interval mode can be set to be performed in a round-robin manner, i.e., the target video source is paused for the second preset duration every first preset duration, so as to avoid fatigue and other problems caused by the continuous watching of the target video source by a user.

[0271] FIG. 9 is a diagram of the distribution of the triggering time of the interval mode in the process of the screen projection and playing according to some embodiments of the present application. As shown in FIG. 9, the interval mode can be configured to pause the target video source for the second preset duration t2 every first preset duration t1 in the process of the screen projection and playing. Thus, the distribution of the triggering time of the interval mode is [T mi ,T ni ]. Wherein i represents the triggering round number (i≥1) of the interval mode in the process of the screen projection and playing, T mi represents the start time of the i-th round of the interval mode, and T niT mi denotes the end time of the i-th interval mode. It can be obtained from FIG. 9 that T ni = T mi + i * t2.

[0272] In some embodiments, the user can set the total number of rounds (K value) of the interval mode through the screen projection mode setting page. The mode information of the interval mode includes the first preset time t1, the second preset time t2 and the total number of rounds K, and 1≤i≤K. In this way, the upper limit value of the interval mode rounds can be limited, so as to avoid the frequent interval breaks from affecting the user's viewing experience.

[0273] In some embodiments, the upper limit value of the interval mode rounds can not be limited, and the upper limit value can depend on the screen projection played time. The longer the screen projection played time is, the relatively larger the accumulated number of rounds is.

[0274] In some embodiments, in the scenario where the screen projection source pushes the target video source through the VideoURL, the mode management module 205 can obtain the played time data of the target video source during the playing process of the target video source. The played time data includes the played time of the target video source. When the target video source starts playing, the time management module 213 can control the timer Timer2 to start positive timing, and the timing time of the Timer2 represents the played time of the target video source.

[0275] In some embodiments, when the played time of the target video source reaches the interval start point T mi , the i-th interval mode is triggered. If the target video source is in a playing state, the mode management module 205 performs the mode action E in the interval mode. The mode action E can be configured as: pausing the playing of the target video source, and the pause lasts for the second preset time t2. The purpose of pausing the playing of the target video source is to prevent the user from watching and listening to the screen projection within the time range [T mi , ni ], so as to force the user to take a break, thereby achieving eye protection, relieving physical and mental fatigue and attention deficit and the like. The implementation mode of pausing the playing of the target video source can be: calling the pause interface of the SessionClientl by the broadcast control management module 212 to pause the audio and video synchronization of the screen projection video source, so that the playing progress of the target video source is stopped at the pause node.

[0276] In some embodiments, the interval mode can further add an associated mode action F, and the mode action F can be configured to pre-remind the i-th interval mode at the T Qi node. The mode action F is executed before the mode action E, and T Qi = T mi - t3, t3 being a second threshold time (for example, 3-5 seconds).

[0277] In some embodiments, the mode management module 205 can execute mode action F: sending an interval mode pre-warning instruction to the View management module 204 through the message processing module 203, when detecting that the played duration of the target video reaches T Qi

[0278] FIG. 10 is a schematic diagram of the change of the user interface in the interval mode when playing the video URL pushed video source (non-live broadcast) type screen projection according to some embodiments of the present application. As shown in subgraph (a) of FIG. 10, the View management module 204 displays the fourth prompt information 101 on the screen projection playing interface in response to the interval mode pre-warning instruction, and the prompt content of the fourth prompt information 101 is an example of “about to enter the interval break”. During the pre-warning period, since the current time is less than T mi , the display keeps playing the content of the target video.

[0279] In some embodiments, the controller is further configured to: control the display to display a preset blocking page on the upper layer of the playing interface of the target video when pausing the playing of the target video; and control the display to cancel the display of the preset blocking page when continuing the playing of the target video from the pause node. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, when pausing the playing of the video, in order to enable the user to concentrate on the break without interruption, the preset blocking page can be used to block the screen projection content, so that the upper layer of the display device only presents the preset blocking page, the preset blocking page has no effective screen projection content, the screen projection playing interface is invisible, the user cannot see the video content, and cannot perform the play control operation on the video, until the break end time is reached, the preset blocking page is cancelled when the video needs to be played continuously, the blocking of the screen projection content is cancelled, and thus the screen projection playing interface is visible, and the user can continue to watch the video.

[0280] In some embodiments, the mode management module 205 triggers the i-th round of interval mode when detecting that the played duration of the target video reaches the interval start point T mi , and the target video is in the playing state, the mode management module 205 can execute mode action E1, which is configured to: sending a screen projection pause instruction to the play control management module 212 through the message processing module 203, and sending a screen projection blocking instruction to the View management module 204 through the message processing module 203.

[0281] ​In some embodiments, in response to the screen projection pause instruction, the control management module 212 can call the pause interface of the SessionClientl, pause the audio and video synchronization of the screen projection film source, and switch the target film source to the pause state. In this way, the play progress of the target film source is static at the pause point, and no mute processing is required when the target film source is in the pause state.

[0282] In some embodiments, as shown in subgraph (b) of FIG. 10, in response to the screen projection blocking instruction, the View management module 204 can cancel the display of the fourth prompt information 101, and set the screen projection play interface to an invisible state (the data management module 202 synchronously rewrites the mVisible state value corresponding to the screen projection device 1 to false). The View management module 204 can display a preset blocking page 102. The preset blocking page 102 has the effect of screening the screen projection play interface on the whole screen, so that the user cannot watch the film source content in the screen projection play interface within the [T mi ,T ni ] time range.

[0283] In some embodiments, as shown in subgraph (b) of FIG. 10, the preset blocking page 102 can display a preset background image and display fifth prompt information 102a on the preset background image. The fifth prompt information 102a is used to prompt the user to continue watching the screen projection content after a second preset time t2. In subgraph (b) of FIG. 10, the fifth prompt information 102a is an example of “10 minutes of rest can continue to watch”. The preset background image can be a solid color background image, an eye protection image, a patterned wallpaper image, etc.

[0284] In some embodiments, the mode management module 205 can obtain the timing time of Timer2 from the time management module 213, so as to obtain the played time length of the target film source. When it is detected that the played time length of the target film source reaches the interval endpoint T ni , the interval mode of the i-th round is ended / quit. The interval mode is also associated with a mode action G, which can be configured to resume the play of the target film source from the pause node (pause point), that is, to continue playing the target film source. Among them, the recovery of the screen projection play is to recover the screen projection audio and video of the user after the intermission, and the implementation manner can be: calling the replay interface of the SessionClientl by the control management module 212, so as to continue playing the audio and video of the screen projection film source from the pause point, so that the play progress of the target film source continues to dynamically change.

[0285] In some embodiments, if the mode action E1 has been executed, the mode management module 205 detects that the played time length of the target film source reaches the interval endpoint T niAt this time, mode action G1 can be executed: send a resume playback command to the broadcast control management module 212 through the message processing module 203, and send an unblocking command to the view management module 204 through the message processing module 203.

[0286] In some embodiments, in response to a resume playback command, the playback control management module 212 can call the replay interface of SessionClient1 to synchronously resume playback of the audio and video of the projected source from the pause point (without needing to unmute). In this way, at the end of a round of interval mode, the audio and video playback of the source is resumed from both the audio and video perspectives, and the playback progress of the source also begins to change dynamically.

[0287] In some embodiments, in response to the unblocking command, as shown in sub-figure (c) of FIG10, the View management module 204 cancels the display of the preset blocking page 102 and sets the previously blocked projection playback interface to a visible state (the data management module 202 simultaneously rewrites the mVisible state value corresponding to the projection device 1 to true). A sixth prompt message 103 can be displayed on the projection playback interface. The sixth prompt message 103 is used to indicate the end of the i-th round of the interval mode. An example of the prompt content of the sixth prompt message 103 in sub-figure (c) of FIG10 is "This interval break has ended, please continue watching the video source."

[0288] In some embodiments, the mode management module 205 detects that the played duration of the target video source has reached the interval start point T. mi When the i-th round of interval mode is triggered, the mode management module 205 determines, based on the screen projection source information obtained from the screen projection source analysis module 215, that the screen projection source type is VideoURL, the media asset playback type is video source (non-live) screen projection, and the current video source is in a playing state, that mode action E2 can be executed. Mode action E2 is configured to: send a screen projection pause command to the broadcast control management module 212 through the message processing module 203, and send a pause and block operation command to the View management module 204 through the message processing module 203.

[0289] In some embodiments, in response to a screen casting pause command, the playback control management module 212 can call the pause interface of SessionClient1 to synchronously pause the audio and video playback of the screen casting source, thereby switching the target source to a paused playback state. In this way, the playback progress of the target source remains unchanged at the pause point, and no muting is required when the target source is in a paused playback state.

[0290] In some embodiments, the controller is further configured to: when the target video source is paused, control the display to display a pause prompt control in the play interface of the target video source, the pause prompt control being used to prompt that the target video source is in a paused play state; when the target video source is in the paused play state, if a play control instruction of the target video source is received, not performing an operation corresponding to the play control instruction; and when the target video source is continued to be played from the pause node, control the display to cancel the display of the pause prompt control, and if a play control instruction of the target video source is received, performing an operation corresponding to the play control instruction. The technical solution provided in this embodiment has the following beneficial effects: for the interval mode, when the video source is paused, the pause prompt control can be used to prompt that the video source has been paused, and the controller will shield the play control instruction of the target video source (such as playing the video source, fast forwarding, rewinding, speed adjustment, etc.), that is, not performing an operation corresponding to the play control instruction, so as to ensure that the play progress and the play state of the target video source will not be changed due to the play control operation of the user, and the user can concentrate on the break; when the video source is continued to be played, the display of the pause prompt control is canceled, so that the user knows that the video source is resumed to be played, and the shielding of the play instruction of the video source is canceled. In this way, if the user inputs a play operation of the target video source, an operation corresponding to the play instruction is performed, so that the video source is continued to be played and the response of the play control instruction is restored.

[0291] FIG. 11 is a schematic view of a change of a user interface in the interval mode when a video source (non-live broadcast) pushed by VideoURL is played in the screen projection according to some embodiments of the present application. As shown in subgraph (b) of FIG. 11, the View management module 204 cancels the display of the fourth prompt information 101 and displays the pause instruction control 111 and the seventh prompt information 112 on the screen projection play interface in response to the pause and shielding operation instruction. The pause instruction control 111 is used to indicate that the target video source is in the paused play state in the [T mi ,T ni ] period of the interval mode, and the prompt content of the seventh prompt information 112 is an example of “10 minutes of rest can continue to watch, and the current video source is not operable”.

[0292] In some embodiments, the View management module 204 is further configured to listen to a KeyEvent (operation event, including a play control operation event of the target video source) of the user in response to the pause and shielding operation instruction, and dispose the listened KeyEvent. In this way, the View management module 204 can shield (not respond to) the user operation, so that the user cannot intervene in the play control of the target video source. For example, even if the user clicks the pause instruction control 111, the target video source cannot be switched to the play state, and the user cannot perform other play control operations such as speed adjustment, fast forwarding, rewinding, seeking, etc.

[0293] In some embodiments, if the mode action E2 has been performed previously, the mode management module 205 can perform mode action G2: sending a resuming playing instruction to the play control management module 212 through the message processing module 203, and sending a playing and unshielding operation instruction to the View management module 204 through the message processing module 203, when detecting that the played duration of the target piece source reaches the interval end point T ni

[0294] In some embodiments, the play control management module 212 can call the replay interface of the SessionClient1 to continue playing the audio and video of the screen projection piece source from the pause point in synchronization, in response to the resuming playing instruction. In this way, the audio and video playing of the target piece source is resumed from both the audio and the video aspects at the end of a round of interval mode, and the playing progress of the target piece source also continues to dynamically change.

[0295] In some embodiments, as shown in subgraph (c) of FIG. 11, the View management module 204 cancels the display of the pause instruction control 111 and the seventh prompt information 112, and displays the eighth prompt information 113 on the screen projection playing interface, in response to the playing and unshielding operation instruction. An example of the prompt content of the eighth prompt information 113 is “This interval break is over. Please continue watching. The current piece source is operable”.

[0296] In some embodiments, the View management module 204 is further configured to listen to the KeyEvent (operation event) of the user and perform response processing on the listened KeyEvent, in response to the playing and unshielding operation instruction. In this way, the View management module 204 can unshield the user operation and respond to the user operation to realize the user's playing control of the piece source, including but not limited to pausing, resuming playing, speed adjusting, fast forwarding, fast rewinding, seeking, and the like.

[0297] In some embodiments, for the interval mode, there are several cases: (1) the played duration of the target piece source reaches the start time T mi of the i-th round of interval mode; and (2) the played duration of the target piece source reaches the end time T ni of the i-th round of interval mode. Wherein, i≥1.

[0298] In some embodiments, when case (1) is met, it is determined that the continuation playing end condition is met, and the target piece source is paused. During the pause of the target piece source, the screen projection connection is not disconnected.

[0299] ​In some embodiments, when case (1) occurs, the playing of the target video source is paused until case (2) occurs, and it is determined that the resuming end condition is not met, and the target video source needs to be resumed from the pause node. In some embodiments, the interval mode can be set to a single round, i.e., i = 1, and after the first round of interval mode ends, the next round of interval mode is not started.

[0300] In some embodiments, the interval mode can be set to multiple rounds, i.e., i is greater than 1, and after the first round of interval mode ends, the multiple rounds of interval mode are cycled by comparing the played duration of the target video source and the start time T mi of the i-th round of interval mode, until the playing of the target video source ends or the preset round upper limit value K is reached.

[0301] In some embodiments, after the target video source starts playing, if the time period is outside [T mi , T ni ], and the mode management module 205 does not trigger other screen projection modes (such as the timing mode and the time counting mode), it is determined that the resuming end condition is not met, the display device continues to play the target video source, and the operations of pausing the playing of the video source and disconnecting the screen projection connection are not performed.

[0302] In some embodiments, the single round interval mode can also be set to a special case: only the first preset duration is set, and the second preset duration is not limited, so that the interval mode has only one playing time parameter, i.e., the start time T m1 of the single round interval mode (equal to the first preset duration). In this way, when the played duration of the target video source reaches T m1 , the playing of the target video source is paused, and the screen projection connection is not disconnected, and the screen projection playing interface can be blocked when the playing of the video source is paused. In this scenario, the user can also actively resume the playing of the target video source according to the viewing needs after sufficient rest, i.e., the resuming of the target video source is triggered by the user, such as the user issuing a voice instruction for indicating the resuming of the video source.

[0303] In some embodiments, the time counting mode starts counting from the start point of any screen projection (referred to as a screen projection), and the counting duration represents the cumulative playing duration of the a screen projection. If the counting duration reaches the third preset duration t3, the screen projection is disconnected, thereby limiting the upper limit duration of the user watching the screen projection.

[0304] In some embodiments, for the timing mode, the playing time data comprises a played duration of the target piece source, and the resuming time data comprises a third preset duration. The controller can be configured to: if the played duration of the target piece source reaches the third preset duration, stop playing the target piece source, and disconnect the screen projection connection with the screen projection device. The technical solution provided by this embodiment has the following beneficial effects: a scheme (which can be referred to as a timing mode) based on a third time management mechanism is provided for resuming end condition judgment and screen projection control operation. The played duration is started when the piece source starts playing, the target piece source is stopped playing, which avoids the screen projection device continuing to push the screen projection content to the display device based on the screen projection connection when the piece source plays to the third preset duration. When the played duration of the piece source reaches the third preset duration, it is determined that the resuming end condition is met, and then the controller disconnects the screen projection connection, which also avoids the display device continuing to play the screen projection content after the played duration of the piece source reaches the third preset duration, thereby avoiding the screen projection piece source playing for too long.

[0305] In some embodiments, after the controller applies the running mode, the mode management module 205 can monitor the triggering condition and perform the mode action according to the timing mode information.

[0306] FIG. 12 is a schematic diagram of a change of a user interface in a timing mode when playing a piece source (non-live broadcast) pushed by VideoURL in some embodiments of the present application. After the display device starts playing the screen projection content pushed by the screen projection device 1, the screen projection source analysis module 215 can analyze the Session information of the screen projection device 1 to obtain the screen projection source information. As shown in subgraph (a) of FIG. 12, the screen projection source information indicates that the screen projection source pushes the target piece source through VideoURL.

[0307] In some embodiments, when the screen projection management module 201 receives the VideoURL (resource address of the target piece source) sent by the screen projection device 1 through the screen projection instruction, the screen projection management module 201 can send a screen projection start message to the mode management module 205 and the View management module 204 through the message processing module 203. The View management module 204 receives the screen projection start message, and can obtain the media data of the target piece source from the server according to the VideoURL, as shown in subgraph (a) of FIG. 12, and starts playing the target piece source pushed by VideoURL in the screen projection playing interface.

[0308] In some embodiments, when the mode management module 205 receives the screen projection start message, the mode management module 205 starts the timing mode and performs the mode action H set by the timing mode. The mode action H can be configured to: send a timing reminder instruction to the View management module 204 through the message processing module 203, and send a timing instruction A to the time management module 213 through the message processing module 203.

[0309] In some embodiments, the View management module 204 displays the ninth prompt information 121 on the screen projection playing interface in response to the timing reminder instruction, as shown in subgraph (a) of FIG. 12, the ninth prompt information 121 is used to prompt entering the timing mode, and an example of the prompt content of the ninth prompt information 121 is "entering the timing mode A and starting timing the played time length of the screen source".

[0310] In some embodiments, the time management module 213 can start the timer Timer3 in response to the timing instruction A, control the Timer3 to start positive timing, and the timing time of the Timer3 represents the played time length of the target screen source in the timing mode. The time management module 213 can set the upper limit of the positive timing as the third preset time length t3. When the timing time of the Timer3 reaches the third preset time length t3, the time management module 213 can send a second timing reaching message to the mode management module 205 through the message processing module 203, control the Timer3 to stop timing, and clear the timing time.

[0311] In some embodiments, when the timing time of the Timer3 does not reach the third preset time length t3, the mode management module 205 determines that the continuation playing end condition is not met, and the display device continues to play the target screen source.

[0312] In some embodiments, when the played time length of the target screen source reaches the third preset time length t3, the mode management module 205 can perform the mode action A: sending a disconnection screen projection instruction to the screen projection management module 201 through the message processing module 203, so that the screen projection management module 201 responds to the disconnection screen projection instruction, calls the finish() interface of the Session object corresponding to the screen projection device 1, and sends a disconnection screen projection request to the screen projection device 1 through the protocol. The screen projection device 1 responds to the disconnection screen projection request, disconnects the screen projection connection with the display device, and feeds back a disconnection message to the display device. Thus, the screen projection management module 201 receives the disconnection message, releases the related resources (such as the player) occupied by the screen projection, and notifies the View management module 204 to cancel the display of the screen source content pushed by the VideoURL through the message processing module 203, so as to stop playing the target screen source.

[0313] In some embodiments, the controller is configured to: if the played duration of the target video source reaches a third preset duration, control the display to display third prompt information, the third prompt information being used to prompt the user whether to agree to disconnect the screen projection connection; if an operation of the user agreeing to disconnect the screen projection connection is received, stop playing the target video source and disconnect the screen projection connection with the screen projection device; if an operation of the user refusing to disconnect the screen projection connection is received, continue playing the target video source. The technical solution provided in this embodiment has the following beneficial effects: for the timing mode, when the played duration of the video source reaches the third preset duration, the user can be asked whether to agree to disconnect the screen projection connection through the prompt information, and then the user's viewing demand is added as a factor for the controller to decide whether to disconnect the screen projection connection on the basis of the time condition of the timing mode, the screen projection connection is disconnected if the user agrees, and the video source is continued to be played if the user refuses, so that the user's viewing demand and preference are met.

[0314] In some embodiments, when the played duration of the target video source reaches the third preset duration t3, the View management module 204 can prompt that the timing time specified by the timing mode has been reached and ask the user whether to agree or refuse to disconnect the screen projection connection in a manner similar to that of FIG. 5A. If the user agrees to disconnect the screen projection connection, the mode management module 205 can perform mode action A to disconnect the screen projection connection and stop playing the target video source. If the user refuses to disconnect the screen projection connection, the display device continues to play the target video source.

[0315] In some embodiments, the controller can be configured to: when the played duration of the target video source reaches the third preset duration, determine the remaining playing duration of the target video source according to the playing progress of the target video source and the total duration of the target video source; and if the remaining playing duration is greater than a preset threshold, stop playing the target video source and disconnect the screen projection connection with the screen projection device. The technical solution provided in this embodiment has the following beneficial effects: for the timing mode, when the played duration of the video source reaches the third preset duration, the video source can not have been played to the end, so the video source has a time parameter of the remaining playing duration, the remaining playing duration is calculated through the playing progress and the total duration of the video source, and the length of the remaining playing duration is measured through the preset threshold, so that the controller decides whether to disconnect the screen projection connection when the system time reaches the fixed preset time; if the remaining playing duration is relatively large, if the screen projection connection is not disconnected, the display device will continuously play the video source until the video source is played to the end, which can affect the user's plan for the timing rest, and therefore the controller can disconnect the screen projection connection and stop playing the video source in this scenario, so that the user cannot continue to watch the video source content.

[0316] In some embodiments, the controller can be configured to: if the remaining playing time is greater than a preset threshold, control the display to display the remaining playing time and third prompt information, the third prompt information being used to prompt the user whether to agree to disconnect the screen projection connection; if an operation of the user agreeing to disconnect the screen projection connection is received, stop playing the target film source and disconnect the screen projection connection with the screen projection device; and if an operation of the user refusing to disconnect the screen projection connection is received, continue playing the target film source. The technical solution provided in this embodiment has the following beneficial effects: when the played time of the film source reaches the third preset time length, the remaining playing time of the film source is taken as a playing time parameter, if the remaining playing time is relatively large, if the screen projection connection is not disconnected, the display device will continuously play the screen projection content pushed by the screen projection device, which will affect the user's plan for regular rest and may affect the user's rest, resulting in user fatigue or lack of concentration, etc. Therefore, the controller can control the display to display prompt information to inform the user of the remaining playing time of the film source and ask the user whether to disconnect the screen projection connection. In this way, the user can refer to the remaining playing time and the user's viewing demand to decide whether to disconnect the screen projection connection.

[0317] In some embodiments, the controller can be further configured to: if the remaining playing time is not greater than the preset threshold, continue playing the target film source; and disconnect the screen projection connection with the screen projection device when the target film source ends playing. The technical solution provided in this embodiment has the following beneficial effects: when the played time of the film source reaches the third preset time length, if the screen projection connection is not disconnected, the display device will continue to play the film source until the film source ends playing. Therefore, if the remaining playing time of the film source is relatively short when the timing time length reaches the third preset time length, the influence on the user's rest may be relatively small. Thus, the screen projection connection can be disconnected when the film source ends playing, so as to ensure the integrity of the user's viewing of the film source and avoid the screen projection device continuing to push screen projection content to the display device based on the screen projection connection after the preset time is reached and the display device continuing to play the screen projection content after the preset time is exceeded.

[0318] In some embodiments, the controller can be configured to: if the remaining playing time is not greater than the preset threshold, control the display to display the remaining playing time and fourth prompt information, the fourth prompt information being used to prompt the user whether to agree to delay disconnecting the screen projection connection until the target film source ends playing; if an operation of the user agreeing to delay disconnecting the screen projection connection is received, continue playing the target film source; and if an operation of the user refusing to delay disconnecting the screen projection connection is received, stop playing the target film source and disconnect the screen projection connection with the screen projection device. The technical solution provided in this embodiment has the following beneficial effects: when the played time of the film source reaches the third preset time length, if the remaining playing time is relatively short, the controller can control the display to display prompt information to inform the user of the remaining playing time of the film source and ask the user whether to agree to delay disconnecting the screen projection connection until the film source ends playing.

[0319] In some embodiments, after the controller running mode application, the mode management module 205 receives a second timing reaching message sent by the time management module 213, and according to the screen projection source information, if it is determined that the screen projection source is a target piece source pushed by a Video URL, the restDuration of the target piece source can be determined according to the playing progress and the total duration of the target piece source.

[0320] In some embodiments, when the played duration of the target piece source reaches the third preset duration t3, if the restDuration = 0, it indicates that the target piece source has played to the end when the timing (the third preset duration t3) reaches, and the mode management module 205 can perform the mode action J1. The mode action J1 can be configured to send a third prompt instruction to the View management module 204 through the message processing module 203. Since the target piece source has played to the end when the t3 duration of the timing mode indication is reached, there is no effective screen projection content displayed on the screen projection playing interface, and the mode application can disconnect or not disconnect the screen projection connection.

[0321] In some embodiments, as shown in subgraph (b) of FIG. 12, the View management module 204 displays the tenth prompt information 122 on the screen projection playing interface in response to the third prompt instruction. An example of the prompt content of the tenth prompt information 122 is “reach the timing time of the timing mode A, and the piece source has played to the end”.

[0322] In some embodiments, when the played duration of the target piece source reaches the third preset duration t3, if 0 < restDuration ≤ preset threshold, it indicates that the remaining playing duration of the target piece source is short. In this scenario, the mode management module 205 can set the priority of the mode action as: the delayed disconnection of the screen projection operation is prior to the immediate disconnection of the screen projection operation. In this way, the mode management module 205 can temporarily not execute the mode action A, and delay to execute the mode action A when the target piece source plays to the end (the restDuration becomes 0).

[0323] In some embodiments, when the played duration of the target piece source reaches the third preset duration t3, if 0 < restDuration ≤ preset threshold, the View management module 204 can prompt the restDuration, and ask the user whether to agree to delay to disconnect the screen projection when the target piece source plays to the end. If the user agrees to delay to disconnect the screen projection, the display device continues to play the target piece source, and the mode management module 205 executes the mode action A when the target piece source plays to the end. If the user refuses to delay to disconnect the screen projection, the mode management module 205 can immediately execute the mode action A.

[0324] In some embodiments, when the played duration of the target video source reaches the third preset duration t3, if 0 < restDuration < a preset threshold, the mode management module 205 can perform mode action J2, which is configured to send a fourth inquiry instruction to the View management module 204 through the message processing module 203, and send a timing instruction B to the time management module 213 through the message processing module 203. The preset threshold is not limited, for example, 5-10 minutes, etc.

[0325] FIG. 13 is a schematic diagram of the change of the user interface in the timing mode when playing the video URL pushed video source (non-live) type screen projection according to some embodiments of the present application. The View management module 204 responds to the fourth inquiry instruction and displays the eleventh prompt information 131 and the countdown control 132 as shown in subgraph (b) of FIG. 13. An example of the prompt content of the eleventh prompt information 131 is "The timing time of the timing mode A has been reached, the video source remaining 3 minutes, will be delayed to disconnect the screen projection after the video source is played, please press any key if you refuse". The countdown control 132 is used to remind the user of the remaining operable time of refusing to delay disconnecting the screen projection in the countdown manner.

[0326] In some embodiments, the time management module 213 responds to the timing instruction B and controls Timer4 to start counting down from the first threshold time when the View management module 204 starts displaying the eleventh prompt information 131 and the countdown control 132, that is, sets the countdown starting point to the first threshold time (for example, 5 seconds). When Timer4 counts down to zero, the time management module 213 can send a time zero message to the View management module 204 through the message processing module 203. The countdown control 132 should be synchronized with the countdown of the time management module 213.

[0327] In some embodiments, if the user agrees to delay disconnecting the screen projection when the timing time of the timing mode is reached, no operation needs to be input, and the countdown is waited for zero. When the time zero message is received, the View management module 204 cancels the display of the eleventh prompt information 131 and the countdown control 132 if no operation of refusing to delay disconnecting the screen projection is received, and sends an agreement to delay disconnecting the screen projection message to the mode management module 205 through the message processing module 203.

[0328] In some embodiments, the mode management module 205 receives the agree to delay disconnection of casting message, and continues to monitor the restDuration of the target piece source. When the restDuration changes to zero, the mode management module 205 performs mode action A: sends a disconnection of casting instruction to the casting management module 201 through the message processing module 203, so that the casting management module 201 responds to the disconnection of casting instruction, calls the finish() interface of the Session object corresponding to the casting device 1, and sends a disconnection of casting request to the casting device 1 through the protocol by the casting service. The casting device 1 responds to the disconnection of casting request, disconnects the casting connection with the display device, and feeds back a disconnection message to the display device. Thus, the casting management module 201 receives the disconnection message, can release the related resources (such as a player, etc.) occupied by casting, and notifies the View management module 204 to cancel the display of the piece source content on the SurfaceView / TextureView through the message processing module 203. In this way, the mode management module 205 detects the end of the target piece source playing, performs mode action A to disconnect the casting connection with the casting device 1, and realizes the integrity of the piece source playing after the delay of restDuration, so as to realize the integrity of the piece source playing without affecting the user's rest.

[0329] In some embodiments, if the user does not want to continue to watch the remaining piece source content and agrees to disconnect the casting when the timing time of the timing mode is reached, the user can input a refusal to delay disconnection of casting operation before the countdown is cleared. The input method of the refusal to delay operation is not limited, for example, the user can click any key or a preset key on the control device 100 (such as a remote controller), or input a voice instruction intended to refuse to delay disconnection of casting, etc.

[0330] In some embodiments, the View management module 204 responds to the user input of the refusal to delay disconnection of casting operation, and does not receive the time zero message sent by the time management module 213, cancels the eleventh prompt information 131 and the countdown control 132, sends a stop timing instruction to the time management module 213 through the message processing module 203, and sends a refusal to delay disconnection of casting message to the mode management module 205 through the message processing module 203. The time management module 213 responds to the stop timing instruction, controls the Timer4 to stop the countdown, and clears the timing time. The mode management module 205 receives the refusal to delay disconnection of casting message, immediately performs mode action A to disconnect the casting connection with the casting device 1, and stops playing the target piece source.

[0331] In some embodiments, when the played duration of the target video source reaches the third preset duration t3, if restDuration> preset threshold, it indicates that the remaining playing duration of the target video source is relatively long, so as to avoid delaying the user's rest, the mode management module 205 can set the priority of the mode action as: immediately disconnecting the screen projection operation is prior to delaying disconnecting the screen projection operation. In this way, the mode management module 205 can immediately execute the mode action A to stop playing the target video source and disconnect the screen projection connection.

[0332] In some embodiments, when the played duration of the target video source reaches the third preset duration t3, if restDuration> preset threshold, the mode management module 205 can execute the mode action J3, which can be configured to: send a fifth inquiry instruction to the View management module 204 through the message processing module 203, and send a timing instruction C to the time management module 213 through the message processing module 203.

[0333] FIG. 14 is a schematic diagram of the change of the user interface in the timing mode when playing the video URL pushed video source (non-live) type screen projection according to some embodiments of the present application. The View management module 204 responds to the fifth inquiry instruction and displays the twelfth prompt information 141 and the countdown control 142 on the display as shown in subgraph (b) of FIG. 14. An example of the prompt content of the twelfth prompt information 141 is "The timing time of the timing mode A has been reached, the remaining video source is 17 minutes, and the screen projection will be disconnected. If you refuse, please press the XX key". The countdown control 142 is used to remind the user of the remaining operable time of refusing to disconnect the screen projection through the countdown mode.

[0334] In some embodiments, the time management module 213 responds to the timing instruction C and controls the timer Timer4 to start counting down from the first threshold time (for example, 5 seconds) when the View management module 204 starts displaying the twelfth prompt information 141 and the countdown control 142. When Timer4 counts down to zero, the time management module 213 can send a time zero message to the View management module 204 through the message processing module 203. The countdown control 142 should be synchronized with the countdown of the time management module 213.

[0335] In some embodiments, when the View management module 204 receives the time zero message, if it does not receive the refusal to disconnect the screen projection operation, it cancels the display of the twelfth prompt information 141 and the countdown control 142, and sends an agreement to disconnect the screen projection message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the agreement to disconnect the screen projection message and immediately executes the mode action A to disconnect the screen projection connection with the screen projection device 1 and stop playing the target video source.

[0336] In some embodiments, the View management module 204 responds to the user input of the rejection of the disconnection of the screen projection operation, and does not receive the time zero message sent by the time management module 213, cancels the display of the twelfth prompt information 141 and the countdown control 142, sends a rejection of disconnection of screen projection message to the mode management module 205 through the message processing module 203, and sends a stop timing instruction to the time management module 213 through the message processing module 203. The time management module 213 responds to the stop timing instruction, controls Timer4 to stop the countdown, and clears the timing time. The mode management module 205 receives the rejection of disconnection of screen projection message, does not perform the mode action A, and makes the View management module 204 continue to display the target film source in the screen projection playing interface.

[0337] In some embodiments, the mode management module 205 receives the rejection of disconnection of screen projection message, and can perform the mode action K, which is configured to send a fourth prompt instruction to the View management module 204 through the message processing module 203.

[0338] FIG. 15 is a schematic diagram of the change of the user interface in the timing mode when playing the VideoURL pushed film source (non-live) type screen projection according to some embodiments of the present application. The View management module 204 responds to the fourth prompt instruction, and displays the thirteenth prompt information 151 on the screen projection playing interface through the display as shown in subgraph (c) of FIG. 15. The prompt content of the thirteenth prompt information 151 is an example of “the timing has been stopped and the disconnection of the screen projection is delayed, input the preset operation to disconnect the screen projection at any time”.

[0339] In some embodiments, the input mode of the preset operation is not limited. For example, the preset operation is an example of pressing (short pressing or long pressing) the preset key (such as the back key, etc.) on the control device 100, clicking the disconnection of screen projection button set on the screen projection playing interface, inputting the voice instruction containing the intention of disconnection of the screen projection, inputting the gesture operation indicating the disconnection of the screen projection, etc.

[0340] In some embodiments, the View management module 204 responds to the user input of the preset operation, and sends a disconnection of screen projection message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the disconnection of screen projection message, immediately performs the mode action A to notify the screen projection management module 201 to disconnect the screen projection connection with the screen projection device 1 by calling the finish() interface of the SessionClient1, and stop playing the target film source.

[0341] In some embodiments, after the View management module 204 starts playing the target video source corresponding to the VideoURL, the mode management module 205 can monitor the restDuration of the current video source in real time. When the restDuration is detected to be changed to zero, if a second time reaching message sent by the time management module 213 is not received, indicating that the total duration of the target video source is less than the third preset time t3, i.e., the target video source has already played to the end before the t3 time parameter of the timing mode is reached, the mode action L can be performed. The mode action L can be configured to send a screen projection end message to the View management module 204 through the message processing module 203.

[0342] FIG. 16 is a schematic diagram of the change of the user interface in the timing mode when playing the video source (non-live broadcast) pushed by the VideoURL in some embodiments of the present application. As shown in subgraph (b) of FIG. 16, the View management module 204 receives the screen projection end message, and displays the fourteenth prompt information 161 on the screen projection playing interface. An example of the prompt content of the fourteenth prompt information 161 is “the played duration of the video source has not reached the timing time specified in the timing mode A, and the video source has already played to the end”.

[0343] In some embodiments, as shown in subgraph (b) of FIG. 16, in the scenario where the screen projection source is the target video source pushed by the VideoURL, and the duration is less than the third preset time t3, when the View management module 204 receives the screen projection end message, a screen projection switching button can also be displayed on the screen projection playing interface, so that the user can switch to other screen projection content for continuous watching before the t3 timing time of the timing mode is reached. Since the target video source has already played to the end before the continuation end condition of the timing mode is met, there is no effective video source content to be displayed on the screen projection playing interface. At this time, the screen projection management module 201 can not actively disconnect the screen projection connection, i.e., the screen projection connection can be disconnected or not disconnected.

[0344] In some embodiments, for the timing mode, there are several cases: (1) the played duration of the target video source reaches the third preset time t3; (2) the restDuration of the target video source is greater than a preset threshold; (3) the restDuration of the target video source is not greater than the preset threshold; (4) the user agrees to disconnect the screen projection connection; (5) the user refuses to delay to disconnect the screen projection connection until the target video source plays to the end; (6) the user agrees to delay to disconnect the screen projection connection until the target video source plays to the end; (7) the target video source plays to the end.

[0345] Based on the above several cases, when at least case (1) is reached, it is determined that the continuation end condition is met, the playing of the target video source is stopped, and the screen projection connection is disconnected. Other cases can further expand the possibility of the continuation end condition by being appropriately combined with case (1).

[0346] In some embodiments, when case (1) occurs, the user can be further asked whether to agree to disconnect the screen projection connection. If case (4) is reached, it is determined that the resume end condition is met, the target video source is stopped playing, and the screen projection connection is disconnected.

[0347] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated. If case (2) occurs, it is determined that the resume end condition is met, the target video source is stopped playing, and the screen projection connection is disconnected.

[0348] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated. If case (2) occurs, the user can be further asked whether to agree to disconnect the screen projection connection. If case (4) is reached, it is determined that the resume end condition is met, the target video source is stopped playing, and the screen projection connection is disconnected.

[0349] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated. If case (3) occurs, the target video source continues to play until case (7) occurs, it is determined that the resume end condition is met, the target video source is stopped playing, and the screen projection connection is disconnected.

[0350] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated. If case (3) occurs, the user can be further asked whether to agree to delay the disconnection of the screen projection until the end of the target video source. If case (5) occurs, it is determined that the resume end condition is met, the target video source is stopped playing, and the screen projection connection is disconnected.

[0351] In some embodiments, when case (1) occurs, the restDuration of the target video source can be further calculated. If case (3) occurs, the user can be further asked whether to agree to delay the disconnection of the screen projection until the end of the target video source. If case (6) occurs, the target video source continues to play until case (7) occurs, it is determined that the resume end condition is met, the target video source is stopped playing, and the screen projection connection is disconnected.

[0352] In some embodiments, before the played duration of the target video source reaches the third preset duration t3, if the mode management module 205 does not trigger other screen projection modes (such as the timing mode, the interval mode), it is determined that the resume end condition is not met, the display device continues to play the target video source, and the screen projection connection is not disconnected.

[0353] The above embodiments take the display of single-path projection (projection path number = 1) as an example. In some embodiments, if the projection path number is greater than 1, and the display device displays multiple paths of projection on the same screen, the multiple paths of projection can share the timing mode, i.e., the timing mode is effective for the multiple paths of projection at the same time. In this way, when the system time reaches the preset time T of the timing mode y , the mode management module 205 triggers the timing mode for the multiple paths of projection at the same time, and the multiple paths of projection are turned off at the same time in the timing mode.

[0354] In some embodiments, if the projection path number is greater than 1, because the start time of each path of projection can be different, the mode application can separately process the interval mode and the timing mode for each path of projection.

[0355] The above embodiments take the timing mode, the interval mode, and the timing mode as examples, and detailedly explain the trigger condition monitoring and mode action execution of the projection mode based on the architecture of the mode application. The trigger condition and the execution action of the projection mode can be configured as needed according to the use scenario and the requirement, and the constraint control of each projection play can be realized through the mode application.

[0356] In some embodiments, the mode management module 205 can configure one or more of the above modes. When multiple projection modes coexist, the multiple modes can be processed according to a preset rule, which is not limited.

[0357] In some embodiments, an example of a preset rule is to process the modes according to the first trigger principle. Assuming that the mode management module 205 is configured with N modes, and the trigger condition of mode a is the first to be met, mode a can be processed in the multiple mode coexistence scenario, and the processing of the N-1 modes after mode a is cancelled.

[0358] In some embodiments, an example of a preset rule is to process the modes according to the last trigger principle. Assuming that the mode management module 205 is configured with N modes, and the trigger condition of mode b is the last to be met, the mode management module 205 can skip the processing of the N-1 modes before mode b, and process mode b in the multiple mode coexistence scenario.

[0359] In some embodiments, an example of a preset rule is to execute the mode actions in the order of the mode trigger. Assuming that the mode management module 205 is configured with the timing mode and the interval mode, if the trigger condition of the interval mode is met first, the mode action of the interval mode is executed first, and when the trigger condition of the timing mode is met later, the mode action of the timing mode is executed.

[0360] In some embodiments, a preset rule is that the mode processing is performed according to a preset mode priority. The mode management module 205 can process the N modes in sequence according to the priority of the N modes.

[0361] In some embodiments, the mode priority can be set by the user, and the mode management module 205 saves the mode priority set by the user.

[0362] In some embodiments, the mode management module 205 can set the mode priority according to the user preference. For example, the mode priority can be set according to the frequency of use of the N modes.

[0363] In some embodiments, the mode application runs in the application layer, and the mode application is controlled by the controller 250, so that the controller 250 can implement the screen projection mode processing method in different modes in the above embodiments by running the mode application. The software architecture of the mode application is not limited to the example provided in FIG. 3B.

[0364] FIG. 17 is a timing interaction diagram one of the screen projection mode processing method provided in some embodiments of the present application. Referring to FIG. 17, the interaction objects include a user, a screen projection sending end (i.e., a screen projection device), and a screen projection receiving end (i.e., a display device). The user can initiate screen projection to the screen projection receiving end based on different screen projection protocols at the screen projection sending end, so that the screen projection sending end sends a screen projection request to the screen projection receiving end.

[0365] In some embodiments, referring to FIG. 17, the screen projection receiving end can inquire the user whether to accept the screen projection request of the screen projection sending end through a UI or voice, etc. If the user accepts the screen projection request, the screen projection receiving end sends an agree screen projection message to the screen projection sending end. The screen projection sending end receives the agree screen projection message and establishes a screen projection connection with the screen projection receiving end.

[0366] In some embodiments, referring to FIG. 17, if the screen projection sending end is a push movie source type screen projection (referred to as: target movie source) to the screen projection receiving end through a VideoURL, after the screen projection connection is established, the screen projection sending end can send a screen projection instruction to the screen projection receiving end. The screen projection instruction can include a VideoURL (video link, also referred to as a resource address) of the screen projection data, Session information, and metadata, etc. The Session information includes but is not limited to a device ID of the screen projection sending end, screen projection source information, etc. The screen projection source information includes a screen projection source type, which includes mirror screen projection (mirror) and video link push screen projection (VideoURL). The metadata includes but is not limited to the name, actor, director, release date, style label (such as action, comedy, suspense, etc.) of the target movie source, etc.

[0367] In some embodiments, referring to FIG. 17, the screen projection receiving end receives the screen projection instruction, and can obtain the VideoURL, Session information and metadata from the screen projection instruction. If the screen projection source type is determined to be VideoURL according to the Session information, the screen projection receiving end can further determine the type of the screen projection media asset, which includes live streaming type (real-time streaming) and clip source type.

[0368] In some embodiments, the screen projection receiving end can determine the type of the screen projection media asset according to the attribute values of duration, Seek and MIME provided by the metadata and the Session information. For example, if the metadata indicates that the screen projection content is of the type of movie or episode, the duration is greater than 0 (for example, 45 min), and the Seek action can be performed, the screen projection receiving end determines that the screen projection sending end pushes the clip source type screen projection, and the clip source is the existing media asset (with a clear total duration of the clip source) provided by the VideoURL, rather than the real-time streaming media asset recorded in real time. The VideoURL corresponds to the target clip source.

[0369] In some embodiments, referring to FIG. 17, the screen projection receiving end can download the multimedia data (i.e., the screen projection data) of the target clip source according to the VideoURL, and control the player to play the target clip source according to the screen projection data.

[0370] In some embodiments, referring to FIG. 17, the screen projection receiving end can obtain the continuation time data. The screen projection receiving end can obtain the continuation time data according to the previously preset and stored mode information, or according to the mode information set by the user in real time based on the screen projection mode setting page when the target clip source starts playing. The screen projection mode includes but is not limited to the timing mode, the interval mode and the timing mode. For different screen projection modes, the continuation time data contains different parameters, and the continuation time data includes but is not limited to at least one of the following parameters: preset time, first preset duration, second preset duration and third preset duration.

[0371] In some embodiments, referring to FIG. 17, the screen projection receiving end can also acquire the playing time data during the playing process after the target video source starts playing. The playing time data includes, but is not limited to, at least one of the following parameters: the system time of the display device, the played time length of the target video source. The played time length can be a parameter acquired by a timer when the target video source starts playing. In some embodiments, referring to FIG. 17, the screen projection receiving end can determine whether the continuation end condition is met based on the continuation time data and the playing time data. For different screen projection modes, the judgment criteria of the continuation end condition are different. For example, for the timing mode, to meet the continuation end condition, at least the system time should reach the preset time. For the interval mode, to meet the continuation end condition, at least the played time length of the target video source should reach the first preset time length. For the timing mode, to meet the continuation end condition, at least the played time length of the target video source should reach the third preset time length.

[0372] In some embodiments, referring to FIG. 17, if the screen projection receiving end determines that the continuation end condition is met, the target operation is performed. For different screen projection modes, the target operation corresponding to the mode action can be different. For example, for the timing mode and the timing mode, the target operation can be configured to disconnect the screen projection connection with the screen projection sending end. For the interval mode, the target operation can be configured to pause playing the target video source pushed by the screen projection sending end.

[0373] In some embodiments, for the timing mode and the timing mode, the screen projection receiving end can also refer to at least one of multiple factors such as the user's viewing intention and the remaining playing time length of the target video source to decide whether to disconnect the screen projection connection or delay the disconnection of the screen projection connection until the target video source ends playing, so as to accurately and flexibly control the screen projection mode processing and the video source continuation / pausing, reduce the related operation of manually switching the screen projection mode by the user, and improve the user experience.

[0374] For the screen projection receiving end, the display device can include a controller configured with the above-mentioned software program executed by the screen projection receiving end to realize the interaction with the screen projection sending end and the screen projection playing processing. For different screen projection modes, the judgment basis of the continuation end condition and the execution of the mode action / target operation can be specifically referred to the description of the related embodiments above, and the timing interaction embodiments will not be described herein.

[0375] FIG. 18 is a timing interaction diagram of a screen projection mode processing method (timing mode) provided by some embodiments of the present application. Referring to FIG. 18, the interactive two ends include a screen projection sending end (i.e., a screen projection device) and a screen projection receiving end (i.e., a display device).

[0376] In some embodiments, referring to FIG. 18, the screen projection receiving end can include a screen projection service (CastServer), a video player activity (VideoPlayerActivity, corresponding to a screen projection playing interface), a view display module (ViewModule), a player (Player), a mode manager (ModeManager), a time manager (TimerManager), a playing state manager (PlayStateManager), and a mode analysis module (ModeAnalysis). The screen projection service (CastServer) corresponds to the screen projection management module 201 in FIG. 3B; the view display module (ViewModule) and the video player activity (VideoPlayerActivity) can correspond to the View management module 204 in FIG. 3B; the player (Player) and the playing state manager (PlayStateManager) can correspond to the play control management module 212 in FIG. 3B; the mode manager (ModeManager) and the mode analysis module (ModeAnalysis) can correspond to the mode management module 205 in FIG. 3B; and the time manager (TimerManager) corresponds to the time management module 213 in FIG. 3B.

[0377] In some embodiments, referring to FIG. 18, if the screen projection sending end pushes the target video source to the screen projection receiving end through a VideoURL, after establishing a screen projection connection, the screen projection sending end can send a screen projection instruction to the screen projection receiving end. The screen projection instruction can include a VideoURL (video link or resource address) of screen projection data, Session information, metadata, and the like.

[0378] In some embodiments, referring to FIG. 18, the CastServer receives the screen projection instruction, obtains the VideoURL, Session information, and metadata from the screen projection instruction, and can start the VideoPlayerActivity. The VideoPlayerActivity is used to control the ViewModule to display the related View, such as initializing the configuration and displaying the screen projection playing interface. The VideoPlayerActivity can also send a playing instruction to the Player, so that the Player responds to the playing instruction, downloads the multimedia data of the target video source from the server according to the VideoURL, and plays the target video source, so that the screen projection playing interface displays the video content of the target video source, and the audio output device plays the audio content of the target video source.

[0379] In some embodiments, referring to FIG. 18, after the Player plays the target video source, the Player can monitor the playing process of the target video source, and synchronize information related to the playing process of the target video source to the PlayStateManager, such as the playing state and the playing progress of the target video source. The playing state includes a playing state and a pausing state.

[0380] In some embodiments, referring to FIG. 18, for the timing mode, since the system time and the preset time are used to determine whether the resuming end condition is met, and thus whether to disconnect the screen projection connection, the timing mode does not involve the timing mechanism, and thus the TimerManager can not start the timing.

[0381] In some embodiments, referring to FIG. 18, after the CastServer receives the screen projection instruction, the CastServer can obtain the metadata of the target video source from the screen projection instruction, and send the metadata and the Session information to the ModeManager. The ModeManager can determine the screen projection source information according to the metadata and the Session information. In FIG. 18, the target video source pushed by the VideoURL is taken as an example.

[0382] In some embodiments, the ModeAnalysis can obtain the resuming time data from the mode information preset or obtained by the user in real time, and obtain the playing time data during the playing of the target video source. The playing time data can include the system time, the timing time of the TimerManager (recorded playing time of the target video source), and the like. Referring to FIG. 18, the ModeAnalysis can detect the screen projection mode (referred to as the first screen projection mode) triggered currently based on the resuming time data and the playing time data, and determine whether the resuming end condition is met. The mode information can include at least one of the timing mode information, the interval mode information, and the timing mode information.

[0383] In some embodiments, referring to FIG. 18, the ModeManager can start the mode listener, and the mode listener faces the ModeAnalysis to listen to the mode trigger event corresponding to the first screen projection mode generated by the ModeAnalysis, so as to realize the mode synchronization between the ModeAnalysis and the ModeManager.

[0384] In some embodiments, the first screen projection mode triggered is taken as an example, and the first screen projection mode is the timing mode. Referring to FIG. 18, the ModeAnalysis detects that the system time reaches the preset time T yWhen the timing mode is determined to be triggered, the timing mode trigger event is sent to the ModeManager. When the mode listener of the ModeManager listens to the timing mode trigger event, the ModeManager switches the current mode to the timing mode and acquires the playing progress of the target video source from the PlayStateManager (or the Player).

[0385] In some embodiments, referring to FIG. 18, the ModeManager can calculate the restDuration of the target video source according to the playing progress and the total duration of the target video source. The ModeManager can compare the restDuration with a threshold value, and then decide the target mode action of the timing mode according to the size of the restDuration.

[0386] In some embodiments, referring to FIG. 18, taking the single threshold value comparison as an example, if the restDuration is not greater than the threshold value, the ModeManager can set the mode action priority as the delayed disconnection of the casting operation is prior to the immediate disconnection of the casting operation. In this way, the ModeManager can send the query instruction 1 to the ViewModule. The ViewModule responds to the query instruction 1, referring to the example of FIG. 5C, can prompt that the system time has reached the preset time, prompt the restDuration of the target video source, and query whether the user agrees to delay the disconnection of the casting connection until the end of the playing of the target video source. Assuming that the user agrees to delay the disconnection of the casting, the ViewModule can send the message of agreeing to delay the disconnection of the casting to the ModeManager.

[0387] In some embodiments, referring to FIG. 18, the ModeManager receives the message of agreeing to delay the disconnection of the casting, monitors the change of the restDuration, and exits the timing mode when the restDuration becomes 0 (indicating that the playing of the target video source is ended). Then, the ModeManager sends the disconnection instruction of the casting to the CastServer. The CastServer responds to the disconnection instruction of the casting, can call the finish() interface of the Session object to disconnect the casting connection with the casting sending end. After the casting connection is disconnected, the CastServer can send the message of having disconnected the casting to the VideoPlayerActivity. The VideoPlayerActivity receives the message of having disconnected the casting, sends the stop playing instruction to the Player, and sends the exit casting instruction to the ViewModule. The Player responds to the stop playing instruction, stops playing the target video source, cleans up the casting data, releases the player resources, and closes the player. The ViewModule responds to the exit casting instruction, and prompts “the playing of the casting content is ended, and the casting is disconnected”.

[0388] In some embodiments, referring to FIG. 18, if the restDuration is greater than the threshold, the ModeManager can set the mode action priority as the immediate disconnection of the casting operation is prior to the delayed disconnection of the casting operation, so that the ModeManager can send the query instruction 2 to the ViewModule. The ViewModule responds to the query instruction 2, referring to the examples of FIG. 6 or FIG. 7, can prompt that the system time has reached the preset time, prompt the restDuration of the target piece source, and query whether to immediately disconnect the casting connection. Assuming that the user agrees to immediately disconnect the casting, the ViewModule can send the agreement to immediately disconnect the casting message to the ModeManager. The ModeManager receives the agreement to immediately disconnect the casting message, exits the timing mode, and sends the disconnection instruction to the CastServer.

[0389] In some embodiments, taking the double threshold comparison as an example, the ModeManager can set a first threshold and a second threshold, and the second threshold is greater than the first threshold. If the restDuration is not greater than the first threshold, referring to the example of FIG. 5C, the ModeManager can set the delayed disconnection of the casting operation is prior to the immediate disconnection of the casting operation, and the ViewModule queries whether the user agrees to delay to disconnect the casting connection until the end of the target piece source.

[0390] In some embodiments, if the restDuration is greater than the first threshold and not greater than the second threshold, referring to the examples of FIG. 6 or FIG. 7, the ModeManager can set the immediate disconnection of the casting operation is prior to the delayed disconnection of the casting operation, and the ViewModule queries whether the user agrees to immediately disconnect the casting connection.

[0391] In some embodiments, if the restDuration is greater than the second threshold, referring to the example of FIG. 8, the ModeManager sets the immediate disconnection of the casting operation is prior to the delayed disconnection of the casting operation, and the ViewModule queries whether the user agrees to immediately disconnect the casting connection. If the user refuses to immediately disconnect the casting connection, since the restDuration time is long, it may affect the user's rest, and the user can support to disconnect the casting before the end of the target piece source at any time by inputting a preset operation.

[0392] Figure 19 is a timing interaction diagram of the screen casting mode processing method (interval mode) provided in some embodiments of this application. Referring to Figure 19, when the target video source is started, VideoPlayerActivity can also start TimerManager, which controls the Timer to start timing when the target video source starts playing, so as to keep track of the played duration of the target video source. TimerManager can synchronize the timing of the Timer to ModeAnalysis. In this way, for interval mode, the playback time data obtained by ModeAnalysis includes the played duration of the target video source (i.e., the timing of the Timer), and the resume playback time data includes the playback duration based on the start time T of the interval mode. mi and the final time T ni Among them, T mi and T ni It is calculated based on the first preset duration t1, the second preset duration t2, and the round i.

[0393] In some embodiments, referring to Figure 19, ModeAnalysis detects that the timing of the Timer has reached the starting time T of the i-th round interval mode. mi When it is determined that the interval mode in the i-th round has been triggered, an interval mode trigger event can be sent to the ModeManager. When the ModeManager's mode listener detects this interval mode trigger event, the ModeManager switches the current mode to interval mode and sends an "Entering Interval Mode" message to the PlayStateManager.

[0394] In some embodiments, referring to Figure 19, when PlayStateManager receives the entry interval mode message, if it detects that the target video source is in playback, it sends a pause playback command to Player and an obscuring command to ViewModule. In response to the pause playback command, Player can call the pause interface of the casting sender's Session to synchronously pause the audio and video playback of the target video source, thus stopping the playback progress at the pause point. In response to the obscuring command, as shown in the example in Figure 10, ViewModule displays a preset obscuring page on top of the casting playback interface, making the video content of the target video source invisible to the user. The user cannot hear the audio or see the video of the target video source, thus achieving the purpose of a mid-game break.

[0395] In some embodiments, referring to Figure 19, ModeAnalysis detects that the timing of the Timer has reached the end time T of the i-th round interval mode. niWhen the ModeManager receives the interval mode end event, the ModeManager can send an exit interval mode message to the PlayStateManager.

[0396] In some embodiments, referring to FIG. 19, the PlayStateManager receives the exit interval mode message, detects that the target video source is in the paused playing state, and then sends a resume playing instruction to the Player and a cancel shielding instruction to the ViewModule. The Player, in response to the resume playing instruction, can call the replay interface of the screen projection sending end Session to continue playing the audio and video of the target video source from the paused node, so that the playing progress of the target video source continues to dynamically change, thereby resuming the target video source. The ViewModule, in response to the cancel shielding instruction, cancels the display of the preset shielding page, so that the screen projection playing interface is not shielded and is visible to the user. Subsequently, the ModeAnalysis can continue to detect according to the playing time data and the resuming time data, and wait for the next round (i.e., the i+1th round) of interval mode triggering.

[0397] FIG. 20 is a timing interaction diagram of a screen projection mode processing method (interval mode) provided by some embodiments of the present application. Compared with the timing interaction diagram of the example of FIG. 19, both of them are for the interval mode scenario, but there are the following differences:

[0398] ①Referring to FIG. 20, after the ModeManager sends the enter interval mode message to the PlayStateManager, if the PlayStateManager detects that the target video source is in the playing state, the PlayStateManager sends an operation shielding instruction to the ViewModule.

[0399] ②Referring to FIG. 20, the ViewModule, in response to the operation shielding instruction, listens to the KeyEvent (operation event, including the user's operation event on the target video source) of the user and disposes the listened KeyEvent, so that the ViewModule can shield (not respond to) the user operation, so that the user cannot intervene in the operation of the target video source. As shown in the example of FIG. 11, instead of shielding the screen projection playing interface with the preset shielding page, the ViewModule displays the pause instruction control 111 on the screen projection playing interface and prompts that the target video source is not operable in the interval mode. For example, when the user clicks the pause instruction control 111, the ViewModule shields / does not respond to the user operation, so that the user cannot switch the playing state of the target video source in the interval mode, and the user cannot perform other operation on the target video source, such as adjusting the speed, fast forwarding, fast rewinding, etc.

[0400] ③Referring to FIG. 20, after the ModeManager sends the exit interval mode message to the PlayStateManager, the PlayStateManager detects that the target video source is in the pause playing state, and sends the unblock operation instruction to the ViewModule.

[0401] ④Referring to FIG. 20, the ViewModule unblocks the user operation in response to the unblock operation instruction, that is, responds to the KeyEvent. As shown in the example of FIG. 11, the ViewModule prompts the end of the i-th round interval mode, and prompts that the target video source is operable, so that the user can continue to perform the pause playing, fast forward, fast backward, seek, speed adjustment and other control operations on the target video source.

[0402] FIG. 21 is a timing interaction diagram of a screen projection mode processing method (timing mode) provided by some embodiments of the present application. Referring to FIG. 21, when the ModeAnalysis detects that the timing time of the Timer reaches the third preset time length t3, it determines that the timing mode is triggered, and sends the timing mode trigger event to the ModeManager. When the mode listener of the ModeManager listens to the timing mode trigger event, the ModeManager switches the current mode to the timing mode, and obtains the playing progress of the target video source from the PlayStateManager (or the Player).

[0403] In some embodiments, referring to FIG. 21, the ModeManager can calculate the remaining playing time (restDuration) of the target video source according to the playing progress and the total time length of the target video source. The ModeManager can compare the restDuration with a threshold, and then decide the target mode action of the timing mode according to the size of the restDuration.

[0404] In some embodiments, referring to FIG. 21, taking the single threshold comparison as an example, if the restDuration is not greater than the threshold, the ModeManager can set the mode action priority as that the delayed disconnection of the screen projection operation is prior to the immediate disconnection of the screen projection operation, so that the ModeManager can send the query instruction 3 to the ViewModule. The ViewModule responds to the query instruction 3, referring to the example of FIG. 13, can prompt that the screen projection watching time length reaches the specified time length (i.e., the third preset time length t3), prompt the restDuration of the target video source, and query whether the user agrees to disconnect the screen projection connection when the target video source is played to the end. Assuming that the user agrees to delay the disconnection of the screen projection, the ViewModule can send the agreement to delay the disconnection of the screen projection message to the ModeManager.

[0405] In some embodiments, referring to FIG. 21, the ModeManager receives the message of agreeing to delay disconnection of the screen projection, monitors the change of the restDuration, and when the restDuration becomes 0 (indicating that the target video source ends playing), the ModeManager can exit the timing mode. The ModeManager can send a stop timing instruction to the TimerManager, and the TimerManager can control the Timer to stop timing and clear the timing time of the Timer in response to the stop timing instruction.

[0406] In some embodiments, referring to FIG. 21, when the target video source ends playing, the ModeManager can send a disconnection instruction of the screen projection to the CastServer. The CastServer can call the finish() interface of the Session object in response to the disconnection instruction of the screen projection, disconnect the screen projection connection with the screen projection sending end, and send a disconnection message of the screen projection to the VideoPlayerActivity after the screen projection connection is disconnected. The VideoPlayerActivity receives the disconnection message of the screen projection, sends a stop playing instruction to the Player and an exit screen projection instruction to the ViewModule. The Player stops playing the target video source, clears the screen projection data, releases the player resources, and closes the player in response to the stop playing instruction. The ViewModule prompts “the screen projection content ends playing, and the screen projection is disconnected” in response to the exit screen projection instruction.

[0407] In some embodiments, referring to FIG. 21, if the restDuration is greater than a threshold value, the ModeManager can set the mode action priority as the immediate disconnection of the screen projection operation is prior to the delay disconnection of the screen projection operation, so that the ModeManager can send an inquiry instruction 4 to the ViewModule. The ViewModule responds to the inquiry instruction 4, referring to the example of FIG. 14, can prompt that the screen projection watching time reaches a specified time length (i.e., the third preset time length t3), prompt the restDuration of the target video source, and inquire whether the user agrees to immediately disconnect the screen projection connection. Assuming that the user agrees to immediately disconnect the screen projection, the ViewModule can send a message of agreeing to immediately disconnect the screen projection to the ModeManager. The ModeManager receives the message of agreeing to immediately disconnect the screen projection, exits the timing mode, and sends a disconnection instruction of the screen projection to the CastServer.

[0408] In some embodiments, the ViewModule can inquire whether the user agrees to disconnect the screen projection immediately in response to the inquiry instruction 4. If the user refuses to disconnect the screen projection immediately, the restDuration time is long enough to affect the user's rest, as shown in FIG. 15, the ViewModule can prompt that the counting has stopped and the screen projection is delayed to be disconnected, and prompt that the screen projection can be disconnected at any time before the end of the target video source by inputting a preset operation.

[0409] In some embodiments, multiple thresholds can also be set in the timing mode, for example, double thresholds (including a first threshold and a second threshold, the second threshold being greater than the first threshold). The ModeManager can compare the restDuration and the multiple thresholds to determine the target mode action performed when the restDuration is in different threshold ranges, which will not be described herein.

[0410] In some embodiments, the user can configure the mode set according to the viewing needs. The mode set can be presented as {timing mode}, {interval mode}, {timing mode}, {timing mode, interval mode}, {timing mode, timing mode}, {interval mode, timing mode}, {timing mode, interval mode, timing mode}. Different timing interaction logics in different scenarios can be adapted, and the software program configuration and flow interaction logic of each module in the mode application can be adapted.

[0411] In some embodiments, when the first screen projection mode is the timing mode, the interval mode, or the timing mode, the mode application architecture shown in FIG. 3B or the timing interaction logic shown in FIGS. 17-21 can be used to determine whether the continuation end condition is met according to the mode type, the continuation time data, and the playing time data in the scenario of the VideoURL push video source screen projection, to process the triggered first screen projection mode, and to perform the matching target mode action, thereby adapting the constraints and controls of the screen projection in different modes. In this way, the user's manual mode intervention is reduced, the mode processing efficiency and the human-computer interaction efficiency are improved, and the intelligent and accurate control of different modes can be achieved.

[0412] The screen projection receiving end can include a controller, and the controller can execute the technical solutions provided by at least one embodiment of the present application. When the mode application is configured and run in the screen projection receiving end, the mode application is controlled by the controller to execute the related program steps, and the continuation end condition discrimination of different screen projection modes, the mode action execution, and the related UI update can be achieved through the interaction and flow transfer of the underlying modules of the mode application, which will not be described herein. The controller can also execute the timing interaction logic shown in FIGS. 17-21 to achieve the above functions.

[0413] Some embodiments of the present application further provide a computer storage medium which can store a program. When the computer storage medium is configured in the display device 200, the program can include all or part of the program steps involved in the screen projection mode processing method of the mode application or the controller configuration in the above embodiments when executed. The computer storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0414] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

[0415] For the convenience of explanation, the above description has been made in combination with specific embodiments. However, the above exemplary discussion is not intended to exhaust or limit the embodiments to the specific forms disclosed above. Various modifications and variations can be derived according to the above teachings. The selection and description of the above embodiments are to better explain the content of the present disclosure, so that those skilled in the art can better use the embodiments. Industrial applicability

[0416] The scheme provided in the embodiments of the present application can be used for a display device to reduce user manual mode intervention. In the technical scheme provided in the embodiments of the present application, the screen projection device can include a resource address in a screen projection instruction when projecting a piece source to the display device, so that the display device can request data of a target piece source from a server according to the resource address, thereby playing the target piece source; the display device can acquire play-continuation time data, the play-continuation time data including time parameters related to trigger conditions of different screen projection modes; the display device can further acquire play time data, the play time data being related time parameters involved in a process of establishing a screen projection connection and playing a screen projection piece source, so that the play time data and the play-continuation time data are compared to determine whether a play-continuation end condition of the target piece source is met; if the play-continuation end condition is met, a screen projection disconnection operation or a piece source pausing operation can be performed based on settings of different screen projection modes, and otherwise, if the play-continuation end condition is not met, the piece source is continuously played, so that after the piece source is started, the play-continuation end condition of the piece source is determined by using the play time data and the play-continuation time data, thereby the controller automatically disconnects the screen projection connection or pauses the piece source in the case that the play-continuation end condition is met, the display device is prevented from continuously playing screen projection content, intelligent control of screen projection playing based on a time management mechanism is implemented, accuracy of screen projection mode processing is improved, user manual mode intervention is reduced, and screen projection processing efficiency and man-machine interaction efficiency are improved.

Claims

A display device characterized by comprising: The display device comprises: a display configured to display a user interface; a communication device configured to communicate data with a server; a controller configured to perform: in response to receiving a screen projection instruction for playing a target video source sent by the screen projection device, obtaining and playing the target video source from a server corresponding to a resource address contained in the screen projection instruction according to the resource address; obtaining continuation time data; obtaining playing time data during playing of the target video source; if it is determined that a continuation end condition is met based on the playing time data and the continuation time data, performing a target operation; wherein the target operation comprises a screen projection disconnection operation or a pause playing operation on the target video source; if it is determined that the continuation end condition is not met based on the playing time data and the continuation time data, continuing to play the target video source. The display device according to claim 1, characterized in that The playing time data comprises system time of the display device, and the continuation time data comprises a preset time; The controller performing the target operation if it is determined that the continuation end condition is met based on the playing time data and the continuation time data is specifically configured to: if the system time reaches the preset time, stop playing the target video source and disconnect the screen projection connection with the screen projection device. The display device according to claim 2, wherein The controller performing the target operation if the system time reaches the preset time and stopping playing the target video source and disconnecting the screen projection connection with the screen projection device is specifically configured to: when the system time reaches the preset time, controlling the display to display first prompt information, the first prompt information being used to prompt a user whether to agree to disconnect the screen projection connection; if an operation of the user agreeing to disconnect the screen projection connection is received, stopping playing the target video source and disconnecting the screen projection connection with the screen projection device; The controller is further configured to: if an operation of the user refusing to disconnect the screen projection connection is received, continuing to play the target video source. The display device according to claim 2, wherein The controller performing the target operation if the system time reaches the preset time and determining that the continuation end condition is met is specifically configured to: when the system time reaches the preset time, determining a remaining playing time length of the target video source according to a playing progress of the target video source and a total time length of the target video source; if the remaining playing time length is greater than a preset threshold, stopping playing the target video source and disconnecting the screen projection connection with the screen projection device. The display device according to claim 4, wherein The controller performing the target operation if the remaining playing time length is greater than a preset threshold and stopping playing the target video source and disconnecting the screen projection connection with the screen projection device is specifically configured to: when the remaining playing time length is greater than a preset threshold, controlling the display to display the remaining playing time length and first prompt information, the first prompt information being used to prompt a user whether to agree to disconnect the screen projection connection; if an operation of the user agreeing to disconnect the screen projection connection is received, stopping playing the target video source and disconnecting the screen projection connection with the screen projection device; The controller is further configured to continue playing the target video source if an operation of the user rejecting to disconnect the screen projection connection is received. The display device according to claim 4, characterized in that The controller is further configured to, after determining the remaining playing time of the target video source according to the playing progress of the target video source and the total time length of the target video source, continue playing the target video source if the remaining playing time is not greater than the preset threshold. The controller is further configured to disconnect the screen projection connection with the screen projection device when the playing of the target video source ends. The controller is further configured to, after determining the remaining playing time of the target video source according to the playing progress of the target video source and the total time length of the target video source, continue playing the target video source if the remaining playing time is not greater than the preset threshold. The display device according to claim 6, characterized in that The controller is further configured to stop playing the target video source and disconnect the screen projection connection with the screen projection device if an operation of the user rejecting to delay disconnecting the screen projection connection is received. The playing time data includes a played time length of the target video source, and the resuming time data includes a first preset time length. The display device according to claim 1, characterized in that The controller is further configured to, after determining that the resuming end condition is met based on the playing time data and the resuming time data, perform a target operation. The controller is further configured to pause playing the target video source if the played time length of the target video source reaches the first preset time length. The resuming time data further includes a second preset time length. The display device according to claim 8, characterized in that The controller is further configured to, after pausing playing the target video source if the played time length of the target video source reaches the first preset time length, continue playing the target video source from a pause node when the played time length of the target video source reaches a sum of the first preset time length and the second preset time length. The controller is further configured to: control the display to display a preset blocking page on an upper layer of a playing interface of the target video source when playing the target video source is paused; The display device according to claim 9, characterized in that control the display to cancel displaying the preset blocking page when the target video source is continued to play from the pause node. The controller is further configured to: control the display to display a pause prompt control in the playing interface of the target video source when playing the target video source is paused, the pause prompt control being used to prompt that the target video source is in a paused playing state; The display device according to claim 9, characterized in that if a playing control instruction of the target video source is received when the target video source is in the paused playing state, do not perform an operation corresponding to the playing control instruction; control the display to cancel displaying the pause prompt control when the target video source is continued to play from the pause node, and perform an operation corresponding to the playing control instruction of the target video source if the playing control instruction of the target video source is received. The playing time data includes a played time length of the target video source, and the resuming time data includes a first preset time length and a second preset time length. ​ The display device according to claim 1, characterized in that ​ The controller is specifically configured to perform a target operation if it is determined that the resume end condition is met based on the play time data and the resume time data. If the played duration of the target video source reaches the first preset duration, the controller starts an interval mode of a first round, and suspends playing of the target video source. When the played duration of the target video source reaches a sum of the first preset duration and the second preset duration, the controller exits the interval mode of the first round, and continues playing the target video source from the suspension node. The display device according to claim 12, characterized in that After the controller exits the interval mode of the first round and continues playing the target video source from the suspension node, the controller is further configured to: If the played time length of the target piece source reaches the start time T of the interval mode of the i-th round mi , the interval mode of the i-th round is started, and the playing of the target piece source is paused; wherein T mi = i*t1+ (i-1)*t2, t1 represents the first preset time length, t2 represents the second preset time length, i represents the round number of the interval mode, and i is greater than 1. If the played time length of the target clip source reaches the end time T of the interval mode of the i-th round ni , the interval mode of the i-th round is exited, and the target clip source is continued to play from the pause node; wherein T ni = T mi + t2 = i*(t1 + t2). The display device according to claim 1, characterized in that The play time data includes a played duration of the target video source, and the resume time data includes a third preset duration. The controller is specifically configured to perform a target operation if it is determined that the resume end condition is met based on the play time data and the resume time data. If the played duration of the target video source reaches the third preset duration, the controller stops playing the target video source, and disconnects the screen projection connection with the screen projection device. The display device of claim 14, wherein If the played duration of the target video source reaches the third preset duration, the controller controls the display to display third prompt information, and the third prompt information is used to prompt the user whether to agree to disconnect the screen projection connection. If an operation of the user agreeing to disconnect the screen projection connection is received, the controller stops playing the target video source, and disconnects the screen projection connection with the screen projection device. The controller is further configured to continue playing the target video source if an operation of the user refusing to disconnect the screen projection connection is received. The display device according to claim 14, characterized in that The controller is specifically configured to determine that the resume end condition is met if the played duration of the target video source reaches the third preset duration. When the played duration of the target video source reaches the third preset duration, the controller determines a remaining play duration of the target video source according to a play progress of the target video source and a total duration of the target video source. If the remaining play duration is greater than a preset threshold, the controller stops playing the target video source, and disconnects the screen projection connection with the screen projection device. The display device of claim 16, wherein If the remaining play duration is greater than a preset threshold, the controller controls the display to display the remaining play duration and third prompt information, and the third prompt information is used to prompt the user whether to agree to disconnect the screen projection connection. If an operation of the user agreeing to disconnect the screen projection connection is received, the controller stops playing the target video source, and disconnects the screen projection connection with the screen projection device. The controller is further configured to continue playing the target video source if an operation of the user refusing to disconnect the screen projection connection is received. The display device according to claim 16, characterized in that The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. At the end of playing the target video source, disconnect the screen projection connection with the screen projection device. The display device according to claim 18, wherein The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. A screen projection mode processing method, characterized in that, The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source. The controller is further configured to, if the remaining playing time length is not greater than the preset threshold, continue playing the target video source.

Images