Screen projection mode processing method and display equipment

Abstract

The embodiment of the invention discloses a screen projection mode processing method and display equipment, and the method comprises the steps: obtaining and playing a target film source from a server corresponding to a resource address according to the resource address contained in a screen projection instruction in response to the received screen projection instruction which is sent by the screen projection equipment and is used for playing the target film source; acquiring continuous playing time data; in the process of playing the target film source, obtaining playing time data; if it is determined that a continuous playing ending condition is met based on the playing time data and the continuous playing time data, a target operation is executed, and the target operation comprises a screen projection disconnection operation or a playing pause operation on the target film source; and if it is determined that a continuous playing ending condition is not satisfied based on the playing time data and the continuous playing time data, continuing to play the target film source. In this way, the accuracy of screen projection mode processing can be improved, manual mode intervention of a user is reduced, the screen projection processing efficiency and the man-machine interaction efficiency are improved, and intelligent and accurate control over screen projection playing is achieved.

Description

Technical Field

[0001] The present application relates to the field of screen projection technology, and in particular to a screen projection mode processing method and a display device. Background Art

[0002] When the display device is displaying the projected content, if certain preset conditions are triggered, it may be necessary to disconnect the projection, or to take a break before continuing to play the projection. For example, when the display device is displaying a film or television projection program, if the timing mode is started, the user can disconnect the projection when the projection has been played for a preset duration a to avoid exceeding the healthy viewing time set by the user. For another example, when the display device is displaying children's educational programs, the user can turn on the eye protection mode or the halftime mode every time the projection viewing time is preset for a duration b to avoid problems such as eye fatigue and lack of concentration caused by long-term uninterrupted learning in children.

[0003] For these user scenarios, when the preset trigger conditions are met, the user needs to manually intervene in the mode to adjust the screen projection status. For example, the user can observe the length of the screen projection or set an alarm reminder, and terminate the screen projection at the sending or receiving end at the time when the screen projection needs to be disconnected; for example, in the eye protection mode, the user needs to pause the screen projection first, and then resume the screen projection playback when the eye protection mode ends. This will lead to low operating efficiency on the one hand, and on the other hand, it is impossible to intelligently and accurately control different screen projection modes. Summary of the invention

[0004] The embodiments of the present application provide a screen projection mode processing method and a display device, which can improve the accuracy of screen projection mode processing, reduce user manual mode intervention, improve screen projection processing efficiency and human-computer interaction efficiency, and realize intelligent and precise control of screen projection playback.

[0005] In a first aspect, an embodiment of the present application provides a display device, including:

[0006] A display, for displaying a user interface;

[0007] A communication device, used for data communication with a server;

[0008] The controller is configured to execute:

[0009] In response to receiving a screen projection instruction for playing a target film source sent by the screen projection device, according to a resource address included in the screen projection instruction, acquiring and playing the target film source from a server corresponding to the resource address;

[0010] Get the resume time data;

[0011] In the process of playing the target video source, obtaining the playing time data;

[0012] If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes disconnecting the screen projection operation or pausing the playing of the target film source;

[0013] If it is determined based on the play time data and the resume play time data that the resume play end condition is not satisfied, the target film source continues to be played.

[0014] The technical solution provided by the above first aspect embodiment has the following beneficial effects: when the projection device sends a film source to the display device, the resource address can be included in the projection instruction, so that the display device can request the data of the target film source from the server according to the resource address, thereby playing the target film source; the display device can obtain the resume time data, and the resume time data includes time parameters related to the trigger conditions of different projection modes; the display device can also obtain the playback time data, and the playback time data is the relevant time parameters involved in the process of establishing a projection connection and playing the projection source, so that by comparing the playback time data and the resume time data, it can be determined whether the resume time requirements for the target film source are met. If the conditions for ending the continued broadcast are met, the screen projection operation can be disconnected or the playback of the film source can be paused based on the settings of different screen projection modes. Otherwise, if the conditions for ending the continued broadcast are not met, the film source continues to be played. In this way, after the film source starts playing, the playback time data and the resumed broadcast time data are used to determine the conditions for ending the continued broadcast of the film source. When the conditions for ending the continued broadcast are met, the controller automatically disconnects the screen projection connection or pauses the playback of the film source, thereby avoiding the display device from continuously playing the projection content. This realizes intelligent control of screen projection playback based on the time management mechanism, improves the accuracy of screen projection mode processing, reduces user intervention in manual modes, and improves screen projection processing efficiency and human-computer interaction efficiency.

[0015] In some embodiments of the first aspect, the playback time data includes the system time of the display device, and the resumed playback time data includes a preset time; if the controller determines that the resumed playback end condition is met based on the playback time data and the resumed playback time data, then the target operation is performed, and is specifically configured as follows: if the system time reaches the preset time, then the target film source is stopped from playing, and the screen projection connection with the projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: a scheme for determining the resumed playback end condition and the projection control operation based on the first time management mechanism (which can be called a timing mode) is provided, that is, when the system time reaches a fixed preset time, it is determined that the resumed playback end condition is met, and the controller disconnects the projection connection to stop playing the target film source, so as to avoid the projection device from continuing to push the projection content to the display device based on the projection connection when the preset time is reached, and also avoid the display device from continuing to play the projection content after exceeding the preset time, thereby avoiding affecting the user's work and rest due to the projection content playing time being too late.

[0016] In some embodiments of the first aspect, the controller stops playing the target film source and disconnects the projection connection with the projection device if the system time reaches the preset time. Specifically, the controller is configured as follows: when the system time reaches the preset time, the display is controlled to display a first prompt message, and the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the target film source is stopped from playing, and the projection connection with the projection device is disconnected; the controller is also configured as follows: if the user refuses to disconnect the projection connection, the target film source continues to play. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then, based on the time condition of the timing mode, the user's viewing needs are added to decide whether to disconnect the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the film source continues to play, thereby satisfying the user's viewing needs and preferences.

[0017] In some embodiments of the first aspect, the controller executes if the system time reaches the preset time, determining that the resume broadcast end condition is met, and is specifically configured as follows: when the system time reaches the preset time, determining the remaining playback time of the target film source based on the playback progress of the target film source and the total duration of the target film source; if the remaining playback time is greater than the preset threshold, stopping playback of the target film source and disconnecting the screen projection connection with the screen projection device. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, the film source may not have finished playing, so the film source has a time parameter of remaining playing time. The remaining playing time is calculated by the playing progress and total time of the film source, and the length of the remaining playing time is measured by a preset threshold, so that the controller decides whether to disconnect the screen projection connection when the system time reaches a fixed preset time; if the remaining playing time is large, if the screen projection connection is not disconnected, the display device will continuously play the projection content pushed by the projection device, which may affect the user's plan to take a regular break. Therefore, in this scenario, the controller can disconnect the screen projection connection and stop playing the film source, so that the user cannot continue to watch the film source content.

[0018] In some embodiments of the first aspect, the controller stops playing the target film source and disconnects the projection connection with the projection device if the remaining playback time is greater than a preset threshold. The controller is specifically configured as follows: when the remaining playback time is greater than the preset threshold, the display is controlled to display the remaining playback time and a first prompt message, wherein the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if an operation of the user agreeing to disconnect the projection connection is received, the target film source is stopped and the projection connection with the projection device is disconnected; the controller is also configured as follows: if an operation of the user refusing to disconnect the projection connection is received, the target film source continues to be played. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches a fixed preset time, the remaining playback time of the film source is used as a playback time parameter. If the remaining playback time is large, if the projection connection is not disconnected, the display device will continuously play the projection content pushed by the projection device, which will affect the user's regular rest plan. Therefore, the controller can control the display to display a prompt message to inform the user of the remaining playback time of the film source and ask the user whether to disconnect the projection connection. In this way, the user can refer to the remaining playback time and the user's viewing needs to decide whether to disconnect the projection connection.

[0019] In some embodiments of the first aspect, when the system time reaches the preset time, the controller determines the remaining playback time of the target film source according to the playback progress of the target film source and the total duration of the target film source, and is further configured to: if the remaining playback time is not greater than the preset threshold, continue to play the target film source; when the playback of the target film source ends, disconnect the screen projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches a fixed preset time, if the projection connection is not disconnected, the display device will continue to play the film source until the film source ends. Therefore, if the remaining playback time of the film source is short when the preset time is reached, it may not have much impact on the user's rest. In this way, the screen projection connection can be disconnected until the end of the playback of the film source, thereby ensuring the integrity of the user's viewing of the film source, avoiding the projection device from continuing to push the projection content to the display device based on the projection connection after the preset time is reached, and also avoiding the display device from continuing to play the projection content after the preset time exceeds the preset time.

[0020] In some embodiments of the first aspect, the controller executes if the remaining playback time is not greater than the preset threshold, continue to play the target film source, and is specifically configured as follows: if the remaining playback time is not greater than the preset threshold, control the display to display the remaining playback time and the second prompt information, the second prompt information is used to prompt the user whether to agree to delay the disconnection of the projection connection until the end of the playback of the target film source; if the user agrees to delay the disconnection of the projection connection, continue to play the target film source; the controller is also configured to: if the user refuses to delay the disconnection of the projection connection, stop playing the target film source and disconnect the projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches a fixed preset time, if the remaining playback time is short, the controller can control the display to display a prompt information to inform the user of the remaining playback time of the film source, and ask the user whether to agree to delay the disconnection of the projection connection until the end of the film source playback, so that the user can refer to the remaining playback time and viewing needs to decide whether to disconnect the projection immediately or delay the disconnection of the projection.

[0021] In some embodiments of the first aspect, the play time data includes the played time of the target film source, and the continued play time data includes a first preset time; if the controller determines that the continued play end condition is met based on the play time data and the screen continued play data, then the target operation is performed, and is specifically configured as follows: if the played time of the target film source reaches the first preset time, the target film source is paused. The technical solution provided by this embodiment has the following beneficial effects: a solution for determining the continued play end condition and the screen projection control operation based on the second time management mechanism (which can be called an interval mode) is provided. After the film source starts playing, the played time of the film source can be recorded, and the played time and the first preset time are used as parameters to determine whether the continued play end condition is met. When the played time reaches the first preset time, the user may need to take a break, and the controller can pause the play of the film source, so that the play progress of the film source stagnates at the pause node, and the display device no longer continues to play the film source, so that the user pauses watching the film source, thereby achieving the purpose of rest.

[0022] In some embodiments of the first aspect, the resumed playback time data also includes a second preset duration; after the controller executes the operation of pausing the target source if the playback time of the target source reaches the first preset duration, the controller is further configured to: when the playback time of the target source reaches the sum of the first preset duration and the second preset duration, continue to play the target source from the pause node. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, the playback of the source is paused when the playback time of the source reaches the first preset duration. If the display device keeps pausing the source, the playback progress of the source will stagnate, resulting in the source being unable to be continuously resumed. Therefore, the parameter of the second preset duration is increased. When the playback time reaches the sum of the first preset duration and the second preset duration, that is, when the paused playback time of the source reaches the second preset duration, the source can be resumed from the pause node, thereby achieving the purpose of a halftime break during the playback of the source and avoiding the continuous pause of the source.

[0023] In some embodiments of the first aspect, the controller is further configured to: when pausing the playback of the target film source, control the display to display a preset blocking page on the upper layer of the playback interface of the target film source; when continuing to play the target film source from the pause node, control the display to cancel the display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, when pausing the playback of the film source, in order to allow the user to concentrate on resting without interference, the preset blocking page can be used to block the projection content, so that the upper layer of the display device only presents the preset blocking page, and the preset blocking page has no valid projection content, and the projection playback interface is invisible, so that the user cannot see the film source content, nor can the film source be played and controlled until the end time of the break is reached. When the film source needs to be resumed, the preset blocking page is canceled, and the blocking of the projection content is canceled, so that the projection playback interface is visible, so that the user can continue to watch the film source.

[0024] In some embodiments of the first aspect, the controller is further configured to: when pausing the playback of the target film source, control the display to display a pause prompt control on the playback interface of the target film source, wherein the pause prompt control is used to prompt that the target film source is in a paused playback state; when the target film source is in a paused playback state, if a user's playback control instruction for the target film source is received, do not execute the operation corresponding to the playback control instruction; when continuing to play the target film source from the pause node, control the display to cancel the display of the pause prompt control, and if a user's playback control instruction for the target film source is received, execute the operation corresponding to the playback control instruction. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, when pausing the playback of the film source, the pause prompt control can be used to prompt that the film source has been paused, and the controller will shield the user's playback control instructions for the target film source (such as playing the film source, fast forward, fast rewind, speed adjustment, etc.), that is, the operations corresponding to the playback control instructions will not be executed, ensuring that the playback progress and playback status of the target film source will not be changed due to the user's playback control operations, so that the user can concentrate on the halftime break; when resuming the playback of the film source, the pause prompt control is canceled to inform the user that the film source has resumed playback, and the shielding of the film source playback instruction is canceled, so that if the user inputs a playback operation for the target film source, the operation corresponding to the playback instruction is executed, thereby realizing the resumption of the film source and the response recovery of the playback control instruction.

[0025] In some embodiments of the first aspect, the playback time data includes the played time of the target film source, and the continued playback time data includes a first preset time; if the controller determines that the continued playback end condition is met based on the playback time data and the continued playback time data, then the target operation is executed, and is specifically configured as follows: if the played time of the target film source reaches the first preset time, then the first round of interval mode is started to pause the playback of the target film source. The technical solution provided by this embodiment has the following beneficial effects: the interval mode can execute a single round, so that when the played time of the film source reaches the first preset time, that is, when the starting point of the first round of the interval mode is reached, the playback of the film source is paused, thereby avoiding continuous and uninterrupted playback of the projection content. In this way, the number and frequency of the controller executing the interval mode can be limited, avoiding frequent pauses in the playback of the film source during the playback of the film source.

[0026] In some embodiments of the first aspect, the resumed playback time data also includes a second preset duration; after the controller starts the first round of interval mode and pauses the playback of the target film source, it is also configured to: when the playback time of the target film source reaches the sum of the first preset duration and the second preset duration, exit the first round of interval mode and continue to play the target film source from the pause node. The technical solution provided by this embodiment has the following beneficial effects: The technical solution provided by this embodiment has the following beneficial effects: for the single round / first round interval mode, the playback of the film source is paused when the playback time of the target film source reaches the first preset duration, and the duration of the paused playback of the film source is the second preset duration, so that when the playback time of the target film source reaches the sum of the first preset duration and the second preset duration, exit the first round of interval mode and resume the playback of the film source from the pause node, so that the controller can limit the rounds and frequency of executing the interval mode, and avoid frequent pauses in the playback of the film source during the playback of the film source.

[0027] In some embodiments of the first aspect, after the controller exits the first round of interval mode and continues to play the target video source from the pause node, it is further configured to: if the playing time of the target video source reaches the starting time T of the interval mode of the i-th round, mi , then start the interval mode of the i-th round and pause the playing of the target source; wherein, T mi =i*t1+(i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number in the interval mode, i is greater than 1; if the broadcasting time of the target source reaches the end time T of the interval mode of the i-th round ni , then exit the interval mode of the i-th round and continue playing the target source from the pause node; wherein, T ni =T mi+ t2 = i*(t1+t2). The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be executed multiple times, especially for scenes with a long total duration of the target film source. If only one round of interval mode is executed, the display device will play the film source uninterruptedly after exiting the first round of interval mode. Therefore, multiple rounds of interval mode can be set to cycle, that is, every first preset duration, the film source is paused for a second preset duration, to avoid problems such as fatigue caused by continuous viewing of the film source by the user.

[0028] In some embodiments of the first aspect, the playback time data includes the played time of the target film source, and the continued playback time data includes a third preset time; if the controller determines that the continued playback end condition is met based on the playback time data and the projection and continued playback time data, then the target operation is executed, and is specifically configured as follows: if the played time of the target film source reaches the third preset time, then the playback of the target film source is stopped, and the projection connection with the projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: it provides a solution for determining the end condition of resume broadcasting and controlling screen projection operations based on the third time management mechanism (which may be called a timing mode), and starts timing the elapsed broadcasting time when the film source starts broadcasting. When the elapsed broadcasting time of the film source reaches a third preset time, it is determined that the end condition of resume broadcasting is met, and the controller disconnects the screen projection connection to stop playing the target film source. This prevents the screen projection device from continuing to push the projection content to the display device based on the screen projection connection when the film source is played to the third preset time, and also prevents the display device from continuing to play the projection content after the elapsed broadcasting time of the film source reaches the third preset time, thereby avoiding the projection film source from playing for too long.

[0029] In some embodiments of the first aspect, the controller stops playing the target film source and disconnects the projection connection with the projection device if the playback time of the target film source reaches the third preset time, and is specifically configured as follows: if the playback time of the target film source reaches the third preset time, the display is controlled to display a third prompt message, and the third prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the target film source is stopped from playing, and the projection connection with the projection device is disconnected; the controller is also configured as follows: if the user refuses to disconnect the projection connection, the target film source is continued to play. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the playback time of the film source reaches the third preset time, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then based on the time condition of the timing mode, the user's viewing needs are added as a factor for the decision controller to disconnect the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the film source continues to be played, thereby satisfying the user's viewing needs and preferences.

[0030] In some embodiments of the first aspect, the controller determines that the condition for ending the continued broadcast is met if the broadcast time of the target film source reaches the third preset time, and is specifically configured as follows: when the broadcast time of the target film source reaches the third preset time, the remaining broadcast time of the target film source is determined according to the playback progress of the target film source and the total time of the target film source; if the remaining playback time is greater than the preset threshold, the playback of the target film source is stopped, and the screen projection connection with the screen projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the playing time of the film source reaches the third preset time, the film source may not have finished playing, so the film source has a time parameter of the remaining playing time, and the remaining playing time is calculated by the playing progress and total time of the film source, and the length of the remaining playing time is measured by the preset threshold, so that the controller decides whether to disconnect the screen projection connection when the system time reaches a fixed preset time; if the remaining playing time is large, if the screen projection connection is not disconnected, the display device will continue to play the film source until the film source ends, which may affect the user's plan to take a regular break. Therefore, in this scenario, the controller can disconnect the screen projection connection and stop playing the film source, so that the user cannot continue to watch the film source content.

[0031] In some embodiments of the first aspect, the controller stops playing the target film source and disconnects the projection connection with the projection device if the remaining playback time is greater than a preset threshold. The controller is specifically configured as follows: if the remaining playback time is greater than the preset threshold, the display is controlled to display the remaining playback time and a third prompt message, and the third prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the target film source is stopped from playing and the projection connection with the projection device is disconnected; the controller is also configured as follows: if the user refuses to disconnect the projection connection, the target film source continues to play. The technical solution provided by this embodiment has the following beneficial effects: when the played time of the film source reaches the third preset time, the remaining playing time of the film source is used as a playing time parameter. If the remaining playing time is large, if the screen projection connection is not disconnected, the display device will continuously play the projection content pushed by the screen projection device, which will affect the user's regular rest plan, which may affect the user's rest and cause user fatigue or lack of concentration. Therefore, the controller can control the display to display a prompt message to inform the user of the remaining playing time of the film source and ask the user whether to disconnect the screen projection connection. In this way, the user can refer to the remaining playing time and the user's viewing needs to decide whether to disconnect the screen projection connection.

[0032] In some embodiments of the first aspect, when the played time of the target film source reaches the third preset time, the controller determines the remaining play time of the target film source according to the play progress of the target film source and the total time of the target film source, and is further configured to: if the remaining play time is not greater than the preset threshold, continue to play the target film source; when the play of the target film source ends, disconnect the screen projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: when the played time of the film source reaches the third preset time, if the projection connection is not disconnected, the display device will continue to play the film source until the film source ends. Therefore, when the timing time reaches the third preset time, if the remaining play time of the film source is short, the impact on the user's rest may not be great, and the projection connection can be delayed until the end of the film source playback, thereby ensuring the integrity of the user's viewing of the film source, avoiding the projection device from continuing to push the projection content to the display device based on the projection connection after the preset time is reached, and also avoiding the display device from continuing to play the projection content after the preset time exceeds the preset time.

[0033] In some embodiments of the first aspect, the controller executes if the remaining playback time is not greater than the preset threshold, then continue to play the target film source, and is specifically configured as follows: if the remaining playback time is not greater than the preset threshold, control the display to display the remaining playback time and the fourth prompt information, the fourth prompt information is used to prompt the user whether to agree to delay the disconnection of the projection connection until the playback of the target film source ends; if the user agrees to delay the disconnection of the projection connection, then continue to play the target film source; the controller is also configured as follows: if the user refuses to delay the disconnection of the projection connection, then stop playing the target film source and disconnect the projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: when the playback time of the film source reaches the third preset time, if the remaining playback time is short, the controller can control the display to display a prompt information to inform the user of the remaining playback time of the film source, and ask the user whether to agree to delay the disconnection of the projection connection until the end of the playback of the film source to watch the movie.

[0034] In a second aspect, an embodiment of the present application further provides a method for processing a screen projection mode, including:

[0035] In response to receiving a screen projection instruction for playing a target film source sent by a screen projection device, according to a resource address included in the screen projection instruction, obtaining and playing the target film source from a server corresponding to the resource address;

[0036] Get the resume time data;

[0037] In the process of playing the target video source, obtaining the playing time data;

[0038] If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes disconnecting the screen projection operation or pausing the playing of the target film source;

[0039] If it is determined based on the play time data and the resume play time data that the resume play end condition is not satisfied, the target film source continues to be played.

[0040] The technical solution provided by the above second aspect embodiment has the following beneficial effects: when the projection device sends a film source to the display device, the resource address can be included in the projection instruction, so that the display device can request the data of the target film source from the server according to the resource address, thereby playing the target film source; the display device can obtain the resume time data, and the resume time data includes time parameters related to the trigger conditions of different projection modes; the display device can also obtain the playback time data, and the playback time data is the relevant time parameters involved in the process of establishing a projection connection and playing the projection source, so that by comparing the playback time data and the resume time data, it can be determined whether the resume time requirements for the target film source are met. If the conditions for ending the continued broadcast are met, the screen projection operation can be disconnected or the playback of the film source can be paused based on the settings of different screen projection modes. Otherwise, if the conditions for ending the continued broadcast are not met, the film source continues to be played. In this way, after the film source starts playing, the playback time data and the resumed broadcast time data are used to determine the conditions for ending the continued broadcast of the film source. When the conditions for ending the continued broadcast are met, the controller automatically disconnects the screen projection connection or pauses the playback of the film source, thereby avoiding the display device from continuously playing the projection content. This realizes intelligent control of screen projection playback based on the time management mechanism, improves the accuracy of screen projection mode processing, reduces user intervention in manual modes, and improves screen projection processing efficiency and human-computer interaction efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0042] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0043] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0044] Figure 3A A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0045] Figure 3B A software architecture diagram of a mode application provided in some embodiments of the present application;

[0046] Figure 4A A schematic diagram of a timing mode setting method provided in some embodiments of the present application;

[0047] Figure 4B A schematic diagram of an interval mode setting method provided in some embodiments of the present application;

[0048] Figure 4C A schematic diagram of a timing mode setting method provided in some embodiments of the present application;

[0049] Figure 4D A schematic diagram of a screen projection mode setting page provided in some embodiments of the present application;

[0050] Figure 5A Schematic diagram of changes in the user interface when the triggering conditions of the timing mode are met in some embodiments of the present application Figure 1 ;

[0051] Figure 5B Schematic diagram of changes in the user interface when the triggering conditions of the timing mode are met in some embodiments of the present application Figure 2 ;

[0052] Figure 5C Schematic diagram 3 of the change of the user interface when the triggering condition of the timing mode is met provided in some embodiments of the present application;

[0053] Figure 6 Schematic diagram 4 of the change of the user interface when the triggering condition of the timing mode is met provided in some embodiments of the present application;

[0054] Figure 7 Schematic diagram 5 of the change of the user interface when the triggering condition of the timing mode is met provided in some embodiments of the present application;

[0055] Figure 8 Schematic diagram of changes in the user interface when the triggering conditions of the timing mode are met in some embodiments of the present application Figure 6 ;

[0056] Fig. 9 A schematic diagram of the triggering time distribution of the interval mode in the screen projection playback process provided by some embodiments of the present application;

[0057] Fig.10 Schematic diagram of changes in the user interface in interval mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 1 ;

[0058] Fig.11 Schematic diagram of changes in the user interface in interval mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 2 ;

[0059] Fig.12 Schematic diagram of changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 1 ;

[0060] Fig.13 Schematic diagram of changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 2 ;

[0061] Fig.14 Schematic diagram 3 of the changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL for screen casting provided in some embodiments of the present application;

[0062] Fig.15 Schematic diagram 4 of the changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL for screen casting provided in some embodiments of the present application;

[0063] Fig.16 Schematic diagram 5 of the changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL for screen casting provided in some embodiments of the present application;

[0064] Fig.17 Timing interaction of the screen projection mode processing method provided in some embodiments of the present application Figure 1 ;

[0065] Fig.18 A timing interaction diagram of a screen projection mode processing method (timing mode) provided in some embodiments of the present application;

[0066] Fig.19 Timing interaction of the projection mode processing method (interval mode) provided in some embodiments of the present application Figure 1 ;

[0067] Fig. 20 Timing interaction of the projection mode processing method (interval mode) provided in some embodiments of the present application Figure 2 ;

[0068] Fig.21 A timing interaction diagram of the screen projection mode processing method (timing mode) provided in some embodiments of the present application. DETAILED DESCRIPTION

[0069] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0070] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0071] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0072] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0073] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0074] In the embodiments of the present application, the display device generally refers to a device with image display and data processing capabilities. For example, the display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0075] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application.

[0076] like Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0077] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0078] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0079] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0080] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0081] Figure 2 A schematic diagram of the hardware configuration of a display device provided for some embodiments of the present application.

[0082] In some embodiments, see Figure 2 The display device 200 may include at least one of a tuner and demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0083] In some embodiments, the tuner-demodulator 210 can receive broadcast television signals via wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing, and resonance, so as to demodulate the audio and video signals carried in the frequency of the television channel selected by the user, as well as additional information (such as EPG data) from multiple wireless or wired broadcast television signals.

[0084] In some embodiments, tuner 210, based on user selection and controlled by controller 250, responds to the frequency of a user-selected television channel and the broadcast television signal carried by that frequency.

[0085] In some embodiments, the tuner-demodulator 210 can receive signals in a variety of ways depending on the broadcasting format of the broadcast television signal, including but not limited to: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and can implement digital modulation or analog modulation according to different modulation types; and can demodulate analog signals and digital signals according to different types of received broadcast television signals.

[0086] In some embodiments, the tuner 210 may also be in an external device, such as an external set-top box, etc. In this way, the set-top box outputs the broadcast television signal after modulation and demodulation, and transmits it to the display device 200 through the device interface 240 .

[0087] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0088] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0089] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0090] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 to the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 to the external device through a wireless signal or a wireless network. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc. The display device 200 can establish a screen projection connection with an external device (such as a terminal device) through different screen projection protocols.

[0091] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0092] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0093] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0094] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0095] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0096] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0097] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0098] Figure 3A A schematic diagram of the software configuration of a display device provided in some embodiments of the present application.

[0099] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3A As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0100] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0101] In some embodiments, see Figure 3A , the application layer can run multiple applications, such as application 1, application 2, application 3, etc. In order to solve the related problems raised in the background technology, the embodiment of the present application provides an application, which is exemplarily named "mode application". The mode application runs in the application layer, and the controller (including at least one processor) can implement the screen projection mode processing method provided in the embodiment of the present application by running the mode application.

[0102] In some embodiments, the controller can configure and display the projection mode by running the mode application. The mode application can configure at least one trigger condition (also known as: continuation end condition) and mode action (also known as: mode operation, target operation, etc.) of the projection mode, so that when the trigger condition is met, the mode application can switch to the corresponding projection mode and execute the mode action corresponding to the projection mode (for example, disconnect the projection, or pause the playback of the film source, etc.). The projection mode includes but is not limited to: timing mode, timing mode, interval mode, etc. Among them, the timing mode refers to disconnecting the projection connection when the system time of the display device reaches the preset time. The interval mode refers to the user's projection viewing time (or broadcast time) every first preset time interval, pausing the playback of the projection content, and continuing to play the projection content after a rest transition of the second preset time. The interval mode in different usage scenarios is presented as, for example, eye protection mode, halftime mode, etc. The timing mode refers to disconnecting the projection connection when the projection has been broadcast for a third preset time. The purpose of these screen projection modes is to restrict users' screen projection viewing behavior and prevent users from watching screen projection content for a long time without restraint, which may cause problems such as eye fatigue and staying up late.

[0103] In some embodiments, when the display device displays at least one projection content, the controller can run a mode application, monitor the triggering conditions of the projection mode through the interaction and information flow between modules within the mode application, execute the mode actions of the projection mode, and refresh the content and template / layout displayed in the user interface to adapt to the projection mode.

[0104] In some embodiments, the mode application can preset interface templates corresponding to mode actions of multiple different projection modes. For example, in the timing mode, if it is detected that the system time reaches the preset time (i.e., the trigger condition of the timing mode is met), the interface template can be configured to display a prompt message on the user interface to prompt that the preset time has been reached and ask the user whether to agree to disconnect the projection. For another example, in the interval mode, when the projection has been broadcast for a first preset time (i.e., the interval mode meets the trigger condition), the interface template can be configured to display a preset template page on the upper layer of the projection playback interface, and the preset template page can be specifically a preset shielding page to block / shield the display of the projection content. The preset template page is also used to prompt the subsequent broadcast of the projection content after the second preset time. In this way, the mode application can monitor the trigger conditions of multiple projection modes, and when the trigger condition of any first projection mode is met, according to the interface template preset by the first projection mode, the View and UI elements in the user interface that have changed due to entering the first projection mode are dynamically updated, so as to realize the trigger condition monitoring, display control and action execution of the projection mode in the same application.

[0105] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access resources in the system and obtain system services during execution. Applications (including mode applications) can access resources in the system and obtain system services and required information through the API interface. For example, mode applications can obtain information such as the number of projection channels, projection device information, device connection status, current signal source category, etc. from the lower layer (for example, the kernel layer) through the API interface (for example, the Fl ow interface, etc.).

[0106] See also Figure 3AIn the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0107] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0108] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0109] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3A As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0110] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0111] After the display device establishes a projection connection with the projection device, if the display device and the projection device do not disconnect the projection connection, based on the projection connection, the projection device can continuously push the projection content to the display device, and the display device can continuously play the projection content.

[0112] In some embodiments, the user can manually disconnect the screen projection connection through either the display device or the projection device, so that the projection device cannot push the projection content to the display device, and the display device stops broadcasting the projection content.

[0113] In some embodiments, a play button may be provided on the screen projection playback interface, and when the play button is triggered, it can be used to switch the playback state of the screen projection content. In this way, the user can click the play button to switch the screen projection content to the pause playback state, thereby stopping the continued playback of the screen projection content.

[0114] The above-mentioned embodiment stops the continued broadcast of the screen projection content through manual operation by the user, which requires the user to input manual operation multiple times, affecting the control efficiency of the screen projection playback. In addition, the user may stop the continued broadcast of the screen projection in different scenarios. For example, the user generally goes to bed before 22:00, then the user needs to pay attention to observe the time, or set an alarm reminder, etc., to know that it is time to rest at night, so as to manually disconnect the screen projection connection. In this way, on the one hand, the efficiency of human-computer interaction is low, and the user needs to manually perform corresponding operations for different scenarios (such as disconnecting the screen projection, pausing playback, etc.). On the other hand, the user needs to manually determine the end condition of the continued broadcast. Once the user forgets the time, the screen projection may continue to play uninterruptedly, affecting the user's rest.

[0115] The following embodiments of the present application provide a screen projection continuation termination condition determination and screen projection playback control scheme based on a time management mechanism. The principle of the scheme is: after establishing a screen projection connection and starting to play the projection content, the controller can determine whether the continuation termination condition for the target film source is met based on the acquired playback time data and continuation time data; if the continuation termination condition is met, the controller can execute a screen projection disconnection operation or a pause operation for playing the projection content based on the settings of different projection modes; otherwise, if the continuation termination condition is not met, the projection content continues to be played. In this way, after the projection content starts to play, the playback time data and the continuation time data are used to determine the continuation termination condition of the film source, so that when the continuation termination condition is met, the controller automatically disconnects the screen projection connection or pauses playing the film source, thereby avoiding the projection device from continuously pushing the projection content and avoiding the display device from continuously playing the projection content, thereby realizing intelligent control of screen projection playback based on the time management mechanism, improving the accuracy of projection mode processing, reducing user manual mode intervention, and improving projection processing efficiency and human-computer interaction efficiency. Figure 3B The software architecture diagram of the mode application provided in some embodiments of the present application. The controller can implement the screen projection mode processing solution based on the time management mechanism of the present application by running the mode application.

[0116] See also Figure 3B The software architecture of mode switching includes but is not limited to: screen projection management module 201, data management module 202, message processing module 203, View management module 204, mode management module 205, sound management module 206, location management module 207, algorithm processing module 208, application interaction processing module 209, service management module 210, replacement management module 211, broadcast control management module 212, time management module 213, focus management module 214, screen projection source analysis module 215, etc.

[0117] In some embodiments, the screen projection management module 201 is used to perform protocol interaction with the screen projection device through the screen projection service, manage the connection and disconnection of the screen projection, manage the status and list of the screen projection device, etc. Among them, the screen projection protocol is not limited, for example, Miracast, AirPlay, DLNA, etc. can be used.

[0118] In some embodiments, the data management module 202 is used to manage the information and data involved in different modes of the mode application, and to synchronously update the relevant information and data.

[0119] In some embodiments, the message processing module 203 is used to implement message transmission and flow between modules in the pattern application.

[0120] In some embodiments, the View management module 204 is used to control the interface display and update of different projection modes included in the mode application.

[0121] In some embodiments, the mode management module 205 can be used to store mode information of at least one screen projection mode, and the mode information includes mutually related trigger conditions and mode actions. In this way, when the display device displays the projection content, the mode management module 205 can monitor the trigger conditions of each projection mode. If the trigger condition of the first projection mode (or the condition for the end of the continued broadcast) is met, it switches to the first projection mode, and notifies other related modules to perform matching mode actions (or target operations) according to the projection source information provided by the projection source analysis module 215. Among them, the projection source information includes the projection source type, and the projection source type includes but is not limited to: mirror projection and VideoURL (video link projection), etc. Among them, mirror projection refers to the projection device recording the screen content of the local end by means of screen recording and the like and pushing it to the display device synchronously; VideoURL refers to the projection device pushing the URL of the media resource (i.e., resource link, also known as resource address) to the display device, so that the display device obtains the projection data from the server by accessing the URL. The VideoURL class can also be further divided into live broadcast class (real-time streaming class) and non-live broadcast class (such as movies, TV series and other source media resources pushed by URL).

[0122] In some embodiments, the mode management module 205 can also be used to configure interface templates corresponding to different projection modes and projection source types (hereinafter referred to as: mode templates). The mode templates are used to specify the interface content and layout characteristics under different modes and projection source types, thereby providing a basis for the View management module 204 to display and update the user interface when the mode application executes the mode action.

[0123] In some embodiments, for the timing mode, the mode template set by the mode management module 205 is, for example: a prompt page is displayed on the upper layer of the screen projection playback interface, and the prompt page includes countdown information and prompt information a. Among them, the countdown information displays a countdown starting from a first threshold time (for example, 5 seconds). An exemplary prompt information a is used to prompt that the preset time has been reached before the countdown is reset, and the screen projection is about to be disconnected, and ask the user whether to agree to disconnect the screen projection. In this way, before the countdown is reset, the user can agree or refuse to disconnect the screen projection.

[0124] In some embodiments, another exemplary prompt information a is related to the screen projection source information. If the screen projection source is a source type screen projection pushed by VideoURL (non-live type), the prompt content of the prompt information e can be determined based on the length of the remaining playback time of the source. For example, an example of prompt information e is "There are 15 minutes left in the screen projection content. Do you agree to disconnect the screen projection immediately?"

[0125] In some embodiments, it is assumed that the time interval corresponding to the interval mode is [T m ,T n ], where Tm is the starting time node (or starting moment) of the interval mode, T n is the end time node (or end time) of the interval mode, T n =T m +T0, T0 is the duration of the interval mode. For the interval mode, the mode template set by the mode management module 205 is, for example, m The node displays the prompt information b and the preset occlusion page in turn, and n The node displays prompt information c. Among them, prompt information b is used to prompt entering the interval mode. The preset shielding page is used to shield the screen casting playback interface below so that the user cannot continue to watch the screen casting content. The preset shielding page can prompt the screen casting content to be played after T0 duration. The prompt information c is exemplified as "The interval mode ends, please continue watching".

[0126] In some embodiments, for the timing mode, the timing mode is entered when the screen projection content starts to play, and the timer (Timer) is started to start timing. The timer can be used to count the length of time the screen projection has been played. Then, the mode template set by the mode management module 205 is, for example: when the start time T1 of the screen projection content is reached, prompt information d is displayed on the upper layer of the screen projection playback interface; when the timing time reaches the preset length T2, that is, when the system time reaches T1+T2, countdown information and prompt information e are displayed on the upper layer of the screen projection playback interface. Among them, the prompt information d is exemplarily prompted as "the timing of the screen projection viewing time starts".

[0127] In some embodiments, the text content of prompt information e is related to the screen projection source information. If the screen projection source type is mirror projection, prompt information e is used to prompt that the specified screen projection viewing time has been reached, and ask the user whether to agree to disconnect the screen projection. If the screen projection source is a film source type projection pushed by VideoURL (non-live broadcast), the prompt content of prompt information e can be determined based on the length of the remaining playback time of the film source. For example, an example of prompt information e is "There are 3 minutes left in the current film source. Do you want to delay until the end of the film source to disconnect the screen projection?".

[0128] It should be noted that the mode management module 205 can adaptively configure the mode information and mode template corresponding to each projection mode according to the characteristics of different modes and scenario requirements, and is not limited to the examples of the embodiments of the present application.

[0129] In some embodiments, the sound management module 206 is used to process the sound of the projection source in different modes, such as mute, unmute, volume control, etc.

[0130] In some embodiments, assuming that in the interval mode, the screen projection source type is mirror projection or VideoURL live projection, the sound management module 206 can mSet the current projection screen to setMute(true) at the node, and n At the node, set the current projection screen to setMute(false). Among them, setMute() is used to control whether the sound is muted. setMute(false) is used to set the sound to non-muted / sounding, and setMute(true) is used to set the sound to mute / no sound. In this way, in [T m ,T n ] Within the interval, the projected screen is blocked by the preset masking page, and the projection sound is also muted, thereby shielding the user from the projection media and making it impossible for the user to watch the projection content in the interval mode, thereby achieving the purpose of eye protection and halftime break.

[0131] In some embodiments, the position management module 207 is used to set the display position distribution of multiple projection windows in a multi-projection scenario according to the connection status of multiple projection sources and the focus of the interface. Taking the display device connected to three projections as an example, namely projection A, projection B and projection C, the position management module 207 can set the relative positions of projection A, projection B and projection C in the interface. Assuming that projection A is earlier than projection B and projection C is the latest connected, the three projections can be arranged in the order of access time, for example, projection A is set on the left side of the upper area of ​​the interface, projection B is set on the right side of the upper area of ​​the interface, and projection C is set in the center of the lower area of ​​the interface.

[0132] In some embodiments, if projection screen A is disconnected and projection screen D is newly connected, the position management module 207 can keep the positions of projection screens B and C unchanged in the interface, and set projection screen D at the position of the original projection screen A to avoid the problem of poor projection viewing effect caused by the displacement and shaking of the projection content. For another example, when projection screen D is connected, if the focus falls on the window of projection screen B, projection screen B at the focus position can be replaced by projection screen D, and the positions of the original projection screens A and C remain unchanged.

[0133] It should be noted that the position management module 207 can configure the positioning rules of multiple projection screens according to the mode category and the number of projection screens. When any projection screen source is connected or disconnected, the position management module 207 can reconfigure the display position distribution of each projection screen window in the user interface based on the change in the number of projection screens.

[0134] In some embodiments, the algorithm processing module 208 is used to adaptively and dynamically match the UI typesetting and layout under different projection modes and projection paths, including matching the sizes (including width and height) and display positions (such as the position coordinates of key points of the projection window) of different Views and projection windows in the user interface, thereby providing data basis for the View management module 204 to update the user interface.

[0135] In some embodiments, the application interaction processing module 209 is used to implement interaction with other external applications when switching modes. For example, mode setting / switching can set multiple startup entries, including but not limited to mode options presented after calling up the mode menu, voice entry, etc. These startup entries can interact with the application interaction processing module 209 and perform different customized management according to the differences and categories of the startup entries.

[0136] In some embodiments, the service management module 210 is used to start the mode application, manage the opening and closing of related services involved in the mode application, and customize specific services in specific scenarios and modes.

[0137] In some embodiments, the replacement management module 211 is used to replace a previous screen projection according to the replacement rules when the number of screen projection channels exceeds the upper limit of the display device's bearing capacity, so that the most recently connected screen projection can be displayed. For example, the display device supports up to three screen projection channels. At this time, the display device has connected screen projections A, B, and C. If screen projection D is received, the replacement management module 211 can make screen projection D replace the earliest connected screen projection A, thereby updating to screen projections B, C, and D. For another example, when the display device receives screen projection D, if the interface focus falls on the window of screen projection B, the replacement management module 211 can make screen projection D replace screen projection B where the focus is, thereby ensuring that the latest screen projection can be connected and displayed. It should be noted that the replacement rules configured by the replacement management module 211 are not limited to the embodiments of the present application, and adaptive replacement rules can be set according to different scenarios and different modes.

[0138] In some embodiments, the broadcast control management module 212 is used to control the playback of the media content of the projection source in different modes. For example, when the focus is on projection A, the broadcast control management module 212 can fast forward, rewind, double speed, pause playback, resume playback, etc. on projection A. It should be noted that the broadcast control management module 212 can perform different broadcast control processing according to the media type of the playback content. For example, video content can be fast forwarded, rewinded, double speed control, paused, volume, etc., and text content can be zoomed, font adjusted, annotated, marked, etc.

[0139] In some embodiments, the time management module 213 is used to process time events involved in the operation of different modes. For example, the projection window may be configured with some additional content such as controls, icons or prompt information, and these additional contents will be automatically hidden after displaying for a preset time. Therefore, the time management module 213 can start counting up or counting down when these additional contents begin to be displayed, and after the timing reaches the preset time, the message processing module 203 notifies the view management module 204 to hide or cancel the display of these additional contents.

[0140] In some embodiments, for example, when prompt information a is displayed in the timing mode, the time management module 213 starts a timer (Timer) and controls the timer (Timer) to count down from a first threshold time (e.g., 5 seconds), so that the user can choose whether to disconnect the screen projection during the countdown. When the countdown is reset to zero, the View management module 204 cancels the prompt information a.

[0141] In some embodiments, for example, in interval mode, if the screen projection source is a source type screen projection pushed by VideoURL (non-live broadcast type), the time management module 213 can start a timer (Timer) when the source starts playing, and control the timer (Timer) to count up to record the playing time of the source. When the playing time of the source reaches the first preset time, the interval mode is started, and the mode application can pause the playing of the source (the sound and picture are synchronously paused, and the playing progress stagnates at the pause node). When the playing time reaches the first preset time and the second preset time, where the second preset time is the duration of the interval mode, the source continues to play from the pause node (the sound and picture resume playing synchronously, and the playing progress continues to change).

[0142] In some embodiments, for example, in interval mode, if the screen projection source is a source screen projection (non-live broadcast type) pushed by VideoURL, the time management module 213 can start the timer (Timer) when the source starts playing, control the timer (Timer) to count up, and start the interval mode when the timing time of the timer reaches the first preset duration. When switching to interval mode, the time management module 213 can clear the timer and re-control the timer timing, and exit this round of interval mode when the timing time reaches the second preset duration. When exiting the interval mode, the time management module 213 can clear the timer and restart the timing, and when the timing time reaches the first preset duration, start the next round of interval mode. By analogy, during the playback of the film source, multiple rounds of interval modes can be cycled to avoid problems such as fatigue and lack of concentration caused by users watching the film source for a long time.

[0143] In some embodiments, such as in timing mode, the time management module 213 can start the timer (Timer) at the start of the screen projection, control the timer (Timer) to start counting up, so as to record the duration of the screen projection, and the time management module 213 can also set the upper limit of the timer (Timer) to a third preset duration. In this way, when the timing time of the timer (Timer) reaches the third preset duration, the View management module 204 displays a prompt message e. Positive timing refers to increasing the time second by second from 0 until the timer timing upper limit is reached, and the timing upper limit is related to the continued broadcast time data. Countdown refers to decreasing the time second by second from the threshold time until the timing time of the timer is reset to zero.

[0144] In some embodiments, the playback time data includes but is not limited to at least one of the following parameters: a preset time set in the timing mode, a first preset duration and a second preset duration set in the interval mode, and a third preset duration set in the timing mode.

[0145] In some embodiments, when the time management module 213 controls the timer (Timer) to count up or count down, the view management module 204 can also synchronously display the timing information. For example, when the view management module 204 displays the prompt information a or the prompt message e, the countdown information is updated synchronously with the timer (Timer). When the time management module 213 detects that the countdown is cleared, the view management module 204 is notified to cancel the display of the countdown information, and cancel the prompt information a or the prompt message e.

[0146] In some embodiments, the focus management module 214 is used to process the focus involved in the operation of the mode application, such as responding to user key operations, controlling the display, hiding and movement of the focus, recording focus information, etc., where the focus information includes but is not limited to the focus position, focus display status, etc., and the focus information can be synchronized to other related modules through the message processing module 203.

[0147] In some embodiments, the focus management module 214 can synchronize the focus information to the position management module 207 through the message processing module 203, so that the position management module 207 decides the position arrangement of multiple projection windows according to the focus information. The focus management module 214 can also synchronize the focus information to the broadcast control management 212 through the message processing module 203, so that the broadcast control management 212 can play the projection source with focus according to the focus information. The focus management module 214 can also synchronize the focus information to the view management module 204 through the message processing module 203, so that the view management module 204 can display the focus, and so on.

[0148] In some embodiments, the projection source analysis module 215 is used to analyze the projection source Session maintained by the projection management module 201 to obtain the projection source information. The projection source information includes but is not limited to the projection source type and the media playback type. Among them, the projection source type includes but is not limited to mirror projection (Mirror), video link projection (VideoURL), etc. The media playback type includes but is not limited to two major categories, namely live broadcast (real-time streaming) and film source (non-live broadcast), where the film source includes but is not limited to dramas, movies, entertainment, news, cartoons, education and other subcategories.

[0149] In some embodiments, the screen projection source analysis module 215 can obtain the screen projection source type from the Session object of the screen projection source through the screen projection protocol.

[0150] In some embodiments, if the projection source type is VideoURL, the projection source analysis module 215 can obtain the duration, Seek status, MIME (Multipurpose Internet Mail Extensions) and other information of the media pushed by the projection through the projection protocol to determine whether the projection source pushes live media.

[0151] In some embodiments, if the duration of the media resource is zero and the media resource cannot perform a Seek action, the screen projection source analysis module 215 determines that the media resource pushed by the screen projection source is a live broadcast type.

[0152] In some embodiments, if the MIME is configured as "application / x-mpegURL" or "video / MP2T", etc., the screen projection source analysis module 215 determines that the media resource pushed by the screen projection source is a live broadcast type.

[0153] In some embodiments, the projection source analysis module 215 can obtain the media information of the Session object of the projection source through the projection protocol, and the media information can include metadata of the film source. The metadata includes but is not limited to: the title, actors, directors, release date, style tags (such as action, comedy, suspense, etc.), duration, and other information of the film source.

[0154] In some embodiments, the projection source analysis module 215 can determine whether the projection source is a source type projection pushed by VideoURL based on metadata. For example, if the media resource information indicates that it is a non-live resource such as a movie or TV series, the duration is greater than 0, the projection content can perform a Seek action, or the MIME is not a live configuration, then the projection source analysis module 215 can determine that the projection source type is VideoURL and the media resource playback type is a source type.

[0155] The above introduces the functional configuration of each module in the mode application. The following will combine the specific mode application scenarios to explain the specific execution procedures of each module in the mode application and the interaction and flow of information data between modules, so as to realize the mode application to automatically monitor the trigger conditions of the screen projection mode. When the trigger conditions of any mode are met, the matching mode action is executed according to the screen projection source information. It should also be noted that the modules in the mode application can be added, deleted or replaced according to the functional configuration and playback scenario of the screen projection mode.

[0156] In some embodiments, after establishing a screen projection connection with the screen projection device, the screen projection content pushed by the screen projection device to the display device is a film source type screen projection pushed through a resource address (URL), then the controller can be configured to execute: in response to receiving a screen projection instruction sent by the screen projection device for playing a target film source, according to the resource address contained in the screen projection instruction, obtaining and playing the target film source from the server corresponding to the resource address; obtaining resume time data; during the process of playing the target film source, obtaining the playback time data; if based on the playback time data and the resume time data, it is determined that the resume end condition is met, then executing the target operation; wherein the target operation includes disconnecting the screen projection operation or pausing the playback of the target film source; if based on the playback time data and the resume time data, it is determined that the resume end condition is not met, then continuing to play the target film source.

[0157] After the controller executes the scheme of the above embodiment, the following beneficial effects can be achieved: when the projection device sends a film source to the display device, the resource address can be included in the projection instruction, so that the display device can request the data of the target film source from the server according to the resource address, thereby playing the target film source; the display device can obtain the resume time data, and the resume time data includes time parameters related to the trigger conditions of different projection modes; the display device can also obtain the playback time data, and the playback time data is the relevant time parameters involved in the process of establishing a projection connection and playing the projection source, so that by comparing the playback time data and the resume time data, it can be determined whether the resume time requirements for the target film source are met. If the conditions for ending the continued broadcast are met, the screen projection operation can be disconnected or the playback of the film source can be paused based on the settings of different screen projection modes. Otherwise, if the conditions for ending the continued broadcast are not met, the film source continues to be played. In this way, after the film source starts playing, the playback time data and the resumed broadcast time data are used to determine the conditions for ending the continued broadcast of the film source. When the conditions for ending the continued broadcast are met, the controller automatically disconnects the screen projection connection or pauses the playback of the film source, thereby avoiding the display device from continuously playing the projection content. This realizes intelligent control of screen projection playback based on the time management mechanism, improves the accuracy of screen projection mode processing, reduces user intervention in manual modes, and improves screen projection processing efficiency and human-computer interaction efficiency.

[0158] In some embodiments, after the display device is powered on, the controller may start Figure 3B The provided mode application determines whether the resuming end condition is met according to the playing time data and the resuming time data by running the mode application, thereby deciding whether to execute the target operation or continue to play the target film source.

[0159] In some embodiments, the controller can control the mode application to manage the screen projection source and obtain mode information when starting the screen projection. The mode information may include the resume time data and the mode action. According to the resume time data and the playback time data obtained during the playback of the screen projection content, it can be determined whether the trigger condition (or the resume end condition) is met. When the resume end condition is met, the corresponding operation is performed according to the mode action configured in the mode category. For example, the operation of disconnecting the screen projection connection can be performed in the timing mode and the timing mode, and the operation of pausing the playback of the film source can be performed in the interval mode.

[0160] In some embodiments, the above mode information may be preset before the screen casting starts, for example, by the user according to his / her own viewing needs and preferences. That is, in this scenario, the mode management module 205 can directly read the mode information preset and stored in the local machine.

[0161] In some embodiments, when the screen is projected and broadcasted, the View management module 204 can display a related mode setting page, and the user can set the mode information based on the mode setting page. That is, the mode information in this scenario is obtained instantly by the mode management module 205 according to the user's setting operation based on the mode setting page when the screen is projected and broadcasted.

[0162] In some embodiments, after the mode application starts running, the service management module 210 can perform initialization tasks, including but not limited to: the service management module 210 starts the screen projection service to listen to screen projection requests (connection) and / or exit screen projection requests (disconnection) initiated by other electronic devices, controls the View management module 204 to initialize the configuration of the View displayed by the application layer, controls the data management module 202 to create some preparation data, etc.

[0163] In some embodiments, after the initialization task is completed, the mode application can control the screen projection management module 201 to register the monitoring logic of UsessionConnectionListener, UsessionPrepareListener, USessionDisplayListener and UsessionEventListener. Among them, Session represents a conversation between the client and the server, and can record client information (also known as: device information). The client information is configured as {id=, type=, protocol=,...}, where id represents the device id of the client for identifying the client, type represents the type of the client, and protocol represents the screen projection protocol used by the client.

[0164] In some embodiments, UsessionConnectionListener is used to monitor changes in the connection status of the client in the Session, and the connection status includes a connected state and an unconnected state (or a disconnected state). UsessionPrepareListener is used to prepare for screen projection interaction with the client. UsessionDisplayListener is used to monitor changes in interface playback information, and the interface playback information includes but is not limited to playback content information and playback status, etc. UsessionEventListener is used to monitor client control events, etc. In this way, the screen projection management module 201 can monitor relevant information of the screen projection signal source (hereinafter referred to as: screen projection signal source information) through the screen projection service. The screen projection signal source information includes but is not limited to device information, connection status, etc. of the screen projection device.

[0165] In some embodiments, the screen projection management module 201 can send the screen projection signal source information to the message processing module 203, and the message processing module 203 forwards the screen projection signal source information to the data management module 202. The data management module 202 can create and store a screen projection device list based on the screen projection signal source information, and the screen projection device list includes relevant information of electronic devices (referred to as: screen projection devices) that have established screen projection connections with the display device 200. The underlying structure of an exemplary screen projection device list provided in an embodiment of the present application is as follows:

[0166] [{mInputName=screen projection device 1,

[0167] mIsConnected=true,

[0168] mInputSourceId=,

[0169] mVisible=true,

[0170] mSourceType=,

[0171] mSession=SessionBase{id=Client 1, type=, protocol=}…}]

[0172] Among them, mInputName is the device name set by the data management module 202 for the screen projection device, such as screen projection device 1, and the digital suffix of the screen projection device does not exceed the real-time screen projection number of the display device. mIsConnected indicates the connection status of the screen projection device, mIsConnected = true indicates the connected state, and mIsConnected = false indicates the unconnected state or disconnected state. If the screen projection device 1 is disconnected, the information of the screen projection device 1 can be deleted from the screen projection device list, or the mIsConnected status value corresponding to the screen projection device 1 can be changed to false. mInputSourceId is used to indicate the signal source ID of the screen projection device. mSourceType is used to indicate the signal source type; mVisible = true is used to indicate the display status of the signal source. If mVisible = true, it means that the screen projection content pushed by the screen projection device is in a visible state. If mVisible = false, it means that the screen projection content is invisible or hidden. mSession=SessionBase{id=Client1,type=,protocol=}…} is used to record the device information of the screen projection device, for example, the id of screen projection device 1 is Client1. The display device can have an upper limit on the screen projection capability, for example, it supports up to K-way screen projection, and the screen projection device list includes information of up to K screen projection devices with mIsConnected=true.

[0173] In some embodiments, when the screen projection service receives a screen projection request sent by the first screen projection device (Client 1), the screen projection management module 201 obtains the device information of the screen projection device contained in the screen projection request (hereinafter referred to as: first screen projection device information), and the structure of the first screen projection device information is, for example, {id=, type=, protocol=,…}, and synchronizes the first screen projection device information to the data management module 202 through the message processing module 203, so that the data management module 202 manages the first screen projection device information. Among them, an exemplary structure of the screen projection request is {"cmd":"REQUEST","data":"{\"info\":{\"id\":\"\",\"name\":\"\"},\"version\":,\"type\":}"}.

[0174] In some embodiments, if the user agrees to the screen projection request of the first projection device, or the number of projection channels does not reach the upper limit of the display device's projection capability (supporting up to K projection channels, where K is a positive integer greater than 1), indicating that the display device can receive the projection channel, the screen projection service can send a projection consent message to the first projection device through the projection protocol layer. An exemplary structure of the projection consent message is {"cmd":"ACK","data":"{\"version\":,\"ack\":,\"status\":\"\",\"reason\":\"\",\"type\":0}"}.

[0175] In this way, when the first screen projection device receives the screen projection consent message, it can perform tasks related to preparing for screen projection, such as establishing a screen projection connection with the display device, and then starting screen recording. After the screen recording is ready, it can send a screen projection ready message to the screen projection service through the screen projection protocol layer. Among them, an exemplary structure of the screen projection ready message can be configured as {"cmd":"REQUEST_DATA_OK","data":"{\"info\":{\"id\":\"\",\"name\":\"\"},\"version\":,\"type\":}"}.

[0176] In some embodiments, when the screen projection service receives the screen projection ready message, it can feedback an ACK message to the first screen projection device, so that the first screen projection device pushes the projection data of the second content to the display device when receiving the ACK message. Among them, an exemplary structure of the ACK message is {"cmd":"DATA_ACK","data":"{\"version\":,\"ack\":,\"status\":\"\",\"type\":0}"}.

[0177] In some embodiments, when the screen projection service receives a screen projection ready message, the screen projection management module 201 sends the first screen projection device information to the data management module 202 through the message processing module 203; the data management module 202 can insert the first screen projection device information in the screen projection device list, and set the device name of the first screen projection device (for example, projection device 1), connection status value (mIsConnected) and visibility status value (mVisible), etc.

[0178] According to the above processing flow, the mode application can monitor the screen projection requests of more electronic devices, and complete the connection and reception of the screen projection until the number of screen projection channels reaches the upper limit K of the screen projection capability of the display device. If the K+1th screen projection is received, the replacement management module 211 can select the previous screen projection (hereinafter referred to as Z screen projection) as the replacement object, and notify the screen projection management module 201 to disconnect the connection of Z screen projection through the message processing module 203. In this way, the number of screen projection channels is reduced by one and is less than the K value, and the screen projection management module 201 can access the latest received K+1th screen projection.

[0179] In some embodiments, the first projection device receives the ACK message and can push the projection data and session information to the display device. The session information includes configuration information related to the projection data pushed by the first projection device. If the projection source type is VideoURL, the exemplary structure of the session information includes but is not limited to:

[0180] {Session:SessionClient1,

[0181] View:SurfaceView / TextureView,

[0182] / / VideoURL video,

[0183] type:VideoURL,

[0184] metadata:...,

[0185] duration:45min,

[0186] Ratio:16:9,

[0187] …}

[0188] Among them, SessionClient1 is used to indicate that the ID of the first screen projection device associated with the Session is Client1.

[0189] View:SurfaceView / TextureView means that the projection content pushed by Client1 is displayed on the SurfaceView / TextureView of the display device.

[0190] type:VideoURL indicates that the projection source type pushed by Client1 is video link projection (VideoURL). metadata is the metadata of the source, including the source's title, actors, director, release date, style tags (such as action, comedy, suspense, etc.). duration indicates the duration of the source, that is, the total playback time of the source. Ratio is the aspect ratio of the projection content pushed by Client1, that is, the ratio of width to height.

[0191] In some embodiments, after the screen projection service receives the projection data and session information, the screen projection management module 201 can forward the session information to the data management module 202 through the message processing module 203, so that the data management module 202 stores the session information, and forward the projection data to the screen projection source analysis module 215 through the message processing module 203, so that the screen projection source analysis module 215 obtains the projection source information according to the session information of the screen projection device.

[0192] In some embodiments, the screen projection source analysis module 215 can read the type attribute value configured in the Session information. If it is type:mirror, the screen projection source information indicates that the screen projection source is mirror projection.

[0193] In some embodiments, the projection source analysis module 215 can read the type attribute value configured in the Session information. If it is type: VideoURL, the projection source analysis module 215 further queries the metadata, duration, Seek status, etc. of the film source to determine whether the projection content is a live broadcast or a film source, thereby providing more accurate projection source information.

[0194] In some embodiments, if the metadata indicates that the projection content is a movie, TV series, etc., duration>0 (for example, 45 minutes), and the Seek action can be executed, the projection source information provided by the projection source analysis module 215 is used to indicate: the projection source pushes the film source (non-live) type projection through a video link (also known as a resource address).

[0195] In some embodiments, the screen projection source analysis module 215 can forward the screen projection source information to the mode management module 205 through the message processing module 203. The mode management module 205 obtains the playback time data during the screen projection playback process based on the mode information of at least one screen projection mode that has been obtained, and determines whether the continuation end condition is met through the playback time data and the continuation time data contained in the mode information. Determining whether the continuation end condition is met is actually to determine whether the trigger condition of a certain screen projection mode is met. When the trigger condition of any first screen projection mode is met, the target mode action (also called target operation) to be executed that matches the screen projection source information and the mode type can be determined specifically. Through the flow between other modules, the mode application executes the target mode action and controls the display and refresh of the user interface.

[0196] In some embodiments, the playback time data includes but is not limited to at least one of the following parameters: the system time of the display device, the playback time of the film source, etc.

[0197] In some embodiments, the algorithm processing module 208 may obtain the Session information of the first screen projection device (Client 1) from the data management module 202, and obtain the aspect ratio Ratio of the screen projection content from the Session information.

[0198] In some embodiments, the algorithm processing module 208 can calculate the layout data according to the screen resolution (e.g., 1920*1080) and Ratio and other data. The layout data includes the size (width Width1*height Height1) and display position (x1, y1) of SurfaceView / TextureView. SurfaceView / TextureView is used to display the projection content pushed by Client1. An exemplary data structure of the layout data generated by the algorithm processing module 208 is as follows:

[0199] {Session:SessionClient1,

[0200] View:SurfaceView / TextureView,

[0201] Position:(x1,y1),

[0202] width:Width1,

[0203] height:Height1,

[0204] …}

[0205] In some embodiments, the algorithm processing module 208 can send the layout data to the data processing module 202 and the View management module 204 respectively through the message processing module 203, so that the data processing module 202 can sort and store the layout data, and the View management module 204 can display the projection content in SurfaceView / TextureView according to the layout data.

[0206] In some embodiments, after receiving the layout data, the View management module 204 can set the display data information through the LayoutParams interface, and the display data information includes data generated according to the layout data that can be recognized and set by the display. An exemplary data structure of the display data information is as follows:

[0207] FrameLayout.LayoutParams lp1=new FrameLayout.LayoutParams(width,height,0);

[0208] lp1.width = Width1;

[0209] lp1.height = Height1;

[0210] lp1.leftMargin = x1;

[0211] lp1.topMargin = y1;

[0212] mPlayerView.setLayoutParams(lp1);

[0213] In this way, the View management module 204 sets the size and display position of the SurfaceView / TextureView according to the display data information, and loads the projection data pushed by Client1 into the SurfaceView / TextureView, thereby completing the display of the projection content.

[0214] Figure 4A Schematic diagram of the timing mode setting method provided in some embodiments of the present application. The user can open the projection mode setting page through the system settings, mode application or other access portal to pre-customize the setting mode information. Alternatively, the View management module 204 can display the projection mode setting page when the projection starts, so that the mode management module 205 can obtain the mode information immediately.

[0215] In some embodiments, see Figure 4AIn the sub-figure (a), the projection mode setting page 40 includes panels corresponding to N projection modes (referred to as projection mode panels). Exemplarily, the projection mode panels include a timing mode panel 41, an interval mode panel 42, and a timing mode panel 43. Among them, the timing mode panel 41 is used to set and manage the timing mode, the interval mode panel 42 is used to set and manage the interval mode, and the timing mode panel 43 is used to set and manage the timing mode.

[0216] In some embodiments, see Figure 4A In sub-picture (a), each projection mode section includes an add button (presented as “+” in the example of FIG. 4 ).

[0217] When the user clicks the add button of the timing mode section 41, see Figure 4A In the sub-figure (b), the display shows the timing mode setting page, and the timing mode setting page includes a first mode name setting control 41a. The first mode name setting control 41a is used to allow the user to input the name of the timing mode, such as "timing mode A".

[0218] In some embodiments, see Figure 4A In the sub-figure (b), the timing mode setting page also includes a first trigger condition setting control 41b. The timing mode can be configured to trigger the display device when the system time reaches a fixed preset time T y The first trigger condition setting control 41b is used to allow the user to set the preset time T y , for example, set to 21:30. In this way, the resume time data may include the preset time T y .

[0219] In some embodiments, see Figure 4A In the sub-figure (b), the timing mode setting page also includes a first mode action setting control 41c. The timing mode can be configured to be set to a preset time T when the system time of the display device reaches the preset time T y The first mode action setting control 41c is used to allow the user to set the mode action of the timing mode, for example, to "disconnect screen projection" or "shutdown".

[0220] In some embodiments, see Figure 4A In the sub-figure (b), the timing mode setting page also includes a first cancel button 41d and a first save button 41e. The first cancel button 41d is used to cancel the timing mode setting. When the first cancel button 41d is triggered, the display closes the timing mode setting page. The first save button 41e is used to save the timing mode. When the first save button 41e is triggered, the mode application can save the acquired timing mode information to the mode management module 205. The timing mode information example is {mode name: timing mode A, trigger condition: preset time Ty =21:30, mode action: disconnect screen projection}.

[0221] Figure 4B This is a schematic diagram of the interval mode setting method provided in some embodiments of the present application. Figure 4B In the sub-figure (a), the controller responds to the user triggering the operation of adding the button of the interval mode plate 42, see Figure 4B In the sub-figure (b), the display is controlled to display the interval mode setting page, and the interval mode setting page includes a second mode name setting control 42a. The second mode name setting control 42a is used to allow the user to input the name of the interval mode, such as "interval mode A".

[0222] In some embodiments, see Figure 4B In sub-figure (b), the interval mode setting page also includes a second trigger condition setting control 42b. The interval mode is used to allow the user to rest for a second preset time t2 every first preset time t1 when watching the projection screen, so as to achieve the purpose of halftime and avoid problems such as user eye fatigue and lack of concentration. The second trigger condition setting control 42b is used to allow the user to set the first preset time t1 and the second preset time t2, for example, the first preset time t1 is 60 minutes, and the second preset time t2 is 10 minutes. In this way, the resume time data can include the first preset time t1 and the second preset time t2.

[0223] In some embodiments, see Figure 4B In sub-figure (b), the timing mode setting page also includes a second mode action setting control 42c. The second mode action setting control 42c is used to allow the user to set the mode action of the interval mode (i.e., set the working state of the screen projection during the halftime break), for example, to "pause the screen projection".

[0224] In some embodiments, see Figure 4B In sub-figure (b), the timing mode setting page also includes a second cancel button 42d and a second save button 42e. The second cancel button 42d is used to cancel the interval mode setting. When the second cancel button 42d is triggered, the display closes the interval mode setting page. The second save button 42e is used to save the interval mode. When the second save button 42e is triggered, the mode application can save the acquired interval mode information to the mode management module 205. An example of interval mode information is {mode name: interval mode A; trigger condition: t1 = 60min, t2 = 10min; mode action: pause screen projection}.

[0225] Figure 4C This is a schematic diagram of the timing mode setting method provided in some embodiments of the present application. Figure 4C In the sub-figure (a), the controller responds to the user triggering the operation of adding the button of the timing mode block 43, see Figure 4C In the sub-figure (b), the display is controlled to display the timing mode setting page, and the interval mode setting page includes a third mode name setting control 43a. The third mode name setting control 43a is used to allow the user to input the name of the timing mode, such as "timing mode A".

[0226] In some embodiments, see Figure 4C In sub-figure (b), the timing mode setting page also includes a third trigger condition setting control 43b. The timing mode can be configured to start timing from the start of screen projection, and the timing duration represents the cumulative playback time of the projection content (referred to as the playback duration), and the corresponding mode action is executed when the timing duration reaches the third preset duration t3. The third trigger condition setting control 43b is used to enable the user to set the third preset duration t3, for example, the third preset duration t3 is 2h. In this way, the continued broadcast time data can include the third preset duration t3.

[0227] In some embodiments, see Figure 4C In the sub-picture (b), the timing mode setting page also includes a third mode action setting control 43c. The third mode action setting control 43c is used to allow the user to set the mode action of the timing mode, for example, to "disconnect the screen projection".

[0228] In some embodiments, see Figure 4C In sub-figure (b), the timing mode setting page also includes a third cancel button 43d and a third save button 43e. The third cancel button 43d is used to cancel the timing mode setting. When the third cancel button 43d is triggered, the display closes the timing mode setting page. The third save button 43e is used to save the timing mode. When the third save button 43e is triggered, the mode application can save the acquired timing mode information to the mode management module 205. An example of timing mode information is {mode name: timing mode A, trigger condition: t3 = 2h, mode action: disconnect screen projection}.

[0229] Depend on Figure 4A to Figure 4C It can be seen that the user can add the required type of projection mode and set the mode information of the projection mode by clicking the add button of any projection mode panel. The mode information may include at least one of timing mode information, interval mode information and timing mode information.

[0230] Figure 4D Schematic diagram of the screen projection mode setting page provided in some embodiments of the present application. Figure 4D As shown in the figure, after the user has added a certain projection mode, the mode information will be displayed in the associated projection mode section. Figure 4A to Figure 4CIn the example, the timing mode section 41 displays the timing mode information corresponding to the timing mode A, the interval mode section 42 displays the interval mode information corresponding to the interval mode A, and the timing mode section 43 displays the timing mode information corresponding to the timing mode A.

[0231] In some embodiments, Figure 4D As shown, each section can also configure the associated switch button, edit button and delete button for the added mode information. Among them, the switch button is used to turn on or off the mode, the edit button is used to edit and modify the mode information, and the delete button is used to delete the mode.

[0232] In this way, the mode management module 205 can store the mode information pre-set by the user through the projection mode setting page 40, or obtain and store the mode information based on the user's setting operation on the projection mode setting page 40 when the projection starts, and control and manage the projection of the display device according to the mode information. Among them, the mode information includes at least one trigger condition and mode action of the projection mode. For example, the trigger condition of timing mode A is 'the system time reaches 21:30', and the executed mode action is 'disconnect the projection'; the trigger condition of interval mode A is 'every interval of 1h for viewing time', and the executed mode action is 'pause the projection for 10min (i.e., a 10min halftime break)'; the trigger condition of timing mode A is 'the cumulative viewing time reaches 2h', and the executed mode action is 'disconnect the projection'.

[0233] For the above-mentioned timing mode, the playback time data includes the system time of the display device, and the resumed playback time data includes the preset time. In this way, the controller can be configured as follows: if the system time reaches the preset time, it is determined that the resumed playback end condition is met, the target film source is stopped from playing, and the projection connection with the projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: a scheme for determining the resumed playback end condition and the projection control operation based on the first time management mechanism (i.e., the timing mode) is provided. When the system time reaches a fixed preset time, it is determined that the resumed playback end condition is met, and the controller disconnects the projection connection to stop playing the target film source. This avoids the projection device from continuing to push the projection content to the display device based on the projection connection when the preset time is reached, and also avoids the display device from continuing to play the projection content after the preset time has exceeded. This avoids affecting the user's work and rest due to the projection content playing time being too late.

[0234] Figure 5A Schematic diagram of changes in the user interface when the triggering conditions of the timing mode are met in some embodiments of the present application Figure 1 .

[0235] After the controller operation mode is applied, the timing mode can be processed as follows to determine the end condition of the target source's playback, thereby deciding whether to disconnect the screen projection connection. Figure 5A As shown in sub-figure (a), assuming that the display device plays the projection content 1 pushed by the projection device 1 in full screen, the mode application can control the projection source analysis module 215 to parse the session information of the projection device 1 to obtain the projection source information, and forward the projection source information to the mode management module 205 through the message processing module 203, so that the mode management module 205 stores the projection source information corresponding to the projection content 1. Figure 5A In the example, the projection source type is VideoURL, and the media resource playback type is the source media resource (hereinafter referred to as the target source).

[0236] In some embodiments, the mode management module 205 can obtain the resume time data according to the mode information, obtain the play time data during the playback of the target source, and determine whether the resume end condition is met by comparing the resume time data with the play time data, and determine whether the trigger condition of a certain projection mode is met. y , then the timing mode is triggered, and the timing mode can be associated with mode action A, and mode action A is to disconnect the screen projection connection. In this way, the mode management module 205 can send a disconnect screen projection message to the screen projection management module 201 through the message processing module 203; the screen projection management module 201 responds to the disconnect screen projection message and disconnects the communication connection between the display device and the screen projection device 1 through the screen projection service (referred to as: screen projection connection).

[0237] In some embodiments, if the system time reaches a preset time, the controller stops playing the target film source and disconnects the projection connection with the projection device. Specifically, the controller is configured as follows: when the system time reaches the preset time, the display is controlled to display a first prompt message, and the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the target film source is stopped from playing, and the projection connection with the projection device is disconnected; the controller is also configured as follows: if the user refuses to disconnect the projection connection, the target film source continues to play. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then, based on the time condition of the timing mode, the user's viewing needs are added to decide whether to disconnect the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the film source continues to play, thereby satisfying the user's viewing needs and preferences.

[0238] When the mode management module 205 switches to the timing mode A, the View management module 204 can display a prompt page. Figure 5A Sub-figure (b) of the figure shows that the preset time of timing mode A has been reached, and the prompt page is used to prompt that the preset time of timing mode A has been reached, and to ask the user whether to disconnect the screen projection connection. If the user inputs a click operation on the approval button, the mode management module 205 can send a disconnect screen projection message to the screen projection management module 201 through the message processing module 203, and the screen projection management module 201 responds to the disconnect screen projection message and disconnects the screen projection connection with the screen projection device 1 through the screen projection service. If the user inputs a click operation on the rejection button, the target film source continues to be played, and the screen projection connection is not disconnected. In this way, when the system time reaches the preset time of the timing mode, the user's viewing needs can be considered to decide whether to disconnect the screen projection connection.

[0239] In some embodiments, the timing mode is used to set the timer to a fixed preset time T y Disconnect the screen to avoid exceeding the preset time T y If the user still watches the screen projection content without restraint, it can be applied to scenarios such as night reminders. However, for the screen projection of the video source (non-live) pushed by VideoURL, after reaching the preset time T y The screencast source may not have finished playing (i.e. the playing time of the source is less than the total duration). If the screencast is disconnected directly, the user will miss the preset time T y After that, you will not be able to watch the entire content.

[0240] In some embodiments, the controller is specifically configured to: when the system time reaches the preset time, determine the remaining playback time of the target film source according to the playback progress of the target film source and the total duration of the target film source; if the remaining playback time is greater than the preset threshold, stop playing the target film source and disconnect the screen projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, the film source may not have finished playing, so the film source has a time parameter of the remaining playback time, and the remaining playback time is calculated by the playback progress and total duration of the film source, and the length of the remaining playback time is measured by the preset threshold, so that the controller decides whether to disconnect the screen projection connection when the system time reaches the fixed preset time; if the remaining playback time is large, if the projection connection is not disconnected, the display device will continuously play the projection content pushed by the projection device, which may affect the user's plan to take a regular break. Therefore, in this scenario, the controller can disconnect the projection connection and stop playing the film source, so that the user cannot continue to watch the film source content.

[0241] In some embodiments, the controller is specifically configured to: when the remaining playback time is greater than a preset threshold, control the display to display the remaining playback time and a first prompt message, the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the target film source and disconnect the projection connection with the projection device; if the user refuses to disconnect the projection connection, continue to play the target film source. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches a fixed preset time, the remaining playback time of the film source is used as a playback time parameter. If the remaining playback time is large, if the projection connection is not disconnected, the display device will continuously play the projection content pushed by the projection device, which will affect the user's regular rest plan. Therefore, the controller can control the display to display a prompt message to inform the user of the remaining playback time of the film source and ask the user whether to disconnect the projection connection. In this way, the user can refer to the remaining playback time and the user's viewing needs to decide whether to perform an immediate disconnection of the projection operation or a delayed disconnection of the projection operation. Among them, the delayed disconnection of the projection operation refers to delaying the disconnection of the projection connection until the target film source ends.

[0242] In some embodiments, the controller is further configured to: if the remaining playback time is not greater than a preset threshold, continue to play the target film source, and disconnect the screen projection connection with the projection device when the target film source finishes playing. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches a fixed preset time, if the projection connection is not disconnected, the display device will continue to play the film source until the film source ends playing. Therefore, if the remaining playback time of the film source is short when the preset time is reached, it may not have much impact on the user's rest. In this way, the projection connection can be disconnected until the film source ends playing, thereby ensuring the integrity of the user's viewing of the film source, avoiding the projection device from continuing to push the projection content to the display device based on the projection connection after the preset time is reached, and avoiding the display device from continuing to play the projection content after the preset time exceeds the preset time.

[0243] In some embodiments, the controller is configured to: if the remaining playback time is not greater than a preset threshold, control the display to display the remaining playback time and a second prompt message, the second prompt message is used to prompt the user whether to agree to delay the disconnection of the projection connection until the target film source is finished playing; if the user agrees to delay the disconnection of the projection connection, continue to play the target film source; if the user refuses to delay the disconnection of the projection connection, stop playing the target film source and disconnect the projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: when the system time reaches a fixed preset time, if the remaining playback time is short, the controller can control the display to display a prompt message to inform the user of the remaining playback time of the film source, and ask the user whether to agree to delay the disconnection of the projection connection until the film source is finished playing, so that the user can refer to the remaining playback time and viewing needs to decide whether to disconnect the projection immediately or delay the disconnection of the projection.

[0244] In some embodiments, after the controller runs the mode application, the mode application can also implement the following embodiments to control the screen projection playback according to the remaining playback time of the source after the timing mode is triggered. y When the target source is pushed, the total duration of the target source can be obtained through the metadata of the target source, and the getposition() interface of VideoURL can be called to query the current playback progress of the target source pushed by VideoURL, and the remaining playback duration of the target source (restDuration) can be calculated based on the duration and playback progress of the target source. Then restDuration = duration - T now Among them, duration is the total duration of the target source, representing the total playback time of the target source (referred to as total duration); T now It is related to the playback progress of the source, indicating the current playback time of the target source; restDuration indicates the duration of the unplayed content of the source. For example, if the total duration of the source is 45 minutes and the current playback is up to the 40th minute, then there are 5 minutes of content left to play.

[0245] In some embodiments, in order to measure the length of restDuration, the mode management module 205 can set at least one preset threshold. If the preset threshold is one, restDuration≤preset threshold, it means that the remaining playback time of the target film source is short, then the delayed disconnection of the screen projection operation can be performed first, that is, the screen projection connection is disconnected until the target film source is finished playing, so as to ensure the integrity of the film source playback without affecting the user's rest as much as possible, and prevent the user from missing the subsequent exciting content. If restDuration>preset threshold, it means that the remaining playback time of the target film source is long, which will affect the user's rest to a greater extent, then the immediate disconnection of the screen projection operation will be performed first.

[0246] In some embodiments, if there are multiple preset thresholds, for example, a first threshold and a second threshold are set, and the second threshold is greater than the first threshold, a more refined range analysis of restDuration can be performed. For example, if restDuration≤the first threshold, indicating that the remaining playback time of the target film source is short, the delayed disconnection of the screen projection operation can be prioritized, that is, the screen projection connection is disconnected until the target film source is finished playing. If the first threshold value<restDuration≤the second threshold value, indicating that the remaining playback time of the target film source is moderate, the user can be asked whether to disconnect the screen projection connection immediately or delay the disconnection of the screen projection connection. If restDuration>the second threshold value, indicating that the remaining playback time of the target film source is long, the immediate disconnection of the screen projection operation is prioritized. Among them, the values ​​of the first threshold value and the second threshold value are not limited, for example, the first threshold value is set to 5min, and the second threshold value is set to 30min.

[0247] In some embodiments, taking the implementation method of double preset thresholds as an example, if restDuration is not greater than the first threshold, it indicates that the remaining time of the film source is short, and the impact of this short time on the user's rest can be ignored. In this scenario, the mode management module 205 can set the priority of the mode action to: delaying the disconnection of the projection operation takes precedence over the immediate disconnection of the projection operation. In this way, the mode management module 205 can execute mode action B1, and mode action B1 is configured to: send a first prompt instruction to the View management module 204 through the message processing module 203, and disconnect the projection connection when the target film source ends (mode action A), that is, delay the operation of disconnecting the projection connection by the length of restDuration.

[0248] Figure 5B Schematic diagram of changes in the user interface when the triggering conditions of the timing mode are met in some embodiments of the present application Figure 2 .like Figure 5B As shown in sub-figure (b), if the restDuration of the target film source is not greater than the first threshold, the View management module 204 responds to the first prompt instruction and displays a prompt message 51 on the screen projection playback interface. The prompt message 51 is used to prompt the restDuration of the target film source and to automatically disconnect the screen projection after the target film source is finished playing. Figure 5B An example of the prompt content of prompt information 51 is "The preset time of timing mode A has been reached, 3 minutes remaining, and the screen projection will be automatically disconnected after the current film source is finished playing."

[0249] In some embodiments, when the mode management module 205 detects that the playback of the target film source has ended, that is, restDuration is cleared, it executes mode action A: it sends a disconnect screen projection instruction to the projection management module 201 through the message processing module 203, so that the projection management module 201 responds to the disconnect screen projection instruction, calls the finish() interface of the Session object corresponding to the projection device 1, and the projection service sends a disconnect screen projection request to the projection device 1 through the protocol. The projection device 1 responds to the disconnect screen projection request, disconnects the projection connection with the display device, and feeds back a disconnect message to the display device, so that the projection management module 201 receives the disconnect message, can release the related resources occupied by the projection (such as a player, etc.), and notifies the View management module 204 through the message processing module 203 to cancel the display of the film source content pushed by the projection device 1 in the SurfaceView / TextureView to stop playing the target film source.

[0250] In some embodiments, if restDuration is not greater than the first threshold, the mode management module 205 can set the priority of the mode action to: delay disconnection of the projection operation takes precedence over immediate disconnection of the projection operation. In this way, the mode management module 205 can also execute mode action B2, which is configured to: send a second prompt instruction to the View management module 204 through the message processing module 203.

[0251] Figure 5C Schematic diagram 3 of the change of the user interface when the triggering condition of the timing mode is met in some embodiments of the present application. Figure 5C As shown in sub-figure (b), if the restDuration of the target source is not greater than the first threshold, the View management module 204 can display a prompt pop-up window 52 on the screen projection playback interface in response to the second prompt instruction. The prompt pop-up window 52 is used to prompt the restDuration of the target source and ask whether to delay the disconnection of the screen projection connection until the target source ends. The prompt pop-up window 52 also includes a first consent button 52a and a first rejection button 52b.

[0252] In some embodiments, see Figure 5C In sub-figure (b), if the user inputs a click operation on the first consent button 52a, the View management module 204 can send a consent delay disconnection screen projection message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the consent delay disconnection screen projection message and executes mode action A when restDuration is cleared (i.e., the target video source ends playing) to disconnect the screen projection connection with the screen projection device 1.

[0253] In some embodiments, see Figure 5CIn sub-figure (b), if the user inputs a click operation on the first rejection button 52b, the View management module 204 can send a rejection delay disconnection screen projection message to the mode management module 205 through the message processing module 203. The mode management module 205 receives the rejection delay disconnection screen projection message and executes mode action A to disconnect the screen projection connection with the screen projection device 1.

[0254] In some embodiments, if restDuration is greater than the first threshold and not greater than the second threshold, it indicates that the remaining time of the source is not very short but not long (moderate), so the timing mode can be added with an associated mode action C1, which is to y The node decides whether to disconnect the screen projection connection immediately by prompting the restDuration of the film source and asking the user whether they agree to disconnect the screen projection.

[0255] In some embodiments, when the system time reaches a preset time T y When restDuration is greater than the first threshold and not greater than the second threshold, the mode management module 205 executes mode action C1 after the timing mode is triggered. The mode action C1 is configured as follows: sending a first inquiry instruction to the View management module 204 through the message processing module 203, so that the View management module 204 responds to the first inquiry instruction by displaying the first inquiry content to inquire whether to disconnect the screen after the timing mode is triggered. The first inquiry content can be presented to the user in the form of a pop-up window, prompt information, etc.

[0256] Figure 6 Schematic diagram 4 of the change of the user interface when the triggering condition of the timing mode is met in some embodiments of the present application. Figure 6 As shown in sub-figure (b) of , the View management module 204 can display an inquiry pop-up window 60 on the display in response to the first inquiry instruction, and the inquiry pop-up window 60 is used to prompt that the preset time of the timing mode and the restDuration of the target source (for example, 17 minutes) have been reached, and to ask whether to agree to disconnect the screen projection. The inquiry pop-up window 60 includes a second consent button 61 and a second rejection button 62.

[0257] In some embodiments, when the View management module 204 starts to display the inquiry pop-up window 60, the time management module 213 can control the timer Timer1 to start counting up, and determine whether the timing time of Timer1 reaches the first threshold time (for example, 5 seconds). If the timing time of Timer1 reaches the first threshold time, the time management module 213 can send a first timing reaching message to the View management module 204 through the message processing module 203, and after the first timing reaching message is successfully sent, control Timer1 to stop timing and reset the timing time to zero.

[0258] In some embodiments, if the user agrees to disconnect the screen projection in the timing mode, the user can click the second consent button 61 within the first threshold time. In response to the user clicking the second consent button 61 and not receiving the first timing reached message, the View management module 204 closes the inquiry pop-up window 60, sends a message of agreeing to disconnect the screen projection to the mode management module 205 through the message processing module 203, and sends a stop timing message to the time management module 213 through the message processing module 203. The time management module 213 receives the stop timing message, controls Timer1 to stop timing, and clears the timing time.

[0259] In some embodiments, the mode management module 205 receives a message agreeing to disconnect the screen projection, and executes mode action A: sends a disconnect screen projection instruction to the screen projection management module 201 through the message processing module 203, so that the screen projection management module 201 responds to the disconnect screen projection instruction, calls the finish() interface of the Session object corresponding to the screen projection device 1, and the screen projection service sends a disconnect screen projection request to the screen projection device 1 through the protocol. The screen projection device 1 responds to the disconnect screen projection request, disconnects the screen projection connection with the display device, and feeds back a disconnect message to the display device, so that the screen projection management module 201 receives the disconnect message, can release the related resources occupied by the screen projection (such as a player, etc.), and notifies the View management module 204 through the message processing module 203 to cancel the display of the source content pushed by the VideoURL in the SurfaceView / TextureView to stop playing the target source.

[0260] In some embodiments, the execution order of stopping playing the target film source and disconnecting the screen projection connection is not limited. The two operations can be executed simultaneously, or the target film source can be stopped first and then the screen projection connection can be disconnected, or the screen projection connection can be disconnected first and then the target film source can be stopped.

[0261] In some embodiments, if the user wants to continue watching the projection content and refuses to immediately disconnect the projection in the timing mode, the user can click the second rejection button 62 within the first threshold time. In response to the user clicking the second rejection button 62 and not receiving the first timing reached message, the View management module 204 closes the inquiry pop-up window 60, sends a message of refusing to disconnect the projection to the mode management module 205 through the message processing module 203, and sends a stop timing message to the time management module 213 through the message processing module 203. The mode management module 205 receives the message of refusing to disconnect the projection, does not perform the operation of disconnecting the projection connection for the time being, and continues to monitor the restDuration of the current film source. When it detects that the restDuration changes to no more than the first threshold, it can execute the aforementioned mode action B1 or mode action B2. The time management module 213 receives the stop timing message, controls Timer1 to stop timing, and clears the timing time.

[0262] In some embodiments, if the user neither clicks the second consent button 61 nor the second rejection button 62 within the first threshold time, a timeout and no response event occurs. When the View management module 204 receives the first timing reached message sent by the time management module 213, if the user does not click the second consent button 61 or the second rejection button 62, the inquiry pop-up window 60 is closed, and a timeout and no response message is sent to the mode management module 205 through the message processing module 203. When the mode management module 205 receives the timeout and no response message, it can perform mode action A by default, that is, immediately disconnect the screen projection connection. Among them, the first threshold time is data configured in a timing mechanism. Through the timing mechanism, on the one hand, the user is asked about his willingness to disconnect / maintain the screen projection in a specific mode, and on the other hand, it can avoid the situation where the inquiry pop-up window 60 is always displayed due to the user's inactivity for a long time, avoid the inquiry pop-up window 60 blocking the content displayed by the user interface, and avoid the screen projection disconnection waiting and delay caused by the timeout and no response event.

[0263] Figure 7 Schematic diagram 5 of the change of the user interface when the triggering condition of the timing mode is met in some embodiments of the present application. Figure 7 As shown in sub-figure (a) of FIG. 1 , when the display device displays the target source pushed by the projection device 1 through the VideoURL, the mode management module 205 detects that the system time reaches the preset time T yAfter the timing mode is triggered, if it is determined that restDuration is greater than the first threshold and not greater than the second threshold, the mode management module 205 in this scenario can set the priority of the mode action to: immediately disconnect the screen projection operation takes precedence over the delayed disconnection of the screen projection operation. In this way, the mode management module 205 can execute mode action C2, which is configured to: send a second query instruction to the View management module 204 through the message processing module 203, and send a countdown instruction to the time management module 213 through the message processing module 203.

[0264] In some embodiments, see Figure 7 In sub-figure (b), the View management module 204 can display the first prompt information 71 and the countdown control 72 through the display in response to the second inquiry instruction. An example of the prompt content of the first prompt information 71 is "The preset time of timing mode A has been reached, and there are 17 minutes left for the film source. The screen projection will be disconnected. If you refuse, please press any key." The countdown control 72 is used to display the remaining operational time for the user to refuse to disconnect the screen projection through a countdown method.

[0265] In some embodiments, the time management module 213 responds to the countdown instruction, controls the timer (Timer1) to start the countdown, and determines whether the countdown is reset (i.e., becomes 0S) when the view management module 204 starts to display the first prompt information 71. When the countdown is reset, the time management module 213 can send a time reset message to the view management module 204 through the message processing module 203.

[0266] In some embodiments, the countdown method implemented by the time management module 213 is to start from the first threshold time, and count the time in a second-by-second manner until the countdown is cleared, and the countdown mechanism automatically terminates. Taking the first threshold time as 5S (seconds) as an example, the remaining time of the countdown is 5S, 4S, 3S, 3S, 1S, 0S in sequence, and the countdown control 72 should be synchronized with the countdown of the time management module 213, that is, the countdown control 72 dynamically presents a jump time change of 5S, 4S, 3S, 3S, 1S, 0S.

[0267] In some embodiments, if the user wants to continue watching the source content of the screen projection and refuses to disconnect the screen projection immediately in the timing mode, the user can input the rejection of the screen projection disconnection operation before the countdown is reset. The input method of the rejection of the screen projection disconnection operation is not limited. For example, the user can click any button on the control device 100 (such as a remote control), or click a preset button. The preset button is not limited, such as a return button, an exit button, etc.

[0268] In some embodiments, the View management module 204 responds to the user input of refusing to disconnect the screen projection operation and does not receive the time reset message sent by the time management module 213, then cancels the display of the first prompt information 71 and the countdown control 72, and sends a message of refusing to disconnect the screen projection to the mode management module 205 through the message processing module 203; the mode management module 205 receives the message of refusing to disconnect the screen projection, does not execute mode action A for the time being, and continues to monitor the restDuration of the current film source. When it is detected that the restDuration changes to no more than the first threshold, it can execute the aforementioned mode action B1 or mode action B2.

[0269] In some embodiments, if the user agrees to immediately disconnect the screen projection in the timing mode, there is no need to input any operation and wait for the countdown to be reset. When the View management module 204 receives the message of time reset, if it does not receive the rejection of the disconnection operation of the screen projection, it cancels the display of the first prompt message 71 and the countdown control 72, and sends a message of consent to disconnect the screen projection to the mode management module 205 through the message processing module 203. The mode management module 205 receives the message of consent to disconnect the screen projection and executes mode action A: sends a disconnection instruction to the screen projection management module 201 through the message processing module 203. In this way, through the countdown mechanism, on the one hand, the user is asked about his willingness to disconnect / maintain the screen projection in a specific mode, and on the other hand, the first prompt message 71 is avoided from being displayed for a long time, thereby reducing the waiting time and delay for the screen projection to be disconnected.

[0270] In some embodiments, when the system time reaches a preset time T y When restDuration is greater than the second threshold, it indicates that the remaining time of the film source is long, which will affect the user's rest. In this scenario, the mode management module 205 can set the priority of the mode action to: immediately disconnecting the projection operation takes precedence over delaying the disconnection of the projection operation.

[0271] In some embodiments, when the system time reaches a preset time T y When restDuration is greater than the second threshold, the mode management module 205 can execute mode action A to make the screen projection management module 201 immediately disconnect the screen projection connection with the screen projection device 1.

[0272] In some embodiments, when the system time reaches a preset time T yWhen restDuration is greater than the second threshold, the mode management module 205 can execute the mode action D of the timing mode, and the mode action D is configured as: sending a third inquiry instruction to the View management module 204 through the message processing module 203, and sending a countdown instruction to the time management module 213 through the message processing module 203. In this way, during the countdown, it is inquired whether to disconnect the screen projection after the timing mode is triggered. Based on the user's consent or refusal to disconnect the screen projection operation instruction, the mode management module 205 can decide whether to execute mode action A immediately or delay the execution of mode action A. And, if mode action A is delayed, it supports the user to disconnect the screen projection at any time before the end of the film source playback.

[0273] In some embodiments, the timing mode includes the following situations: (1) the system time reaches the preset time; (2) the restDuration of the target film source is greater than the preset threshold; (3) the restDuration of the target film source is not greater than the preset threshold; (4) the user agrees to disconnect the screen projection connection; (5) the user refuses to delay the disconnection of the screen projection connection until the target film source ends playing; (6) the user agrees to delay the disconnection of the screen projection connection until the target film source ends playing; (7) the playback of the target film source ends.

[0274] Based on the above situations, when at least situation (1) is achieved, it is determined that the replay end condition is met, the target source is stopped from playing, and the projection connection is disconnected. Other situations can be appropriately combined with situation (1) to further expand the possibility of replay end conditions.

[0275] In some embodiments, when situation (1) occurs, the user may be further asked whether he agrees to disconnect the screen projection connection. If situation (4) is reached, it is determined that the conditions for ending the resumed broadcast are met, the target film source is stopped from being played, and the screen projection connection is disconnected.

[0276] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (2) occurs, it is determined that the replay end condition is met, the target film source is stopped, and the projection connection is disconnected.

[0277] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (2) occurs, the user is further asked whether he agrees to disconnect the screen projection connection. If situation (4) is reached, it is determined that the conditions for ending the resumed broadcast are met, the target film source is stopped from playing, and the screen projection connection is disconnected.

[0278] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (3) occurs, the target film source continues to be played until situation (7) occurs. It is determined that the conditions for ending the continued playback are met, the target film source is stopped, and the projection connection is disconnected.

[0279] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (3) occurs, the user is further asked whether he agrees to delay disconnecting the screen projection until the target film source finishes playing. If situation (5) occurs, it is determined that the conditions for ending the resumed playback are met, the target film source is stopped from playing, and the screen projection connection is disconnected.

[0280] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (3) occurs, the user is further asked whether he agrees to delay disconnecting the screen projection until the target film source finishes playing. If situation (6) occurs, the target film source continues to play until situation (7) occurs. It is determined that the conditions for ending the resumed playback are met, the target film source is stopped, and the screen projection connection is disconnected.

[0281] In some embodiments, when the system time reaches a preset time T y Previously, if the mode management module 205 did not trigger other screen projection modes (such as interval mode, timing mode), it was determined that the replay end condition was not met, and the display device continued to play the target film source without disconnecting the screen projection connection.

[0282] Figure 8 Schematic diagram of changes in the user interface when the triggering conditions of the timing mode are met in some embodiments of the present application Figure 6 The View management module 204 responds to the third query instruction, such as Figure 8 As shown in sub-figure (b), the second prompt message 81 and the countdown control 82 are displayed. An example of the prompt content of the second prompt message 81 is "The preset time of timing mode A has been reached, and there are 35 minutes of film source left. The screen projection will be disconnected. If you refuse, please press any key." The countdown control 82 is used to display the remaining operational time for the user to refuse to disconnect the screen projection through a countdown method.

[0283] In some embodiments, the time management module 213 responds to the countdown instruction, and when the View management module 204 starts to display the second prompt information 81, controls Timer1 to start the countdown, and determines whether the countdown is reset. When the countdown is reset, the time management module 213 can send a time reset message to the View management module 204 through the message processing module 203. The countdown control 72 should be synchronized with the countdown of the time management module 213.

[0284] In some embodiments, when the View management module 204 receives the time reset message, if it does not receive the rejection of disconnecting the screen projection operation, it cancels the display of the second prompt information 81 and the countdown control 82, and sends a message of consent to disconnect the screen projection to the mode management module 205 through the message processing module 203. After receiving the message of consent to disconnect the screen projection, the mode management module 205 immediately executes mode action A to stop playing the target source and disconnect the screen projection connection.

[0285] In some embodiments, the View management module 204 responds to the user input of the rejection disconnection screen projection operation and does not receive the time reset message sent by the time management module 213, then cancels the display of the second prompt information 81 and the countdown control 82, and sends a rejection disconnection screen projection message to the mode management module 205 through the message processing module 203. After receiving the rejection disconnection screen projection message, the mode management module 205 can execute the mode action D1, which is configured to send a third prompt instruction to the View management module 204 through the message processing module 203.

[0286] In some embodiments, the View management module 204 responds to the third prompt instruction, such as Figure 8 As shown in sub-figure (c), a third prompt message 83 is displayed on the screen projection playback interface, and an example of the prompt content of the third prompt message 83 is "The screen projection has been delayed and disconnected. Enter the preset operation to disconnect the screen projection at any time."

[0287] In some embodiments, if restDuration is greater than the second threshold, it indicates that the remaining time of the video source is relatively long. y Although the user may refuse to disconnect the screen projection because he / she is still not satisfied, he / she may want to rest due to fatigue while the video source is still playing, but he / she does not want to wait for the video source to finish before disconnecting the screen projection. In this way, the user can y After that and before restDuration is reset to zero, you can enter the preset operation at any time to disconnect the screen projection.

[0288] In some embodiments, the input method of the preset operation is not limited. For example, the preset operation examples are: pressing (short press or long press) a preset button (such as a return button, etc.) on the control device 100, clicking a disconnect screen projection button set on the screen projection playback interface, inputting a voice command containing the intention to disconnect the screen projection, inputting a gesture operation indicating disconnecting the screen projection, etc.

[0289] In some embodiments, the View management module 204 responds to the preset operation input by the user and sends a disconnect screen projection message to the mode management module 205 through the message processing module 203. Upon receiving the disconnect screen projection message, the mode management module 205 immediately executes mode action A, so that the screen projection management module 201 disconnects the screen projection connection with the screen projection device 1 by calling the finish() interface of SessionClient1.

[0290] In some embodiments, for the interval mode, the playback time data includes the playback time of the target film source, and the continued playback time data includes a first preset time. The controller can be configured to: if the playback time of the target film source reaches the first preset time, pause the playback of the target film source. The technical solution provided by this embodiment has the following beneficial effects: a solution for determining the end condition of continued playback and screen projection control operation based on the second time management mechanism (which can be called the interval mode) is provided. After the film source starts playing, the playback time of the film source can be recorded, and the playback time and the first preset time are used as parameters to determine whether the end condition of continued playback is met. When the playback time reaches the first preset time, the user may need to take a break, and the controller can pause the playback of the film source, so that the playback progress of the film source stagnates at the pause node, and the display device no longer continues to play the film source, allowing the user to pause watching the film source, thereby achieving the purpose of rest.

[0291] In some embodiments, for the interval mode, the resume time data also includes a second preset duration. The controller is also configured to: when the played time of the target film source reaches the sum of the first preset duration and the second preset duration, continue to play the target film source from the pause node. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, the film source is paused when the played time of the film source reaches the first preset duration. If the display device keeps pausing the film source, the playback progress of the film source will stagnate, resulting in the inability to continue the continuous playback of the film source. Therefore, the parameter of the second preset duration is increased. When the played time reaches the sum of the first preset duration and the second preset duration, that is, when the pause playback time of the film source reaches the second preset duration, the film source can be resumed from the pause node, thereby achieving the purpose of realizing a halftime break during the playback of the film source and avoiding the continuous pause of the film source.

[0292] In some embodiments, the controller can be configured to: if the playing time of the target source reaches the first preset time, start the first round of interval mode and pause the playing of the target source. The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be executed in a single round, so that when the playing time of the source reaches the first preset time, that is, when the starting point of the first round of the interval mode is reached, the source is paused, so that the number and frequency of the controller executing the interval mode can be limited, avoiding frequent pauses in the playing of the source during the playing of the source.

[0293] In some embodiments, the controller is further configured to: when the played time of the target film source reaches the sum of the first preset time and the second preset time, exit the first round of interval mode, and continue to play the target film source from the pause node. The technical solution provided by this embodiment has the following beneficial effects: The technical solution provided by this embodiment has the following beneficial effects: For the single round / first round interval mode, the film source is paused when the played time of the target film source reaches the first preset time, and the duration of the paused playback of the film source is the second preset time, so that when the played time of the target film source reaches the sum of the first preset time and the second preset time, exit the first round interval mode, and continue to play the film source from the pause node, so that the rounds and frequency of the controller executing the interval mode can be limited to avoid frequent pauses of the film source during the playback of the film source.

[0294] In some embodiments, after the controller exits the first round of interval mode and continues to play the target source from the pause node, it is further configured to: if the playing time of the target source reaches the starting time T of the interval mode of the i-th round, mi , then the interval mode of the i-th round is started and the target source is paused; wherein, T mi =i*t1+(i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number in the interval mode, and i is greater than 1. If the broadcast duration of the target source reaches the end time T of the interval mode of the i-th round ni , then exit the interval mode of the i-th round and continue playing the target source from the pause node; where T ni =T mi + t2 = i*(t1+t2). The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be executed multiple times, especially for scenes with a long total duration of the target film source. If only one round of interval mode is executed, the display device will play the film source uninterruptedly after exiting the first round of interval mode. Therefore, multiple rounds of interval mode can be set to cycle, that is, every first preset duration, the film source is paused for a second preset duration, to avoid problems such as fatigue caused by continuous viewing of the film source by the user.

[0295] Fig. 9 A schematic diagram of the triggering time distribution of the interval mode in the screen projection playback process provided by some embodiments of the present application. Fig. 9 As shown, the interval mode can be configured to pause the playback of the target source for a second preset time t2 at intervals of a first preset time t1, thereby calculating the triggering time distribution of the interval mode as [T mi ,T ni ], where i represents the triggering round of the interval mode in the screen projection playback process (i≥1), T mi Indicates the starting time of the i-th round interval mode, T niIndicates the end time of the interval mode of round i. Fig. 9 You can get: T mi =i*t1+(i-1)*t2, T ni =T mi +t2=i*(t1+t2).

[0296] In some embodiments, the user can set the total number of rounds (K value) of the interval mode through the projection mode setting page. The mode information of the interval mode includes: the first preset duration t1, the second preset duration t2 and the total number of rounds K, then 1≤i≤K. In this way, the upper limit of the number of rounds of the interval mode can be limited to avoid frequent intermissions affecting the user's viewing experience.

[0297] In some embodiments, the upper limit of the interval mode rounds may not be limited, and the upper limit may depend on the duration of the screen projection. The longer the screen projection duration, the larger the accumulated rounds.

[0298] In some embodiments, in the scenario where the projection source pushes the target source via VideoURL, the mode management module 205 can obtain the playback time data during the playback of the target source, and the playback time data includes the playback time of the target source. When the target source starts playing, the time management module 213 can control the timer Timer2 to start counting up, and the timing time of Timer2 represents the playback time of the target source.

[0299] In some embodiments, when the playback time of the target source reaches the starting point T of the interval, mi When the target source is in the playing state, the interval mode of the i-th round is triggered. If the target source is in the playing state, the mode management module 205 executes the mode action E in the interval mode. The mode action E can be configured as: pausing the playing of the target source of the screen projection, and the pause lasts for the second preset time length t2. The purpose of pausing the playing of the target source is to allow the user to mi ,T ni ] The screen projection cannot be viewed or listened to within the time range, forcing the user to take a halftime break, thereby protecting the eyes and alleviating physical and mental fatigue and inattention. The implementation method of pausing the playback of the target source can be: the playback control management module 212 calls the pause interface of SessionClient1 to synchronously pause the audio and video playback of the screen projection source, so that the playback progress of the target source stagnates at the pause node and remains unchanged.

[0300] In some embodiments, the interval mode may further include an associated mode action F, which may be configured to Qi The node gives a pre-alert for the interval mode of the i-th round. Mode action F is executed before mode action E. Qi =T mi-t3, t3 is the second threshold time (for example, 3 to 5 seconds).

[0301] In some embodiments, the mode management module 205 detects that the playing time of the target video source has reached T Qi When the interval mode is reached, the mode action F may be executed: the interval mode pre-reminder instruction is sent to the View management module 204 through the message processing module 203 .

[0302] Fig.10 Schematic diagram of changes in the user interface in interval mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 1 .like Fig.10 As shown in sub-figure (a) of FIG, the View management module 204 responds to the interval mode pre-reminder instruction and displays the fourth prompt information 101 on the screen projection playback interface. The prompt content example of the fourth prompt information 101 is "about to enter the interval rest". During the pre-reminder period, since the current time is less than T mi , the display keeps playing the content of the target source.

[0303] In some embodiments, the controller is further configured to: when pausing the playback of the target film source, control the display to display a preset blocking page on the upper layer of the playback interface of the target film source; when continuing to play the target film source from the pause node, control the display to cancel the display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, when pausing the playback of the film source, in order to allow the user to concentrate on resting without interference, the preset blocking page can be used to block the projection content, so that the upper layer of the display device only presents the preset blocking page, which has no valid projection content, and the projection playback interface is invisible, so that the user cannot see the film source content, nor can he perform playback control operations on the film source, until the end time of the break is reached, and the preset blocking page is canceled when the film source needs to be resumed, and the blocking of the projection content is canceled, so that the projection playback interface is visible, so that the user can continue to watch the film source.

[0304] In some embodiments, the mode management module 205 detects that the playing time of the target video source has reached the starting point T of the interval. mi , triggering the interval mode of the i-th round, the mode management module 205 obtains the projection source information from the projection source analysis module 215. If it is determined that the projection source type is VideoURL, the media resource playback type is film source, and the target film source is in the playing state, then the mode action E1 can be executed. The mode action E1 is configured as: sending a projection pause instruction to the broadcast control management module 212 through the message processing module 203, and sending a projection block instruction to the View management module 204 through the message processing module 203.

[0305] In some embodiments, in response to the screen projection pause instruction, the playback control management module 212 can call the pause interface of SessionClient1 to synchronously pause the audio and video of the screen projection source, thereby switching the target source to the paused playback state. In this way, the playback progress of the target source remains unchanged at the pause point, and there is no need to mute the target source when it is in the paused playback state.

[0306] In some embodiments, Fig.10 As shown in sub-figure (b), the View management module 204 can cancel the display of the fourth prompt information 101 in response to the screen projection blocking instruction, and set the screen projection playback interface to an invisible state (the data management module 202 synchronously rewrites the mVisible state value corresponding to the screen projection device 1 to false). The View management module 204 can display the preset blocking page 102. The preset blocking page 102 is used to block the screen projection playback interface on the entire screen, so that the user can mi ,T ni ]The source content in the screen projection playback interface cannot be viewed within the time range.

[0307] In some embodiments, Fig.10 As shown in sub-figure (b) of , the preset shielding page 102 can display a preset background image, and display the fifth prompt information 102a on the preset background image, and the fifth prompt information 102a is used to prompt to continue watching the projection content after the second preset time t2. Fig.10 The fifth prompt information 102a in the sub-figure (b) is exemplified as “You can continue watching after a 10-minute break.” The preset background image may be a solid color background image, an eye protection image, a wallpaper image with a pattern, or the like.

[0308] In some embodiments, the mode management module 205 can obtain the timing time of Timer2 from the time management module 213, thereby obtaining the elapsed time of the target source. ni , the interval mode of the i-th round ends / exits. The interval mode is also associated with mode action G, which can be configured to resume the playback of the target source from the pause node (pause point), that is, to continue playing the target source. Among them, the purpose of resuming the screen projection playback is to restore the user's screen projection and audio-visual after the halftime break. The implementation method can be: the broadcast control management module 212 calls the replay interface of SessionClient1 to synchronize the audio and video of the screen projection source from the pause point, so that the playback progress of the target source continues to change dynamically.

[0309] In some embodiments, if the mode action E1 has been executed before, the mode management module 205 detects that the playing time of the target video source has reached the end point T of the interval.ni When the mode action G1 is executed, the message processing module 203 sends a resume playback instruction to the broadcast control management module 212, and the message processing module 203 sends a remove blocking instruction to the View management module 204.

[0310] In some embodiments, in response to the resume playback instruction, the playback control management module 212 can call the replay interface of SessionClient1 to synchronously continue playing the audio and video of the projection source from the pause point (without unmuting). In this way, when a round of interval mode ends, the audio and video playback of the source is resumed from both the audio and visual aspects, and the playback progress of the source also begins to change dynamically.

[0311] In some embodiments, the View management module 204 responds to the unblocking instruction, such as Fig.10 As shown in the sub-figure (c) of FIG, the preset blocking page 102 is canceled, and the previously blocked projection screen playback interface is set to a visible state (the data management module 202 synchronously rewrites the mVisible state value corresponding to the projection device 1 to true), and the sixth prompt information 103 can be displayed on the projection screen playback interface. Among them, the sixth prompt information 103 is used to prompt the end of the interval mode of the i-th round. Fig.10 An example of the prompt content of the sixth prompt information 103 in the sub-figure (c) is "This interval break is over, please continue watching the movie source."

[0312] In some embodiments, the mode management module 205 detects that the playing time of the target video source has reached the starting point T of the interval. mi When the interval mode of the i-th round is triggered, the mode management module 205 obtains the projection source information from the projection source analysis module 215. If it is determined that the projection source type is VideoURL, the media resource playback type is film source (non-live) type projection, and the current film source is in the playing state, then the mode action E2 can be executed. The mode action E2 is configured as: sending a projection pause instruction to the broadcast control management module 212 through the message processing module 203, and sending a pause and shielding operation instruction to the View management module 204 through the message processing module 203.

[0313] In some embodiments, in response to the screen projection pause instruction, the playback control management module 212 can call the pause interface of SessionClient1 to synchronously pause the audio and video of the screen projection source, thereby switching the target source to the paused playback state. In this way, the playback progress of the target source remains unchanged at the pause point, and there is no need to mute the target source when it is in the paused playback state.

[0314] In some embodiments, the controller is further configured to: when pausing the playback of the target film source, control the display to display a pause prompt control on the playback interface of the target film source, and the pause prompt control is used to prompt that the target film source is in a paused playback state; when the target film source is in a paused playback state, if a playback control instruction for the target film source is received from the user, the operation corresponding to the playback control instruction is not executed; when resuming playback of the target film source from the pause node, control the display to cancel the display of the pause prompt control, and if a playback control instruction for the target film source is received from the user, the operation corresponding to the playback control instruction is executed. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, when pausing the playback of the film source, the pause prompt control can be used to prompt that the film source has been paused, and the controller will shield the user's playback control instructions for the target film source (such as playing the film source, fast forward, fast rewind, speed adjustment, etc.), that is, the operations corresponding to the playback control instructions will not be executed, ensuring that the playback progress and playback status of the target film source will not be changed due to the user's playback control operations, so that the user can concentrate on the halftime break; when resuming the playback of the film source, the pause prompt control is canceled to inform the user that the film source has resumed playback, and the shielding of the film source playback instruction is canceled, so that if the user inputs a playback operation for the target film source, the operation corresponding to the playback instruction is executed, thereby realizing the resumption of the film source and the response recovery of the playback control instruction.

[0315] Fig.11 Schematic diagram of changes in the user interface in interval mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 2 .like Fig.11 As shown in sub-figure (b), the View management module 204 cancels the display of the fourth prompt information 101 in response to the pause and shielding operation instruction, and displays the pause indication control 111 and the seventh prompt information 112 on the screen projection playback interface. Among them, the pause indication control 111 is used to indicate the [T mi ,T ni ] During the time period, the target film source is in a paused playback state, and an example of the prompt content of the seventh prompt information 112 is "You can continue watching after a 10-minute break, and the current film source cannot be operated."

[0316] In some embodiments, the View management module 204 responds to the pause and shielding operation instructions, and is also used to monitor the user's KeyEvent (operation event, including the user's playback control operation event of the target video source), and dispose the monitored KeyEvent. In this way, the View management module 204 can shield (not respond to) user operations, so that the user cannot interfere with the playback control of the target video source. For example, even if the user clicks the pause indicator control 111, the target video source cannot be switched to the play state, and the user cannot adjust the speed, fast forward, fast rewind, seek, and other playback control operations on the video source.

[0317] In some embodiments, if the mode action E2 has been executed before, the mode management module 205 detects that the playing time of the target video source has reached the end point T of the interval. ni When the mode action G2 is executed, the message processing module 203 sends a resume playback instruction to the broadcast control management module 212, and sends a playback and unblocking operation instruction to the View management module 204 through the message processing module 203.

[0318] In some embodiments, in response to the resume playback instruction, the playback control management module 212 can call the replay interface of SessionClient1 to synchronously continue to play the audio and video of the projection source from the pause point. In this way, when a round of interval mode ends, the audio and video playback of the target source is resumed from both the audio and visual aspects, and the playback progress of the target source continues to change dynamically.

[0319] In some embodiments, Fig.11 As shown in sub-figure (c), the View management module 204 responds to the play and unblock operation instructions, cancels the display of the pause indication control 111 and the seventh prompt information 112, and displays the eighth prompt information 113 on the screen projection playback interface. The prompt content example of the eighth prompt information 113 is "The break in this interval is over, please continue watching, the current film source is operable."

[0320] In some embodiments, the View management module 204 responds to the play and unblock operation instructions, and is also used to monitor the user's KeyEvent (operation event) and respond to the monitored KeyEvent. In this way, the View management module 204 can unblock the user's operation and respond to the user's operation to achieve the user's control of the playback of the film source, including but not limited to pausing the film source, resuming the playback, adjusting the speed, fast forward, fast rewind, seek and other operations.

[0321] In some embodiments, for the interval mode, there are several cases: (1) the broadcast time of the target source reaches the starting time T of the i-th round interval mode. mi (2) The target source’s broadcast time reaches the end time T of the i-th round interval mode ni . Where i≥1.

[0322] In some embodiments, when situation (1) is met, it is determined that the resuming end condition is met, and the target video source is paused. During the pause of the target video source, the screen projection connection is not disconnected.

[0323] In some embodiments, when situation (1) occurs, the target video source is paused until situation (2) occurs, and it is determined that the replay end condition is not met, and the target video source needs to be replayed from the pause node. In some embodiments, the interval mode can be set to a single round, that is, i=1, and after the first round of interval mode ends, the next round of interval mode will not be started.

[0324] In some embodiments, the interval mode can be set to multiple rounds, that is, i is greater than 1, then after the first round of interval mode ends, by comparing the broadcast time of the target source with the starting time T of the i-th round of interval mode mi , to cycle multiple rounds of interval modes until the target source ends playing or reaches the preset round upper limit value K.

[0325] In some embodiments, after the target source starts playing, at [T mi ,T ni ], if the mode management module 205 does not trigger other screen projection modes (such as timing mode, timer mode), it is determined that the continuation end condition is not met, and the display device continues to play the target film source, and does not perform the operation of pausing the playback of the film source or disconnecting the screen projection connection.

[0326] In some embodiments, a special case can be set for the single-round interval mode: only the first preset duration is set, and the second preset duration is not limited. In this way, the interval mode has only one playback time parameter, that is, the starting time T of the single-round interval mode. m1 (equal to the first preset duration). In this way, when the target video source has been played for a duration of T m1 When the target source is paused, the screen projection connection is not disconnected, and the screen projection playback interface can be blocked when the source is paused. In this scenario, the user can also actively resume the target source after a sufficient rest time according to the viewing needs, that is, the user triggers the resumption of the target source, for example, the user issues a voice command to instruct the resumption of the source.

[0327] In some embodiments, the timing mode starts from the starting point of any projection (abbreviated as: projection a), and the timing duration represents the cumulative playback time of projection a. If the timing duration reaches the third preset duration t3, the projection is disconnected, thereby limiting the upper limit of the time for users to watch the projection.

[0328] In some embodiments, for the timing mode, the playback time data includes the playback time of the target film source, and the continued playback time data includes a third preset duration. The controller can be configured to: if the playback time of the target film source reaches the third preset duration, stop playing the target film source, and disconnect the screen projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: providing a solution for determining the end condition of continued playback and screen projection control operation based on the third time management mechanism (which can be called a timing mode), and starting to count the playback time when the film source starts to play, so that the target film source stops playing, so as to avoid the projection device from continuing to push the projection content to the display device based on the projection connection when the film source is played to the third preset duration. When the playback time of the film source reaches the third preset duration, it is determined that the continued playback condition is met, and the controller disconnects the projection connection, and also avoids the display device from continuing to play the projection content after the playback time of the film source reaches the third preset duration, thereby avoiding the projection film source from playing for too long.

[0329] In some embodiments, after the controller runs the mode application, the mode management module 205 can monitor the trigger conditions and execute the mode actions of the timing mode according to the timing mode information.

[0330] Fig.12 Schematic diagram of changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 1 After the display device starts playing the projection content pushed by the projection device 1, the projection source analysis module 215 can parse the session information of the projection device 1 to obtain the projection source information. Fig.12 As shown in sub-figure (a), the projection source information indicates that the projection source pushes the target video source through VideoURL.

[0331] In some embodiments, when the screen projection management module 201 receives the VideoURL (resource address of the target video source) sent by the screen projection device 1 through the screen projection instruction, it can send a screen projection start message to the mode management module 205 and the View management module 204 through the message processing module 203. The View management module 204 receives the screen projection start message and can obtain the media resource data of the target video source from the server according to the VideoURL, such as Fig.12 As shown in sub-figure (a), the target video source pushed by VideoURL is played on the screen projection playback interface.

[0332] In some embodiments, when the mode management module 205 receives the screen projection start message, it starts the timing mode and executes the mode action H set in the timing mode. The mode action H can be configured as: sending a timing reminder instruction to the View management module 204 through the message processing module 203, and sending a timing instruction A to the time management module 213 through the message processing module 203.

[0333] In some embodiments, the View management module 204 responds to the timing reminder instruction, such as Fig.12 As shown in sub-figure (a), a ninth prompt message 121 is displayed on the screen projection playback interface. The ninth prompt message 121 is used to prompt entering the timing mode. An example of the prompt content of the ninth prompt message 121 is "Enter timing mode A and start timing the playback time of the projection source."

[0334] In some embodiments, the time management module 213 may start the timer Timer3 in response to the timing instruction A, and control Timer3 to start counting up. The timing time of Timer3 represents the broadcasting time of the target source in the timing mode. The time management module 213 may set the upper limit of the counting up to the third preset time t3. When the timing time of Timer3 reaches the third preset time t3, the time management module 213 may send a second timing reaching message to the mode management module 205 through the message processing module 203, and control Timer3 to stop timing, and clear the timing time.

[0335] In some embodiments, when the timing time of Timer3 does not reach the third preset time length t3, the mode management module 205 determines that the continuous broadcast end condition is not satisfied, and the display device continues to play the target film source.

[0336] In some embodiments, when the played time of the target film source reaches the third preset time t3, the mode management module 205 can execute mode action A: send a disconnect screen projection instruction to the projection management module 201 through the message processing module 203, so that the projection management module 201 responds to the disconnect screen projection instruction, calls the finish() interface of the Session object corresponding to the projection device 1, and the projection service sends a disconnect screen projection request to the projection device 1 through the protocol. The projection device 1 responds to the disconnect screen projection request, disconnects the projection connection with the display device, and feeds back a disconnect message to the display device, so that the projection management module 201 receives the disconnect message, can release the related resources occupied by the projection (such as a player, etc.), and notify the View management module 204 through the message processing module 203 to cancel the display of the source content pushed by the VideoURL in the SurfaceView / TextureView to stop playing the target film source.

[0337] In some embodiments, the controller is configured to: if the played time of the target film source reaches a third preset time, control the display to display a third prompt message, and the third prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the target film source and disconnect the projection connection with the projection device; if the user refuses to disconnect the projection connection, continue to play the target film source. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the played time of the film source reaches the third preset time, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then based on the time condition of the timing mode, the user's viewing needs are added as a factor in determining whether the controller disconnects the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the film source continues to be played, thereby satisfying the user's viewing needs and preferences.

[0338] In some embodiments, when the duration of the target video source being played reaches a third preset duration t3, the target video source is referred to as Figure 5A In a similar prompt and inquiry manner, the View management module 204 can prompt that the timer time specified in the timing mode has been reached, and ask the user whether to agree or refuse to disconnect the screen projection connection. If the user agrees to disconnect the screen projection connection, the mode management module 205 can execute mode action A to disconnect the screen projection connection and stop playing the target source. If the user refuses to disconnect the screen projection connection, the display device continues to play the target source.

[0339] In some embodiments, the controller can be configured to: when the played time of the target film source reaches the third preset time, the remaining play time of the target film source is determined according to the play progress of the target film source and the total time of the target film source; if the remaining play time is greater than the preset threshold, the target film source is stopped from being played, and the screen projection connection with the screen projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the played time of the film source reaches the third preset time, the film source may not have been played to the end, so that the film source has a time parameter of the remaining play time, and the remaining play time is calculated by the play progress and total time of the film source, and the length of the remaining play time is measured by the preset threshold, so that the controller decides whether to disconnect the screen projection connection when the system time reaches a fixed preset time; if the remaining play time is large, if the screen projection connection is not disconnected, the display device will continue to play the film source until the film source is played, which may affect the user's plan to take a regular break. Therefore, in this scenario, the controller can disconnect the screen projection connection and stop playing the film source, so that the user cannot continue to watch the film source content.

[0340] In some embodiments, the controller can be configured to: if the remaining playback time is greater than a preset threshold, control the display to display the remaining playback time and a third prompt message, the third prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; if the user agrees to disconnect the screen projection connection, stop playing the target film source and disconnect the screen projection connection with the screen projection device; if the user refuses to disconnect the screen projection connection, continue to play the target film source. The technical solution provided by this embodiment has the following beneficial effects: when the playback time of the film source reaches the third preset time, the remaining playback time of the film source is used as a playback time parameter. If the remaining playback time is large, if the screen projection connection is not disconnected, the display device will continuously play the screen projection content pushed by the screen projection device, which will affect the user's regular rest plan, and may affect the user's rest, causing the user to be tired or not concentrate. Therefore, the controller can control the display to display a prompt message to inform the user of the remaining playback time of the film source, and ask the user whether to disconnect the screen projection connection, so that the user can refer to the remaining playback time and the user's viewing needs to decide whether to disconnect the screen projection connection.

[0341] In some embodiments, the controller can also be configured as follows: if the remaining playback time is not greater than a preset threshold, the target film source continues to be played; when the target film source is finished playing, the screen projection connection with the screen projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: when the playback time of the film source reaches the third preset time, if the screen projection connection is not disconnected, the display device will continue to play the film source until the film source is finished playing. Therefore, when the timing reaches the third preset time, if the remaining playback time of the film source is short, the impact on the user's rest may not be significant. In this case, the screen projection connection can be disconnected until the end of the playback of the film source, thereby ensuring the integrity of the user's viewing of the film source, avoiding the screen projection device from continuing to push the projection content to the display device based on the projection connection after the preset time is reached, and avoiding the display device from continuing to play the projection content after the preset time exceeds the preset time.

[0342] In some embodiments, the controller is configured to: if the remaining playback time is not greater than a preset threshold, control the display to display the remaining playback time and a fourth prompt message, the fourth prompt message being used to prompt the user whether to agree to delay disconnecting the screen projection connection until the target film source is finished playing; if the user agrees to delay disconnecting the screen projection connection, continue to play the target film source; if the user refuses to delay disconnecting the screen projection connection, stop playing the target film source, and disconnect the screen projection connection with the screen projection device. The technical solution provided by this embodiment has the following beneficial effects: when the played time of the film source reaches the third preset time, if the remaining playback time is short, the controller can control the display to display a prompt message to inform the user of the remaining playback time of the film source, and ask the user whether to agree to delay disconnecting the screen projection connection until the film source is finished playing.

[0343] In some embodiments, after the controller runs the mode application, when the mode management module 205 receives the second timing arrival message sent by the time management module 213, based on the projection source information, if it is determined that the projection source is pushing the target film source through VideoURL, then the restDuration of the target film source can be determined based on the playback progress and total duration of the target film source.

[0344] In some embodiments, when the target source has been played for a third preset duration t3, if restDuration=0, indicating that the target source has finished playing when the timing (third preset duration t3) is reached, the mode management module 205 can execute mode action J1, and mode action J1 can be configured as: sending a third prompt instruction to the View management module 204 through the message processing module 203. Since the target source has finished playing when the duration t3 indicated by the timing mode is reached, there is no valid screen projection content displayed on the screen projection playback interface, and the mode application can disconnect or not disconnect the screen projection connection.

[0345] In some embodiments, Fig.12 As shown in sub-figure (b), the View management module 204 responds to the third prompt instruction and displays the tenth prompt information 122 on the screen projection playback interface. An example of the prompt content of the tenth prompt information 122 is "The timing time of timing mode A has been reached and the film source has ended."

[0346] In some embodiments, when the target video source has been played for a third preset duration t3, if 0<restDuration≤preset threshold, it indicates that the remaining playback time of the target video source is short. In this scenario, the mode management module 205 can set the priority of the mode action to: delay disconnection of the screen projection operation takes precedence over immediate disconnection of the screen projection operation. In this way, the mode management module 205 can temporarily not execute mode action A, and delay execution of mode action A until the target video source ends playback (restDuration becomes 0).

[0347] In some embodiments, when the target source has been played for a third preset duration t3, if 0<restDuration≤preset threshold, the View management module 204 may prompt restDuration and ask the user whether to agree to delay disconnecting the screen projection until the target source is finished playing. If the user agrees to delay disconnecting the screen projection, the display device continues to play the target source, and the mode management module 205 executes mode action A when the target source is finished playing. If the user refuses to delay disconnecting the screen projection, the mode management module 205 may immediately execute mode action A.

[0348] In some embodiments, when the played time of the target source reaches the third preset time t3, if 0<restDuration≤preset threshold, the mode management module 205 can execute mode action J2, and the mode action J2 is configured to: send a fourth query instruction to the View management module 204 through the message processing module 203, and send a timing instruction B to the time management module 213 through the message processing module 203. The preset threshold is not limited, for example, 5min to 10min.

[0349] Fig.13 Schematic diagram of changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application Figure 2 The View management module 204 responds to the fourth query instruction, such as Fig.13 As shown in sub-figure (b), the eleventh prompt message 131 and the countdown control 132 may be displayed. An example of the prompt content of the eleventh prompt message 131 is "The timing time of timing mode A has been reached, and there are 3 minutes left for the film source. The screen projection will be disconnected after the film source is played. If you refuse, please press any key." The countdown control 132 is used to remind the user through a countdown method to refuse the remaining operational time for delaying the disconnection of the screen projection.

[0350] In some embodiments, the time management module 213 responds to the timing instruction B, and when the View management module 204 starts to display the eleventh prompt information 131 and the countdown control 132, it controls Timer4 to count down from the first threshold time, that is, sets the countdown starting point to the first threshold time (e.g., 5 seconds). When the countdown of Timer4 is reset to zero, the time management module 213 can send a time reset message to the View management module 204 through the message processing module 203. The countdown control 132 should be synchronized with the countdown of the time management module 213.

[0351] In some embodiments, if the user agrees to delay disconnection of the screen projection when the timing time of the timing mode is reached, no operation needs to be entered and the countdown is waited for to be cleared. When the View management module 204 receives the time reset message, if it does not receive the rejection of the delayed disconnection of the screen projection operation, it cancels the display of the eleventh prompt message 131 and the countdown control 132, and sends a message of agreeing to delay disconnection of the screen projection to the mode management module 205 through the message processing module 203.

[0352] In some embodiments, when the mode management module 205 receives a message agreeing to delay disconnection of the screen projection, it continues to monitor the restDuration of the target film source, and executes mode action A when the restDuration changes to zero: the screen projection management module 201 sends a disconnection instruction to the screen projection management module 201 through the message processing module 203, so that the screen projection management module 201 responds to the disconnection instruction and calls the finish() interface of the Session object corresponding to the screen projection device 1, and the screen projection service sends a disconnection request to the screen projection device 1 through the protocol. The screen projection device 1 responds to the disconnection request, disconnects the screen projection connection with the display device, and feeds back a disconnection message to the display device, so that the screen projection management module 201 receives the disconnection message, can release the related resources occupied by the screen projection (such as a player, etc.), and notify the View management module 204 through the message processing module 203 to cancel the display of the screen projection source content in the SurfaceView / TextureView. In this way, when the mode management module 205 detects that the playback of the target film source has ended, it executes mode action A to disconnect the screen projection connection with the screen projection device 1, and executes mode action A after a delay of restDuration, thereby achieving the integrity of the film source playback with almost no impact on the user's rest.

[0353] In some embodiments, if the user does not want to continue watching the remaining source content and agrees to disconnect the screen projection when the timing time of the timing mode is reached, the user can input a rejection of the delayed disconnection of the screen projection operation before the countdown is reset. The input method of rejecting the delayed operation is not limited. For example, the user can click any button or preset button on the control device 100 (such as a remote control), or input a voice command intended to reject the delayed disconnection of the screen projection.

[0354] In some embodiments, the View management module 204 responds to the user input of rejecting the delayed disconnection of the screen projection operation, and does not receive the time reset message sent by the time management module 213, then cancels the eleventh prompt information 131 and the countdown control 132, sends a stop timing instruction to the time management module 213 through the message processing module 203, and sends a reject delay disconnection screen projection message to the mode management module 205 through the message processing module 203. In response to the stop timing instruction, the time management module 213 controls Timer4 to stop the countdown and resets the timing time to zero. The mode management module 205 receives the reject delay disconnection screen projection message and immediately executes mode action A to disconnect the screen projection connection with the screen projection device 1 and stop playing the target film source.

[0355] In some embodiments, when the target source's playback time reaches the third preset time t3, if restDuration>preset threshold, it indicates that the target source's remaining playback time is long. To avoid delaying the user's rest, the mode management module 205 in this scenario can set the priority of the mode action to: immediately disconnect the screen projection operation takes precedence over delayed disconnection of the screen projection operation. In this way, the mode management module 205 can immediately execute mode action A to stop playing the target source and disconnect the screen projection connection.

[0356] In some embodiments, when the broadcast time of the target film source reaches the third preset time t3, if restDuration>preset threshold, the mode management module 205 can execute mode action J3, and the mode action J3 can be configured as: sending a fifth query instruction to the View management module 204 through the message processing module 203, and sending a timing instruction C to the time management module 213 through the message processing module 203.

[0357] Fig.14 Schematic diagram 3 of the change of the user interface in the timing mode when playing the video source (non-live) pushed by VideoURL in some embodiments of the present application. The View management module 204 responds to the fifth query instruction, such as Fig.14 As shown in sub-figure (b) of , the twelfth prompt message 141 and the countdown control 142 can be displayed on the display. An example of the prompt content of the twelfth prompt message 141 is "The timing time of timing mode A has been reached, and there are 17 minutes left for the film source. The screen projection will be disconnected. If you refuse, please press the XX key." The countdown control 142 is used to remind the user of the remaining operational time to refuse to disconnect the screen projection through a countdown method.

[0358] In some embodiments, the time management module 213 responds to the timing instruction C, and when the View management module 204 starts to display the twelfth prompt information 141 and the countdown control 142, it controls the timer Timer4 to start the countdown from the first threshold time (e.g., 5 seconds). When the countdown of Timer4 is reset to zero, the time management module 213 can send a time reset message to the View management module 204 through the message processing module 203. The countdown control 142 should be synchronized with the countdown of the time management module 213.

[0359] In some embodiments, when the View management module 204 receives the time reset message, if it does not receive the rejection of disconnecting the screen projection operation, it cancels the display of the twelfth prompt information 141 and the countdown control 142, and sends a message of consent to disconnect the screen projection to the mode management module 205 through the message processing module 203. Upon receiving the message of consent to disconnect the screen projection, the mode management module 205 immediately executes mode action A to disconnect the screen projection connection with the screen projection device 1 and stop playing the target film source.

[0360] In some embodiments, the View management module 204 responds to the user input of the rejection disconnection operation of the screen projection, and does not receive the time reset message sent by the time management module 213, then cancels the display of the twelfth prompt information 141 and the countdown control 142, sends a rejection disconnection message to the mode management module 205 through the message processing module 203, and sends a stop timing instruction to the time management module 213 through the message processing module 203. In response to the stop timing instruction, the time management module 213 controls Timer4 to stop the countdown and resets the timing time to zero. The mode management module 205 receives the rejection disconnection message of the screen projection, does not execute mode action A, and enables the View management module 204 to continue to display the target film source on the screen projection playback interface.

[0361] In some embodiments, when the mode management module 205 receives a message of refusing to disconnect the screen projection, it can execute mode action K, and mode action K is configured to: send a fourth prompt instruction to the View management module 204 through the message processing module 203.

[0362] Fig.15 Schematic diagram 4 of the change of the user interface in the timing mode when playing the video source (non-live) pushed by VideoURL in some embodiments of the present application. The View management module 204 responds to the fourth prompt instruction, such as Fig.15 As shown in sub-figure (c), the thirteenth prompt message 151 is displayed on the screen projection playback interface through the display, and an example of the prompt content of the thirteenth prompt message 151 is "The timing has been stopped and the screen projection will be disconnected with a delay. Enter the preset operation to disconnect the screen projection at any time."

[0363] In some embodiments, the input method of the preset operation is not limited. For example, the preset operation examples are: pressing (short press or long press) a preset button (such as a return button, etc.) on the control device 100, clicking a disconnect screen projection button set on the screen projection playback interface, inputting a voice command containing the intention to disconnect the screen projection, inputting a gesture operation indicating disconnecting the screen projection, etc.

[0364] In some embodiments, the View management module 204 responds to the preset operation input by the user and sends a disconnect screen projection message to the mode management module 205 through the message processing module 203. Upon receiving the disconnect screen projection message, the mode management module 205 immediately executes mode action A to notify the screen projection management module 201 to disconnect the screen projection connection with the screen projection device 1 by calling the finish() interface of SessionClient1 and stop playing the target video source.

[0365] In some embodiments, after the View management module 204 starts playing the target film source corresponding to the VideoURL, the mode management module 205 can monitor the restDuration of the current film source in real time. When it is detected that the restDuration changes to zero, if the second timing arrival message sent by the time management module 213 is not received, it indicates that the total duration (duration) of the target film source is less than the third preset duration t3, that is, the target film source has ended before the t3 timing parameter of the timing mode is reached, then mode action L can be executed. Mode action L can be configured as: sending a screen projection end message to the View management module 204 through the message processing module 203.

[0366] Fig.16 Schematic diagram 5 of the changes in the user interface in the timing mode when playing a video source (non-live) pushed by VideoURL in some embodiments of the present application. Fig.16 As shown in sub-figure (b), the View management module 204 receives the screen projection end message and displays the fourteenth prompt message 161 on the screen projection playback interface. An example of the prompt content of the fourteenth prompt message 161 is "The playback time of the film source has not reached the timing time specified by timing mode A, and the film source has ended."

[0367] In some embodiments, Fig.16 As shown in sub-figure (b), when the projection source is the target source pushed by VideoURL and the duration is less than the third preset duration t3, when the View management module 204 receives the projection end message, it can also display a switch projection button on the projection playback interface so that the user can switch to other projection content to continue watching before the timing mode t3 timing time is reached. Since the target source has been played before the timing mode's continuation end condition is met, there is no valid source content to display on the projection playback interface. At this time, the projection management module 201 may not actively disconnect the projection connection, that is, it may disconnect or not disconnect the projection connection.

[0368] In some embodiments, the timing mode includes the following situations: (1) the playing time of the target film source reaches the third preset time t3; (2) the restDuration of the target film source is greater than the preset threshold; (3) the restDuration of the target film source is not greater than the preset threshold; (4) the user agrees to disconnect the screen projection connection; (5) the user refuses to delay the disconnection of the screen projection connection until the end of the target film source playback; (6) the user agrees to delay the disconnection of the screen projection connection until the end of the target film source playback; (7) the playback of the target film source ends.

[0369] Based on the above situations, when at least situation (1) is achieved, it is determined that the replay end condition is met, the target source is stopped from playing, and the projection connection is disconnected. Other situations can be appropriately combined with situation (1) to further expand the possibility of replay end conditions.

[0370] In some embodiments, when situation (1) occurs, the user may be further asked whether he agrees to disconnect the screen projection connection. If situation (4) is reached, it is determined that the conditions for ending the resumed broadcast are met, the target film source is stopped from being played, and the screen projection connection is disconnected.

[0371] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (2) occurs, it is determined that the replay end condition is met, the target film source is stopped, and the projection connection is disconnected.

[0372] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (2) occurs, the user is further asked whether he agrees to disconnect the screen projection connection. If situation (4) is reached, it is determined that the conditions for ending the resumed broadcast are met, the target film source is stopped from playing, and the screen projection connection is disconnected.

[0373] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (3) occurs, the target film source continues to be played until situation (7) occurs. It is determined that the conditions for ending the continued playback are met, the target film source is stopped, and the projection connection is disconnected.

[0374] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (3) occurs, the user is further asked whether he agrees to delay disconnecting the screen projection until the target film source finishes playing. If situation (5) occurs, it is determined that the conditions for ending the resumed playback are met, the target film source is stopped from playing, and the screen projection connection is disconnected.

[0375] In some embodiments, when situation (1) occurs, the restDuration of the target film source can be further calculated. If situation (3) occurs, the user is further asked whether he agrees to delay disconnecting the screen projection until the target film source finishes playing. If situation (6) occurs, the target film source continues to play until situation (7) occurs. It is determined that the conditions for ending the resumed playback are met, the target film source is stopped, and the screen projection connection is disconnected.

[0376] In some embodiments, before the broadcast time of the target film source reaches the third preset time t3, if the mode management module 205 does not trigger other screen projection modes (such as timing mode, interval mode), it is determined that the continuation end condition is not met, and the display device continues to play the target film source without disconnecting the screen projection connection.

[0377] The above embodiment takes the display of a single screen projection (screen projection number = 1) as an example. In some embodiments, if the number of screen projections is greater than 1, and the display device displays multiple screen projections on the same screen, the multiple screen projections can share the timing mode, that is, the timing mode is valid for multiple screen projections at the same time. In this way, when the system time reaches the preset time T of the timing mode y When the mode management module 205 triggers the timing mode for multi-channel screen projection at the same time, the multi-channel screen projection is disconnected at the same time in the timing mode.

[0378] In some embodiments, if the number of projection channels is greater than 1, since the start time of each projection channel may be different, the mode application can process each projection channel separately in interval mode and timing mode.

[0379] The above embodiments take the timing mode, interval mode and timing mode as examples, and based on the architecture of the mode application, describe in detail the underlying software logic such as the trigger condition monitoring and mode action execution of the projection mode. Those skilled in the art can configure the trigger conditions and execution actions of the projection mode as appropriate according to the usage scenarios and requirements, and implement constraint control of each projection playback through the mode application.

[0380] In some embodiments, the mode management module 205 can configure one or more of the above modes. When multiple screen projection modes coexist, the multiple modes can be processed according to preset rules, which are not limited.

[0381] In some embodiments, an example of a preset rule is: processing the mode according to the first triggered principle. Assuming that the mode management module 205 is configured with N modes, where the trigger condition of mode a is met first, then in a multi-mode coexistence scenario, mode a can be processed, and the processing of N-1 modes after mode a can be cancelled.

[0382] In some embodiments, an example of a preset rule is: mode processing is performed according to the latest triggering principle. Assuming that the mode management module 205 is configured with N modes, and the triggering condition of mode b is reached the latest, the mode management module 205 can skip the processing of N-1 modes before mode b and process mode b in a multi-mode coexistence scenario.

[0383] In some embodiments, an example of a preset rule is: execute mode actions in sequence according to the order of mode triggering. Assuming that the mode management module 205 is configured with a timing mode and an interval mode, if the triggering condition of the interval mode is met first, the mode action of the interval mode is executed first, and when the triggering condition of the timing mode is met later, the mode action of the timing mode is executed.

[0384] In some embodiments, an example of a preset rule is: performing mode processing according to a preset mode priority. The mode management module 205 can process the N modes in sequence according to the priority of the N modes.

[0385] In some embodiments, the mode priority can be customized by the user, and the mode management module 205 saves the mode priority set by the user.

[0386] In some embodiments, the mode management module 205 can set the mode priority according to user preferences. For example, the mode priority can be set according to the usage frequency of N modes.

[0387] In some embodiments, the mode application runs at the application layer, and the mode application is controlled by the controller 250. Therefore, the controller 250 can implement the projection mode processing method in different modes in the above embodiments by running the mode application. The software architecture of the mode application is not limited to Figure 3B Examples provided.

[0388] Fig.17 Timing interaction of the screen projection mode processing method provided in some embodiments of the present application Figure 1 See also Fig.17 The interaction objects include users, screen projection senders (i.e., screen projection devices) and screen projection receivers (i.e., display devices). Users can initiate screen projection to the screen projection receiver based on different screen projection protocols at the screen projection sender, so that the screen projection sender sends a screen projection request to the screen projection receiver.

[0389] In some embodiments, see Fig.17 The screen projection receiving end can ask the user whether to accept the screen projection request of the screen projection sending end through UI or voice. If the user accepts the screen projection request, the screen projection receiving end sends a screen projection consent message to the screen projection sending end. The screen projection sending end receives the screen projection consent message and establishes a screen projection connection with the screen projection receiving end.

[0390] In some embodiments, see Fig.17If the screen projection sender pushes the source type projection (referred to as: target source) to the screen projection receiver through VideoURL, then after the screen projection connection is established, the screen projection sender can send a projection instruction to the screen projection receiver. The projection instruction may include the VideoURL (video link, also known as resource address) of the projection data, Session information and metadata, etc. Among them, Session information includes but is not limited to: the device ID of the screen projection sender, the projection source information, etc. The projection source information includes the projection source type, and the projection source type includes mirror projection (mirror) and projection pushed by video link (VideoURL). Metadata includes but is not limited to the name of the target film source, actors, directors, release date, style tags (such as action, comedy, suspense, etc.) and other information.

[0391] In some embodiments, see Fig.17 , the screen casting receiving end receives the screen casting instruction and can obtain VideoURL, Session information and metadata from the screen casting instruction. If the screen casting receiving end determines that the screen casting source type is VideoURL based on the Session information, it can further determine the type of screen casting media resource, which includes live broadcast (real-time streaming) and film source.

[0392] In some embodiments, the screen projection receiving end can determine the type of screen projection media based on the attribute values ​​such as duration, Seek and MIME provided by metadata and Session information. For example, if the metadata indicates that the projection content is a movie, TV series, etc., duration>0 (for example, 45 minutes), and the Seek action can be executed, then the screen projection receiving end determines that the screen projection sending end pushes a source type projection, and the source is the existing media provided by VideoURL (with a clear total duration of the source), rather than real-time streaming media recorded in real time. VideoURL corresponds to the push target source.

[0393] In some embodiments, see Fig.17 The screen projection receiver can download the multimedia data (i.e., screen projection data) of the target source according to the VideoURL, and control the player to play the target source according to the screen projection data.

[0394] In some embodiments, see Fig.17, the screen projection receiving end can obtain the resume time data. The screen projection receiving end can obtain the resume time data according to the previously preset and stored mode information, or according to the mode information set by the user based on the screen projection mode setting page when the target film source starts to play. The screen projection mode includes but is not limited to: timing mode, interval mode and timing mode. For different screen projection modes, the resume time data contains different parameters, and the resume time data includes but is not limited to at least one of the following parameters: preset time, first preset duration, second preset duration and third preset duration.

[0395] In some embodiments, see Fig.17 The screen projection receiving end can also obtain the playback time data during the playback process after the target video source starts playing. The playback time data includes but is not limited to at least one of the following parameters: the system time of the display device and the playback time of the target video source. Among them, the playback time can be a parameter obtained by the timer when the target video source starts playing. In some embodiments, see Fig.17 , the screen projection receiving end can determine whether the continuation broadcast end condition is met based on the continuation broadcast time data and the playback time data. For different screen projection modes, the criteria for judging the continuation broadcast end condition are different. For example, for the timing mode, if the continuation broadcast end condition is to be met, the system time must at least reach the preset time. For the interval mode, if the continuation broadcast end condition is to be met, the broadcast time of the target film source must at least reach the first preset time. For the timing mode, if the continuation broadcast end condition is to be met, the broadcast time of the target film source must at least reach the third preset time.

[0396] In some embodiments, see Fig.17 , if the screen projection receiving end determines that the conditions for ending the replay are met, the target operation is executed. For different screen projection modes, the target operation corresponding to the mode action may be different. For example, for the timing mode and the timer mode, the target operation can be configured to disconnect the screen projection connection with the screen projection sending end. For the interval mode, the target operation can be configured to pause the playback of the target source pushed by the screen projection sending end.

[0397] In some embodiments, for the timing mode and the timer mode, the screen projection receiving end can also refer to at least one of multiple factors such as the user's viewing intention and the remaining playback time of the target film source to decide whether to disconnect the screen projection connection, or delay disconnecting the screen projection connection until the target film source finishes playing, thereby accurately and flexibly controlling the screen projection mode processing and the resumption / stop of the film source, reducing the user's related operations of manually switching the screen projection mode, and improving the user experience.

[0398] For the screen projection receiving end, the display device may include a controller configured with the above-mentioned software program executed by the screen projection receiving end to realize interaction with the screen projection sending end and screen projection playback processing. For different screen projection modes, the basis for determining the end condition of the continued broadcast and the execution of the mode action / target operation, please refer to the description of the previous related embodiments, and this timing interaction embodiment will not be repeated.

[0399] Fig.18 This is a timing interaction diagram of the screen projection mode processing method (timing mode) provided in some embodiments of the present application. Fig.18 The interactive ends include the screen projection sending end (i.e., the screen projection device) and the screen projection receiving end (i.e., the display device).

[0400] In some embodiments, see Fig.18 The screen casting receiving end may include: screen casting service (CastServer), video player activity (VideoPlayerActivity, corresponding to the screen casting playback interface), view display module (ViewModule), player (Player), mode manager (ModeManager), time manager (TimerManager), play state manager (PlayStateManager), mode analysis module (ModeAnalysis). Among them, the screen casting service (CastServer) corresponds to Figure 3B The screen projection management module 201 in the view display module (ViewModule) and the video player activity (VideoPlayerActivity) may correspond to Figure 3B The View management module 204 in the player (Player) and the play state manager (PlayStateManager) can correspond to Figure 3B The broadcast control management module 212 in the mode manager (ModeManager) and the mode analysis module (ModeAnalysis) may correspond to Figure 3B The mode management module 205 in the time manager (TimerManager) corresponds to Figure 3B The time management module 213 in.

[0401] In some embodiments, see Fig.18 If the screen projection sender pushes the target film source to the screen projection receiver through VideoURL, then after establishing the screen projection connection, the screen projection sender can send a screen projection instruction to the screen projection receiver. The screen projection instruction may include the VideoURL (video link, or resource address) of the screen projection data, Session information and metadata, etc.

[0402] In some embodiments, see Fig.18 , CastServer receives the screen casting instruction, obtains VideoURL, Session information and metadata from the screen casting instruction, and can start VideoPlayerActivity. VideoPlayerActivity is used to control ViewModule to display related Views, such as initializing configuration and displaying the screen casting playback interface. VideoPlayerActivity can also send a play instruction to the Player, so that the Player responds to the play instruction, downloads the multimedia data of the target source from the server according to VideoURL, and plays the target source, so that the screen casting playback interface displays the video content of the target source, and the audio output device plays the audio content of the target source.

[0403] In some embodiments, see Fig.18 After starting to play the target source, the Player can also monitor the playback process of the target source and synchronize information related to the playback process of the target source to the PlayStateManager, such as the playback state and playback progress of the target source. The playback state includes the playing state and the paused playback state.

[0404] In some embodiments, see Fig.18 For the timing mode, since the system time and the preset time are used to determine whether the conditions for ending the replay are met, and thus decide whether to disconnect the screen projection connection, the timing mode does not involve a timing mechanism, so the TimerManager does not need to start the timing.

[0405] In some embodiments, see Fig.18 , CastServer receives the screen casting command, can obtain the metadata of the target source from the screen casting command, and send the metadata and session information to ModeManager. ModeManager can determine the screen casting source information based on the metadata and session information. Fig.18 In the example, the screen projection source is the target video source pushed by VideoURL.

[0406] In some embodiments, ModeAnalysis can obtain the playback time data from the mode information preset by the user or obtained immediately, and obtain the playback time data during the playback of the target source. The playback time data may include the system time, the timing time of TimerManager (recording the playback time of the target source), etc. Fig.18ModeAnalysis can detect the currently triggered projection mode (referred to as: first projection mode) based on the resume time data and the play time data to determine whether the resume end condition is met. The mode information may include at least one of timing mode information, interval mode information, and timing mode information.

[0407] In some embodiments, see Fig.18 , ModeManager can start the mode listener, which is oriented to ModeAnalysis to listen to the mode trigger event corresponding to the first projection mode generated by ModeAnalysis, thereby realizing the mode synchronization between ModeAnalysis and ModeManager.

[0408] In some embodiments, the first screen projection mode that is triggered is a timing mode as an example, that is, the play time data includes the system time, and the resume time data includes the preset time. Fig.18 , ModeAnalysis detects that the system time reaches the preset time T y When the timing mode is determined to be triggered, a timing mode trigger event is sent to ModeManager. When the mode listener of ModeManager listens to the timing mode trigger event, ModeManager switches the current mode to the timing mode and obtains the playback progress of the target source from PlayStateManager (or Player).

[0409] In some embodiments, see Fig.18 , ModeManager can calculate the remaining playback time (restDuration) of the target source based on the playback progress and total duration of the target source. ModeManager can compare restDuration with the threshold, and then decide the target mode action to be executed in the timing mode based on the size of restDuration.

[0410] In some embodiments, see Fig.18 Taking a single threshold comparison as an example, if restDuration is not greater than the threshold, ModeManager can set the mode action priority to delay the disconnection of the projection operation over the immediate disconnection of the projection operation, so that ModeManager can send a query instruction 1 to ViewModule. ViewModule responds to the query instruction 1, see Figure 5CIn the example, the system time can be prompted that the preset time has been reached, the restDuration of the target source can be prompted, and the user can be asked whether he agrees to delay the disconnection of the screen projection until the target source ends. Assuming that the user agrees to delay the disconnection of the screen projection, ViewModule can send a message to ModeManager that it agrees to delay the disconnection of the screen projection.

[0411] In some embodiments, see Fig.18 , ModeManager receives the message agreeing to delay the disconnection of the screen casting, monitors the changes in restDuration, and when restDuration becomes 0 (indicating that the target source has finished playing), it exits the timing mode and sends a disconnection instruction to CastServer. In response to the disconnection instruction, CastServer can call the finish() interface of the Session object to disconnect the screen casting connection with the screen casting sender. After the screen casting connection is disconnected, CastServer can send a disconnected screen casting message to VideoPlayerActivity. VideoPlayerActivity receives the disconnected screen casting message, sends a stop playback instruction to the Player, and sends an exit screen casting instruction to the ViewModule. In response to the stop playback instruction, the Player stops playing the target source, cleans up the casting data, releases the player resources, and closes the player. In response to the exit screen casting instruction, the ViewModule prompts "The playback of the casting content has ended and the casting has been disconnected."

[0412] In some embodiments, see Fig.18 If restDuration is greater than the threshold, ModeManager can set the mode action priority to immediately disconnect the screen projection operation before delaying the disconnection of the screen projection operation, so that ModeManager can send a query instruction 2 to ViewModule. ViewModule responds to the query instruction 2, see Figure 6 or Figure 7 In the example, it can prompt that the system time has reached the preset time, prompt the restDuration of the target source, and ask whether to disconnect the screen projection connection immediately. Assuming that the user agrees to disconnect the screen projection immediately, ViewModule can send a message to ModeManager that agrees to disconnect the screen projection immediately. ModeManager receives the message that agrees to disconnect the screen projection immediately, exits the timing mode, and sends a disconnect screen projection instruction to CastServer.

[0413] In some embodiments, taking dual threshold comparison as an example, ModeManager can set a first threshold and a second threshold, and the second threshold is greater than the first threshold. Figure 5CFor example, ModeManager can set the delayed disconnection of the screen casting operation to take precedence over the immediate disconnection of the screen casting operation, and ViewModule asks the user whether to agree to delay the disconnection of the screen casting connection until the target source ends.

[0414] In some embodiments, if restDuration is greater than the first threshold and not greater than the second threshold, Figure 6 or Figure 7 For example, ModeManager can set the immediate disconnection of the screen projection operation to take precedence over the delayed disconnection of the screen projection operation, and ViewModule asks the user whether they agree to disconnect the screen projection connection immediately.

[0415] In some embodiments, if restDuration is greater than the second threshold, Figure 8 In the example, ModeManager sets the immediate disconnection of the screen projection operation to take precedence over the delayed disconnection of the screen projection operation, and ViewModule asks the user whether to agree to disconnect the screen projection connection immediately. If the user refuses to disconnect the screen projection connection immediately, the long restDuration time may affect the user's rest. The user is supported to disconnect the screen projection at any time before the target source ends by inputting a preset operation.

[0416] Fig.19 Timing interaction of the projection mode processing method (interval mode) provided in some embodiments of the present application Figure 1 See also Fig.19 When the target source is played, VideoPlayerActivity can also start TimerManager, which controls the Timer to start timing when the target source starts playing, so as to count the elapsed time of the target source. TimerManager can synchronize the timing of the Timer to ModeAnalysis. In this way, for the interval mode, the playback time data obtained by ModeAnalysis includes the elapsed time of the target source (i.e., the timing of the Timer), and the continued playback time data includes the starting time T according to the interval mode. mi and the end time T ni Among them, T mi and T ni It is calculated based on the first preset time length t1, the second preset time length t2 and the round i.

[0417] In some embodiments, see Fig.19 , ModeAnalysis detects that the timing time of Timer reaches the starting time T of the i-th round interval mode miWhen the interval mode of the i-th round is determined to be triggered, an interval mode trigger event can be sent to ModeManager. When the mode listener of ModeManager listens to the interval mode trigger event, ModeManager switches the current mode to the interval mode and sends an interval mode entry message to PlayStateManager.

[0418] In some embodiments, see Fig.19 , PlayStateManager receives the message of entering interval mode. If it detects that the target source is in the playing state, it sends a pause instruction to the Player and a block instruction to the ViewModule. In response to the pause instruction, the Player can call the pause interface of the projection sender Session to synchronously pause the audio and video of the target source, so that the playback progress of the target source remains unchanged at the pause node. The ViewModule responds to the block instruction, see Fig.10 In the example of , a preset shielding page is displayed on the upper layer of the screen projection playback interface, so that the video content of the target source is invisible to the user due to being shielded. The user cannot hear the audio of the target source, nor can he see the video picture of the target source, thereby achieving the purpose of halftime break.

[0419] In some embodiments, see Fig.19 , ModeAnalysis detects that the timing time of Timer reaches the end time T of the i-th round interval mode ni When the mode listener of ModeManager listens to the interval mode end event, ModeManager can send an exit interval mode message to PlayStateManager.

[0420] In some embodiments, see Fig.19 , PlayStateManager receives the exit interval mode message and detects that the target source is in a paused playback state, and then sends a resume playback instruction to the Player, and a cancel block instruction to the ViewModule. In response to the resume playback instruction, the Player can call the replay interface of the projection sender Session to continue playing the audio and video of the target source from the pause node, so that the playback progress of the target source continues to change dynamically, thereby resuming the playback of the target source. In response to the cancel block instruction, the ViewModule cancels the display of the preset block page to make the projection playback interface unobstructed and visible to the user. Afterwards, ModeAnalysis can continue to detect according to the playback time data and the resume time data, waiting for the next round (i.e., the i+1th round) of interval mode to be triggered.

[0421] Fig. 20 Timing interaction of the projection mode processing method (interval mode) provided in some embodiments of the present application Figure 2 .and Fig.19 Compared with the timing interaction diagram of the example, although both are aimed at the interval mode scenario, there are the following differences:

[0422] ①See Fig. 20 After ModeManager sends a message to PlayStateManager to enter the interval mode, if PlayStateManager detects that the target source is in the playing state, it sends an operation shielding instruction to ViewModule.

[0423] ②See Fig. 20 , ViewModule responds to the operation shielding instruction, monitors the user's KeyEvent (operation event, including the user's playback control operation event of the target video source), and disposes the monitored KeyEvent, so that ViewModule can shield (not respond) the user operation, making it impossible for the user to interfere with the playback control of the target video source. Fig.11 In the example of , ViewModule does not use the preset shielding page to shield the screen projection playback interface, but displays the pause indicator control 111 on the screen projection playback interface, and prompts that the target source is not operable in the interval mode. For example, when the user clicks the pause indicator control 111, ViewModule will block / not respond to the user operation, so that the user cannot switch the playback status of the target source in the interval mode, and the user cannot perform other playback control operations on the target source, such as adjusting the speed, fast forward, fast rewind, etc.

[0424] ③See Fig. 20 After ModeManager sends an exit interval mode message to PlayStateManager, PlayStateManager detects that the target source is in a paused playback state and sends a lift operation shielding instruction to ViewModule.

[0425] ④See Fig. 20 , ViewModule responds to the instruction to remove the operation shielding, and removes the shielding of user operations, that is, responds to the monitored KeyEvent. Fig.11 In the example, ViewModule prompts that the i-th round interval mode has ended and prompts that the target source is operable, so that the user can continue to perform playback control operations such as pause, fast forward, rewind, seek, and speed adjustment on the target source.

[0426] Fig.21This is a timing interaction diagram of the screen projection mode processing method (timing mode) provided in some embodiments of the present application. Fig.21 When ModeAnalysis detects that the timing time of the Timer reaches the third preset time t3, it determines that the timing mode is triggered and sends a timing mode trigger event to ModeManager. When the mode listener of ModeManager listens to the timing mode trigger event, ModeManager switches the current mode to the timing mode and obtains the playback progress of the target source from PlayStateManager (or Player).

[0427] In some embodiments, see Fig.21 , ModeManager can calculate the remaining playback time (restDuration) of the target source based on the playback progress and total duration of the target source. ModeManager can compare restDuration with the threshold, and then decide the target mode action to be executed by the timing mode based on the size of restDuration.

[0428] In some embodiments, see Fig.21 Taking a single threshold comparison as an example, if restDuration is not greater than the threshold, ModeManager can set the mode action priority to delay the disconnection of the projection operation over the immediate disconnection of the projection operation, so that ModeManager can send a query instruction 3 to ViewModule. ViewModule responds to the query instruction 3, see Fig.13 For example, it can prompt that the screen casting viewing time reaches the specified time (i.e., the third preset time t3), prompt the restDuration of the target source, and ask the user whether to agree to delay the disconnection of the screen casting connection until the target source ends. Assuming that the user agrees to delay the disconnection of the screen casting, ViewModule can send a message to ModeManager that it agrees to delay the disconnection of the screen casting.

[0429] In some embodiments, see Fig.21 , ModeManager receives the message of agreeing to delay the disconnection of screen projection, monitors the change of restDuration, and when restDuration becomes 0 (indicating that the target source has finished playing), it can exit the timing mode. ModeManager can send a stop timing instruction to TimerManager. In response to the stop timing instruction, TimerManager can control the Timer to stop timing and clear the timing time of the Timer.

[0430] In some embodiments, see Fig.21, when the playback of the target source ends, ModeManager can send a disconnect screen casting instruction to CastServer. In response to the disconnect screen casting instruction, CastServer can call the finish() interface of the Session object to disconnect the screen casting connection with the screen casting sender. After the screen casting connection is disconnected, CastServer can send a disconnected screen casting message to VideoPlayerActivity. VideoPlayerActivity receives the disconnected screen casting message, sends a stop playback instruction to Player, and sends an exit screen casting instruction to ViewModule. In response to the stop playback instruction, Player stops playing the target source, cleans up the screen casting data, releases player resources, and closes the player. In response to the exit screen casting instruction, ViewModule prompts "The playback of the screen casting content has ended and the screen casting has been disconnected."

[0431] In some embodiments, see Fig.21 If restDuration is greater than the threshold, ModeManager can set the mode action priority to immediately disconnect the screen projection operation before delaying the disconnection of the screen projection operation, so that ModeManager can send a query instruction 4 to ViewModule. ViewModule responds to the query instruction 4, see Fig.14 For example, it can prompt that the screen casting viewing time reaches the specified time (i.e., the third preset time t3), prompt the restDuration of the target film source, and ask the user whether to agree to disconnect the screen casting connection immediately. Assuming that the user agrees to disconnect the screen casting immediately, ViewModule can send a message to ModeManager that agrees to disconnect the screen casting immediately. ModeManager receives the message that agrees to disconnect the screen casting immediately, exits the timing mode, and sends a disconnect screen casting instruction to CastServer.

[0432] In some embodiments, the ViewModule responds to the query instruction 4 and can ask the user whether to agree to disconnect the screen projection immediately. If the user refuses to disconnect the screen projection immediately, the restDuration time may be long and may affect the user's rest. Fig.15 For example, ViewModule can prompt that the timing has been stopped and the screen projection is disconnected with a delay, and prompt that the screen projection can be disconnected at any time before the target source ends by inputting a preset operation.

[0433] In some embodiments, multiple thresholds may also be set in the timing mode, such as dual thresholds (including a first threshold and a second threshold, the second threshold being greater than the first threshold). ModeManager may compare restDuration with the multiple thresholds to determine the target mode action to be performed when restDuration is within different threshold ranges, and this embodiment will not be described in detail.

[0434] In some embodiments, the user can configure a mode set according to the viewing needs. The mode set can be presented as {timing mode}, {interval mode}, {timing mode}, {timing mode, interval mode}, {timing mode, timing mode}, {interval mode, timing mode}, {timing mode, interval mode, timing mode}. For different mode sets, the timing interaction logic in different scenarios can be adapted, and the software program configuration and flow interaction logic of each module in the mode application can be adapted.

[0435] In some embodiments, when the first projection mode is a timing mode, an interval mode or a timing mode, the first projection mode can be selected according to Figure 3B An example schema application architecture, or Figures 17 to 21 The example's sequential interaction logic is implemented in the scenario of video URL push source screen casting. According to the mode type, the replay time data and the play time data, it determines whether the replay end condition is met, processes the triggered first screen casting mode, and executes the matching target mode action, so as to adapt to the constraints and control of screen casting playback in different modes. In this way, the user's manual mode intervention is reduced, the mode processing efficiency and human-computer interaction efficiency are improved, and different modes can be intelligently and accurately controlled.

[0436] The screen projection receiving end may include a controller, and the controller executes the technical solution provided by at least one embodiment of the present application. When the screen projection receiving end configures and runs the mode application, when the mode application is controlled by the controller to execute relevant program steps, the previous relevant embodiments can be referred to, and the interaction and flow of the underlying modules of the mode application can be used to realize the judgment of the end condition of the continuation of different screen projection modes, the execution of mode actions, and the update and change of related UI. It will not be repeated here. The controller can also execute Figures 17 to 21 The example timing interaction logic realizes the above functions of this application.

[0437] Some embodiments of the present application also provide a computer storage medium, which may store a program. When the computer storage medium is configured in the display device 200, the program may include all or part of the program steps involved in the screen projection mode processing method configured by the mode application or controller in the above embodiment. Among them, the computer storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0438] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0439] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of this disclosure, so that those skilled in the art can better use the embodiments.

Claims

1. A display device, characterized in that: include: A display, for displaying a user interface; A communication device, used for data communication with a server; The controller is configured to execute: In response to receiving a screen projection instruction for playing a target film source sent by the screen projection device, according to a resource address included in the screen projection instruction, acquiring and playing the target film source from a server corresponding to the resource address; Get the resume time data; In the process of playing the target video source, obtaining the playing time data; If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes disconnecting the screen projection operation or pausing the playing of the target film source; If it is determined based on the play time data and the resume play time data that the resume play end condition is not satisfied, the target film source continues to be played.

2. The display device according to claim 1, characterized in that The play time data includes the system time of the display device, and the resume play time data includes the preset time; The controller executes the target operation if it is determined based on the play time data and the resume play time data that the resume play end condition is satisfied, and is specifically configured as follows: If the system time reaches the preset time, the target film source is stopped from playing and the screen projection connection with the screen projection device is disconnected.

3. The display device according to claim 2, characterized in that The controller stops playing the target film source and disconnects the screen projection connection with the screen projection device if the system time reaches the preset time, and is specifically configured as follows: when the system time reaches the preset time, controls the display to display a first prompt message, wherein the first prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; if the user agrees to disconnect the screen projection connection, stops playing the target film source and disconnects the screen projection connection with the screen projection device; The controller is also configured to: if a user operation of refusing to disconnect the screen projection connection is received, continue to play the target film source.

4. The display device according to claim 2, characterized in that The controller determines that the broadcast continuation end condition is satisfied if the system time reaches the preset time, and is specifically configured as follows: When the system time reaches the preset time, determining the remaining playback time of the target film source according to the playback progress of the target film source and the total duration of the target film source; If the remaining playback time is greater than a preset threshold, the playback of the target film source is stopped and the screen projection connection with the screen projection device is disconnected.

5. The display device according to claim 4, characterized in that The controller stops playing the target video source and disconnects the screen projection connection with the screen projection device if the remaining playback time is greater than a preset threshold. Specifically, the controller is configured to: when the remaining playback time is greater than the preset threshold, control the display to display the remaining playback time and a first prompt message, wherein the first prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; If the user agrees to disconnect the screen projection connection, stop playing the target video source and disconnect the screen projection connection with the screen projection device; The controller is also configured to: if a user operation of refusing to disconnect the screen projection connection is received, continue to play the target film source.

6. The display device according to claim 4, characterized in that The controller is further configured to: after determining the remaining playback time of the target film source according to the playback progress of the target film source and the total duration of the target film source when the system time reaches the preset time: If the remaining playback time is not greater than the preset threshold, continue to play the target video source; When the playback of the target film source ends, the screen projection connection with the screen projection device is disconnected.

7. The display device according to claim 6, characterized in that The controller executes if the remaining playback time is not greater than the preset threshold, continuing to play the target film source, and is specifically configured as follows: if the remaining playback time is not greater than the preset threshold, controlling the display to display the remaining playback time and a second prompt message, the second prompt message being used to prompt the user whether to agree to delay disconnecting the projection connection until the playback of the target film source ends; if the user agrees to delay disconnecting the projection connection, continuing to play the target film source; The controller is also configured to: stop playing the target film source and disconnect the screen projection connection with the screen projection device if receiving an operation from the user to refuse to delay disconnecting the screen projection connection.

8. The display device according to claim 1, characterized in that The play time data includes the play time of the target video source, and the continued play time data includes a first preset time; The controller executes the target operation if it is determined that the continuation broadcast end condition is met based on the playback time data and the projection screen continuation broadcast data, and is specifically configured as follows: If the playing time of the target film source reaches the first preset time, the playing of the target film source is paused.

9. The display device according to claim 8, characterized in that The continuous broadcast time data also includes a second preset duration; After executing the step of pausing the target film source if the playing time of the target film source reaches the first preset time, the controller is further configured to: When the playing time of the target film source reaches the sum of the first preset time and the second preset time, the target film source continues to be played from the pause node.

10. The display device according to claim 9, characterized in that The controller is also configured to: When pausing the target film source, controlling the display to display a preset shielding page on the upper layer of the playback interface of the target film source; When the target film source is continued to be played from the pause node, the display is controlled to cancel display of the preset shielding page.

11. The display device according to claim 9, characterized in that The controller is also configured to: When pausing the target film source, controlling the display to display a pause prompt control on the playback interface of the target film source, wherein the pause prompt control is used to prompt that the target film source is in a paused playback state; When the target video source is in a paused playback state, if a playback control instruction for the target video source is received from the user, the operation corresponding to the playback control instruction is not performed; When the target film source is continued to be played from the pause node, the display is controlled to cancel the display of the pause prompt control, and if a play control instruction for the target film source is received from the user, an operation corresponding to the play control instruction is executed.

12. The display device according to claim 1, characterized in that The play time data includes the play time of the target video source, and the continued play time data includes a first preset time; The controller executes the target operation if it is determined based on the play time data and the resume play time data that the resume play end condition is satisfied, and is specifically configured as follows: If the playing time of the target film source reaches the first preset time, the first round of interval mode is started to pause the playing of the target film source.

13. The display device according to claim 12, characterized in that The continuous broadcast time data also includes a second preset duration; After starting the first round of interval mode and pausing the playing of the target video source, the controller is further configured to: When the playing time of the target film source reaches the sum of the first preset time and the second preset time, the first round of interval mode is exited, and the target film source is continued to be played from the pause node.

14. The display device according to claim 13, characterized in that After the controller exits the first round of interval mode and continues to play the target video source from the pause node, it is further configured as follows: If the broadcast time of the target source reaches the starting time T of the interval mode of the i-th round mi , then start the interval mode of the i-th round and pause the playing of the target source; wherein, T mi =i*t1+(i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number in the interval mode, and i is greater than 1; If the broadcast time of the target source reaches the end time T of the interval mode of the i-th round ni , then exit the interval mode of the i-th round and continue playing the target source from the pause node; wherein, T ni =T mi +t2=i*(t1+t2).

15. The display device according to claim 1, characterized in that The play time data includes the play time of the target video source, and the continued play time data includes a third preset time; The controller executes the target operation if it is determined based on the playback time data and the casting and replaying time data that the replaying end condition is met, and is specifically configured as follows: If the playing time of the target film source reaches the third preset time, the playing of the target film source is stopped and the screen projection connection with the screen projection device is disconnected.

16. The display device according to claim 15, characterized in that The controller stops playing the target film source and disconnects the screen projection connection with the screen projection device if the playing time of the target film source reaches the third preset time. Specifically, the controller is configured to: control the display to display a third prompt message if the playing time of the target film source reaches the third preset time, and the third prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; If the user agrees to disconnect the screen projection connection, stop playing the target video source and disconnect the screen projection connection with the screen projection device; The controller is also configured to: if receiving an operation of the user refusing to disconnect the screen projection connection, continue to play the target film source.

17. The display device according to claim 15, characterized in that The controller determines that the replay end condition is satisfied if the play duration of the target film source reaches the third preset duration, and is specifically configured as follows: When the played time of the target film source reaches the third preset time, the remaining playing time of the target film source is determined according to the playing progress of the target film source and the total time of the target film source; If the remaining playback time is greater than a preset threshold, the playback of the target film source is stopped and the screen projection connection with the screen projection device is disconnected.

18. The display device according to claim 17, characterized in that The controller stops playing the target film source and disconnects the screen projection connection with the screen projection device if the remaining playback time is greater than a preset threshold, and is specifically configured as follows: if the remaining playback time is greater than the preset threshold, controls the display to display the remaining playback time and a third prompt message, wherein the third prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; if the user agrees to disconnect the screen projection connection, stops playing the target film source and disconnects the screen projection connection with the screen projection device; The controller is also configured to: if a user operation of refusing to disconnect the screen projection connection is received, continue to play the target film source.

19. The display device according to claim 17, characterized in that The controller is further configured to: determine the remaining playback time of the target film source according to the playback progress of the target film source and the total time of the target film source when the playback time of the target film source reaches the third preset time; If the remaining playback time is not greater than the preset threshold, continue to play the target video source; When the playback of the target film source ends, the screen projection connection with the screen projection device is disconnected.

20. The display device according to claim 19, characterized in that The controller executes if the remaining playback time is not greater than the preset threshold, then continue to play the target film source, and is specifically configured as follows: if the remaining playback time is not greater than the preset threshold, control the display to display the remaining playback time and fourth prompt information, the fourth prompt information is used to prompt the user whether to agree to delay the disconnection of the projection connection until the playback of the target film source ends; if the user agrees to delay the disconnection of the projection connection, then continue to play the target film source; The controller is also configured to: if a user operation of refusing to delay disconnecting the screen projection connection is received, stop playing the target film source and disconnect the screen projection connection with the screen projection device.

21. A method for processing screen projection mode, characterized in that: include: In response to receiving a screen projection instruction for playing a target film source sent by a screen projection device, according to a resource address included in the screen projection instruction, obtaining and playing the target film source from a server corresponding to the resource address; Get the resume time data; In the process of playing the target video source, obtaining the playing time data; If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes disconnecting the screen projection operation or pausing the playing of the target film source; If it is determined based on the play time data and the resume play time data that the resume play end condition is not satisfied, the target film source continues to be played.

Images