Screen projection mode processing method and display equipment

Abstract

The embodiment of the invention discloses a screen projection mode processing method and display equipment, and the method comprises the steps: playing screen projection media resources in response to a received screen projection instruction sent by screen projection equipment; the screen projection media assets are screen contents sent by the screen projection equipment, or the screen projection media assets are live broadcast media assets acquired according to a resource address contained in the screen projection instruction; acquiring continuous playing time data; in the process of playing the screen projection media assets, obtaining playing time data; if it is determined that a continuous playing ending condition is met based on the playing time data and the continuous playing time data, target operation is executed, and the target operation comprises screen projection disconnecting operation or screen projection media asset playing shielding operation; the playing shielding operation is used for shielding audiovisual of the user to the screen projection media assets; and if it is determined that the continuous playing ending condition is not met, continuing to play the screen projection media assets. In this way, the accuracy of screen projection mode processing can be improved, manual mode intervention of a user is reduced, the screen projection processing efficiency and the man-machine interaction efficiency are improved, and intelligent and accurate control over screen projection playing is achieved.

Description

Technical Field

[0001] The present application relates to the field of screen projection technology, and in particular to a screen projection mode processing method and a display device. Background Art

[0002] When the display device is displaying the projected content, if certain preset conditions are triggered, it may be necessary to disconnect the projection, or to continue the projection after a break. For example, when the display device is displaying a film or television projection program, if the timing mode is started, the user can disconnect the projection when the projection has been played for a preset time a, so as to avoid exceeding the healthy viewing time set by the user. For another example, when the display device is displaying children's educational programs, the user can turn on the eye protection mode or the halftime mode once every preset time b to avoid problems such as eye fatigue and lack of concentration caused by long-term uninterrupted learning in children.

[0003] For these user scenarios, when the preset conditions are triggered, the user needs to manually adjust the screen projection status. For example, the user can terminate the screen projection at the screen projection sender or receiver at the time point when the screen projection needs to be disconnected by observing the screen projection broadcast time or setting an alarm reminder; for example, in the eye protection mode, the user needs to disconnect the screen projection first, and then restore the screen projection connection through the screen projection sender when the eye protection mode ends. This will lead to low operating efficiency on the one hand, and on the other hand, it is impossible to intelligently and accurately control different screen projection modes. Summary of the invention

[0004] The embodiments of the present application provide a screen projection mode processing method and a display device, which can improve the accuracy of screen projection mode processing, reduce user manual mode intervention, improve screen projection processing efficiency and human-computer interaction efficiency, and realize intelligent and precise control of screen projection playback.

[0005] In a first aspect, an embodiment of the present application provides a display device, including:

[0006] A display, for displaying a user interface;

[0007] A communication device, used for data communication with a server;

[0008] The controller is configured to execute:

[0009] In response to receiving a screen projection instruction sent by a screen projection device, playing screen projection media resources; wherein the screen projection media resources are screen contents sent by the screen projection device, or the screen projection media resources are live media resources obtained from a server corresponding to the resource address contained in the screen projection instruction;

[0010] Get the resume time data;

[0011] During the process of playing the projection media asset, obtaining playback time data;

[0012] If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes a disconnection of the screen projection operation or a play shielding operation of the screen projection media; wherein the play shielding operation is used to mute the screen projection media and switch it to an invisible state to shield the user from viewing and listening to the screen projection media;

[0013] If, based on the playback time data and the resumed playback time data, it is determined that the resumed playback condition is not satisfied, the projection media asset continues to be played.

[0014] The technical solution provided by the first aspect embodiment has the following beneficial effects: when the screen projection device sends the projection media to the display device, the projection media can be mirror data (i.e., the screen content recorded by the screen projection device), or the resource address of the live media can be included in the screen projection instruction. The display device can obtain and play the live media from the server according to the resource address; the display device can obtain the resume time data, and the resume time data includes time parameters related to the trigger conditions of different screen projection modes; the display device can also obtain the playback time data, and the playback time data is the relevant time parameters obtained in the process of establishing the screen projection connection and playing the projection media, so as to compare the playback time data and the resume time data. It can be determined whether the conditions for ending the resumed broadcast of the projected media are met; if the conditions for ending the resumed broadcast are met, the projection operation can be disconnected or the playback shielding operation can be performed based on the settings of different projection modes. Otherwise, if the conditions for ending the resumed broadcast are not met, the film source continues to be played. In this way, after the film source starts playing, the playback time data and the resumed broadcast time data are used to judge the conditions for ending the resumed broadcast of the film source. When the conditions for ending the resumed broadcast are met, the controller automatically disconnects the projection connection or pauses the playback of the film source, thereby avoiding the display device from continuously playing the projection content, realizing intelligent control of projection playback based on the time management mechanism, improving the accuracy of projection mode processing, reducing user manual mode intervention, and improving projection processing efficiency and human-computer interaction efficiency.

[0015] In some embodiments of the first aspect, the playback time data includes the system time of the display device, and the resumed playback time data includes a preset time; if the controller determines that the resumed playback end condition is met based on the playback time data and the resumed playback time data, then the target operation is performed, and is specifically configured as follows: if the system time reaches the preset time, stop playing the projection media, and disconnect the projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: it provides a scheme for determining the resumed playback end condition and the projection control operation based on the first time management mechanism (which can be called a timing mode), that is, when the system time reaches a fixed preset time, it is determined that the resumed playback end condition is met, and the controller disconnects the projection connection to stop playing the target film source, so as to avoid the projection device from continuing to push the projection content to the display device based on the projection connection when the preset time is reached, and also avoid the display device from continuing to play the projection content after exceeding the preset time, thereby avoiding affecting the user's work and rest due to the projection content playing time being too late.

[0016] In some embodiments of the first aspect, the controller stops playing the projection media and disconnects the projection connection with the projection device if the current system time reaches the preset time. Specifically, the controller is configured as follows: when the system time reaches the preset time, the display is controlled to display a first prompt message, the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the projection media is stopped from playing, and the projection connection with the projection device is disconnected; the controller is also configured as follows: if the user refuses to disconnect the projection connection, the projection media continues to play. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then, based on the time condition of the timing mode, the user's viewing needs are added to decide whether to disconnect the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the source continues to be played, thereby meeting the user's usage needs and preferences.

[0017] In some embodiments of the first aspect, the controller stops playing the projection media and disconnects the projection connection with the projection device if the system time reaches the preset time. The controller is specifically configured as follows: when the system time reaches the preset time, query the type of the projection media; if the projection media is the screen content sent by the projection device, control the display to display a second prompt message, and the second prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the projection media and disconnect the projection connection with the projection device; the controller is also configured as follows: if the user refuses to disconnect the projection connection, continue playing the projection media. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, for the projection media of the mirror projection type, since the projection connection needs to be disconnected in order to stop playing the mirror projection, the display device and the projection device must be in a connected state when the mirror projection can be received. In this way, the user can be asked through a prompt message whether to agree to disconnect the projection connection, and then on the basis of the time conditions of the timing mode, the factor of the user's viewing needs is added to decide whether to disconnect the projection connection. If the user agrees, the projection connection is disconnected. If the user refuses, the film source continues to be played to meet the user's viewing needs and preferences.

[0018] In some embodiments of the first aspect, the controller executes if the system time reaches the preset time, and after querying the type of the projected media, it is configured as follows: if the projected media is a live broadcast media, then obtaining the playback status of the projected media, the playback status including the live broadcast status or the live broadcast end status; if the projected media is in the live broadcast status, controlling the display to display a third prompt message, the third prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, then stopping playing the projection media and disconnecting the projection connection with the projection device; if the user refuses to disconnect the projection connection, then continuing to play the projection media. The technical solution provided by this embodiment has the following beneficial effects: for live media resources pushed by URL, since live media resources are real-time streaming media resources that are recorded instantly and have no definite total playback time, when the system time reaches the preset time, the live media resources may be in the live broadcast state or the live broadcast end state; if the cast screen media resources are in the live broadcast state, the display device will continue to pull and play the live real-time stream. The user may want to continue watching the cast screen media resources, so a prompt message can be used to ask the user whether to agree to disconnect the cast screen connection to meet the user's usage needs and preferences.

[0019] In some embodiments of the first aspect, after the controller executes the operation of obtaining the playback status of the cast media if the cast media is a live broadcast media, the controller is further configured to: if the cast media is in a live broadcast end state, control the display to display a fourth prompt message, wherein the fourth prompt message is used to prompt that the cast media has ended live broadcast. The technical solution provided by this embodiment has the following beneficial effects: for live broadcast media pushed by a URL, when the system time reaches a preset time, if the cast media is in a live broadcast end state, the live broadcast real-time stream is interrupted, and the display device has no valid cast media to play, it can be prompted that the cast media has ended live broadcast. Since there is no live stream to play after the live broadcast ends, the cast connection can be disconnected or not.

[0020] In some embodiments of the first aspect, the playback time data includes the played time of the projected media, and the continued playback time data includes a first preset duration; if the controller determines that the continued playback end condition is met based on the playback time data and the projected playback data, then the target operation is executed, and is specifically configured as follows: if the played time of the projected media reaches the first preset duration, then the projected media is muted, and the display is controlled to display a preset masking page on the upper layer of the playback interface of the projected media. The technical solution provided by this embodiment has the following beneficial effects: it provides a solution for determining the end condition of the resumed broadcast and the screen projection control operation based on the second time management mechanism (which can be called the interval mode). After the film source starts broadcasting, the broadcast time of the film source can be recorded, and the broadcast time and the first preset time can be used as parameters for determining whether the end condition of the resumed broadcast is met. When the broadcast time reaches the first preset time, the user may need to take a break. Since it is impossible to pause the mirror screen projection and live broadcast screen projection, the projection media can be muted and blocked. When the live broadcast media is blocked, the projection live broadcast progress will not stagnate, that is, the user cannot hear the sound of the projection media, nor can he see the playback screen of the projection media, thereby shielding the user from the sight and sound of the projection media, thereby achieving the purpose of allowing the user to rest.

[0021] In some embodiments of the first aspect, the continued broadcast time data also includes a second preset duration; after the controller executes the operation of pausing the playback of the projected media if the playback duration of the projected media reaches the first preset duration, the controller is also configured to: when the playback duration of the projected media reaches the sum of the first preset duration and the second preset duration, unmute the projected media and control the display to cancel display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, the film source is paused when the playing time of the film source reaches the first preset time; when the playing time reaches the sum of the first preset time and the second preset time, if the display device has always muted and blocked the projected media, although the projected content will not stagnate when the projected media is blocked, the user will not be aware of it, resulting in the user being able to only watch the preset blocked page for a long time and unable to watch the projected playback interface. Therefore, the parameter of the second preset time is increased, that is, when the paused playback time of the projected media reaches the second preset time, the muting of the projected media can be unmute and the blocking can be cancelled, so that the projected media can continue to be played when the interval mode is exited.

[0022] In some embodiments of the first aspect, when the broadcast time of the projection media reaches the sum of the first preset time and the second preset time, the controller unmutes the projection media and controls the display to cancel the display of the preset blocking page. The specific configuration is as follows: when the broadcast time of the projection media reaches the sum of the first preset time and the second preset time, query the type of the projection media; if the projection media is the screen content sent by the projection device, unmute the projection media and control the display to cancel the display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, if the projection media belongs to the mirror projection, since the display device will continue to receive and display the mirror projection when the projection connection is not disconnected, so when exiting the interval mode, in order to achieve the continuation of the mirror projection, the projection media can be muted and the screen blocking can be unmute, so that the audiovisual shielding of the mirror projection can be removed, and the user can continue to watch the audio and video content of the projection media.

[0023] In some embodiments of the first aspect, the controller executes, after querying the type of the projected media when the broadcast time of the projected media reaches the sum of the first preset time and the second preset time, the controller is further configured to: if the projected media is a live broadcast media, obtain the playback status of the projected media, and the playback status includes a live broadcast status or a live broadcast end status; if the projected media is in a live broadcast status, unmute the projected media, control the display to cancel display of the preset blocking page, and continue playing the projected media from the current live broadcast progress; if the projected media is in a live broadcast end state, control the display to cancel display of the preset blocking page, and control the display to display a fifth prompt message, and the fifth prompt message is used to prompt that the live broadcast of the projected media has ended. The technical solution provided by this embodiment has the following beneficial effects: for live media resources pushed by URL, when the broadcast duration of the screen projection media resources reaches the sum of the first preset duration and the second preset duration, if the screen projection media resources are in the live broadcast state, it indicates that the display device can pull and play the real-time live stream, and the playback progress of the real-time stream is constantly changing during the interval break. By unmuting and unblocking the screen projection media resources, the screen projection media resources can be continued to be played from the current live progress; if the screen projection media resources are in the live broadcast end state, the live real-time stream is interrupted, and the display device has no valid screen projection media resources to play, it can be prompted that the screen projection media resources have ended live broadcast. Since there is no live stream to play after the live broadcast ends, the screen projection connection can be disconnected or not.

[0024] In some embodiments of the first aspect, the play time data includes the played time of the projected media, and the continued play time data includes a first preset time; if the controller determines that the continued play end condition is met based on the play time data and the continued play time data, then the target operation is executed, and is specifically configured as follows: if the played time of the projected media reaches the first preset time, then the first round of interval mode is started, the projected media is muted, and the display is controlled to display a preset blocking page on the upper layer of the playback interface of the projected media. The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be executed in a single round, so that when the played time of the projected media reaches the first preset time, that is, when the starting point of the first round of the interval mode is reached, the projected media is blocked and muted, thereby avoiding continuous and uninterrupted playback of the projected content, and the controller can also limit the rounds and frequency of executing the interval mode to avoid frequent blocking of media playback during the playback of the projected media.

[0025] In some embodiments of the first aspect, the continued broadcast time data also includes a second preset duration; after the controller executes the first round of interval mode and pauses the playback of the projection media, it is further configured to: when the playback time of the projection media reaches the sum of the first preset duration and the second preset duration, exit the first round of interval mode, cancel the mute of the projection media, and control the display to cancel the display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the single round / first round interval mode, when the playback time of the target source reaches the first preset duration, the projection media is muted and blocked, and the duration of the projection media shielding playback is the second preset duration, so that when the playback time of the projection media reaches the sum of the first preset duration and the second preset duration, exit the first round interval mode, and by canceling the blocking and muting, it can be achieved that the projection media is played after exiting the single interval mode, and the controller can also limit the rounds and frequency of executing the interval mode to avoid frequently shielding the media playback during the projection media playback process.

[0026] In some embodiments of the first aspect, after the controller exits the first round of interval mode, unmutes the projection media, and controls the display to cancel displaying the preset shielding page, it is further configured to: if the broadcasting time of the projection media reaches the starting time T of the interval mode of the i-th round mi , then the interval mode of the i-th round is started, the projection media asset is muted, and the display is controlled to display the preset shielding page on the upper layer of the playback interface of the projection media asset; wherein, T mi =i*t1+(i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number in the interval mode, and i is greater than 1; if the broadcast duration of the projection media reaches the end time T of the interval mode of the i-th round ni , then exit the interval mode of the i-th round, unmute the projection media, and control the display to cancel the display of the preset blocking page; wherein, T ni =T mi + t2 = i*(t1+t2). The technical solution provided by this embodiment has the following beneficial effects: if the interval mode is executed only once, the display device will continuously play the projection media after exiting the first round of interval mode. Therefore, multiple rounds of interval mode rotation can be set, that is, every first preset time, the projection media will be shielded from playing for a second preset time. By rotating multiple rounds of interval modes during the projection media playback process, problems such as fatigue caused by continuous viewing of projection media by the user can be avoided.

[0027] In some embodiments of the first aspect, the playback time data includes the played time of the projected media asset, and the continued playback time data includes a third preset duration; if the controller determines that the projection and continued playback end condition is met based on the playback time data and the continued playback time data, then the target operation is executed, and is specifically configured as follows: if the played time of the projected media asset reaches the third preset duration, then the playback of the projected media asset is stopped, and the projection connection with the projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: it provides a solution for determining the end conditions of resume broadcasting and controlling screen projection operations based on the third time management mechanism (which can be called a timing mode), and starts timing the elapsed broadcast time when the screen projection media starts broadcasting. When the elapsed broadcast time of the screen projection media reaches a third preset time, it is determined that the end conditions of resume broadcasting are met, and the controller disconnects the screen projection connection to stop playing the screen projection media. This prevents the screen projection device from continuing to push the projected content to the display device based on the screen projection connection when the screen projection media is played to the third preset time, and also prevents the display device from continuing to play the projected content after the elapsed broadcast time reaches the third preset time, thereby avoiding the screen projection source from playing for too long.

[0028] In some embodiments of the first aspect, the controller stops playing the projection media and disconnects the projection connection with the projection device if the playback time of the projection media reaches the third preset time, and is specifically configured as follows: when the playback time of the projection media reaches the third preset time, the display is controlled to display a sixth prompt message, the sixth prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the projection media is stopped from playing, and the projection connection with the projection device is disconnected; the controller is also configured as follows: if the user refuses to disconnect the projection connection, the projection media continues to play. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the playback time of the projection media reaches the third preset time, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then based on the time condition of the timing mode, the user's viewing needs are used as a factor in determining whether the controller disconnects the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the projection media continues to play, thereby meeting the user's usage needs and preferences.

[0029] In some embodiments of the first aspect, the controller stops playing the projected media and disconnects the projection connection with the projection device if the broadcast time of the projection media reaches the third preset time. The controller is specifically configured as follows: when the broadcast time of the projection media is equal to the third preset time, query the type of the projection media; if the projection media is the screen content sent by the projection device, control the display to display a seventh prompt message, and the seventh prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the projection media and disconnect the projection connection with the projection device; the controller is also configured as follows: if the user refuses to disconnect the projection connection, continue playing the projection media. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the broadcast time of the projection media is equal to the third preset time, for the projection media of the mirror projection type, since the projection connection needs to be disconnected in order to stop playing the mirror projection, the display device and the projection device are in a connected state when the mirror projection can be received. In this way, the user can be asked whether he agrees to disconnect the projection connection through a prompt message to meet the user's usage needs and preferences.

[0030] In some embodiments of the first aspect, the controller executes if the broadcast time of the projected media asset is equal to the third preset time, after querying the type of the projected media asset, and is configured as follows: if the projected media asset is a live broadcast media asset, then obtaining the playback status of the projected media asset, the playback status including the live broadcast status or the live broadcast end status; if the projected media asset is in the live broadcast status, controlling the display to display an eighth prompt message, the eighth prompt message being used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, then stopping playing the projection media asset and disconnecting the projection connection with the projection device; if the user refuses to disconnect the projection connection, then continuing to play the projection media asset. The technical solution provided by this embodiment has the following beneficial effects: for live media resources pushed by URL, since live media resources are real-time streaming media resources that are recorded instantly and have no definite total playback time, when the playback time of the projection media resources is equal to the third preset time, the live media resources may be in the live broadcast state or the live broadcast end state; if the projection media resources are in the live broadcast state, the display device will keep pulling and playing the live real-time stream, and the user can be asked whether he agrees to disconnect the projection connection through a prompt message to meet the user's usage needs and preferences.

[0031] In some embodiments of the first aspect, after the controller executes the operation of obtaining the playback status of the projection media if the projection media is a live broadcast media, the controller is further configured to: if the projection media is in a live broadcast end state, control the display to display a ninth prompt message, and the ninth prompt message is used to prompt that the projection media has ended live broadcast. The technical solution provided by this embodiment has the following beneficial effects: for live broadcast media pushed by a URL, when the broadcast duration of the projection media is equal to the third preset duration, if the projection media is in a live broadcast end state, the live real-time stream is interrupted, and the display device has no valid projection media to play, it can be prompted that the projection media has ended live broadcast. Since there is no live stream to play after the live broadcast ends, the projection connection can be disconnected or not.

[0032] In a second aspect, an embodiment of the present application further provides a method for processing a screen projection mode, including:

[0033] In response to receiving a screen projection instruction sent by a screen projection device, playing screen projection media resources; wherein the screen projection media resources are screen contents sent by the screen projection device, or the screen projection media resources are live media resources obtained from a server corresponding to the resource address contained in the screen projection instruction;

[0034] Get the resume time data;

[0035] During the process of playing the projection media asset, obtaining playback time data;

[0036] If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes a disconnection of the screen projection operation or a play shielding operation of the screen projection media; wherein the play shielding operation is used to mute the screen projection media and switch it to an invisible state to shield the user from viewing and listening to the screen projection media;

[0037] If it is determined based on the playback time data and the continued playback time data that the continued playback condition is not met, the projection media asset continues to be played.

[0038] The technical solution provided by the above second aspect embodiment has the following beneficial effects: when the screen projection device sends the projection media to the display device, the projection media can be mirror data (i.e., the screen content recorded by the screen projection device), or the resource address of the live media can be included in the screen projection instruction. The display device can obtain and play the live media from the server according to the resource address; the display device can obtain the resume time data, and the resume time data includes time parameters related to the trigger conditions of different screen projection modes; the display device can also obtain the playback time data, and the playback time data is the relevant time parameters obtained in the process of establishing the screen projection connection and playing the projection media, so as to compare the playback time data and the resume time data. It can be determined whether the conditions for ending the resumed broadcast of the projected media are met; if the conditions for ending the resumed broadcast are met, the projection operation can be disconnected or the playback shielding operation can be performed based on the settings of different projection modes. Otherwise, if the conditions for ending the resumed broadcast are not met, the film source continues to be played. In this way, after the film source starts playing, the playback time data and the resumed broadcast time data are used to judge the conditions for ending the resumed broadcast of the film source. When the conditions for ending the resumed broadcast are met, the controller automatically disconnects the projection connection or pauses the playback of the film source, thereby avoiding the display device from continuously playing the projection content, realizing intelligent control of projection playback based on the time management mechanism, improving the accuracy of projection mode processing, reducing user manual mode intervention, and improving projection processing efficiency and human-computer interaction efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0040] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0041] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0042] Figure 3A A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0043] Figure 3B A software architecture diagram of a mode application provided in some embodiments of the present application;

[0044] Figure 4A A schematic diagram of a timing mode setting method provided in some embodiments of the present application;

[0045] Figure 4BA schematic diagram of an interval mode setting method provided in some embodiments of the present application;

[0046] Figure 4C A schematic diagram of a timing mode setting method provided in some embodiments of the present application;

[0047] Figure 4D A schematic diagram of a screen projection mode setting page provided in some embodiments of the present application;

[0048] Figure 5A Schematic diagram of the change of the user interface when the triggering conditions of the timing mode are met in the mirror projection provided in some embodiments of the present application Figure 1 ;

[0049] Figure 5B Schematic diagram of the change of the user interface when the triggering conditions of the timing mode are met in the mirror projection provided in some embodiments of the present application Figure 2 ;

[0050] Fig. 6A Schematic diagram of the change of the user interface when the trigger conditions of the timing mode are met for the live screen projection media provided in some embodiments of the present application Figure 1 ;

[0051] Figure 6B Schematic diagram of the change of the user interface when the trigger conditions of the timing mode are met for the live screen projection media provided in some embodiments of the present application Figure 2 ;

[0052] Figure 6C Schematic diagram 3 of the changes in the user interface of the live screen projection media resource provided in some embodiments of the present application when the triggering conditions of the timing mode are met;

[0053] Figure 7 A schematic diagram of the triggering time distribution of the interval mode in the screen projection playback process provided by some embodiments of the present application;

[0054] Figure 8 A schematic diagram of changes in the user interface in interval mode when playing mirrored screen projection provided in some embodiments of the present application;

[0055] Fig. 9 A schematic diagram of changes in the user interface in interval mode when playing a live broadcast screen projection pushed by VideoURL provided in some embodiments of the present application;

[0056] Fig.10 A schematic diagram of changes in the user interface in the timing mode when playing mirrored screen projection provided in some embodiments of the present application;

[0057] Fig.11Schematic diagram of changes in the user interface in the timing mode when playing the live broadcast type screen projection pushed by VideoURL in some embodiments of the present application Figure 1 ;

[0058] Fig.12 Schematic diagram of changes in the user interface in the timing mode when playing the live broadcast type screen projection pushed by VideoURL in some embodiments of the present application Figure 2 ;

[0059] Fig.13 Schematic diagram 3 of the changes in the user interface in the timing mode when playing the live broadcast screen projection pushed by VideoURL in some embodiments of the present application;

[0060] Fig.14 Timing interaction of the screen projection mode processing method provided in some embodiments of the present application Figure 1 ;

[0061] Fig.15A A timing interaction diagram of a method for processing a screen projection mode in a scenario where live media resources are pushed via VideoURL provided in some embodiments of the present application;

[0062] Fig. 15B A timing interaction diagram of a screen projection mode processing method in a mirror screen projection scenario provided by some embodiments of the present application;

[0063] Fig.16 Timing interaction of the screen projection mode processing method provided in some embodiments of the present application Figure 2 ;

[0064] Fig.17 FIG3 is a timing interaction diagram of the screen projection mode processing method provided in some embodiments of the present application. DETAILED DESCRIPTION

[0065] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0066] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0067] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0068] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0069] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0070] In the embodiments of the present application, the display device generally refers to a device with image display and data processing capabilities. For example, the display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0071] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application.

[0072] like Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0073] The mobile terminal 300 can be used as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0074] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0075] like Figure 1As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0076] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0077] Figure 2 A schematic diagram of the hardware configuration of a display device provided for some embodiments of the present application.

[0078] In some embodiments, see Figure 2 The display device 200 may include at least one of a tuner and demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0079] In some embodiments, the tuner-demodulator 210 can receive broadcast television signals via wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing, and resonance, so as to demodulate the audio and video signals carried in the frequency of the television channel selected by the user, as well as additional information (such as EPG data) from multiple wireless or wired broadcast television signals.

[0080] In some embodiments, tuner 210, based on user selection and controlled by controller 250, responds to the frequency of a user-selected television channel and the broadcast television signal carried by that frequency.

[0081] In some embodiments, the tuner-demodulator 210 can receive signals in a variety of ways depending on the broadcasting format of the broadcast television signal, including but not limited to: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and can implement digital modulation or analog modulation according to different modulation types; and can demodulate analog signals and digital signals according to different types of received broadcast television signals.

[0082] In some embodiments, the tuner 210 may also be in an external device, such as an external set-top box, etc. In this way, the set-top box outputs the broadcast television signal after modulation and demodulation, and transmits it to the display device 200 through the device interface 240 .

[0083] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0084] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0085] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0086] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 to the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 to the external device through a wireless signal or a wireless network. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc. The display device 200 can establish a screen projection connection with an external device (such as a terminal device) through different screen projection protocols.

[0087] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0088] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0089] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0090] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0091] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0092] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0093] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0094] Figure 3A A schematic diagram of the software configuration of a display device provided in some embodiments of the present application.

[0095] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3A As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0096] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0097] In some embodiments, see Figure 3A , the application layer can run multiple applications, such as application 1, application 2, application 3, etc. In order to solve the related problems raised in the background technology, the embodiment of the present application provides an application, which is exemplarily named "mode application". The mode application runs in the application layer, and the controller (including at least one processor) can implement the screen projection mode processing method provided in the embodiment of the present application by running the mode application.

[0098] In some embodiments, the controller can configure and display the projection mode by running the mode application. The mode application can configure at least one trigger condition (also known as: continuation end condition) and mode action (also known as: mode operation, target operation, etc.) of the projection mode, so that when the trigger condition is met, the mode application can switch to the corresponding projection mode and execute the mode action corresponding to the projection mode (for example, disconnect the projection, or play the projection media, etc.). The projection mode includes but is not limited to: timing mode, timing mode, interval mode, etc. Among them, the timing mode refers to disconnecting the projection connection when the system time of the display device reaches the preset time. The interval mode refers to the user's projection viewing time (or played time) every first preset time interval, pausing or blocking the playback of the projection media, and continuing to play the projection media after a rest transition of the second preset time. The interval mode in different usage scenarios is presented as an eye protection mode, a halftime break mode, etc. The timing mode refers to disconnecting the projection connection when the played time of the projection media reaches the third preset time. The purpose of these screen projection modes is to restrict users' screen projection viewing behavior and prevent users from watching screen projection content for a long time without restraint, which may cause problems such as eye fatigue and staying up late.

[0099] In some embodiments, when the display device displays at least one projection content, the controller can run a mode application, monitor the triggering conditions of the projection mode through the interaction and information flow between modules within the mode application, execute the mode actions of the projection mode, and refresh the content and template / layout displayed in the user interface to adapt to the projection mode.

[0100] In some embodiments, the mode application can preset interface templates corresponding to mode actions of multiple different projection modes. For example, in the timing mode, if it is detected that the system time reaches the preset time (i.e., the trigger condition of the timing mode is met), the interface template can be configured to display a prompt message on the user interface to prompt that the preset time has been reached, and ask the user whether to confirm to disconnect the projection. For another example, in the interval mode, when the projection has been broadcast for a first preset time (i.e., the trigger condition of the interval mode is met), the interface template can be configured to display a preset template page on the upper layer of the projection playback interface, and the preset template page can be specifically a preset blocking page to block / shield the display of the projection media. The preset template page is used to prompt the playback of the projection media after the second preset time. In this way, the mode application can monitor the trigger conditions of multiple projection modes, and when the trigger conditions of any first projection mode are met, according to the interface template preset by the first projection mode, the View and UI elements in the user interface that have changed due to entering the first projection mode are dynamically updated, so as to realize the trigger condition monitoring, display control and action execution of the projection mode in the same application.

[0101] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access resources in the system and obtain system services during execution. Applications (including mode applications) can access resources in the system and obtain system services and required information through the API interface. For example, mode applications can obtain information such as the number of projection channels, projection device information, device connection status, current signal source category, etc. from the lower layer (for example, the kernel layer) through the API interface (for example, the Fl ow interface, etc.).

[0102] See also Figure 3AIn the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0103] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0104] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0105] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3A As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0106] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0107] After the display device establishes a projection connection with the projection device, if the display device and the projection device do not disconnect the projection connection, based on the projection connection, the projection device can continuously push the projection content to the display device, and the display device can continuously play the projection content.

[0108] In some embodiments, the user can manually disconnect the screen projection connection through either the display device or the projection device, so that the projection device cannot push the projection content to the display device, and the display device stops broadcasting the projection content.

[0109] In some embodiments, a play button may be provided on the screen projection playback interface, and when the play button is triggered, it can be used to switch the playback state of the screen projection content. In this way, the user can click the play button to switch the screen projection content to the pause playback state, thereby stopping the continued playback of the screen projection content.

[0110] The above-mentioned embodiment stops the continued broadcast of the screen projection content through manual operation by the user, which requires the user to input manual operation multiple times, affecting the control efficiency of the screen projection playback. In addition, the user may stop the continued broadcast of the screen projection in different scenarios. For example, the user generally goes to bed before 22:00, then the user needs to pay attention to observe the time, or set an alarm reminder, etc., to know that it is time to rest at night, so as to manually disconnect the screen projection connection. In this way, on the one hand, the efficiency of human-computer interaction is low, and the user needs to manually perform corresponding operations for different scenarios (such as disconnecting the screen projection, pausing playback, etc.). On the other hand, the user needs to manually determine the end condition of the continued broadcast. Once the user forgets the time, the screen projection may continue to play uninterruptedly, affecting the user's rest.

[0111] The following embodiments of the present application provide a screen projection continuation termination condition determination and screen projection playback control scheme based on a time management mechanism. The principle of the scheme is: after establishing a screen projection connection and starting to play the projection content, the controller can determine whether the continuation termination condition for the target film source is met based on the acquired playback time data and continuation time data; if the continuation termination condition is met, the controller can execute a screen projection disconnection operation or a pause operation for playing the projection content based on the settings of different projection modes; otherwise, if the continuation termination condition is not met, the projection content continues to be played. In this way, after the projection content starts to play, the playback time data and the continuation time data are used to determine the continuation termination condition of the film source, so that when the continuation termination condition is met, the controller automatically disconnects the screen projection connection or pauses playing the film source, thereby avoiding the projection device from continuously pushing the projection content and avoiding the display device from continuously playing the projection content, thereby realizing intelligent control of screen projection playback based on the time management mechanism, improving the accuracy of projection mode processing, reducing user manual mode intervention, and improving projection processing efficiency and human-computer interaction efficiency.

[0112] Figure 3B The software architecture diagram of the mode application provided in some embodiments of the present application. The controller can implement the screen projection mode processing solution based on the time management mechanism of the present application by running the mode application.

[0113] See also Figure 3B The software architecture of mode switching includes but is not limited to: screen projection management module 201, data management module 202, message processing module 203, View management module 204, mode management module 205, sound management module 206, location management module 207, algorithm processing module 208, application interaction processing module 209, service management module 210, replacement management module 211, broadcast control management module 212, time management module 213, focus management module 214, screen projection source analysis module 215, etc.

[0114] In some embodiments, the screen projection management module 201 is used to perform protocol interaction with the screen projection device through the screen projection service, manage the connection and disconnection of the screen projection, manage the status and list of the screen projection device, etc. Among them, the screen projection protocol is not limited, for example, Miracast, AirPlay, DLNA, etc. can be used.

[0115] In some embodiments, the data management module 202 is used to manage the information and data involved in different modes of the mode application, and to synchronously update the relevant information and data.

[0116] In some embodiments, the message processing module 203 is used to implement message transmission and flow between modules in the pattern application.

[0117] In some embodiments, the View management module 204 is used to control the interface display and update of different projection modes included in the mode application.

[0118] In some embodiments, the mode management module 205 is used to store mode information of at least one screen projection mode, and the mode information includes mutually related trigger conditions and mode actions. In this way, when the display device displays the projection content, the mode management module 205 can monitor the trigger conditions of each projection mode. If the trigger condition of the first mode (or the condition for the end of the continued broadcast) is met, it switches to the first projection mode, and notifies other related modules to perform matching mode actions (or target operations) according to the projection source information provided by the projection source analysis module 215. Among them, the projection source information includes the projection source type, and the projection source type includes but is not limited to: mirror projection and VideoURL (video link projection), etc. Among them, mirror projection refers to the projection device recording the screen content of the local end by means of screen recording and the like and pushing it to the display device synchronously; VideoURL refers to the projection device pushing the URL (i.e., resource link, also known as resource address) of the media resource to the display device, so that the display device can obtain the projection data from the server by accessing the URL. The screen projection media resources pushed by VideoURL can also be further divided into live media resources (real-time streams) and non-live media resources (such as movies, TV series and other source media resources pushed by URL).

[0119] In some embodiments, the mode management module 205 can also be used to configure interface templates corresponding to different projection modes and projection source types (hereinafter referred to as: mode templates). The mode templates are used to specify the interface content and layout characteristics under different modes and projection source types, thereby providing a basis for the View management module 204 to display and update the user interface when the mode application executes the mode action.

[0120] In some embodiments, for the timing mode, the mode template set by the mode management module 205 is, for example: a prompt page is displayed on the upper layer of the screen projection playback interface, and the prompt page includes countdown information and prompt information a. Among them, the countdown information displays a countdown starting from a first threshold time (for example, 5 seconds). An exemplary prompt information a is used to prompt that the preset time has been reached before the countdown is reset, and the screen projection is about to be disconnected, and ask the user whether to agree to disconnect the screen projection. In this way, before the countdown is reset, the user can agree or refuse to disconnect the screen projection.

[0121] In some embodiments, it is assumed that the time interval corresponding to the interval mode is [T m ,T n ], where T m is the starting time node (or starting moment) of the interval mode, T n is the end time node (or end time) of the interval mode, T n =Tm +T0, T0 is the duration of the interval mode. For the interval mode, the mode template set by the mode management module 205 is, for example, m The node displays the prompt information b and the preset occlusion page in turn, and n The node displays prompt information c. Among them, prompt information b is used to prompt entering the interval mode. The preset shielding page is used to shield the screen casting playback interface below so that the user cannot continue to watch the screen casting content. The preset shielding page can prompt the screen casting content to be played after T0 duration.

[0122] In some embodiments, the text content of the prompt information c is related to the screen projection source information. If the screen projection source type is mirror projection, the prompt information c is exemplarily prompted as "Interval mode ends, please continue watching". If the screen projection source type is VideoURL and it is a live media resource, and in T n If the live broadcast of the screen-casting media resource at the node has not ended, the prompt information c is exemplarily prompted as "Interval mode ends, please continue watching". If the screen-casting source type is VideoURL and it is a live broadcast media resource, and at T n If the live broadcast of the projection media resource at the node has ended, the prompt information c may exemplarily prompt "the interval mode has ended, and the live broadcast of the projection content has ended."

[0123] In some embodiments, for the timing mode, the timing mode is entered when the projection media starts to play, and the timer (Timer) starts counting up. The timer can be used to count the length of time the projection media has been played. The mode template set by the mode management module 205 is, for example: when the start time T1 of the projection content is reached, prompt information d is displayed on the upper layer of the projection playback interface; when the timing time reaches the preset length T2, that is, when the system time reaches T1+T2, countdown information and prompt information e are displayed on the upper layer of the projection playback interface. Among them, prompt information d is used to prompt "the timing of the projection viewing time starts".

[0124] In some embodiments, the text content of the prompt information e is related to the screen projection source information. If the screen projection source type is mirror projection, the prompt information e is used to prompt that the specified screen projection viewing time has been reached, and ask the user whether to agree to disconnect the screen projection. If the screen projection source type is VideoURL and it is a live media asset, and the live broadcast of the screen projection media asset has not ended when the T1+T2 moment is reached, the prompt information e prompts that the specified screen projection viewing time has been reached, and asks the user whether to agree to disconnect the screen projection. If the screen projection source type is VideoURL and it is a live media asset, and the live broadcast of the screen projection media asset has ended before the T1+T2 moment is reached, the prompt information c is used to prompt that the live broadcast of the screen projection content has ended (the specified screen projection viewing time has not been reached).

[0125] It should be noted that the mode management module 205 can adaptively configure the mode information and mode template corresponding to each projection mode according to the characteristics of different modes and scenario requirements, and is not limited to the examples of the embodiments of the present application.

[0126] In some embodiments, the sound management module 206 is used to process the sound of the projection source in different modes, such as mute, unmute, volume control, etc.

[0127] In some embodiments, assuming that in the interval mode, the sound management module 206 can m Set the current projection screen to setMute(true) at the node, and n At the node, set the current projection screen to setMute(false). Among them, setMute() is used to control whether the sound is muted. setMute(false) is used to set the sound to non-muted / sounding, and setMute(true) is used to set the sound to mute / no sound. In this way, in [T m ,T n ] Within the interval, the projected screen is blocked by the preset masking page, and the projection sound is also muted, thereby shielding the user from the projection media and making it impossible for the user to watch the projection content in the interval mode, thereby achieving the purpose of eye protection and halftime break.

[0128] In some embodiments, the position management module 207 is used to set the display position distribution of multiple projection windows in a multi-projection scenario according to the connection status of multiple projection sources and the focus of the interface. Taking the display device connected to three projections as an example, namely projection A, projection B and projection C, the position management module 207 can set the relative positions of projection A, projection B and projection C in the interface. Assuming that projection A is earlier than projection B and projection C is the latest connected, the three projections can be arranged in the order of access time, for example, projection A is set on the left side of the upper area of ​​the interface, projection B is set on the right side of the upper area of ​​the interface, and projection C is set in the center of the lower area of ​​the interface.

[0129] In some embodiments, if projection screen A is disconnected and projection screen D is newly connected, the position management module 207 can keep the positions of projection screens B and C unchanged in the interface, and set projection screen D at the position of the original projection screen A to avoid the problem of poor projection viewing effect caused by the displacement and shaking of the projection content. For another example, when projection screen D is connected, if the focus falls on the window of projection screen B, projection screen B at the focus position can be replaced by projection screen D, and the positions of the original projection screens A and C remain unchanged.

[0130] It should be noted that the position management module 207 can configure the positioning rules of multiple projection screens according to the mode category and the number of projection screens. When any projection screen source is connected or disconnected, the position management module 207 can reconfigure the display position distribution of each projection screen window in the user interface based on the change in the number of projection screens.

[0131] In some embodiments, the algorithm processing module 208 is used to adaptively and dynamically match the UI typesetting and layout under different projection modes and projection paths, including matching the sizes (including width and height) and display positions (such as the position coordinates of key points of the projection window) of different Views and projection windows in the user interface, thereby providing parameter basis for the View management module 204 to update the user interface.

[0132] In some embodiments, the application interaction processing module 209 is used to implement interaction with other external applications when switching modes. For example, mode setting / switching can set multiple startup entries, including but not limited to mode options presented after calling up the mode menu, voice entry, etc. These startup entries can interact with the application interaction processing module 209 and perform different customized management according to the differences and categories of the startup entries.

[0133] In some embodiments, the service management module 210 is used to start the mode application, manage the opening and closing of related services involved in the mode application, and customize specific services in specific scenarios and modes.

[0134] In some embodiments, the replacement management module 211 is used to replace a previous screen projection according to the replacement rules when the number of screen projection channels exceeds the upper limit of the display device's bearing capacity, so that the most recently connected screen projection can be displayed. For example, the display device supports up to three screen projection channels. At this time, the display device has connected screen projections A, B, and C. If screen projection D is received, the replacement management module 211 can make screen projection D replace the earliest connected screen projection A, thereby updating to screen projections B, C, and D. For another example, when the display device receives screen projection D, if the interface focus falls on the window of screen projection B, the replacement management module 211 can make screen projection D replace screen projection B where the focus is, thereby ensuring that the latest screen projection can be connected and displayed. It should be noted that the replacement rules configured by the replacement management module 211 are not limited to the embodiments of the present application, and adaptive replacement rules can be set according to different scenarios and different modes.

[0135] In some embodiments, the broadcast control management module 212 is used to control the playback of the media content of the projection source in different modes. For example, when the focus is on projection A, the broadcast control management module 212 can fast forward, rewind, double speed, pause playback, resume playback, etc. on projection A. It should be noted that the broadcast control management module 212 can perform different broadcast control processing according to the media type of the playback content. For example, video content can be fast forwarded, rewinded, double speed control, paused, volume, etc., and text content can be zoomed, font adjusted, annotated, marked, etc.

[0136] In some embodiments, the time management module 213 is used to process time events involved in the operation of different modes. For example, the projection window may be configured with some additional content such as controls, icons or prompt information, and these additional contents will be automatically hidden after displaying for a preset time. Therefore, the time management module 213 can start counting up or counting down when these additional contents begin to be displayed, and after the timing reaches the preset time, the message processing module 203 notifies the view management module 204 to hide or cancel the display of these additional contents.

[0137] In some embodiments, for example, when prompt information a is displayed in the timing mode, the time management module 213 starts a timer (Timer) and controls the timer (Timer) to count down from a first threshold time (e.g., 5 seconds), so that the user can choose whether to disconnect the screen projection during the countdown. When the countdown is reset to zero, the View management module 204 cancels the prompt information a.

[0138] In some embodiments, for example, in interval mode, if the projection source is a mirror projection or a live media asset pushed by a VideoURL, the time management module 213 can start a timer (Timer) when the projection media asset starts playing, and control the timer (Timer) to count up to record the elapsed time of the projection media asset. When the elapsed time of the projection media asset reaches the first preset time, the interval mode is started, and the mode application can block the playback of the projection media asset (mute and block the playback interface of the projection media asset). When the elapsed time reaches the first preset time and the second preset time, where the second preset time is the duration of the interval mode, the projection media asset continues to play.

[0139] In some embodiments, for example, in interval mode, if the projection source is a mirror projection or a live media asset pushed by a VideoURL, the time management module 213 can start a timer (Timer) when the projection media asset starts broadcasting, control the timer (Timer) to count up, and start the interval mode when the timing time of the timer reaches a first preset duration. When switching to interval mode, the time management module 213 can clear the timer and re-control the timer to count, and exit the current interval mode when the timing time reaches a second preset duration. When exiting interval mode, the time management module 213 can clear the timer and re-count, and when the timing time reaches the first preset duration, start the next round of interval mode. By analogy, during the playback of projection media assets, multiple rounds of interval modes can be cycled to avoid problems such as fatigue and lack of concentration caused by users watching projection media assets for a long time.

[0140] In some embodiments, for example, in timing mode, the time management module 213 can start the timer (Timer) at the start time of the projection media, control the timer (Timer) to start counting up to record the broadcast time of the projection media, and set the upper limit of the timer (Timer) to the third preset time. In this way, when the timing time of the timer (Timer) reaches the third preset time, the View management module 204 displays the prompt message e. Positive timing refers to increasing the time second by second from 0 until the timer timing upper limit is reached, and the timing upper limit is related to the continued broadcast time data. Countdown refers to decreasing the time second by second from the first threshold time until the timing time of the timer is reset to zero.

[0141] In some embodiments, the playback time data includes but is not limited to at least one of the following parameters: a preset time set in the timing mode, a first preset duration and a second preset duration set in the interval mode, and a third preset duration set in the timing mode.

[0142] In some embodiments, when the time management module 213 controls the timer (Timer) to count up or count down, the view management module 204 can also synchronously display the timing information. For example, when the view management module 204 displays the prompt information a or the prompt message e, the countdown information is updated synchronously with the timer (Timer). When the time management module 213 detects that the countdown is cleared, the view management module 204 is notified to cancel the display of the countdown information, and cancel the prompt information a or the prompt message e.

[0143] In some embodiments, the focus management module 214 is used to process the focus involved in the operation of the mode application, such as responding to user key operations, controlling the display, hiding and movement of the focus, recording focus information, etc., where the focus information includes but is not limited to the focus position, focus display status, etc., and the focus information can be synchronized to other related modules through the message processing module 203.

[0144] In some embodiments, the focus management module 214 can synchronize the focus information to the position management module 207 through the message processing module 203, so that the position management module 207 decides the position arrangement of multiple projection windows according to the focus information. The focus management module 214 can also synchronize the focus information to the broadcast control management 212 through the message processing module 203, so that the broadcast control management 212 can play the projection source with focus according to the focus information. The focus management module 214 can also synchronize the focus information to the view management module 204 through the message processing module 203, so that the view management module 204 can display the focus, and so on.

[0145] In some embodiments, the projection source analysis module 215 is used to analyze the projection source Session maintained by the projection management module 201 to obtain projection source information. The projection source information includes but is not limited to the projection source type and the media asset playback type. Among them, the projection source type includes but is not limited to mirror projection (Mirror), video link projection (VideoURL), etc. The media asset playback type includes but is not limited to two major categories, namely live media assets (real-time streaming) and film source media assets (non-live broadcast). The film source media assets include dramas, movies, entertainment, news, cartoons, education and other subcategories.

[0146] In some embodiments, the screen projection source analysis module 215 can obtain the screen projection source type from the Session object of the screen projection source through the screen projection protocol.

[0147] In some embodiments, if the projection source type is VideoURL, the projection source analysis module 215 can obtain the duration, Seek status, MIME (Multipurpose Internet Mail Extensions) and other information of the media pushed by the projection through the projection protocol to determine whether the projection source pushes live media.

[0148] In some embodiments, if the duration of the media resource is equal to zero and the media resource cannot perform a Seek action, the screen projection source analysis module 215 determines that the media resource pushed by the screen projection source is a live broadcast type.

[0149] In some embodiments, if the MIME is configured as "application / x-mpegURL" or "video / MP2T", etc., the screen projection source analysis module 215 determines that the media resource pushed by the screen projection source is a live broadcast type.

[0150] In some embodiments, the projection source analysis module 215 can obtain the media information of the Session object of the projection source through the projection protocol, and the media information can include metadata of the film source. The metadata includes but is not limited to: the title, actors, directors, release date, style tags (such as action, comedy, suspense, etc.), duration, and other information of the film source.

[0151] In some embodiments, the projection source analysis module 215 can determine whether the projection source is a source type projection pushed by VideoURL based on metadata. For example, if the media resource information indicates that it is a non-live resource such as a movie or TV series, the duration is greater than 0, the projection content can perform a Seek action, or the MIME is not a live configuration, then the projection source analysis module 215 can determine that the projection source type is VideoURL and the media resource playback type is a source type.

[0152] The above introduces the functional configuration of each module in the mode application. The following will combine the specific mode application scenarios to explain the specific execution procedures of each module in the mode application and the interaction and flow of information data between modules, so as to realize the mode application to automatically monitor the trigger conditions of the projection mode, and execute the associated mode action when the trigger conditions of any mode are met. It should also be noted that the modules in the mode application can be added, deleted or replaced according to the functional configuration and playback scenario of the projection mode.

[0153] In some embodiments, after establishing a screen projection connection with the screen projection device, the screen projection device pushes the screen projection media to the display device. The screen projection media can be a mirror screen projection, or the screen projection media can be a live screen projection pushed through a resource address (URL). The controller can be configured to execute: in response to receiving a screen projection instruction sent by the screen projection device, play the screen projection media; in the process of playing the screen projection media, obtain the play time data; if it is determined based on the play time data and the resume time data that the resume end condition is met, then execute the target operation; wherein the target operation includes disconnecting the screen projection operation or shielding the play of the screen projection media, and the play shielding operation is used to mute the screen projection media and switch it to an invisible state to shield the user from the viewing and listening of the screen projection media; if it is determined based on the play time data and the resume time data that the resume end condition is not met, then continue to play the screen projection media.

[0154] After the controller executes the scheme of the above embodiment, the following beneficial effects can be achieved: when the projection device sends projection media to the display device, the projection media can be mirror data (i.e., the screen content recorded by the projection device), or the resource address of the live media can be included in the projection instruction, and the display device can obtain and play the live media from the server according to the resource address; the display device can obtain the resume time data, and the resume time data includes time parameters related to the trigger conditions of different projection modes; the display device can also obtain the playback time data, and the playback time data is the relevant time parameters obtained in the process of establishing the projection connection and playing the projection media, so as to compare the playback time data and the resume time data. , it can be determined whether the conditions for ending the continued broadcast of the projected media resources are met; if the conditions for ending the continued broadcast are met, the projection operation can be disconnected or the playback shielding operation can be performed based on the settings of different projection modes. Otherwise, if the conditions for ending the continued broadcast are not met, the source will continue to be played. In this way, after the source starts playing, the playback time data and the continued broadcast time data are used to judge the conditions for ending the continued broadcast of the source. When the conditions for ending the continued broadcast are met, the controller automatically disconnects the projection connection or pauses the playback of the source, avoiding the display device from continuously playing the projection content, realizing intelligent control of projection playback based on the time management mechanism, improving the accuracy of projection mode processing, reducing user intervention in manual mode, and improving projection processing efficiency and human-computer interaction efficiency.

[0155] In some embodiments, after the display device is powered on, the controller may start Figure 3B The provided mode application determines whether the resuming end condition is met according to the playing time data and the resuming time data by running the mode application, thereby deciding whether to execute the target operation or continue to play the target film source.

[0156] In some embodiments, the controller can control the mode application to manage the screen projection source and obtain mode information when starting the screen projection. The mode information may include the resume time data and the mode action. According to the resume time data and the playback time data obtained during the playback of the screen projection content, it can be determined whether the trigger condition (or the resume end condition) is met. When the resume end condition is met, the corresponding operation is performed according to the mode action configured in the mode category. For example, the operation of disconnecting the screen projection connection can be performed in the timing mode and the timing mode, and the operation of pausing the playback of the film source can be performed in the interval mode.

[0157] In some embodiments, the above mode information may be preset before the screen casting starts, for example, by the user according to his / her own usage needs and preferences. That is, in this scenario, the mode management module 205 can directly read the mode information preset and stored in the local computer.

[0158] In some embodiments, when the screen-cast media asset starts playing, the View management module 204 may display a related mode setting page, and the user may set the mode information based on the mode setting page. That is, in this scenario, the mode information is obtained instantly by the mode management module 205 according to the user's setting operation based on the mode setting page when the screen-cast media asset starts playing.

[0159] In some embodiments, after the mode application starts running, the service management module 210 can perform initialization tasks, including but not limited to: the service management module 210 starts the screen projection service to listen to screen projection requests (connection) and / or exit screen projection requests (disconnection) initiated by other electronic devices, controls the View management module 204 to initialize the configuration of the View displayed by the application layer, controls the data management module 202 to create some preparation data, etc.

[0160] In some embodiments, after the initialization task is completed, the mode application can control the screen projection management module 201 to register the monitoring logic of UsessionConnectionListener, UsessionPrepareListener, USessionDisplayListener and UsessionEventListener. Among them, Session represents a conversation between the client and the server, and can record client information (also known as: device information). The client information is configured as {id=, type=, protocol=,...}, where id represents the device id of the client for identifying the client, type represents the type of the client, and protocol represents the screen projection protocol used by the client.

[0161] In some embodiments, UsessionConnectionListener is used to monitor changes in the connection status of the client in the Session, and the connection status includes a connected state and an unconnected state (or a disconnected state). UsessionPrepareListener is used to prepare for screen projection interaction with the client. UsessionDisplayListener is used to monitor changes in interface playback information, and the interface playback information includes but is not limited to playback content information and playback status, etc. UsessionEventListener is used to monitor client control events, etc. In this way, the screen projection management module 201 can monitor relevant information of the screen projection signal source (hereinafter referred to as: screen projection signal source information) through the screen projection service. The screen projection signal source information includes but is not limited to device information, connection status, etc. of the screen projection device.

[0162] In some embodiments, the screen projection management module 201 can send the screen projection signal source information to the message processing module 203, and the message processing module 203 forwards the screen projection signal source information to the data management module 202. The data management module 202 can create and store a screen projection device list based on the screen projection signal source information, and the screen projection device list includes relevant information of electronic devices (referred to as: screen projection devices) that have established screen projection connections with the display device 200. The underlying structure of an exemplary screen projection device list provided in an embodiment of the present application is as follows:

[0163] [{mInputName=screen projection device 1,

[0164] mIsConnected=true,

[0165] mInputSourceId=,

[0166] mVisible=true,

[0167] mSourceType=,

[0168] mSession=SessionBase{id=Client 1, type=, protocol=}…}]

[0169] Among them, mInputName is the device name set by the data management module 202 for the screen projection device, such as screen projection device 1, and the digital suffix of the screen projection device does not exceed the real-time screen projection number of the display device. mIsConnected indicates the connection status of the screen projection device, mIsConnected = true indicates the connected state, and mIsConnected = false indicates the unconnected state or disconnected state. If the screen projection device 1 is disconnected, the information of the screen projection device 1 can be deleted from the screen projection device list, or the mIsConnected status value corresponding to the screen projection device 1 can be changed to false. mInputSourceId is used to indicate the signal source ID of the screen projection device. mSourceType is used to indicate the signal source type; mVisible = true is used to indicate the display status of the signal source. If mVisible = true, it means that the screen projection content pushed by the screen projection device is in a visible state. If mVisible = false, it means that the screen projection content is invisible or hidden. mSession=SessionBase{id=Client1,type=,protocol=}…} is used to record the device information of the screen projection device, for example, the id of screen projection device 1 is Client1. The display device can have an upper limit on the screen projection capability, for example, it supports up to K-way screen projection, and the screen projection device list includes information of up to K screen projection devices with mIsConnected=true.

[0170] In some embodiments, when the screen projection service receives a screen projection request sent by the first screen projection device (Client 1), the screen projection management module 201 obtains the device information of the screen projection device contained in the screen projection request (hereinafter referred to as: first screen projection device information), and the structure of the first screen projection device information is, for example, {id=, type=, protocol=,…}, and synchronizes the first screen projection device information to the data management module 202 through the message processing module 203, so that the data management module 202 manages the first screen projection device information. Among them, an exemplary structure of the screen projection request is {"cmd":"REQUEST","data":"{\"info\":{\"id\":\"\",\"name\":\"\"},\"version\":,\"type\":}"}.

[0171] In some embodiments, if the user agrees to the screen projection request of the first projection device, or the number of projection channels does not reach the upper limit of the display device's projection capability (supporting up to K projection channels, where K is a positive integer greater than 1), indicating that the display device can receive the projection channel, the screen projection service can send a projection consent message to the first projection device through the projection protocol layer. An exemplary structure of the projection consent message is {"cmd":"ACK","data":"{\"version\":,\"ack\":,\"status\":\"\",\"reason\":\"\",\"type\":0}"}.

[0172] In this way, when the first screen projection device receives the screen projection consent message, it can perform tasks related to preparing for screen projection, such as establishing a screen projection connection with the display device, and then starting screen recording. After the screen recording is ready, it can send a screen projection ready message to the screen projection service through the screen projection protocol layer. Among them, an exemplary structure of the screen projection ready message can be configured as {"cmd":"REQUEST_DATA_OK","data":"{\"info\":{\"id\":\"\",\"name\":\"\"},\"version\":,\"type\":}"}.

[0173] In some embodiments, when the screen projection service receives the screen projection ready message, it can feedback an ACK message to the first screen projection device, so that the first screen projection device pushes the projection data of the second content to the display device when receiving the ACK message. Among them, an exemplary structure of the ACK message is {"cmd":"DATA_ACK","data":"{\"version\":,\"ack\":,\"status\":\"\",\"type\":0}"}.

[0174] In some embodiments, when the screen projection service receives a screen projection ready message, the screen projection management module 201 sends the first screen projection device information to the data management module 202 through the message processing module 203; the data management module 202 can insert the first screen projection device information in the screen projection device list, and set the device name of the first screen projection device (for example, projection device 1), connection status value (mIsConnected) and visibility status value (mVisible), etc.

[0175] According to the above processing flow, the mode application can monitor the screen projection requests of more electronic devices and complete the connection and reception of the screen projection until the number of screen projection channels reaches the upper limit K of the screen projection capability of the display device. If the K+1th screen projection is received, the replacement management module 211 can select the previous screen projection (hereinafter referred to as Z screen projection) as the replacement object, and notify the screen projection management module 201 to disconnect the connection of Z screen projection through the message processing module 203. In this way, the number of screen projection channels is reduced by one and is less than the K value, and the screen projection management module 201 can access the latest received K+1th screen projection.

[0176] In some embodiments, the first screen projection device receives the ACK message and can push the projection data and session information to the display device. The session information includes configuration information related to the projection data pushed by the first screen projection device. If the projection source type is mirror projection, an exemplary structure of the session information is:

[0177] {Session:SessionClient1,

[0178] View:SurfaceView / TextureView,

[0179] / / mirror video music pic,

[0180] type:mirror,

[0181] Ratio:0.47,

[0182] …}

[0183] Among them, SessionClient1 is used to indicate that the device ID associated with the Session is Client1.

[0184] View:SurfaceView / TextureView means that the projection content pushed by Client1 is displayed on the SurfaceView / TextureView of the display device.

[0185] type:mirror indicates that the screen projection source type pushed by Client1 is mirror projection, / / mirror video musicpic indicates that the mirror content includes video, music, etc.

[0186] Ratio is the aspect ratio of the projection content pushed by Client1, that is, the ratio of width to height.

[0187] If the projection source type is VideoURL, another exemplary structure of Session information is:

[0188] {Session:SessionClient1,

[0189] View:SurfaceView / TextureView,

[0190] / / VideoURL video,

[0191] type:VideoURL,

[0192] duration:0,

[0193] Seek:off,

[0194] MIME: video / MP2T;

[0195] Ratio:0.47,

[0196] …}

[0197] Among them, type:VideoURL indicates that the projection source type pushed by Client1 is VideoURL; duration indicates the duration of the projection media asset; Seek indicates the Seek state of the projection media asset, Seek:off indicates that the projection media asset cannot perform the Seek action, and Seek:on indicates that the projection media asset can perform the Seek action; MIME indicates Multipurpose Internet Mail Extensions.

[0198] In some embodiments, after the screen projection service receives the projection data and session information, the screen projection management module 201 can forward the session information to the data management module 202 through the message processing module 203, so that the data management module 202 stores the session information, and forward the projection data to the screen projection source analysis module 215 through the message processing module 203, so that the screen projection source analysis module 215 obtains the projection source information according to the session information of the screen projection device.

[0199] In some embodiments, the screen projection source analysis module 215 can read the type attribute value configured in the Session information. If it is type:mirror, the screen projection source information indicates that the screen projection source is mirror projection.

[0200] In some embodiments, the screen projection source analysis module 215 can read the type attribute value configured in the Session information. If it is type:VideoURL, the screen projection source analysis module 215 further queries duration, Seek and MIME to provide accurate screen projection source information.

[0201] In some embodiments, if duration=0 and Seek:off is satisfied, the screen projection source information provided by the screen projection source analysis module 215 is used to indicate that the screen projection media asset is a live broadcast media asset pushed via a video link.

[0202] In some embodiments, if MIME: video / MP2T, or MIME: application / x-mpegURL, etc., the screen projection source information provided by the screen projection source analysis module 215 is used to indicate that the screen projection media asset is a live broadcast media asset pushed through a video link.

[0203] In some embodiments, if duration is greater than 0, Seek: on, or MIME is not a preset live broadcast attribute value, and the metadata indicates that the projection media asset is the target film source, then the projection source information provided by the projection source analysis module 215 is used to indicate that the projection media asset is a non-live broadcast media asset (or film source media asset) pushed through a video link.

[0204] In some embodiments, the screen projection source analysis module 215 can forward the screen projection source information to the mode management module 205 through the message processing module 203. The mode management module 205 obtains the playback time data during the screen projection playback process based on the mode information of at least one screen projection mode that has been obtained, and determines whether the continuation end condition is met through the playback time data and the continuation time data contained in the mode information. Determining whether the continuation end condition is met is actually to determine whether the trigger condition of a certain screen projection mode is met. When the trigger condition of any first screen projection mode is met, the target mode action (also called target operation) to be executed that matches the screen projection source information and the mode type can be determined specifically. Through the flow between other modules, the mode application executes the mode action and controls the display and refresh of the user interface.

[0205] In some embodiments, the playback time data includes but is not limited to at least one of the following parameters: the system time of the display device, the playback time of the projected media, etc.

[0206] In some embodiments, the algorithm processing module 208 may obtain the Session information of the first screen projection device (Client 1) from the data management module 202, and obtain the aspect ratio Ratio of the screen projection content from the Session information.

[0207] In some embodiments, the algorithm processing module 208 can calculate the layout data according to the screen resolution (e.g., 1920*1080) and parameters such as Ratio. The layout data includes the size (width Width1*height Height1) and display position (x1, y1) of SurfaceView / TextureView. SurfaceView / TextureView is used to display the projection content pushed by Client1. An exemplary data structure of the layout data generated by the algorithm processing module 208 is as follows:

[0208] {Session:SessionClient1,

[0209] View:SurfaceView / TextureView,

[0210] Position:(x1,y1),

[0211] width:Width1,

[0212] height:Height1,

[0213] …}

[0214] In some embodiments, the algorithm processing module 208 can send the layout data to the data processing module 202 and the View management module 204 respectively through the message processing module 203, so that the data processing module 202 can sort and store the layout data, and the View management module 204 can display the projection content in SurfaceView / TextureView according to the layout data.

[0215] In some embodiments, after receiving the layout data, the View management module 204 can set the display parameter information through the LayoutParams interface, and the display parameter information includes parameters that can be recognized and set by the display and generated according to the layout data. An exemplary data structure of the display parameter information is as follows:

[0216] FrameLayout.LayoutParams lp1=new FrameLayout.LayoutParams(width,height,0);

[0217] lp1.width = Width1;

[0218] lp1.height = Height1;

[0219] lp1.leftMargin = x1;

[0220] lp1.topMargin = y1;

[0221] mPlayerView.setLayoutParams(lp1);

[0222] In this way, the View management module 204 sets the size and display position of the SurfaceView / TextureView according to the display parameter information, and loads the projection data pushed by Client1 into the SurfaceView / TextureView, thereby completing the display of the projection content.

[0223] Figure 4A Schematic diagram of the timing mode setting method provided in some embodiments of the present application. The user can open the projection mode setting page through the system settings, mode application or other access portal to pre-customize the setting mode information. Alternatively, the View management module 204 can display the projection mode setting page when the projection starts, so that the mode management module 205 can obtain the mode information immediately.

[0224] In some embodiments, see Figure 4A In the sub-figure (a), the projection mode setting page 40 includes panels corresponding to N projection modes (referred to as projection mode panels). Exemplarily, the projection mode panels include a timing mode panel 41, an interval mode panel 42, and a timing mode panel 43. Among them, the timing mode panel 41 is used to set and manage the timing mode, the interval mode panel 42 is used to set and manage the interval mode, and the timing mode panel 43 is used to set and manage the timing mode.

[0225] In some embodiments, see Figure 4A In sub-picture (a), each projection mode section includes an add button (presented as “+” in the example of FIG. 4 ).

[0226] When the user clicks the add button of the timing mode section 41, see Figure 4A In the sub-figure (b), the display shows the timing mode setting page, and the timing mode setting page includes a first mode name setting control 41a. The first mode name setting control 41a is used to allow the user to input the name of the timing mode, such as "timing mode A".

[0227] In some embodiments, see Figure 4A In the sub-figure (b), the timing mode setting page also includes a first trigger condition setting control 41b. The timing mode can be configured to trigger the display device when the system time reaches a fixed preset time T y The first trigger condition setting control 41b is used to allow the user to set the preset time T y, for example, set to 21:30. In this way, the resume time data may include the preset time T y .

[0228] In some embodiments, see Figure 4A In the sub-figure (b), the timing mode setting page also includes a first mode action setting control 41c. The timing mode can be configured to be set when the system time of the display device reaches a preset time T y The first mode action setting control 41c is used to allow the user to set the mode action of the timing mode, for example, to "disconnect screen projection" or "shutdown".

[0229] In some embodiments, see Figure 4A In the sub-figure (b), the timing mode setting page also includes a first cancel button 41d and a first save button 41e. The first cancel button 41d is used to cancel the timing mode setting. When the first cancel button 41d is triggered, the display closes the timing mode setting page. The first save button 41e is used to save the timing mode. When the first save button 41e is triggered, the mode application can save the acquired timing mode information to the mode management module 205. The timing mode information example is {mode name: timing mode A, trigger condition: preset time T y =21:30, mode action: disconnect screen projection}.

[0230] Figure 4B This is a schematic diagram of the interval mode setting method provided in some embodiments of the present application. Figure 4B In the sub-figure (a), the controller responds to the user triggering the operation of adding the button of the interval mode plate 42, see Figure 4B In the sub-figure (b), the display is controlled to display the interval mode setting page, and the interval mode setting page includes a second mode name setting control 42a. The second mode name setting control 42a is used to allow the user to input the name of the interval mode, such as "interval mode A".

[0231] In some embodiments, see Figure 4B In sub-figure (b), the interval mode setting page also includes a second trigger condition setting control 42b. The interval mode is used to allow the user to rest for a second preset time t2 every first preset time t1 when watching the projection screen, so as to achieve the purpose of halftime and avoid problems such as user eye fatigue and lack of concentration. The second trigger condition setting control 42b is used to allow the user to set the first preset time t1 and the second preset time t2, for example, the first preset time t1 is 60 minutes, and the second preset time t2 is 10 minutes. In this way, the resume time data can include the first preset time t1 and the second preset time t2.

[0232] In some embodiments, see Figure 4BIn sub-figure (b), the timing mode setting page also includes a second mode action setting control 42c. The second mode action setting control 42c is used to allow the user to set the mode action of the interval mode (i.e., set the working state of the screen projection during the halftime break), for example, to "pause the screen projection".

[0233] In some embodiments, see Figure 4B In sub-figure (b), the timing mode setting page also includes a second cancel button 42d and a second save button 42e. The second cancel button 42d is used to cancel the interval mode setting. When the second cancel button 42d is triggered, the display closes the interval mode setting page. The second save button 42e is used to save the interval mode. When the second save button 42e is triggered, the mode application can save the acquired interval mode information to the mode management module 205. An example of interval mode information is {mode name: interval mode A; trigger condition: t1 = 60min, t2 = 10min; mode action: pause screen projection}.

[0234] Figure 4C This is a schematic diagram of the timing mode setting method provided in some embodiments of the present application. Figure 4C In the sub-figure (a), the controller responds to the user triggering the operation of adding the button of the timing mode block 43, see Figure 4C In the sub-figure (b), the display is controlled to display the timing mode setting page, and the interval mode setting page includes a third mode name setting control 43a. The third mode name setting control 43a is used to allow the user to input the name of the timing mode, such as "timing mode A".

[0235] In some embodiments, see Figure 4C In sub-figure (b), the timing mode setting page also includes a third trigger condition setting control 43b. The timing mode can be configured to start timing from the start of screen projection, and the timing duration represents the cumulative playback time of the projection content (referred to as the playback duration), and the corresponding mode action is executed when the timing duration reaches the third preset duration t3. The third trigger condition setting control 43b is used to enable the user to set the third preset duration t3, for example, the third preset duration t3 is 2h. In this way, the continued broadcast time data can include the third preset duration t3.

[0236] In some embodiments, see Figure 4C In the sub-picture (b), the timing mode setting page also includes a third mode action setting control 43c. The third mode action setting control 43c is used to allow the user to set the mode action of the timing mode, for example, to "disconnect the screen projection".

[0237] In some embodiments, see Figure 4CIn sub-figure (b), the timing mode setting page also includes a third cancel button 43d and a third save button 43e. The third cancel button 43d is used to cancel the timing mode setting. When the third cancel button 43d is triggered, the display closes the timing mode setting page. The third save button 43e is used to save the timing mode. When the third save button 43e is triggered, the mode application can save the acquired timing mode information to the mode management module 205. An example of timing mode information is {mode name: timing mode A, trigger condition: t3 = 2h, mode action: disconnect screen projection}.

[0238] Depend on Figure 4A to Figure 4C It can be seen that the user can add the required projection mode and set the mode information of the projection mode by clicking the add button of any projection mode panel. The mode information may include at least one of the timing mode information, interval mode information and timing mode information.

[0239] Figure 4D Schematic diagram of the screen projection mode setting page provided in some embodiments of the present application. Figure 4D As shown in the figure, after the user has added a mode, the mode information will be displayed in the associated projection mode section. Figure 4A to Figure 4C In the example, the timing mode section 41 displays the timing mode information corresponding to the timing mode A, the interval mode section 42 displays the interval mode information corresponding to the interval mode A, and the timing mode section 43 displays the timing mode information corresponding to the timing mode A.

[0240] In some embodiments, Figure 4D As shown, each section can also configure the associated switch button, edit button and delete button for the added mode information. Among them, the switch button is used to turn on or off the mode, the edit button is used to edit and modify the mode information, and the delete button is used to delete the mode.

[0241] In this way, the mode management module 205 can store the mode information pre-set by the user through the projection mode setting page 40, or obtain and store the mode information based on the user's setting operation on the projection mode setting page 40 when the projection starts, and control and manage the projection of the display device according to the mode information. Among them, the mode information includes at least one trigger condition and mode action of the projection mode. For example, the trigger condition of timing mode A is 'the system time reaches 21:30', and the executed mode action is 'disconnect the projection'; the trigger condition of interval mode A is 'watching time every 60 minutes', and the executed mode action is 'blocking the projection playback for 10 minutes (10 minutes of halftime break)'; the trigger condition of timing mode A is 'the cumulative viewing time reaches 2 hours', and the executed mode action is 'disconnect the projection'.

[0242] For the above-mentioned timing mode, the playback time data includes the system time of the display device, and the resumed playback time data includes the preset time. In this way, the controller can be configured as follows: if the system time reaches the preset time, it is determined that the resumed playback end condition is met, the playback of the projection media is stopped, and the projection connection with the projection device is disconnected. The technical solution provided by this embodiment has the following beneficial effects: a scheme for determining the resumed playback end condition and the projection control operation based on the first time management mechanism (which can be called a timing mode) is provided, that is, when the system time reaches a fixed preset time, it is determined that the resumed playback end condition is met, then the controller disconnects the projection connection and stops playing the target film source, thereby avoiding the projection device from continuing to push the projection content to the display device based on the projection connection when the preset time is reached, and also avoiding the display device from continuing to play the projection content after exceeding the preset time, thereby avoiding affecting the user's work and rest due to the projection content playing time being too late.

[0243] In some embodiments, the controller can be configured to: when the system time reaches the preset time, control the display to display a first prompt message, the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the projection media and disconnect the projection connection with the projection device; if the user refuses to disconnect the projection connection, continue playing the projection media. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, a prompt message can be used to ask the user whether he agrees to disconnect the projection connection, and then based on the time condition of the timing mode, the user's viewing needs are added to decide whether to disconnect the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the film source continues to be played, thereby meeting the user's usage needs and preferences.

[0244] Figure 5A Schematic diagram of the change of the user interface when the triggering conditions of the timing mode are met in the mirror projection provided in some embodiments of the present application Figure 1 .

[0245] In some embodiments, the controller can be configured to: when the system time reaches a preset time, query the type of screen projection media; if the screen projection media is the screen content sent by the screen projection device, control the display to display a second prompt message, the second prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; if the user agrees to disconnect the screen projection connection, stop playing the screen projection media and disconnect the screen projection connection with the screen projection device; if the user refuses to disconnect the screen projection connection, continue to play the screen projection media. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the system time reaches a fixed preset time, for the screen projection media of the mirror projection type, since the screen projection connection needs to be disconnected if the mirror projection is to be stopped, the display device and the screen projection device must be in a connected state when the mirror projection can be received, so that the user can be asked whether to agree to disconnect the screen projection connection through a prompt message, and then on the basis of the time condition of the timing mode, the user's viewing needs are added to decide whether to disconnect the screen projection connection. If the user agrees, the screen projection connection is disconnected, and if the user refuses, the film source continues to be played to meet the user's viewing needs and preferences.

[0246] After the controller operation mode is applied, the timing mode can be processed as follows to determine the end condition of the screen projection media, so as to decide whether to disconnect the screen projection connection. Figure 5A As shown in sub-figure (a), assuming that the display device plays the projection content 1 pushed by the projection device 1 in full screen, the mode application can control the projection source analysis module 215 to parse the session information of the projection device 1 to obtain the projection source information, and forward the projection source information to the mode management module 205 through the message processing module 203, so that the mode management module 205 stores the projection source information corresponding to the projection content 1. The projection source information includes the projection source type (mirror projection or VideoURL), the media resource playback type (such as live media resources, film source media resources), etc.

[0247] In some embodiments, the mode management module 205 can obtain the playback time data according to the mode information, obtain the playback time data during the playback of the screen projection media, and determine whether the playback end condition is met by comparing the playback time data with the playback time data, and determine whether the trigger condition of a certain screen projection mode is met. y , then the timing mode is triggered, the timing mode can be associated with mode action A, and mode action A can be configured to disconnect the screen projection connection. In this way, the mode management module 205 can send a disconnect screen projection message to the screen projection management module 201 through the message processing module 203; the screen projection management module 201 responds to the disconnect screen projection message and disconnects the communication connection between the display device and the screen projection device 1 through the screen projection service (referred to as: screen projection connection).

[0248] In some embodiments, the timing mode is used to set the timer to a fixed preset time T y Disconnect the screen to avoid exceeding the preset time T y After that, the user still watches the projection content without restraint, so the mode action A in the timing mode can be configured to disconnect the communication connection with any protocol and type of projection source, including: disconnecting the mirror projection, and disconnecting the projection pushed by VideoURL (live broadcast or film source). In some embodiments, since the user's willingness to cast the screen may change at any time, the timing mode can add an associated mode action B1, which can be configured as follows: when the system time reaches the preset time T y When the user is prompted to disconnect the screen projection connection, the user is asked whether they agree to disconnect the screen projection connection to avoid forced disconnection when the user wants to continue watching the screen projection content. Mode action B1 is executed before mode action A, and mode action A is executed only when the user agrees to disconnect the screen projection. Otherwise, if the user refuses to disconnect the screen projection, mode action A is not executed.

[0249] In some embodiments, the mode management module 205 detects that the system time reaches the preset time T y When the timer mode is switched, the mode is switched to the timing mode, and the mode action B2 is executed: a first query instruction is sent to the View management module 204 through the message processing module 203, and a first timing instruction is sent to the time management module 213 through the message processing module 203.

[0250] In some embodiments, the View management module 204 responds to the first inquiry instruction by displaying the first inquiry content to inquire whether the user agrees to disconnect the screen projection connection in the timing mode. The first inquiry content can be presented to the user in the form of prompt information, pop-up window, etc.

[0251] In some embodiments, Figure 5A As shown in sub-figure (b) of , the View management module 204 can display an inquiry pop-up window 50 on the display in response to the first inquiry instruction. The inquiry pop-up window 50 is used to prompt that the preset time of the timing mode has been reached and ask the user whether to agree to disconnect the screen projection connection. The inquiry pop-up window 50 includes an agree button 51 and a reject button 52.

[0252] In some embodiments, the time management module 213 responds to the first timing instruction, and when the View management module 204 starts to display the query pop-up window 50, the time management module 213 can control the timer Timer1 to start counting up, and determine whether the timing time of Timer1 reaches the first threshold time (for example, 5 seconds). If the timing time of Timer1 reaches the first threshold time, the time management module 213 can send a first timing arrival message to the View management module 204 through the message processing module 203, and after the first timing arrival message is successfully sent, control Timer1 to stop timing and reset the timing time to zero.

[0253] In some embodiments, if the user agrees to disconnect the screen projection in the timing mode, the user can click the consent button 51 within the first threshold time. In response to the user clicking the consent button 51 and not receiving the first timing arrival message, the View management module 204 closes the inquiry pop-up window 50, sends a message of consent to disconnect the screen projection to the mode management module 205 through the message processing module 203, and sends a stop timing instruction to the time management module 213 through the message processing module 203. In response to the stop timing instruction, the time management module 213 controls Timer1 to stop timing and resets the timing time to zero.

[0254] In some embodiments, the mode management module 205 receives a message agreeing to disconnect the screen projection, and executes mode action A: sending a disconnect screen projection instruction to the screen projection management module 201 through the message processing module 203, so that the screen projection management module 201 responds to the disconnect screen projection instruction, calls the finish() interface of the Session object corresponding to the screen projection device 1, and the screen projection service sends a disconnect screen projection request to the screen projection device 1 through the protocol. The screen projection device 1 responds to the disconnect screen projection request, disconnects the screen projection connection with the display device, and feeds back a disconnect message to the display device, so that the screen projection management module 201 receives the disconnect message, can release the related resources occupied by the screen projection (such as a player, etc.), and notifies the View management module 204 through the message processing module 203 to cancel the screen projection content pushed by the screen projection device 1 in the SurfaceView / TextureView to stop playing the screen projection media.

[0255] In some embodiments, for live media pushed by VideoURL, the execution order of stopping the playback of the projection media and disconnecting the projection connection is not limited. The two operations can be performed simultaneously, or the playback of the projection media can be stopped first and then the projection connection can be disconnected, or the projection connection can be disconnected first and then the playback of the projection media can be stopped. For mirror projection, after the projection connection is disconnected, the mirror projection automatically stops transmitting, so that the display device automatically stops playing the mirror projection content.

[0256] In some embodiments, if the user wants to continue watching the screen projection content and refuses to disconnect the screen projection in the timing mode, the user can click the rejection button 52 within the first threshold time. In response to the user clicking the rejection button 52 and not receiving the first timing arrival message, the View management module 204 closes the inquiry pop-up window 50, sends a message of refusing to disconnect the screen projection to the mode management module 205 through the message processing module 203, and sends a stop timing instruction to the time management module 213 through the message processing module 203. The mode management module 205 receives the message of refusing to disconnect the screen projection and can exit the timing mode without executing mode action A. In response to the stop timing instruction, the time management module 213 controls Timer1 to stop timing and resets the timing time to zero.

[0257] In some embodiments, if the user neither clicks the agree button 51 nor the reject button 52 within the first threshold time, a timeout and no response event occurs. When the View management module 204 receives the first timing arrival message sent by the time management module 213, if the user does not click the agree button 51 or the reject button 52, the inquiry pop-up window 50 is closed, and a timeout and no response message is sent to the mode management module 205 through the message processing module 203. When the mode management module 205 receives the timeout and no response message, it can execute mode action A by default, thereby immediately disconnecting the screen projection connection. Among them, the first threshold time is a parameter configured in a timing mechanism. Through the timing mechanism, on the one hand, the user is asked about his willingness to disconnect / maintain the screen projection in a specific mode, and on the other hand, it can avoid the situation where the inquiry pop-up window 50 is always displayed due to the user's inaction for a long time, avoid the inquiry pop-up window 50 blocking the content displayed by the user interface, and avoid the screen projection disconnection waiting and delay caused by the timeout and no response event.

[0258] Figure 5B Schematic diagram of the change of the user interface when the triggering conditions of the timing mode are met in the mirror projection provided in some embodiments of the present application Figure 2 The mode management module 20 will be set to the default time T when the system time reaches the default time T y When the timing mode is triggered, mode action B2 can be executed, and mode action B2 can be configured as: sending a second query instruction to the View management module 204 through the message processing module 203, and sending a second timing instruction to the time management module 213 through the message processing module 203.

[0259] In some embodiments, see Figure 5BIn sub-figure (b), the View management module 204 can display the first prompt information 53 and the first countdown control 54 in response to the second query instruction. An example of the prompt content of the first prompt information 53 is "The preset time of timing mode A has been reached, and the screen projection will be disconnected. If you refuse, please press any key." The first countdown control 54 is used to display the remaining operational time for the user to refuse to disconnect the screen projection connection in a countdown manner.

[0260] In some embodiments, in response to sending the second timing instruction, the time management module 213 can control Timer1 to start the countdown and determine whether the remaining time of the countdown is reset to zero when the View management module 204 starts to display the first prompt information 53. When the countdown of Timer1 is reset to zero (i.e., becomes 0S), the time management module 213 can send a time reset message to the View management module 204 through the message processing module 203.

[0261] In some embodiments, the countdown method implemented by the time management module 213 is to start from the first threshold time, and count the time in a second-by-second manner until the countdown is cleared, and the countdown mechanism automatically terminates. Taking the first threshold time as 5S (seconds) as an example, the remaining time of the countdown is 5S, 4S, 3S, 3S, 1S, 0S in sequence, and the countdown control should be synchronized with the countdown of the time management module 213, that is, the countdown control dynamically presents a jump time change of 5S, 4S, 3S, 3S, 1S, 0S.

[0262] In some embodiments, if the user wants to continue watching the screen projection content and refuses to disconnect the screen projection in the timing mode, the user can input a rejection disconnection screen projection operation before the countdown is reset. The input method of rejecting the disconnection screen projection operation is not limited. For example, the user can click any button on the control device 100 (such as a remote control), or click a preset button. The preset button is not limited, such as a return button, an exit button, etc.

[0263] In some embodiments, the View management module 204 responds to the user input of refusing to disconnect the screen projection operation and does not receive the time reset message sent by the time management module 213, then cancels the display of the first prompt information 53 and the first countdown control 54, and sends a message of refusing to disconnect the screen projection to the mode management module 205 through the message processing module 203; the mode management module 205 receives the message of refusing to disconnect the screen projection, exits the timing mode, and does not execute mode action A.

[0264] In some embodiments, if the user agrees to disconnect the screen projection in the timing mode, there is no need to input any operation and wait for the countdown to be reset. When the View management module 204 receives the time reset message, if it does not receive a refusal to disconnect the screen projection operation, it cancels the first prompt message 53 and the first countdown control 54, and sends a message of consent to disconnect the screen projection to the mode management module 205 through the message processing module 203. The mode management module 205 receives the message of consent to disconnect the screen projection and executes mode action A: sends a disconnect screen projection instruction to the screen projection management module 201 through the message processing module 203. In this way, through the countdown mechanism, on the one hand, the user is asked about his willingness to disconnect / maintain the screen projection in a specific mode, and on the other hand, the first prompt message 53 is avoided from being displayed for a long time, thereby reducing the waiting time and delay for the screen projection to be disconnected.

[0265] In some embodiments, for mirrored screen projection, after the screen projection device 1 establishes a screen projection connection with the display device, the screen projection device 1 can synchronously transmit the recorded mirrored screen projection content to the display device, and the display device synchronously displays the mirrored screen projection content in the screen projection playback interface. If the screen projection connection between the screen projection device 1 and the display device is disconnected, that is, the mirror transmission channel is disconnected, the display device will not be able to obtain the mirrored screen projection content, and will automatically stop playing the mirrored screen projection content. Therefore, if the screen projection connection of the mirrored screen projection is disconnected before the system time reaches the preset time, then when the system time reaches the preset time, the mode management module 205 will detect that the screen projection connection is in a disconnected state, and the timing mode may not be triggered.

[0266] In some embodiments, after the controller executes the query of the type of screen projection media if the system time reaches the preset time, it is configured as follows: if the screen projection media is a live broadcast type of media, then the playback status of the screen projection media is obtained, and the playback status includes a live broadcast status or a live broadcast end status; if the screen projection media is in a live broadcast status, the display is controlled to display a third prompt message, and the third prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; if the user agrees to disconnect the screen projection connection, the screen projection media is stopped from playing, and the screen projection connection with the screen projection device is disconnected; if the user refuses to disconnect the screen projection connection, the screen projection media continues to play. The technical solution provided by this embodiment has the following beneficial effects: for live broadcast type media pushed by URL, since live broadcast type media belongs to real-time streaming media recorded in real time, there is no definite total playback time. When the system time reaches the preset time, the live broadcast type of media may be in a live broadcast status or a live broadcast end status; if the screen projection media is in a live broadcast status, the display device will continue to pull and play the live real-time stream. The user may want to continue watching the screen projection media, and the user can be asked through a prompt message whether to agree to disconnect the screen projection connection to meet the user's usage needs and preferences.

[0267] In some embodiments, after the controller executes the operation of obtaining the playback status of the projected media if the projected media is live media, it is further configured to: if the projected media is in the live broadcast end state, control the display to display a fourth prompt message, and the fourth prompt message is used to prompt that the live broadcast of the projected media has ended. The technical solution provided by this embodiment has the following beneficial effects: for live media pushed by a URL, when the system time reaches a preset time, if the projected media is in the live broadcast end state, the live broadcast real-time stream is interrupted, and the display device has no valid projected media to play, it can be prompted that the live broadcast of the projected media has ended. Since there is no live stream to play after the live broadcast ends, the projection connection can be disconnected or not.

[0268] Fig. 6A Schematic diagram of the change of the user interface when the trigger conditions of the timing mode are met for the live screen projection media provided in some embodiments of the present application Figure 1 See also Fig. 6A As shown in the sub-figure (a) of , the projection device 1 pushes the live media asset corresponding to the VideoURL to the display device. The display device pulls the live stream according to the VideoURL and plays the projection media asset according to the live stream. The mode management module 205 starts when the system time reaches the preset time T y When the live broadcast status request is sent to the screen projection management module 201 through the message processing module 203, the screen projection management module 201 can query the live broadcast status of the screen projection media asset through the screen projection service protocol, and the live broadcast status includes the live broadcast status and the live broadcast end status, and synchronize the live broadcast status to the mode management module 205 through the message processing module 203.

[0269] In some embodiments, when the system time reaches a preset time T y If the projection media is in the live broadcast state, the mode management module 205 can execute any one of mode action A, mode action B1 and mode action B2. Since the projection media is in the live broadcast state, the display device can pull and play the live stream, which affects the user's rest. Therefore, the mode management module 205 can execute mode action A to immediately disconnect the projection connection and stop playing the projection media; or, the mode management module 205 can execute mode action B1 or mode action B2 to inquire about the user's usage needs to determine whether to disconnect the projection connection. Fig. 6A Sub-figure (b) takes the mode management module 205 executing mode action B2 as an example, and asks the user whether to refuse to disconnect the screen projection through a countdown mechanism.

[0270] Figure 6B Schematic diagram of the change of the user interface when the trigger conditions of the timing mode are met for the live screen projection media provided in some embodiments of the present application Figure 2 When the system time reaches the preset time T yWhen the projection media resource is in the live broadcast end state and the display device cannot pull and play the live broadcast stream, the mode management module 205 can execute mode action B3, and mode action B3 can be configured as: sending a live broadcast end message to the View management module 204 through the message processing module 203.

[0271] In some embodiments, the View management module 204 receives a live broadcast end message, see Figure 6B As shown in the example of sub-figure (b), a live broadcast end prompt message 63 may be displayed on the user interface. The live broadcast end prompt message 63 is used to prompt that the live broadcast of the projection media resource has ended when the system time reaches a preset time.

[0272] In some embodiments, see Figure 6B In sub-figure (b), the View management module 204 receives the live broadcast end message, and can also display the first playback button 64 and the first switch screen projection button 65 on the user interface. In response to the user clicking the first playback button 64, the display device can play back the live content of the screen projection media previously recorded on the local end. In this embodiment, when playing live content, the display device can record the live content, that is, "recording while broadcasting", and save the recorded file in the local disk at the end of the live broadcast, so that the recorded file can be read from the local disk and played when playing back the live content.

[0273] In some embodiments, in response to the user clicking the first playback button 64, the display device may send a data request to the server corresponding to the VideoURL, and the data request is used to obtain the screen projection media resource that has been broadcasted and is no longer a real-time stream. In this way, the display device can play the audio and video data of the obtained screen projection media resource.

[0274] Figure 6C Schematic diagram 3 of the change of the user interface when the triggering conditions of the timing mode are met for some embodiments of the present application. The projection device 1 pushes the live media resource corresponding to the VideoURL to the display device. When the system time reaches the preset time T y Previously, if the playback status of a live media asset switched to the live end status, that is, the projection media asset had already ended live before the timing mode was triggered, see Figure 6C In the sub-figure (a), the View management module 204 can display a prompt message on the user interface to indicate that the live broadcast of the projection media resource has ended, and can also display controls / buttons such as "play back immediately" and "switch to other projections" so that the user can watch the live content or switch to other projection content. Since the projection media resource is the live media resource corresponding to the VideoURL and the timing mode has not been triggered, the projection connection is not disconnected.

[0275] In some embodiments, when the system time reaches a preset time Ty If the projection device 1 does not push new projection media and the user does not switch to other projection content, the mode management module 205 can execute any one of mode action A, mode action B1 and mode action B2. Since the projection connection is not disconnected after the projection media live broadcast ends, the mode management module 205 can execute mode action A to immediately disconnect the projection connection; or, the mode management module 205 can execute mode action B1 or mode action B2 to inquire about the user's usage needs to determine whether to disconnect the projection connection. Figure 6C Sub-figure (b) takes the mode management module 205 executing mode action B2 as an example, and asks the user whether to refuse to disconnect the projection connection through a countdown mechanism. If the user refuses to disconnect the projection connection, the projection device 1 can continue to push new projection media to the display device. In some embodiments, for the timing mode, several situations are included: (1) the system time reaches the preset time; (2) the user agrees to disconnect the projection connection; (3) the projection media is a mirror projection; (4) the projection media is a live broadcast media corresponding to the VideoURL; (5) the live broadcast media is in a live broadcast state; (6) the live broadcast media is in a live broadcast end state.

[0276] Based on the above situations, when at least situation (1) is achieved, it is determined that the broadcast continuation end condition is met, the screen projection connection is disconnected, and the playback of the screen projection media asset is stopped. Other situations can be appropriately combined with situation (1) to further expand the possibility of the broadcast continuation end condition.

[0277] In some embodiments, when situation (1) occurs, the user may be further asked whether he agrees to disconnect the projection connection. If situation (2) is reached, it is determined that the conditions for ending the replay are met, the projection connection is disconnected, and the projection media asset is stopped from being played.

[0278] In some embodiments, when situation (1) occurs, the type of screen projection source can be further queried. If situation (3) occurs, it is determined that the conditions for ending the replay are met, the screen projection connection is disconnected, and the playback of the screen projection media resource is stopped.

[0279] In some embodiments, when situation (1) occurs, the type of screen projection source can be further queried. If situation (3) occurs, the user can be further asked whether he agrees to disconnect the screen projection connection. If situation (2) is met, it is determined that the conditions for ending the replay are met, the screen projection connection is disconnected, and the playback of the screen projection media resource is stopped.

[0280] In some embodiments, when situation (1) occurs, the type of screen projection source can be further queried. If situation (4) occurs, the live broadcast status of the screen projection media resource can be further queried. If situation (5) occurs, it is determined that the conditions for ending the replay are met, the screen projection connection is disconnected, and the playback of the screen projection media resource is stopped.

[0281] In some embodiments, when situation (1) occurs, the type of projection source can be further queried. If situation (4) occurs, the live broadcast status of the projection media resource can be further queried. If situation (5) occurs, the user can be further asked whether he agrees to disconnect the projection connection. If situation (2) is met, it is determined that the conditions for ending the replay are met, the projection connection is disconnected, and the projection media resource is stopped from playing.

[0282] In some embodiments, when situation (1) occurs, the type of screen projection source can be further queried. If situation (4) occurs, the live broadcast status of the screen projection media asset can be further queried. If situation (6) occurs, it is determined that the broadcast end condition is met, the screen projection connection is disconnected, and the playback of the screen projection media asset is stopped. Alternatively, if situation (6) occurs, the screen projection connection may not be actively disconnected.

[0283] In some embodiments, when the system time reaches a preset time T y Previously, if the mode management module 205 did not trigger other screen projection modes (such as interval mode, timing mode), it was determined that the replay end condition was not met, and the display device could continue to disconnect the screen projection connection.

[0284] In some embodiments, for the interval mode, the play time data includes the played time of the projected media, and the continued play time data includes a first preset time. The controller can be configured to: if the played time of the projected media reaches the first preset time, mute the projected media, and control the display to display a preset shielding page on the upper layer of the play interface of the projected media. The technical solution provided by this embodiment has the following beneficial effects: it provides a solution for determining the end condition of the resumed broadcast and the screen projection control operation based on the second time management mechanism (which can be called the interval mode). After the film source starts broadcasting, the broadcast time of the film source can be recorded, and the broadcast time and the first preset time can be used as parameters for determining whether the end condition of the resumed broadcast is met. When the broadcast time reaches the first preset time, the user may need to take a break. Since it is impossible to pause the mirror screen projection and live broadcast screen projection, the projection media can be muted and blocked. When the live broadcast media is blocked, the projection live broadcast progress will not stagnate, that is, the user cannot hear the sound of the projection media, nor can he see the playback screen of the projection media, thereby shielding the user from the sight and sound of the projection media, thereby achieving the purpose of allowing the user to rest.

[0285] In some embodiments, for the interval mode, the continued broadcast time data also includes a second preset duration. After executing if the broadcast duration of the projected media reaches the first preset duration, pausing the playback of the projected media, the controller is further configured to: when the broadcast duration of the projected media reaches the sum of the first preset duration and the second preset duration, unmute the projected media, and control the display to cancel displaying the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, the film source is paused when the playing time of the film source reaches the first preset time; when the playing time reaches the sum of the first preset time and the second preset time, if the display device has always muted and blocked the projected media, although the projected content will not stagnate when the projected media is blocked, the user will not be aware of it, resulting in the user being able to only watch the preset blocked page for a long time and unable to watch the projected playback interface. Therefore, the parameter of the second preset time is increased, that is, when the paused playback time of the projected media reaches the second preset time, the muting of the projected media can be unmute and the blocking can be cancelled, so that the projected media can continue to be played when the interval mode is exited.

[0286] In some embodiments, the controller can be configured to: if the broadcast duration of the projected media reaches a first preset duration, then start the first round of interval mode, mute the projected media, and control the display to display a preset blocking page on the upper layer of the playback interface of the projected media. The technical solution provided by this embodiment has the following beneficial effects: the interval mode can be executed in a single round, so that when the broadcast duration of the projected media reaches the first preset duration, that is, when the starting point of the first round of the interval mode is reached, the projected media is blocked and muted, thereby avoiding continuous and uninterrupted playback of the projected content, and the rounds and frequency of the controller executing the interval mode can also be limited to avoid frequent blocking of media playback during the playback of the projected media.

[0287] In some embodiments, after the controller starts the first round of interval mode and pauses the playback of the projection media, it is also configured to: when the playback time of the projection media reaches the sum of the first preset time and the second preset time, exit the first round of interval mode, unmute the projection media, and control the display to cancel the display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the single round / first round interval mode, when the playback time of the target source reaches the first preset time, the projection media will be muted and blocked, and the duration of the projection media shielding playback is the second preset time. In this way, when the playback time of the projection media reaches the sum of the first preset time and the second preset time, exit the first round interval mode. By canceling the blocking and muting, it is possible to play the projection media after exiting the single interval mode. It is also possible to limit the number and frequency of the controller executing the interval mode to avoid frequently shielding the media playback during the projection media playback process.

[0288] In some embodiments of the first aspect, after the controller exits the first round of interval mode, unmutes the projection media, and controls the display to cancel displaying the preset shielding page, it is further configured to: if the broadcasting time of the projection media reaches the starting time T of the interval mode of the i-th round mi , then the interval mode of the i-th round is started, the projection media is muted, and the display is controlled to display the preset shielding page on the upper layer of the playback interface of the projection media; wherein, T mi =i*t1+(i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number in the interval mode, i is greater than 1; if the broadcast duration of the projected media reaches the end time T of the interval mode of the i-th round ni , then exit the interval mode of the i-th round, unmute the projection media, and control the display to cancel the display of the preset blocking page; where T ni =T mi + t2 = i*(t1+t2). The technical solution provided by this embodiment has the following beneficial effects: if the interval mode is executed only once, the display device will continuously play the projection media after exiting the first round of interval mode. Therefore, multiple rounds of interval mode rotation can be set, that is, every first preset time, the projection media will be shielded from playing for a second preset time. By rotating multiple rounds of interval modes during the projection media playback process, problems such as fatigue caused by continuous viewing of projection media by the user can be avoided.

[0289] Figure 7 A schematic diagram of the triggering time distribution of the interval mode in the screen projection playback process provided by some embodiments of the present application. Figure 7 As shown, the interval mode is configured to pause or block the projection media for a second preset time t2 at intervals of a first preset time t1. Thus, the triggering time distribution of the interval mode is calculated as [T mi ,T ni ], where i represents the triggering round of the interval mode in the screen projection playback process (i≥1), T mi Indicates the starting time of the i-th round interval mode, T ni Indicates the end time of the interval mode of round i. Figure 7 You can get: T mi =i*t1+(i-1)*t2, T ni =T mi +t2=i*(t1+t2).

[0290] In some embodiments, the user can set the total number of rounds (K value) of the interval mode through the projection mode setting page. The mode information of the interval mode includes: the first preset duration t1, the second preset duration t2 and the total number of rounds K, then 1≤i≤K. In this way, the upper limit of the number of rounds of the interval mode can be limited to avoid frequent intermissions affecting the user's viewing experience.

[0291] In some embodiments, the upper limit of the interval mode rounds may not be limited, and the upper limit may depend on the broadcasting time of the screen projection media. The longer the broadcasting time of the screen projection media is, the larger the accumulated rounds are.

[0292] In some embodiments, the mode management module 205 can obtain the playback time data during the playback of the projected media, and the playback time data includes the playback time of the projected media. When the projected media starts to play, the time management module 213 can control the timer Timer2 to start counting up, and the timing time of Timer2 represents the playback time of the projected media.

[0293] In some embodiments, when the duration of the projection media reaches the starting point T of the interval, mi When the interval mode of the i-th round is triggered, the mode management module 205 can execute the mode action C configured in the interval mode. The mode action C can be configured as: executing the play shielding operation of the projection media asset, and the play shielding operation lasts for the second preset time length t2. The play shielding operation is used to make the user mi ,T ni ] The projection media cannot be watched and listened to within the time range, that is, the user's viewing and listening of the projection media is blocked to force the user to take a halftime break, thereby protecting the eyes and alleviating physical and mental fatigue and inattention. The playback blocking operation can be configured to: mute the audio content of the projection media, and block the video content of the projection media (making the projection media switch to an invisible state). For mirror projection or live media pushed through VideoURL, during any round of interval mode, the projection media is hidden but still in the playback state, rather than paused.

[0294] In some embodiments, the interval mode may further include an associated mode action D, which may be configured as follows: Qi The node gives a pre-alert for the interval mode of the i-th round. Mode action D is executed before mode action C. Qi =T mi -t3, t3 is the second threshold time (for example, 3 to 5 seconds).

[0295] In some embodiments, the mode management module 205 detects that the duration of the screen projection media asset has reached T QiWhen the interval mode is reached, the mode action D is executed: the interval mode pre-reminder instruction is sent to the View management module 204 through the message processing module 203.

[0296] Figure 8 A schematic diagram of the changes in the user interface in the interval mode when playing mirrored screen projection provided in some embodiments of the present application. After the display device starts playing the projection media pushed by the projection device 1, the projection source analysis module 215 can determine the projection source information based on the session information and metadata of the projection device 1. Figure 8 As shown in sub-figure (a), the screen projection source information indicates that the screen projection media resource is mirror projection.

[0297] like Figure 8 As shown in sub-figure (a) of FIG. 2 , the View management module 204 displays a second prompt message 71 on the screen projection playback interface in response to the interval mode pre-reminder instruction. The prompt content of the second prompt message 71 is, for example, "about to enter the interval break". During the pre-reminder period, since the current time is less than T mi , the display continues to play the projected media.

[0298] In some embodiments, the mode management module 205 detects that the broadcasting time of the screen projection media reaches the starting point T of the interval. mi , triggering the interval mode of the i-th round, and executing mode action C: sending a screen blocking instruction to the View management module 204 through the message processing module 203, and sending a mute instruction to the sound management module 206 through the message processing module 203.

[0299] In some embodiments, Figure 8 As shown in sub-figure (b) of FIG. 2 , the View management module 204 responds to the screen projection blocking instruction, can cancel the display of the second prompt information 71, set the screen projection playback interface to an invisible state (the data management module 202 synchronously rewrites the mVisible state value corresponding to the screen projection device 1 to false), and displays the preset blocking page 72. The preset blocking page 72 is used to block the screen projection playback interface on the entire screen, so that the user can mi ,T ni ]The video content of the cast media cannot be viewed within the time range.

[0300] In some embodiments, Figure 8 As shown in the sub-figure (b) of , the preset shielding page 72 can display a preset background image, and display a third prompt message 72a on the preset background image, and the third prompt message 72a is used to prompt to continue watching the projection content after the second preset time t2. Figure 8 The third prompt information 72a in the sub-picture (b) is exemplified as “You can continue watching after a 10-minute break.” The preset background image may be a solid color background image, an eye protection image, a wallpaper image with a pattern, or the like.

[0301] In some embodiments, the sound management module 206 responds to the mute instruction by calling the setMute() interface of the Session object of the projection device 1 and setting setMute(true), thereby muting the audio content of the projection media pushed by the projection device 1. In this way, on the one hand, the View management module 204 blocks the video content of the projection media through the preset blocking page 72, and on the other hand, the sound management module 206 synchronously mutes the audio content of the projection media, so that the audio and video of the projection media are synchronously blocked from playing. It should be emphasized that in the process of executing the playback blocking operation, the projection device 1 and the display device remain connected, that is, the projection connection is not disconnected.

[0302] In some embodiments, the mode management module 205 can obtain the timing time of Timer2 from the time management module 213, thereby obtaining the elapsed time of the projected media asset. ni , then exit the interval mode of the i-th round. The interval mode can also be configured with mode action E, which is used to lift the playback shielding of the projection media. Among them, lifting the playback shielding of the projection media is to restore the user's projection and audio-visual after the halftime break. The implementation method can be: unmute the audio content of the projection media and unblock the video content of the projection media.

[0303] In some embodiments, when the duration of the projection media has reached the end of the interval T ni When the mode management module 205 executes the mode action E, the mode action E can be configured as: sending a cancel blocking instruction to the View management module 204 through the message processing module 203, and sending a cancel mute instruction to the sound management module 206 through the message processing module 203.

[0304] In some embodiments, the controller can be configured to: when the broadcast duration of the projected media reaches the sum of the first preset duration and the second preset duration, query the type of the projected media; if the projected media is the screen content sent by the projection device, unmute the projected media, and control the display to cancel the display of the preset blocking page. The technical solution provided by this embodiment has the following beneficial effects: for the interval mode, if the projected media belongs to mirror projection, since the display device will continue to receive and display the mirror projection when the projection connection is not disconnected, so when exiting the interval mode, in order to achieve the continuation of the mirror projection, the audiovisual shielding of the mirror projection can be lifted by unmuting the projected media and unblocking the screen, so that the user can continue to watch the audio and video content of the projected media.

[0305] In some embodiments, the View management module 204 can obtain the projection source information corresponding to the projection device 1 in response to the cancel blocking instruction. If the projection source type is determined to be mirror projection according to the projection source information, such as Figure 8 As shown in the sub-figure (c) of FIG, the View management module 204 cancels the display of the preset blocking page 72, sets the previously blocked projection playback interface to a visible state (the data management module 202 simultaneously rewrites the mVisible state value corresponding to the projection device 1 to true), and displays the fourth prompt information 73 on the projection playback interface. The fourth prompt information 73 is used to prompt that the interval mode of the i-th round has ended. Figure 8 An example of the prompt content of the fourth prompt information 73 in sub-figure (c) is "This interval break is over, please continue watching the projection screen."

[0306] In some embodiments, after acquiring the projection source information, the projection source analysis module 215 can send the projection source information to the mode management module 205 through the message processing module 203. The mode management module 205 carries the projection source information when generating the cancel occlusion instruction. In this way, the View management module 204 can read the projection source information from the cancel occlusion instruction in response to the cancel occlusion instruction.

[0307] In some embodiments, the View management module 204 may also send a screen projection source acquisition request directly to the screen projection source analysis module 215 through the message processing module 203 in response to the cancel occlusion instruction. In this way, the screen projection source analysis module 215 responds to the screen projection source acquisition request and feeds back the screen projection source information to the View management module 204 through the message processing module 203.

[0308] In some embodiments, when the projection device 1 starts to transmit projection data to the display device, the Session of the projection device 1 can notify the View management module 204 through the playstatus interface, so that the View management module 204 can pre-acquire the projection source type by calling the getType interface of the Session object of the projection device 1.

[0309] In some embodiments, the sound management module 206 responds to the unmute instruction by calling the setMute() interface of the Session object of the projection device 1 and setting setMute(false) to unmute the audio content of the projection media pushed by the projection device 1. Therefore, when the projection playback interface is unblocked, the projection audio is unmuted. When the projection playback shield is unblocked, the audio and video synchronization should be ensured, so as to restore the audio and video playback of the mirror projection from both the audio and visual aspects at the end of a round of interval mode.

[0310] In some embodiments, the View management module 204 responds to the cancel blocking instruction, and if it is determined that the projection source is a live media asset pushed through the VideoURL according to the projection source information corresponding to the projection device 1, a live status request may be sent to the projection management module 201 through the message processing module 203. In response to the live status request, the projection management module 201 may query the playback status of the projection media asset through the projection service protocol, and the playback status includes the live broadcast status and the live broadcast end status, and notify the View management module 204 of the current playback status of the projection media asset through the message processing module 203.

[0311] In some embodiments, after the controller queries the type of the projected media when the broadcast duration of the projected media reaches the sum of the first preset duration and the second preset duration, the controller is further configured to: if the projected media is a live broadcast media, obtain the playback status of the projected media, the playback status includes a live broadcast status or a live broadcast end status; if the projected media is in a live broadcast status, unmute the projected media, control the display to cancel display of the preset blocking page, and continue playing the projected media from the current live broadcast progress; if the projected media is in a live broadcast end status, control the display to cancel display of the preset blocking page, and control the display to display a fifth prompt message, the fifth prompt message is used to prompt that the live broadcast of the projected media has ended. The technical solution provided by this embodiment has the following beneficial effects: for live media resources pushed by URL, when the broadcast duration of the screen projection media resources reaches the sum of the first preset duration and the second preset duration, if the screen projection media resources are in the live broadcast state, it indicates that the display device can pull and play the real-time live stream, and the playback progress of the real-time stream is constantly changing during the interval break. By unmuting and unblocking the screen projection media resources, the screen projection media resources can be continued to be played from the current live progress; if the screen projection media resources are in the live broadcast end state, the live real-time stream is interrupted, and the display device has no valid screen projection media resources to play, it can be prompted that the screen projection media resources have ended live broadcast. Since there is no live stream to play after the live broadcast ends, the screen projection connection can be disconnected or not.

[0312] Fig. 9 A schematic diagram of the changes in the user interface in interval mode when playing a live broadcast screen projection pushed by a VideoURL is provided in some embodiments of the present application.

[0313] In some embodiments, the View management module 204 responds to the cancel blocking instruction, if it is determined that the screen projection source is a live media asset pushed through the VideoURL, and the screen projection media asset is in a live broadcast state, such as Fig. 9As shown in sub-figure (c), the preset blocking page 72 can be hidden or removed, so that the previously blocked screen projection playback interface is changed to a visible state (the data management module 202 synchronously rewrites the mVisible state value corresponding to the screen projection device 1 to true), and the fourth prompt information 73 is displayed on the screen projection playback interface.

[0314] In some embodiments, when the sound management module 206 receives an unmute instruction, if the projection media is in a live broadcast state, it calls the setMute() interface of the Session object of the projection device 1 and sets setMute(false) to unmute the projection media. In this way, the View management module 204 can control the projection playback interface to continue playing the projection media synchronously with audio and video from the current live broadcast progress according to the projection live stream.

[0315] In some embodiments, the View management module 204 responds to the cancel blocking instruction, if it is determined that the screen projection source is a live media asset pushed through the VideoURL, and the screen projection media asset is in the live broadcast end state, such as Fig. 9 As shown in the sub-figure (d) of , the preset blocking page 72 can be destroyed to make the previously blocked screen projection playback interface visible. Since the live broadcast has ended, that is, the live stream is interrupted, the display device cannot pull the live stream of the screen projection media resource, and the screen projection playback interface has no valid screen projection content to display. Therefore, the screen projection playback interface in this scenario can display the fifth prompt information 74. The fifth prompt information 74 can be used to prompt that the interval break has ended and the screen projection media resource has ended live.

[0316] In some embodiments, Fig. 9 As shown in sub-figure (d) of , the prompt content of the fifth prompt information 74 can be exemplified as "The interval break is over, the screen projection has ended live, do you want to play it back live?". The screen projection playback interface can also include a second playback button 75 and a second switch screen projection button 76. In response to the user's operation instruction to click the second playback button 75, the View management module 204 can obtain the screen projection media data that has been live and recorded from the corresponding server through the VideoURL, or can obtain the media file that has been recorded by the local machine during the live broadcast of the screen projection media, so as to play back the screen projection media. In this way, users are supported to play back live screen projection, and can review the projection content missed during the interval break.

[0317] In some embodiments, Fig. 9 As shown in sub-figure (d), the View management module 204 can switch to display other projection content in response to the user's operation instruction clicking the second switch projection button 76. If the projection number of the display device is zero, the View management module 204 can display the projection guide page (or projection help page).

[0318] In some embodiments, when the duration of the projection media has reached the end of the interval T ni When the live broadcast media resource pushed by VideoURL is in the live broadcast state, the mode management module 205 sends an unmute command to the sound management module 206 through the message processing module 203. If the live broadcast of the projected media resource is over, there is no projected audio to play, and the mode management module 205 may not send an unmute command to the sound management module 206.

[0319] In some embodiments, when the sound management module 206 receives an unmute command, it can obtain the playback status of the projected media from the projection management module 201. If the projected media is in the live broadcast end state, that is, the display device cannot pull the live stream of the projected media, there is no projection audio output, so the sound management module 206 does not respond to the unmute command, that is, does not call the Session's setMute(false) interface to unmute the projection. When the sound management module 206 receives an unmute command, if the projected media is in the live broadcast state, it responds to the unmute command by calling the Session's setMute() interface and setting setMute(false) to unmute the projection.

[0320] In some embodiments, for the interval mode, there are several cases: (1) the broadcast time of the target source reaches the starting time T of the i-th round interval mode. mi (2) The target source’s broadcast time reaches the end time T of the i-th round interval mode ni . Where i≥1; (3) the projection media is mirror projection; (4) the projection media is live media pushed via VideoURL; (5) the live media is in the live broadcast state; (6) the live media is in the end of live broadcast state.

[0321] In some embodiments, when situation (1) is met, it is determined that the condition for ending the continued broadcast is met, and a playback shielding operation is performed on the cast media, that is, the cast playback interface is blocked and the cast media is muted. During the shielding of the playback of the cast media, the cast connection is not disconnected, and the playback progress of the cast media does not stagnate.

[0322] In some embodiments, when situation (1) occurs, a playback shielding operation is performed on the projected media until situation (2) occurs. If it is determined that the conditions for ending the continued broadcast are not met, the screen projection playback interface is unblocked and the projected media is unmuted.

[0323] In some embodiments, after experiencing situation (1) and situation (2) in sequence, the type of the projected media is further determined based on the projection source information. If it is situation (3), the projection playback interface is unblocked and the projection media is unmuted.

[0324] In some embodiments, after experiencing situation (1) and situation (2) in sequence, the type of the projected media is further determined based on the projection source information. If it is situation (4), the playback status of the projected media is further queried. If it is situation (5), the projection playback interface is unblocked and the projection media is unmuted.

[0325] In some embodiments, after experiencing situation (1) and situation (2) in sequence, the type of the projected media asset is further determined based on the projection source information. If it is situation (4), the playback status of the projected media asset is further queried. If it is situation (6), it is prompted that the live broadcast of the projected media asset has ended.

[0326] In some embodiments, the interval mode can be set to a single round, that is, i=1, and after the first round of interval mode ends, the next round of interval mode will not be started.

[0327] In some embodiments, the interval mode can be set to multiple rounds, that is, i is greater than 1, then after the first round of interval mode ends, by comparing the broadcast time of the target source with the starting time T of the i-th round of interval mode mi , to cycle multiple rounds of interval modes until the target source ends playing or reaches the preset round upper limit value K.

[0328] In some embodiments, after the screen projection media asset starts playing, at [T mi ,T ni ], if the mode management module 205 does not trigger other screen projection modes (such as timing mode, timer mode), it is determined that the conditions for ending the continued broadcast are not met, and the display device continues to play the screen projection media without performing the playback blocking operation or disconnecting the screen projection connection operation.

[0329] In some embodiments, a special case can be set for the single-round interval mode: only the first preset duration is set, and the second preset duration is not limited. In this way, the interval mode has only one playback time parameter, that is, the starting time T of the single-round interval mode. m1 (equal to the first preset duration). In this way, when the duration of the screen projection media reaches T m1 In this scenario, the user can also actively remove the blocking of the playback of the cast media after a sufficient rest time according to the use needs, that is, the user can trigger the resumption of the cast media, for example, the user issues a voice command to instruct the resumption of the cast media.

[0330] In some embodiments, the timing mode starts from the starting point of any projection (abbreviated as: projection a), and the timing duration represents the cumulative playback time of projection a. If the timing duration reaches the third preset duration t3, the projection is disconnected, thereby limiting the upper limit of the time for users to watch the projection.

[0331] In some embodiments, for the timing mode, the playback time data includes the played time of the projection media, and the continued playback time data includes a third preset time. The controller can be configured to: if the played time of the projection media reaches the third preset time, stop playing the projection media and disconnect the projection connection with the projection device. The technical solution provided by this embodiment has the following beneficial effects: it provides a solution for determining the continued playback end condition and the projection control operation based on the third time management mechanism (which can be called the timing mode), starts timing the played time when the projection media starts playing, and when the played time of the projection media reaches the third preset time, it is determined that the continued playback end condition is met, and the controller disconnects the projection connection to stop playing the projection media. This prevents the projection device from continuing to push the projection content to the display device based on the projection connection when the projection media plays to the third preset time, and also prevents the display device from continuing to play the projection content after the played time reaches the third preset time, thereby avoiding the projection source playing too long.

[0332] In some embodiments, the controller can be configured to: when the broadcast duration of the projection media reaches the third preset duration, control the display to display the sixth prompt information, and the sixth prompt information is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the projection media and disconnect the projection connection with the projection device; if the user refuses to disconnect the projection connection, continue to play the projection media. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the broadcast duration of the projection media reaches the third preset duration, the user can be asked whether he agrees to disconnect the projection connection through a prompt message, and then based on the time condition of the timing mode, the user's viewing needs are used as a factor in deciding whether the controller disconnects the projection connection. If the user agrees, the projection connection is disconnected, and if the user refuses, the projection media continues to be played, thereby meeting the user's usage needs and preferences.

[0333] In some embodiments, the controller can be configured as follows: when the broadcast duration of the projection media is equal to the third preset duration, query the type of projection media; if the projection media is the screen content sent by the projection device, control the display to display the seventh prompt information, the seventh prompt information is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stop playing the projection media and disconnect the projection connection with the projection device; if the user refuses to disconnect the projection connection, continue playing the projection media. The technical solution provided by this embodiment has the following beneficial effects: for the timing mode, when the broadcast duration of the projection media is equal to the third preset duration, for the projection media of the mirror projection type, since the projection connection needs to be disconnected if the mirror projection is to be stopped, the display device and the projection device are in a connected state when the mirror projection can be received, so that the user can be asked whether he agrees to disconnect the projection connection through a prompt message to meet the user's usage needs and preferences.

[0334] In some embodiments, after the controller runs the mode application, the mode management module 205 can monitor the trigger conditions and execute the mode actions of the timing mode according to the timing mode information.

[0335] Fig.10 A schematic diagram of the changes in the user interface in the timing mode when playing mirrored screen projection provided in some embodiments of the present application. After the display device starts playing the projection media pushed by the projection device 1, the projection source analysis module 215 can determine the projection source information based on the session information and metadata of the projection device 1. Fig.10 As shown in sub-figure (a), the screen projection source information indicates that the screen projection media resource is mirror projection.

[0336] In some embodiments, when the screen projection management module 201 receives the mirrored screen projection data transmitted by the screen projection device 1, it can send a screen projection start message to the mode management module 205 and the view management module 204 respectively through the message processing module 203. The view management module 204 receives the screen projection start message and starts playing the mirrored screen projection data transmitted by the screen projection device 1 on the screen projection playback interface.

[0337] In some embodiments, when the mode management module 205 receives the screen projection start message, it starts the timing mode and executes the mode action F set in the timing mode. The mode action F can be configured as: sending a timing reminder instruction to the View management module 204 through the message processing module 203, and sending a timing instruction A to the time management module 213 through the message processing module 203.

[0338] In some embodiments, the View management module 204 responds to the timing reminder instruction, such as Fig.10As shown in sub-figure (a), the sixth prompt information 101 is displayed on the screen projection playback interface. The sixth prompt information 101 is used to prompt entering the timing mode. An example of the prompt content of the sixth prompt information 101 is "Enter timing mode A and start timing the broadcast time of the screen projection media asset."

[0339] In some embodiments, the time management module 213 may start the timer Timer3 in response to the timing instruction A, and control Timer3 to start counting up. The timing time of Timer3 represents the broadcasting time of the projection media in the timing mode. The time management module 213 may set the upper limit of the counting up to the third preset time t3. When the timing time of Timer3 reaches the third preset time t3, the time management module 213 may send a second timing arrival message to the mode management module 205 through the message processing module 203, and control Timer3 to stop counting, and clear the timing time.

[0340] In some embodiments, when the timing time of Timer3 does not reach the third preset duration t3, the mode management module 205 determines that the broadcast continuation end condition is not met, and the display device continues to play the projection media.

[0341] In some embodiments, when the broadcast duration of the projected media reaches a third preset duration t3, the mode management module 205 can execute mode action A to disconnect the projected connection with the projected device 1.

[0342] In some embodiments, when the duration of the screen projection media reaches the third preset duration t3, the Figure 5A or Figure 5B In a similar prompting and inquiry manner, the View management module 204 can prompt that the timer time specified in the timing mode has been reached, and ask the user whether to agree or refuse to disconnect the projection connection. If the user agrees to disconnect the projection connection, the mode management module 205 can execute mode action A to disconnect the projection connection and stop playing the projection media. If the user refuses to disconnect the projection connection, the display device continues to play the projection media.

[0343] In some embodiments, when the mode management module 205 receives the second timing arrival message sent by the time management module 213, indicating that the broadcast time of the projection media reaches the third preset time t3, the mode action G can be executed, and the mode action G can be configured as: sending a third inquiry instruction to the View management module 204 through the message processing module 203, and sending a timing instruction B to the time management module 213 through the message processing module 203. Among them, the third inquiry instruction is used to instruct the View management module 204 to display the inquiry content in the timing mode to inquire whether to agree or refuse to disconnect the projection when the timing time of the timing mode is reached. The inquiry content can be presented to the user for browsing in the form of prompt information, inquiry pop-up windows, etc.

[0344] In some embodiments, Fig.10 As shown in sub-figure (b), the View management module 204 can display the seventh prompt information 102 and the second countdown control 103 through the display in response to the third inquiry instruction. An example of the prompt content of the seventh prompt information 102 is "The timing time of timing mode A has been reached, and the screen projection will be disconnected. If you refuse, please press any key." The second countdown control 103 is used to display the remaining operational time for the user to refuse to disconnect the screen projection connection through a countdown method.

[0345] In some embodiments, the time management module 213 responds to the timing instruction B, and when the View management module 204 starts to display the seventh prompt information 102, it controls the timer Timer4 to count down from the first threshold time, that is, sets the countdown starting point to the first threshold time (e.g., 5 seconds). When the Timer4 countdown is reset, the time management module 213 can send a time reset message to the View management module 204 through the message processing module 203. The second countdown control 103 should be synchronized with the Timer4 countdown of the time management module 213.

[0346] In some embodiments, if the user agrees to disconnect the screen projection connection, no operation needs to be entered, and the countdown is reset to zero. When the View management module 204 receives the time reset message, if it does not receive a rejection of disconnecting the screen projection operation, it cancels the display of the seventh prompt message 102 and the second countdown control 103, and sends a message of agreeing to disconnect the screen projection to the mode management module 205 through the message processing module 203.

[0347] In some embodiments, the mode management module 205 receives the message of consent to disconnect the screen projection, and executes mode action A to stop playing the screen projection media and disconnect the screen projection connection with the screen projection device 1. In this way, through the countdown mechanism, on the one hand, the user is asked whether he or she is willing to disconnect / maintain the screen projection in the timing mode, and on the other hand, the seventh prompt message 102 is avoided from being displayed for a long time, thereby reducing the waiting time and delay of disconnecting the screen projection.

[0348] In some embodiments, if the user wants to continue watching the mirrored screen and refuses to disconnect the screen projection connection, the user can input a rejection disconnection screen projection operation before the countdown is reset. The input method for rejecting the disconnection screen projection operation is not limited. For example, the user can click any button on the control device 100 (such as a remote control), or click a preset button. The preset button is not limited, such as a return button, an exit button, etc.

[0349] In some embodiments, the View management module 204 responds to the user input of the refusal to disconnect the screen projection operation, and does not receive the time reset message sent by the time management module 213, then cancels the display of the seventh prompt information 102 and the second countdown control 103, sends a stop timing instruction to the time management module 213 through the message processing module 203, and sends a refusal to disconnect the screen projection message to the mode management module 205 through the message processing module 203. In response to the stop timing instruction, the time management module 213 controls Timer4 to stop the countdown and resets the timing time to zero. The mode management module 205 receives the refusal to disconnect the screen projection message, ends the timing mode, and does not execute mode action A, that is, does not disconnect the screen projection connection with the projection device 1, and continues to play the mirror projection.

[0350] In some embodiments, if the broadcast time of the projected media is equal to the third preset time, the controller queries the type of the projected media and is configured as follows: if the projected media is a live broadcast media, the playback status of the projected media is obtained, and the playback status includes a live broadcast status or a live broadcast end status; if the projected media is in a live broadcast status, the control display is displayed with an eighth prompt message, and the eighth prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the playback of the projected media is stopped, and the projection connection with the projection device is disconnected; if the user refuses to disconnect the projection connection, the playback of the projected media is continued. The technical solution provided by this embodiment has the following beneficial effects: for live media resources pushed by URL, since live media resources are real-time streaming media resources that are recorded instantly and have no definite total playback time, when the playback time of the projection media resources is equal to the third preset time, the live media resources may be in the live broadcast state or the live broadcast end state; if the projection media resources are in the live broadcast state, the display device will keep pulling and playing the live real-time stream, and the user can be asked whether he agrees to disconnect the projection connection through a prompt message to meet the user's usage needs and preferences.

[0351] In some embodiments, after the controller executes the operation of obtaining the playback status of the projected media if the projected media is live media, it is further configured to: if the projected media is in the live broadcast end state, control the display to display a ninth prompt message, and the ninth prompt message is used to prompt that the live broadcast of the projected media has ended. The technical solution provided by this embodiment has the following beneficial effects: for live media pushed by a URL, when the broadcast duration of the projected media is equal to the third preset duration, if the projected media is in the live broadcast end state, the live real-time stream is interrupted, and the display device has no valid projected media to play, it can be prompted that the live broadcast of the projected media has ended. Since there is no live stream to play after the live broadcast ends, the projection connection can be disconnected or not.

[0352] In some embodiments, when the mode management module 205 receives the second timing arrival message sent by the time management module 213, indicating that the broadcast duration of the projection media asset has reached the third preset duration t3, the type of the projection media asset can be determined according to the projection source information obtained from the projection source analysis module 215. If the projection media asset is a live broadcast media asset pushed through VideoURL, the mode management module 205 can obtain the playback status of the projection media asset through the projection management module 201, and the playback status includes the live broadcast status and the live broadcast end status.

[0353] Fig.11 Schematic diagram of changes in the user interface in the timing mode when playing the live broadcast type screen projection pushed by VideoURL in some embodiments of the present application Figure 1 .

[0354] In some embodiments, when the mode management module 205 receives the second timing arrival message sent by the time management module 213, if it is determined that the screen projection media is a live broadcast type media pushed through the VideoURL, and the screen projection media is in a live broadcast state, indicating that the live broadcast duration is greater than the third preset duration t3, since the live broadcast of the screen projection media has not yet ended, the user may have the intention to continue watching the screen projection media, then the above-mentioned mode action G can be executed. The View management module 204 responds to the third query instruction, such as Fig.11 As shown in sub-figure (b), by displaying the seventh prompt message 102 and the second countdown control 103, the user is asked whether to agree or refuse to disconnect the screen projection connection, so that the mode management module 205 decides whether to continue to execute mode action A.

[0355] In some embodiments, when the mode management module 205 detects that the projected media resource switches from the live broadcast state to the live broadcast end state, if the mode management module 205 does not receive the second timing arrival message sent by the time management module 213, indicating that the live broadcast duration is less than the third preset duration t3, that is, the projected media resource has ended live before the continuation end condition in the timing mode is met, regardless of whether the user agrees to disconnect the screen projection, the user cannot continue to watch the screen projection live broadcast, then the mode management module 205 can execute mode action H, and the mode action H can be configured as: sending a first screen projection end message to the View management module 204 through the message processing module 203.

[0356] Fig.12 Schematic diagram of changes in the user interface in the timing mode when playing the live broadcast type screen projection pushed by VideoURL in some embodiments of the present application Figure 2 .

[0357] In some embodiments, Fig.12As shown in sub-figure (b), when the View management module 204 receives the first screen projection end message, since the live broadcast stream of the projected media resource is terminated, there is no valid projected content displayed on the projected playback interface. The View management module 204 can display the eighth prompt information 121 on the projected playback interface. An example of the prompt content of the eighth prompt information 121 is "The broadcast duration of the projected media resource has not reached the timing time specified by timing mode A, and the live broadcast has ended."

[0358] In some embodiments, when the mode management module 205 detects that the projected media resource switches from the live broadcast state to the live broadcast end state, if the mode management module 205 just receives the second timing arrival message sent by the time management module 213, indicating that the live broadcast duration is equal to the third preset duration t3, regardless of whether the user agrees to disconnect the screen projection connection, the live broadcast content of the projected media resource cannot be continued to be watched at this time, then the mode management module 205 can execute mode action K, and the mode action K can be configured as: sending a second screen projection end message to the View management module 204 through the message processing module 203.

[0359] Fig.13 Schematic diagram three of the changes in the user interface in timing mode when playing a live screen projection pushed by VideoURL, provided in some embodiments of the present application.

[0360] In some embodiments, Fig.13 As shown in sub-figure (b), when the View management module 204 receives the second screen projection end message, since the live broadcast stream of the screen projection media resource is terminated, there is no valid screen projection content displayed on the screen projection playback interface. The View management module 204 can display the ninth prompt information 131 on the screen projection playback interface. An example of the prompt content of the ninth prompt information 131 is "The broadcast duration of the screen projection media resource has reached the timing time specified by timing mode A, and the live broadcast has ended."

[0361] In some embodiments, Fig.12 As shown, in the scenario where the projected media is live media pushed via VideoURL and the live broadcast duration is less than the third preset duration t3, when the View management module 204 receives the first projection end message, it can also display a playback button and a switch projection button on the projection playback interface to facilitate users to replay the live broadcast or switch to other projections for viewing.

[0362] In some embodiments, if the live broadcast of the projection media a pushed by the projection device 1 ends when the timing time of Timer3 is less than the third preset duration t3, the time management module 213 can control Timer3 to pause the timing, so that the timing time of Timer3 remains unchanged (i.e., not cleared to zero), and the user can switch to other projections at this time, such as watching the projection media b pushed by the projection device 2. After starting to broadcast the projection media b, the time management module 213 can control Timer3 to continue timing from the pause position until the timing time of Timer3 reaches the third preset duration t3, and then send a second timing message to the mode management module 205 through the message processing module 203. In this embodiment, in response to the user switching the projection scene, the broadcasting time of at least one projection media watched by the user is accumulated, and the time the user watches different projection contents is counted. When the cumulative viewing time of the projection reaches the third preset duration t3, it is determined that the continuation end condition in the timing mode is met.

[0363] In some embodiments, Fig.13 As shown, when the timing time of Timer3 is equal to the third preset duration t3, if the projection media a pushed by the projection device 1 has just ended its live broadcast, since the user's cumulative viewing time of the projection has reached the third preset duration t3 constrained by the timing mode, the user needs to take a break. The projection playback interface can only display the ninth prompt information 131, without displaying the playback button and the switch projection button, so as to avoid excessive viewing behavior caused by the user watching the live broadcast or switching to other projection content.

[0364] In some embodiments, the timing mode includes the following situations: (1) the duration of the projection media reaches the third preset duration t3; (2) the user agrees to disconnect the projection connection; (3) the projection media is mirror projection; (4) the projection media is live broadcast media pushed via VideoURL; (5) the live broadcast media is in the live broadcast state; (6) the live broadcast media is in the live broadcast end state.

[0365] Based on the above situations, when at least situation (1) is achieved, it is determined that the broadcast continuation end condition is met, the screen projection connection is disconnected, and the playback of the screen projection media asset is stopped. Other situations can be appropriately combined with situation (1) to further expand the possibility of the broadcast continuation end condition.

[0366] In some embodiments, when situation (1) occurs, the user may be further asked whether he agrees to disconnect the projection connection. If situation (2) is reached, it is determined that the conditions for ending the replay are met, the projection connection is disconnected, and the projection media asset is stopped from being played.

[0367] In some embodiments, when situation (1) occurs, the projection source information can be further queried. If situation (3) occurs, it is determined that the conditions for ending the resumed broadcast are met, the projection connection is disconnected, and the projection media resource is stopped from being played.

[0368] In some embodiments, when situation (1) occurs, the projection source information can be further queried. If situation (3) occurs, the user can be further asked whether he agrees to disconnect the projection connection. If situation (2) is met, it is determined that the conditions for ending the replay are met, the projection connection is disconnected, and the projection media resource is stopped from being played.

[0369] In some embodiments, when situation (1) occurs, the projection source information can be further queried. If situation (4) occurs, the live broadcast status of the projection media resource can be further queried. If situation (5) occurs, it is determined that the conditions for ending the replay are met, the projection connection is disconnected, and the playback of the projection media resource is stopped.

[0370] In some embodiments, when situation (1) occurs, the projection source information can be further queried. If situation (4) occurs, the live broadcast status of the projection media resource can be further queried. If situation (5) occurs, the user can be further asked whether he agrees to disconnect the projection connection. If situation (2) is met, it is determined that the conditions for ending the replay are met, the projection connection is disconnected, and the projection media resource is stopped from playing.

[0371] In some embodiments, when situation (1) occurs, the screen casting source information can be further queried. If situation (4) occurs, the live broadcast status of the screen casting media asset can be further queried. If situation (6) occurs, it is determined that the broadcast continuation end condition is met and the screen casting connection is disconnected. Alternatively, if situation (6) occurs, it can also be prompted that the screen casting media asset has ended live broadcast, but the screen casting connection is not actively disconnected.

[0372] In some embodiments, before the broadcast duration of the projected media reaches the third preset duration t3, if the mode management module 205 does not trigger other projection modes (such as interval mode, timing mode), it is determined that the conditions for ending the continued broadcast are not met, and the display device can continue to disconnect the projection connection.

[0373] The above embodiment takes the display of a single screen projection (screen projection number = 1) as an example. In some embodiments, if the number of screen projections is greater than 1, and the display device displays multiple screen projections on the same screen, the multiple screen projections can share the timing mode, that is, the timing mode is valid for multiple screen projections at the same time. In this way, when the system time reaches the preset time T of the timing mode y When the mode management module 205 triggers the timing mode for multi-channel screen projection at the same time, the multi-channel screen projection is disconnected at the same time in the timing mode.

[0374] In some embodiments, if the number of projection channels is greater than 1, since the start time of each projection channel may be different, the mode application can process each projection channel separately in interval mode and timing mode.

[0375] The above embodiments take the timing mode, interval mode and timing mode as examples, and based on the architecture of the mode application, describe in detail the underlying software logic such as the trigger condition monitoring and mode action execution of the projection mode. Those skilled in the art can configure the trigger conditions and execution actions of the projection mode as appropriate according to the usage scenarios and requirements, and implement constraint control of each projection playback through the mode application.

[0376] In some embodiments, the mode management module 205 can configure one or more of the above modes. When multiple screen projection modes coexist, the multiple modes can be processed according to preset rules, which are not limited.

[0377] In some embodiments, an example of a preset rule is: processing the mode according to the first triggered principle. Assuming that the mode management module 205 is configured with N modes, where the trigger condition of mode a is met first, then in a multi-mode coexistence scenario, mode a can be processed, and the processing of N-1 modes after mode a can be cancelled.

[0378] In some embodiments, an example of a preset rule is: mode processing is performed according to the latest triggering principle. Assuming that the mode management module 205 is configured with N modes, and the triggering condition of mode b is reached the latest, the mode management module 205 can skip the processing of N-1 modes before mode b and process mode b in a multi-mode coexistence scenario.

[0379] In some embodiments, an example of a preset rule is: execute mode actions in sequence according to the order of mode triggering. Assuming that the mode management module 205 is configured with a timing mode and an interval mode, if the triggering condition of the interval mode is met first, the mode action of the interval mode is executed first, and when the triggering condition of the timing mode is met later, the mode action of the timing mode is executed.

[0380] In some embodiments, an example of a preset rule is: performing mode processing according to a preset mode priority. The mode management module 205 can process the N modes in sequence according to the priority of the N modes.

[0381] In some embodiments, the mode priority can be customized by the user, and the mode management module 205 saves the mode priority set by the user.

[0382] In some embodiments, the mode management module 205 can set the mode priority according to user preferences. For example, the mode priority can be set according to the usage frequency of N modes.

[0383] In some embodiments, the mode application runs at the application layer, and the mode application is controlled by the controller 250. Therefore, the controller 250 can implement the projection mode processing method in different modes in the above embodiments by running the mode application. The software architecture of the mode application is not limited to Figure 3B Examples provided.

[0384] Fig.14 Timing interaction of the screen projection mode processing method provided in some embodiments of the present application Figure 1 .

[0385] Fig.15A A timing interaction diagram of a method for processing screen projection mode in a scenario where live media resources are pushed via VideoURL, provided in some embodiments of the present application.

[0386] Fig. 15B A timing interaction diagram of a screen projection mode processing method in a mirrored screen projection scenario provided in some embodiments of the present application.

[0387] See also Fig.14 , Fig.15A and Fig. 15B The interaction objects include users, screen projection senders (i.e., screen projection devices) and screen projection receivers (i.e., display devices). Users can initiate screen projection to the screen projection receiver based on different screen projection protocols at the screen projection sender, so that the screen projection sender sends a screen projection request to the screen projection receiver.

[0388] In some embodiments, see Fig.14 The screen projection receiving end can ask the user whether to accept the screen projection request of the screen projection sending end through UI or voice. If the user accepts the screen projection request, the screen projection receiving end sends a screen projection consent message to the screen projection sending end. The screen projection sending end receives the screen projection consent message and establishes a screen projection connection with the screen projection receiving end.

[0389] In some embodiments, see Fig.14 After the screen projection sender and the screen projection receiver establish a screen projection connection, the screen projection sender can send a screen projection instruction to the screen projection receiver. The screen projection receiver can determine the type of screen projection media according to the screen projection instruction, such as mirror projection, live media pushed through VideoURL, etc.

[0390] In some embodiments, reference Fig.15AIf the screen projection sender pushes live media assets to the screen projection receiver, the VideoURL (video link, also known as resource address), Session information and metadata (metadata) of the live media assets can be configured in the screen projection command. Among them, Session information includes but is not limited to: the device ID of the screen projection sender, screen projection source information, etc. Screen projection source information includes screen projection source type, and screen projection source types include mirror projection (mirror) and media assets pushed by video links (VideoURL). Metadata (metadata) includes but is not limited to information such as the theme, start time, and live broadcast highlights of live media assets.

[0391] In some embodiments, reference Fig.15A The screen projection receiving end receives the screen projection instruction, and determines that the screen projection media asset is the live media asset pushed through the VideoURL according to the Session information and metadata contained in the screen projection instruction. Then, according to the VideoURL, the screen projection media asset is obtained and played, that is, the live stream of the screen projection media asset is pulled.

[0392] In some embodiments, reference Fig. 15B If the screen projection sender sends a mirror screen projection to the screen projection receiver, the screen projection sender can start the screen recording function (referred to as the screen recording function, or the screen recording application) after receiving the screen projection consent message, and record the screen content of the local end, thereby generating mirror screen projection data. The screen projection sender can send the mirror screen projection data and the screen projection instruction to the screen projection receiver. The screen projection instruction includes Session information, and the screen projection source type indicated in the Session information is mirror projection.

[0393] In some embodiments, reference Fig. 15B The screen projection receiving end receives the screen projection instruction, determines that the screen projection media is mirror projection according to the Session information contained in the screen projection instruction, and then plays the received mirror projection data.

[0394] In some embodiments, see Fig.14 , Fig.15A and Fig. 15B , the screen projection receiving end can obtain the resume time data. The screen projection receiving end can obtain the resume time data according to the previously preset and stored mode information, or according to the mode information set by the user based on the screen projection mode setting page when the screen projection media starts. The screen projection mode includes but is not limited to: timing mode, interval mode and timing mode. For different screen projection modes, the resume time data contains different parameters, and the resume time data includes but is not limited to at least one of the following parameters: preset time, first preset duration, second preset duration and third preset duration.

[0395] In some embodiments, see Fig.14 , Fig.15A and Fig. 15B The screen projection receiving end can also obtain the playback time data during the playback process after the screen projection media asset starts playing. The playback time data includes but is not limited to at least one of the following parameters: the system time of the display device and the playback time of the screen projection media asset. Among them, the playback time can be a parameter obtained by the timer when the screen projection media asset starts playing.

[0396] In some embodiments, see Fig.14 , Fig.15A and Fig. 15B , the screen projection receiving end can determine whether the continuation end condition is met based on the continuation time data and the playback time data. For different screen projection modes, the criteria for judging the continuation end condition are different. For example, for the timing mode, if the continuation end condition is to be met, the system time must at least reach the preset time. For the interval mode, if the continuation end condition is to be met, the broadcast time of the projection media asset must at least reach the first preset time. For the timing mode, if the continuation end condition is to be met, the broadcast time of the projection media asset must at least reach the third preset time.

[0397] In some embodiments, see Fig.14 , Fig.15A and Fig. 15B If the screen projection receiving end determines that the conditions for ending the replay are met, the target operation is executed. For different screen projection modes, the target operation corresponding to the mode action may be different. For example, for the timing mode and the timer mode, the target operation can be configured to disconnect the screen projection connection with the screen projection sending end. For the interval mode, the target operation can be configured to perform a playback blocking operation on the projection media asset.

[0398] In some embodiments, for the timing mode and the timer mode, the screen projection receiving end can also decide whether to disconnect the screen projection connection based on at least one of multiple factors such as the type of screen projection media (mirror screen projection or URL live broadcast type media), the live broadcast status of the screen projection media (live broadcast status or live broadcast end status), and the user's viewing willingness (agree or refuse to disconnect the screen projection connection), so as to accurately and flexibly control the screen projection mode processing and the resumption / stop of the film source, reduce the user's manual switching of the screen projection mode related operations, and improve the user experience. For the interval mode, the screen projection receiving end can also decide whether to continue broadcasting the screen projection media or prompt the end of the live broadcast of the screen projection media based on at least one of multiple factors such as the type of screen projection media (mirror screen projection or URL live broadcast type media), the live broadcast status of the screen projection media (live broadcast status or live broadcast end status).

[0399] For the screen projection receiving end, the display device may include a controller configured with the above-mentioned software program executed by the screen projection receiving end to realize interaction with the screen projection sending end and screen projection playback processing. For different screen projection modes, the basis for judging the end condition of the continuous broadcast and the execution of the mode action / target operation, please refer to the description of the previous related embodiments. Fig.14 , Fig.15A and Fig. 15B The exemplary timing interaction embodiments are not described in detail. Fig.16 Timing interaction of the screen projection mode processing method provided in some embodiments of the present application Figure 2 See also Fig.16 The interactive ends include the screen projection sending end (i.e., the screen projection device) and the screen projection receiving end (i.e., the display device). The timing interaction logic is aimed at the mirror screen projection scenario.

[0400] In some embodiments, see Fig.16 The screen casting receiving end may include: screen casting service (CastServer), video player activity (VideoPlayerActivity, corresponding to the screen casting playback interface), view display module (ViewModule), player (Player), mode manager (ModeManager), time manager (TimerManager), play state manager (PlayStateManager), mode analysis module (ModeAnalysis). Among them, the screen casting service (CastServer) corresponds to Figure 3B The screen projection management module 201 in the view display module (ViewModule) and the video player activity (VideoPlayerActivity) may correspond to Figure 3B The View management module 204 in the player (Player) and the play state manager (PlayStateManager) can correspond to Figure 3B The broadcast control management module 212 in the mode manager (ModeManager) and the mode analysis module (ModeAnalysis) may correspond to Figure 3B The mode management module 205 in the time manager (TimerManager) corresponds to Figure 3B The time management module 213 in.

[0401] In some embodiments, see Fig.16After establishing a screen projection connection with the screen projection receiving end, the screen projection sending end sends the mirror projection data and Session information to the screen projection receiving end. After CastServer receives the mirror projection data and Session information, it can start VideoPlayerActivity. VideoPlayerActivity controls ViewModule to display related Views, such as initializing configuration and displaying the screen projection playback interface. VideoPlayerActivity can also send a play instruction to the Player, so that the Player responds to the play instruction, plays the mirror projection data, and makes the screen projection playback interface display the video content in the mirror projection data, and the audio output device plays the audio content in the mirror projection data.

[0402] In some embodiments, for the timing mode, since the system time and the preset time are used to determine whether the conditions for ending the resumed broadcast are met, thereby deciding whether to disconnect the screen projection connection, the timing mode does not involve a timing mechanism. Therefore, in a scenario where only the timing mode is configured, TimerManager may not start the timing when the screen projection starts.

[0403] In some embodiments, for the following mode operation scenarios, TimerManager controls the Timer to start timing when the screen projection starts, so as to count the elapsed time of the projection media asset. Such mode operation scenarios include: single interval mode, single timing mode, timing mode + interval mode, timing mode + timing mode, interval mode + timing mode, timing mode + interval mode + timing mode.

[0404] In some embodiments, Fig.16 This example takes the multi-mode operation scenario of timing mode + interval mode + timing mode as an example. Fig.16 , VideoPlayerActivity can also start TimerManager, which controls the start of Timer when the mirror screen starts to count the playing time of the mirror screen. TimerManager can synchronize the timing of Timer to ModeAnalysis.

[0405] In some embodiments, see Fig.16 When CastServer receives Session information, it can send the Session information to ModeManager. ModeManager obtains the projection source information based on the Session information. Fig.16 In the example, the screen projection source type is mirror projection.

[0406] In some embodiments, see Fig.16, ModeAnalysis can obtain the resume time data from the mode information preset by the user or obtained instantly, as well as the playback time data during the mirror screen projection process. The playback time data may include system time, TimerManager timing time (recording the playback time of the mirror screen projection), etc. ModeAnalysis can detect the currently triggered screen projection mode (referred to as: the first screen projection mode) based on the resume time data and the playback time data, and determine whether the resume end condition is met. Among them, the mode information may include at least one of timing mode information, interval mode information and timing mode information.

[0407] In some embodiments, see Fig.16 , ModeManager can start the mode listener, which is oriented to ModeAnalysis to listen to the mode trigger event corresponding to the first projection mode generated by ModeAnalysis, thereby realizing the mode synchronization between ModeAnalysis and ModeManager.

[0408] In some embodiments, see Fig.16 For the interval mode, the playback time data obtained by ModeAnalysis includes the playback time of the mirror screen (i.e. the timing time of the Timer), and the continued playback time data includes the starting time T according to the interval mode. mi and the end time T ni Among them, T mi and T ni It is calculated based on the first preset time length t1, the second preset time length t2 and the round i.

[0409] In some embodiments, see Fig.16 , ModeAnalysis detects that the timing time of Timer reaches the starting time T of the i-th round interval mode mi When the interval mode of the i-th round is determined to be triggered, an interval mode trigger event can be sent to ModeManager. When the mode listener of ModeManager listens to the interval mode trigger event, ModeManager switches the current mode to the interval mode and sends the shielding screen casting instruction generated when entering the interval mode to PlayStateManager.

[0410] In some embodiments, see Fig.16In response to the screen mirroring instruction, PlayStateManager sends a mute instruction to the Player and a block instruction to the ViewModule. In response to the mute instruction, the Player can call the setMute(true) interface of the Session to mute the mirroring screen. In response to the block instruction, the ViewModule Figure 8 In the example of , a preset shielding page is displayed on the upper layer of the screen casting playback interface to shield the mirror casting playback interface, so that the video content of the mirror casting is not visible to the user due to being shielded. In this way, the user can neither hear the sound of the mirror casting nor see the video picture of the mirror casting, thereby achieving the purpose of the halftime break.

[0411] In some embodiments, see Fig.16 , ModeAnalysis detects that the timing time of Timer reaches the end time T of the i-th round interval mode ni When the interval mode ends, the ModeManager can send an interval mode end event to the ModeManager. When the mode listener of the ModeManager listens to the interval mode end event, the ModeManager can send the unblocking instruction generated when exiting the interval mode to the PlayStateManager.

[0412] In some embodiments, see Fig.16 In response to the unblocking instruction, PlayStateManager sends an unmute instruction to the Player and a cancel block instruction to the ViewModule. In response to the unmute instruction, the Player can call the setMute(false) interface of the Session to unmute the mirror screen. In response to the cancel block instruction, the ViewModule cancels the display of the preset block page so that the screen playback interface is not blocked and visible to the user.

[0413] In some embodiments, see Fig.16 , assuming that after exiting the interval mode of the i-th round, the next one to come is the timing mode. When ModeAnalysis detects that the timing time of the Timer reaches the third preset time length t3, it determines that the timing mode is triggered and sends a timing mode triggering event to ModeManager.

[0414] In some embodiments, see Fig.16, when the mode listener of ModeManager listens to the timing mode trigger event, ModeManager switches the current mode to the timing mode and sends a first inquiry instruction to ViewModule. ViewModule responds to the first inquiry instruction, prompts that the broadcast time of the mirror screen has reached the specified time (that is, the third preset time t3), and asks the user whether to agree to disconnect the screen projection connection. Assuming that the user refuses to disconnect the screen projection connection, ViewModule can send a message to ModeManager to refuse to disconnect the screen projection. ModeManager receives the message to refuse to disconnect the screen projection, exits the timing mode, and the mirror screen projection continues to play.

[0415] In some embodiments, if the user agrees to disconnect the screen projection connection, ViewModule can send a message to ModeManager to agree to disconnect the screen projection. After receiving the message, ModeManager can send a disconnect screen projection instruction to CastServer to cause CastServer to disconnect the screen projection connection with the screen projection sender and stop playing the mirrored screen projection.

[0416] In some embodiments, see Fig.16 , assuming that after exiting the timing mode, the next one to come is the timing mode. ModeAnalysis detects that the system time reaches the preset time T y , it is determined that the timing mode is triggered, and a timing mode trigger event is sent to ModeManager. When the mode listener of ModeManager listens to the timing mode trigger event, ModeManager switches the current mode to the timing mode, and can send a second inquiry instruction to ViewModule. ViewModule responds to the second inquiry instruction, prompts that the system time has reached the preset time, and asks the user whether to agree to disconnect the screen projection connection. Assuming that the user agrees to disconnect the screen projection connection, ViewModule can send a message to ModeManager agreeing to disconnect the screen projection.

[0417] In some embodiments, see Fig.16, ModeManager receives the message of agreeing to disconnect the screen casting, exits the timing mode, and sends a disconnect screen casting instruction to CastServer. In response to the disconnect screen casting instruction, CastServer can call the finish() interface of the Session object to disconnect the screen casting connection with the screen casting sender. After the screen casting connection is disconnected, CastServer can send a disconnected screen casting message to VideoPlayerActivity. VideoPlayerActivity receives the disconnected screen casting message, sends a stop playback instruction to Player, and sends an exit screen casting instruction to ViewModule. Player responds to the stop playback instruction, stops playing the mirrored screen, cleans up the screen casting data, releases player resources, and closes the player. ViewModule responds to the exit screen casting instruction, prompts that the screen casting has been disconnected, and the mirrored screen casting playback ends.

[0418] Fig.17 FIG3 is a timing interaction diagram of a method for processing a screen projection mode provided in some embodiments of the present application. Fig.16 Compared with the timing interaction diagram of the example, the difference between the two scenarios is: ModeManager determines that the projection media is the live media (real-time stream) pushed through VideoURL based on the Session information.

[0419] Based on the differences in screen projection scenarios, Fig.16 Compared with the example timing interaction diagram, the differences in the timing interaction logic of the two are mainly as follows:

[0420] ①See Fig.17 The screen casting sender sends the VideoURL corresponding to the screen casting media asset to CastServer. The Player responds to the playback instruction, obtains and plays the screen casting media asset according to the VideoURL, that is, pulls the live stream of the screen casting media asset.

[0421] ②See Fig.17 , when the timing time of Timer reaches the end point T of the i-th round interval mode ni , ModeManager sends an unblocking instruction to PlayStateManager. Fig.17 In response to the unblocking instruction, PlayStateManager can obtain the playback status of the projection media from the Player. Since the projection sender pushes live (real-time streaming) media to the projection receiver via VideoURL, the playback status of the projection media can include the live broadcast status and the live broadcast end status. In this way, PlayStateManager can send a decision instruction based on the playback status of the projection media.

[0422] ③See Fig.17, PlayStateManager responds to the unblocking instruction. If it finds that the projection media asset is in the live broadcast end state, it can send a first unblocking instruction to ViewModule (indicating the live broadcast end state). ViewModule responds to the first unblocking instruction, cancels the display of the preset blocking page, and prompts that the projection media asset has ended live. Since the projection media asset has ended live, there is no projection audio to play, so PlayStateManager does not need to send an unmute instruction to the Player.

[0423] ④See Fig.17 , PlayStateManager responds to the unblocking instruction. If it finds that the projected media is in a live broadcast state, it can send an unmute instruction to the Player and a second unblock instruction to the ViewModule (indicating that it is in a live broadcast state). In response to the unmute instruction, the Player can call the setMute(false) interface of the Session to unmute the projected media and resume playing with sound. In response to the second unblock instruction, the ViewModule cancels the display of the preset block page and continues to play the projected media from the current live broadcast progress.

[0424] ⑤See Fig.17 When the mode listener of ModeManager listens to the timing mode trigger event, ModeManager can decide to send instructions based on the playback status of the Player synchronization. If the projection media asset is in the live broadcast end state, ModeManager can send a live broadcast end message to ViewModule. ViewModule receives the live broadcast end message and prompts that the projection media asset has ended. If the projection media asset is in the live broadcast state, the first query instruction is sent to ViewModule to solicit the user's opinion to determine whether to disconnect the projection connection.

[0425] ⑦ When the mode listener of ModeManager listens to the timing mode trigger event, it can decide to send the command according to the playback status of the projection media ( Fig.17 (not shown in the figure). If the screen projection media asset is in the live broadcast end state, ModeManager can send a live broadcast end message to ViewModule. ViewModule receives the live broadcast end message and prompts that the screen projection media asset has ended. If the screen projection media asset is in the live broadcast state, a second query instruction is sent to ViewModule to solicit the user's opinion to determine whether to disconnect the screen projection connection. It should be noted that Fig.16 and Fig.17The example illustrates the timing interaction logic in a multi-mode scenario where the timing mode, interval mode, and timer mode are run in sequence according to the mode. If the user sets any one or more projection modes, the timing interaction logic can be adaptively adjusted based on the trigger conditions and mode actions of different modes, combined with the media playback status and the user's viewing needs.

[0426] In some embodiments, the user can configure a mode set according to usage requirements. The mode set can be presented as {timing mode}, {interval mode}, {timing mode}, {timing mode, interval mode}, {timing mode, timing mode}, {interval mode, timing mode}, {timing mode, interval mode, timing mode}. For different mode sets, the timing interaction logic in different scenarios can be adapted, and the software program configuration and flow interaction logic of each module in the mode application can be adapted.

[0427] In some embodiments, when the first projection mode is a timing mode, an interval mode or a timing mode, the first projection mode can be selected according to Figure 3B An example schema application architecture, or Figure 14 to Figure 17 The example's sequential interaction logic is implemented in the scenario of mirroring or pushing live media resources through VideoURL. According to the mode type, screen projection source information, resume time data and playback time data, it determines whether the resume end condition is met, processes the triggered first screen projection mode, and executes the matching target mode action, so as to adapt to the constraints and control of screen projection playback under different screen projection modes. In this way, the user's manual mode intervention is reduced, the mode processing efficiency and human-computer interaction efficiency are improved, and different modes can be intelligently and accurately controlled.

[0428] The screen projection receiving end may include a controller, and the controller executes the technical solution provided by at least one embodiment of the present application. When the screen projection receiving end configures and runs the mode application, when the mode application is controlled by the controller to execute the relevant program steps, the previous relevant embodiments can be referred to, and the interaction and flow of the underlying modules of the mode application can be used to realize the determination of the end condition of the continuation of different screen projection modes, the execution of mode actions, and the update and change of related UI. It will not be repeated here. The controller can also refer to but not limited to Figure 14 to Figure 17 The example timing interaction logic realizes the above functions of this application.

[0429] Some embodiments of the present application also provide a computer storage medium, which may store a program. When the computer storage medium is configured in the display device 200, the program may include all or part of the program steps involved in the screen projection mode processing method configured by the mode application or controller in the above embodiment. Among them, the computer storage medium may be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0430] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0431] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of this disclosure, so that those skilled in the art can better use the embodiments.

Claims

1. A display device, characterized in that: include: A display, for displaying a user interface; A communication device, used for data communication with a server; The controller is configured to execute: In response to receiving a screen projection instruction sent by a screen projection device, playing screen projection media resources; wherein the screen projection media resources are screen contents sent by the screen projection device, or the screen projection media resources are live media resources obtained from a server corresponding to the resource address contained in the screen projection instruction; Get the resume time data; During the process of playing the projection media asset, obtaining playback time data; If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes a disconnection of the screen projection operation or a play shielding operation of the screen projection media; wherein the play shielding operation is used to mute the screen projection media and switch it to an invisible state to shield the user from viewing and listening to the screen projection media; If, based on the playback time data and the resumed playback time data, it is determined that the resumed playback condition is not satisfied, the projection media asset continues to be played.

2. The display device according to claim 1, characterized in that The play time data includes the system time of the display device, and the resume play time data includes the preset time; The controller executes the target operation if it is determined based on the play time data and the resume play time data that the resume play end condition is satisfied, and is specifically configured as follows: If the system time reaches the preset time, stop playing the projection media and disconnect the projection connection with the projection device.

3. The display device according to claim 2, characterized in that The controller stops playing the projection media and disconnects the projection connection with the projection device if the current system time reaches the preset time. Specifically, the controller is configured as follows: when the system time reaches the preset time, the display is controlled to display a first prompt message, wherein the first prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, the projection media is stopped and the projection connection with the projection device is disconnected; The controller is also configured to continue playing the projected media if receiving an operation from the user to refuse to disconnect the projection connection.

4. The display device according to claim 2, characterized in that The controller stops playing the screen projection media resource and disconnects the screen projection connection with the screen projection device if the system time reaches the preset time. Specifically, the controller is configured as follows: When the system time reaches the preset time, query the type of the projection media resource; If the screen projection media is the screen content sent by the screen projection device, control the display to display a second prompt message, where the second prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; If the user agrees to disconnect the screen projection connection, stop playing the screen projection media asset and disconnect the screen projection connection with the screen projection device; The controller is also configured to continue playing the projected media if receiving an operation from the user to refuse to disconnect the projection connection.

5. The display device according to claim 4, characterized in that After the controller executes the query of the type of the projection media resource if the system time reaches the preset time, the controller is configured to: If the screen projection media asset is a live broadcast media asset, then the playback status of the screen projection media asset is obtained, and the playback status includes a live broadcast status or a live broadcast end status; If the screen projection media resource is in a live broadcast state, controlling the display to display a third prompt message, wherein the third prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; If the user agrees to disconnect the screen projection connection, stop playing the screen projection media asset and disconnect the screen projection connection with the screen projection device; If the user refuses to disconnect the screen projection connection, the screen projection media asset continues to be played.

6. The display device according to claim 5, characterized in that After executing the step of obtaining the playback status of the projected media asset if the projected media asset is a live media asset, the controller is further configured to: If the projected screen media resource is in a live broadcast end state, the display is controlled to display a fourth prompt message, and the fourth prompt message is used to prompt that the live broadcast of the projected screen media resource has ended.

7. The display device according to claim 1, characterized in that The play time data includes the play time of the projected media asset, and the continued play time data includes a first preset time; The controller executes the target operation if it is determined that the continuation broadcast end condition is met based on the playback time data and the projection screen continuation broadcast data, and is specifically configured as follows: If the broadcasting time of the projected media reaches the first preset time, the projected media is muted, and the display is controlled to display a preset shielding page on the upper layer of the playback interface of the projected media.

8. The display device according to claim 7, characterized in that The continuous broadcast time data also includes a second preset duration; After executing the operation of pausing the playing of the projected screen media asset if the playing time of the projected screen media asset reaches the first preset time, the controller is further configured to: When the broadcast duration of the projected media reaches the sum of the first preset duration and the second preset duration, the projected media is muted, and the display is controlled to cancel display of the preset blocking page.

9. The display device according to claim 8, characterized in that When the broadcasting time of the projected media reaches the sum of the first preset time and the second preset time, the controller cancels the muting of the projected media and controls the display to cancel the display of the preset shielding page. The specific configuration is: When the broadcast duration of the projected screen media reaches the sum of the first preset duration and the second preset duration, querying the type of the projected screen media; If the projection media is the screen content sent by the projection device, unmute the projection media and control the display to cancel display of the preset blocking page.

10. The display device according to claim 9, characterized in that After the controller queries the type of the projected screen media asset when the broadcast duration of the projected screen media asset reaches the sum of the first preset duration and the second preset duration, the controller is further configured to: If the screen projection media asset is a live broadcast media asset, then the playback status of the screen projection media asset is obtained, and the playback status includes a live broadcast status or a live broadcast end status; If the projected screen media is in a live broadcast state, unmute the projected screen media, control the display to cancel displaying the preset blocking page, and continue playing the projected screen media from the current live broadcast progress; If the projected screen media resource is in a live broadcast end state, the display is controlled to cancel displaying the preset shielding page, and the display is controlled to display a fifth prompt message, where the fifth prompt message is used to prompt that the live broadcast of the projected screen media resource has ended.

11. The display device according to claim 1, characterized in that The play time data includes the play time of the projected media asset, and the continued play time data includes a first preset time; The controller executes the target operation if it is determined based on the play time data and the resume play time data that the resume play end condition is satisfied, and is specifically configured as follows: If the broadcasting time of the projected media reaches the first preset time, the first round of interval mode is started, the projected media is muted, and the display is controlled to display a preset masking page on the upper layer of the playback interface of the projected media.

12. The display device according to claim 11, characterized in that The continuous broadcast time data also includes a second preset duration; The controller is further configured to: after starting the first round of interval mode and pausing the playing of the projection media asset; When the broadcast duration of the projected media reaches the sum of the first preset duration and the second preset duration, the first round of interval mode is exited, the projected media is muted, and the display is controlled to cancel display of the preset blocking page.

13. The display device according to claim 12, characterized in that After the controller exits the first round of interval mode, unmutes the projection media, and controls the display to cancel displaying the preset shielding page, the controller is further configured to: If the broadcasting time of the projection media reaches the starting time T of the interval mode of the i-th round mi , then the interval mode of the i-th round is started, the projection media asset is muted, and the display is controlled to display the preset shielding page on the upper layer of the playback interface of the projection media asset; wherein, T mi =i*t1+(i-1)*t2, t1 represents the first preset duration, t2 represents the second preset duration, i represents the round number in the interval mode, and i is greater than 1; If the broadcasting time of the projection media reaches the end time T of the interval mode of the i-th round ni , then exit the interval mode of the i-th round, unmute the projection media, and control the display to cancel the display of the preset shielding page; wherein, T ni =T mi +t2=i*(t1+t2).

14. The display device according to claim 1, characterized in that The play time data includes the play time of the projected media asset, and the continued play time data includes a third preset time; The controller executes the target operation if it is determined based on the playback time data and the continued playback time data that the casting and continued playback end condition is met, and is specifically configured as follows: If the broadcasting time of the projection media reaches the third preset time, the broadcasting of the projection media is stopped, and the projection connection with the projection device is disconnected.

15. The display device according to claim 14, characterized in that The controller stops playing the projection media and disconnects the projection connection with the projection device if the playback time of the projection media reaches the third preset time. The controller is specifically configured as follows: when the playback time of the projection media reaches the third preset time, controls the display to display a sixth prompt message, wherein the sixth prompt message is used to prompt the user whether to agree to disconnect the projection connection; if the user agrees to disconnect the projection connection, stops playing the projection media and disconnects the projection connection with the projection device; The controller is also configured to continue playing the projected media if receiving an operation from the user to refuse to disconnect the projection connection.

16. The display device according to claim 14, characterized in that The controller stops playing the projected media asset and disconnects the projected connection with the projected device if the projected media asset has been played for a third preset time. The controller is specifically configured as follows: When the broadcast duration of the screen projection media asset is equal to the third preset duration, querying the type of the screen projection media asset; If the screen projection media is the screen content sent by the screen projection device, control the display to display a seventh prompt message, where the seventh prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; If the user agrees to disconnect the screen projection connection, stop playing the screen projection media asset and disconnect the screen projection connection with the screen projection device; The controller is also configured to continue playing the projected media if receiving an operation from the user to refuse to disconnect the projection connection.

17. The display device according to claim 16, characterized in that The controller is configured to: after executing if the broadcast duration of the screen projection media asset is equal to the third preset duration, query the type of the screen projection media asset: If the screen projection media asset is a live broadcast media asset, then the playback status of the screen projection media asset is obtained, and the playback status includes a live broadcast status or a live broadcast end status; If the screen projection media resource is in a live broadcast state, controlling the display to display an eighth prompt message, wherein the eighth prompt message is used to prompt the user whether to agree to disconnect the screen projection connection; If the user agrees to disconnect the screen projection connection, stop playing the screen projection media asset and disconnect the screen projection connection with the screen projection device; If the user refuses to disconnect the screen projection connection, the screen projection media asset continues to be played.

18. The display device according to claim 17, characterized in that After executing the step of obtaining the playback status of the projected media asset if the projected media asset is a live media asset, the controller is further configured to: If the projected screen media resource is in a live broadcast end state, the display is controlled to display a ninth prompt message, and the ninth prompt message is used to prompt that the live broadcast of the projected screen media resource has ended.

19. A method for processing screen projection mode, characterized in that: include: In response to receiving a screen projection instruction sent by a screen projection device, playing screen projection media resources; wherein the screen projection media resources are screen contents sent by the screen projection device, or the screen projection media resources are live media resources obtained from a server corresponding to the resource address contained in the screen projection instruction; Get the resume time data; During the process of playing the projection media asset, obtaining playback time data; If it is determined that the resuming end condition is met based on the playing time data and the resuming time data, a target operation is performed; wherein the target operation includes a disconnection of the screen projection operation or a play shielding operation of the screen projection media; wherein the play shielding operation is used to mute the screen projection media and switch it to an invisible state to shield the user from viewing and listening to the screen projection media; If it is determined based on the playback time data and the continued playback time data that the continued playback condition is not met, the projection media asset continues to be played.

Images