Display device and screen projection method

Abstract

This application provides a display device and a screen projection method. The display device, in response to receiving a first screen projection instruction from a first screen projection device for playing a first multimedia resource, plays the first multimedia resource in a first screen projection window on the screen projection interface. In response to receiving a second screen projection instruction from the first screen projection device for playing a second multimedia resource, the display device determines second media asset information corresponding to the second multimedia resource based on the second screen projection instruction. If, based on the first and second media asset information, it is determined that the similarity of the first media asset satisfies the multi-channel screen projection condition, then the first multimedia resource continues to play in the first screen projection window on the screen projection interface, and the second multimedia resource is played in the second screen projection window on the screen projection interface. This application embodiment can enable multiple screen projections from the same screen projection device on the same display device, improving the user experience.

Description

Technical Field

[0001] This application relates to the field of display device technology, and more particularly to a display device and a projection method. Background Technology

[0002] With the development of communication technology, most display devices (such as televisions) have screen mirroring capabilities, allowing users to cast content (such as audio and video) from electronic devices (such as mobile phones) to the display device for playback. The same display device can support screen mirroring of content from different electronic devices. However, when a user wants to cast different content from the same electronic device to the same display device, the display device will replace the previously cast content with the second casting, failing to meet the user's need for multi-channel screen mirroring from the same electronic device and impacting the user experience. Summary of the Invention

[0003] To address the aforementioned issues, this application provides a display device and a screen projection method that can meet users' needs for multi-channel screen projection through the same device, thereby improving the user experience. Specifically:

[0004] A first aspect of this application provides a display device, including a display and a controller. The display device is configured to display a projection interface. The controller is coupled to the display and configured to: in response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, play the first multimedia resource in a first projection window of the projection interface; wherein the first projection instruction includes first media asset information corresponding to the first multimedia resource. In response to receiving a second projection instruction from the first projection device for playing a second multimedia resource, determine second media asset information corresponding to the second multimedia resource based on the second projection instruction. If, based on the first media asset information and the second media asset information, it is determined that the similarity of the first media asset satisfies the multi-channel projection condition, then the first multimedia resource continues to play in the first projection window of the projection interface, and the second multimedia resource is played in the second projection window of the projection interface.

[0005] Based on the above scheme, when the similarity of the media assets in the two projections meets the conditions for multi-projection, the display device can continue to play the first multimedia resource in the first projection window and play the second multimedia resource in another projection window (i.e., the second projection window) of the projection interface, thereby enabling multi-projection on the same display device through the same projection device.

[0006] In some embodiments, before the controller executes the operation of determining that the similarity between the first media asset information and the second media asset information satisfies the multi-channel projection condition, it is further configured to: in response to the first projection instruction, determine the first device information of the projection device that sent the first projection instruction; in response to the second projection instruction, determine the second device information of the projection device that sent the second projection instruction; and based on the first device information and the second device information, determine that both the projection device that sent the first projection instruction and the projection device that sent the second projection instruction are the first projection device.

[0007] Based on the above scheme, before performing multi-channel projection, the display device can first determine whether the projection device for the second projection is the same as the projection device for the first projection. If it is determined that the two projections are performed using the same device, the subsequent judgment on whether the similarity of the first media asset meets the conditions for multi-channel projection will continue. If it is determined that the two projections are not performed using the same device, multi-channel projection can be performed according to the DLNA protocol.

[0008] In some embodiments, the projection interface further includes a first menu display area corresponding to the first projection window. The first menu display area includes at least one first playback control control, which includes at least one of a first progress adjustment control, a first pause playback control, a first exit projection control, and a first full-screen playback control. After the controller executes the following actions: maintaining the first multimedia resource in the first projection window of the projection interface to continue playing the first multimedia resource, and playing the second multimedia resource in the second projection window of the projection interface, it is further configured to: adjust the playback progress of the first multimedia resource in the first projection window in response to receiving a control instruction from the control device on the first progress adjustment control; or, pause the playback of the first multimedia resource in the first projection window in response to receiving a control instruction from the control device on the first pause playback control; or, control the first multimedia resource to exit projection from the first projection window in response to receiving a control instruction from the control device on the first exit projection control; or, control the first multimedia resource to play in full-screen mode on the projection interface in response to receiving a control instruction from the control device on the first full-screen playback control.

[0009] Based on the above scheme, when the second projection window of the projection interface is playing the second multimedia resource, the first projection device cannot continue to control the playback of the first multimedia resource played in the first projection window. Therefore, the control device can input control commands to at least one first playback control control in the first menu display area corresponding to the first projection window to realize the control of adjusting the playback progress, pausing, exiting projection, and full-screen playback of the first multimedia resource.

[0010] In some embodiments, after the controller continues to play the first multimedia resource in the first projection window of the projection interface and plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: in response to a playback control command sent by the first projection device, perform a corresponding control operation on the second multimedia resource in the second projection window; wherein the control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

[0011] Based on the above solution, when the second projection window of the projection interface plays the second multimedia resource, the first projection device can control the playback progress, pause, and volume of the second multimedia resource played in the second projection window, thereby facilitating the user to control the playback of the first multimedia resource according to their needs.

[0012] In some embodiments, the projection interface further includes a second menu display area corresponding to the second projection window, the second menu display area including at least one second playback control control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, it is further configured to: in response to receiving a control instruction from the control device for at least one second playback control control, perform a corresponding control operation on the second multimedia resource in the second projection window; send playback information of the second multimedia resource to the first projection device, so that the first projection device updates the playback progress, playback duration, and playback status of the second multimedia resource according to the playback information.

[0013] Based on the above scheme, after the second projection window of the projection interface plays the second multimedia resource, the user can also input control commands to at least one second playback control control in the second menu display area corresponding to the second projection window through the control device to control the playback of the second multimedia resource. Simultaneously, the display device can send playback information of the second multimedia resource to the first projection device, so that the first projection device can update the playback progress, duration, and status of the second multimedia resource, achieving consistency in the playback of the second multimedia resource on both the display device and the first projection device. In other words,

[0014] Based on the above solutions, when the same projection device projects multiple media onto a display device, the user can perform playback control operations on the second multimedia resource (such as the media resource projected most recently by the projection device) through the projection device, or through the control device. However, for the first multimedia resource (such as the media resource projected by the projection device not recently), the user can only perform playback control operations on the first multimedia resource through the control device, and cannot perform playback control operations on the first multimedia resource through the projection device.

[0015] In some embodiments, before the controller executes a corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for at least one second playback control control, it is further configured to: control the focus to move between the first projection window and the second projection window in response to receiving a focus switching operation sent by the control device; and display the second menu display area corresponding to the second projection window when the focus moves to the second projection window.

[0016] Based on the above scheme, when controlling the playback progress of the second multimedia resource through the control device, the focus of the control device needs to be switched to the second projection window first. When the focus is on the second projection window, the projection interface can display the second menu display area corresponding to the second projection window. After the second menu display area is displayed, control commands can be input to at least one second playback control control in the second menu display area through the control device to perform corresponding playback control of the second multimedia resource in the second projection window.

[0017] In some embodiments, at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit projection control, and a second full-screen playback control. The controller executes a corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for at least one second playback control control. Specifically, it is configured to: adjust the playback progress of the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the second progress adjustment control; pause the playback of the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the second pause playback control; control the second multimedia resource to exit projection from the second projection window in response to receiving a control instruction from the control device for the second exit projection control; and control the second multimedia resource to play in full-screen mode on the projection interface in response to receiving a control instruction from the control device for the second full-screen playback control.

[0018] Based on the above scheme, after the second projection window of the projection interface plays the second multimedia resource, the user can input control commands to at least one second playback control control in the second menu display area corresponding to the second projection window through the control device as needed, so as to perform controls such as adjusting the playback progress of the first multimedia resource, pausing, exiting projection, and full-screen playback.

[0019] In some embodiments, the controller executes the following: maintaining the first multimedia resource in the first projection window of the projection interface and playing the second multimedia resource in the second projection window of the projection interface. Specifically, this is configured to: continue receiving the first multimedia resource sent by the server corresponding to the first projection address based on the first projection address in the first projection instruction; maintain the first multimedia resource in the first projection window and send a first notification message to the first projection device, and play the second multimedia resource in the second projection window; wherein the display device can receive the control operation of the first projection device on the second multimedia resource, and the first notification message is used to notify the first projection device that the first multimedia resource has exited projection.

[0020] Based on the above scheme, after receiving the second projection command from the first projection device, the display device can send a first notification message to the first projection device to notify it that the first multimedia resource has exited projection. Simultaneously, in order to maintain playback of the first multimedia resource in the first projection window, the display device can continue to retrieve and play the first multimedia resource from the server based on the first projection address in the first projection command, and play the second multimedia resource in the second projection window. This enables multiple multimedia resources from the same projection device to be projected onto the display device via multiple channels.

[0021] In some embodiments, the controller is configured to maintain the playback of the first multimedia resource in the first projection window, send a first notification message to the first projection device, and play the second multimedia resource in the second projection window. This is further configured to: maintain the playback of the first multimedia resource in the first projection window, release the binding relationship between the first projection device and the first multimedia resource, and send a first notification message to the first projection device; create a binding relationship between the first projection device and the second multimedia resource, and play the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

[0022] Based on the above scheme, after receiving the second projection command from the first projection device, the display device can unbind the first projection device from the first multimedia resource and send a first notification message to the first projection device that the first multimedia resource has exited projection. Simultaneously, the display device creates a binding relationship between the first projection device and the second multimedia resource, ensuring that the user can control the playback of the second multimedia resource through the first projection device.

[0023] In some embodiments, before the controller executes a second screen casting instruction sent by the first screen casting device for playing the second multimedia resource, it is further configured to: send a second notification message to the first screen casting device in response to receiving a stop screen casting instruction for stopping the playback of the first multimedia resource; wherein the second notification message is used to notify the first screen casting device that the first multimedia resource has exited screen casting; and to release the binding relationship between the first screen casting device and the first multimedia resource.

[0024] Based on the above scheme, if the display device receives a stop screen casting instruction to stop playing the first multimedia resource before receiving the second screen casting instruction, it can release the binding relationship between the first screen casting device and the first multimedia resource, and notify the first screen casting device that the first multimedia resource has exited screen casting with a second notification message. This makes it easier for the display device to play the second multimedia resource that the first screen casting device has cast again in the second screen casting window, thereby enabling multiple multimedia resources of the same screen casting device to be cast multiple times on the display device.

[0025] In some embodiments, the controller executes the following: maintaining the first multimedia resource in the first projection window of the projection interface and playing the second multimedia resource in the second projection window of the projection interface. Specifically, this is configured to: continue receiving the first multimedia resource sent by the server corresponding to the first projection address based on the first projection address in the first projection instruction; maintain the first multimedia resource in the first projection window and continue playing it; create a binding relationship between the first projection device and the second multimedia resource, and play the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

[0026] Based on the above scheme, after receiving a stop casting command, the display device can receive a second casting command sent by the first casting device, and create a binding relationship between the first casting device and the second multimedia resource according to the second casting command, so that the first casting device can control the second multimedia resource. Simultaneously, the second multimedia resource is played in the second casting window, realizing multi-channel casting of multiple multimedia resources from the same casting device onto the display device.

[0027] In some embodiments, the controller is further configured to: in response to receiving an acquisition request sent by the first projection device, determine playback information of a second multimedia resource bound to the first projection device; and send the playback information of the second multimedia resource to the first projection device; wherein the playback information includes at least one of the playback progress, playback duration, and playback status of the second multimedia resource.

[0028] Based on the above scheme, the first projection device can actively send a request to the display device to obtain the playback information of the second multimedia resource. The display device sends the playback information of the second multimedia resource to the first projection device according to the request, so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource, thereby achieving consistency in the playback of the second multimedia resource on the display device and the first projection device.

[0029] In some embodiments, the controller performs a process based on first media asset information and second media asset information to determine that the similarity of the first media asset satisfies the multi-channel projection condition. Specifically, this is configured to: determine the similarity type of the first media asset based on the first media asset information and the second media asset information; if the similarity type of the first media asset is a first type, then determine that the similarity of the first media asset satisfies the multi-channel projection condition; wherein, the first type is used to indicate that the similarity of the first media asset is lower than a first similarity threshold.

[0030] Based on the above scheme, the display device determines whether the similarity of the first media asset meets the conditions for multi-channel projection according to the similarity type of the first media asset similarity. When the similarity of the first media asset is lower than the first similarity threshold, that is, when the similarity between the first media asset information and the second media asset information is low, it is determined that the similarity of the first media asset meets the conditions for multi-channel projection, and multi-channel projection can be performed. Therefore, the display device of this application can perform multi-channel projection of multiple multimedia resources with low similarity (or dissimilarity).

[0031] In some embodiments, the similarity type of the first media asset similarity is a first type including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to multimedia resources of different dramas.

[0032] Based on the above scheme, when the first multimedia resource and the second multimedia resource are multimedia resources of different series, such as when the first multimedia resource and the second multimedia resource are different or unrelated TV series (or movies), multi-channel screen casting of the first multimedia resource and the second multimedia resource can be realized.

[0033] In some embodiments, the controller is further configured to: if the similarity type of the first media asset similarity is a second type, determine that the first media asset similarity does not meet the multi-channel projection conditions; wherein, the second type is used to indicate that the first media asset similarity is higher than a second similarity threshold; control the first multimedia resource to exit projection from the first projection window, and play the second multimedia resource in the first projection window.

[0034] Based on the above scheme, when the similarity type of the first media asset is the second type, the first media asset similarity does not meet the conditions for multi-channel casting. In this case, the display device does not perform multi-channel casting, but performs substitution casting, that is, the second multimedia resource replaces the first multimedia resource for playback in the first casting window. Therefore, when the user needs to switch between different episodes or resolutions of the currently watched series (such as TV series), the display device can directly perform the substitution operation instead of multi-channel casting, which improves the user experience.

[0035] In some embodiments, the similarity type of the first media asset similarity is the second type, including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information are different multimedia resources of the same series or the same multimedia resource with different media asset parameters.

[0036] Based on the above scheme, when the first multimedia resource and the second multimedia resource belong to different multimedia resources of the same series (such as different episodes), or have different media asset parameters (such as different resolutions), the similarity type of the first media asset similarity is the second type. Therefore, when a user needs to switch between different episodes or resolutions of the currently viewed series (such as a TV drama), the display device can directly switch operations instead of multi-channel screen casting, thus improving the user experience.

[0037] In some embodiments, the controller performs the function of determining the similarity type of the first media asset similarity, specifically configured to: preprocess the first title information in the first media asset information to obtain processed first title information; preprocess the second title information in the second media asset information to obtain processed second title information; if the processed first title information and the processed second title information are different, then the similarity type of the first media asset similarity is determined to be a first type; if the processed first title information and the processed second title information are the same, then the similarity type of the first media asset similarity is determined to be a second type.

[0038] Based on the above scheme, the title information in the first and second media asset information is preprocessed, and the two preprocessed title information are compared. If the two preprocessed title information are the same, it indicates that the first and second multimedia resources are similar; if they are the same, it indicates that the first and second multimedia resources are not similar. Since the title information corresponding to multimedia resources in different applications may be different, irrelevant information (such as numbers and spaces) can be removed from the title information during preprocessing. By comparing the main information (such as name characters) retained in the title information, the similarity type of the first media asset can be determined more accurately.

[0039] In some embodiments, before the controller determines that the similarity of the first media asset satisfies the multi-channel projection conditions based on the first media asset information and the second media asset information, it is further configured to: determine the resource type of the first multimedia resource based on the first projection address in the first projection instruction; determine the resource type of the second multimedia resource based on the second projection address in the second projection instruction; if the resource type of the first multimedia resource and the resource type of the second multimedia resource are both online resources, then determine whether the similarity of the first media asset satisfies the multi-channel projection conditions based on the first media asset information and the second media asset information.

[0040] Based on the above scheme, before determining whether the similarity of the first media asset meets the conditions for multi-channel projection, the resource types of the multimedia resource to be projected (i.e., the second multimedia resource) and the multimedia resource already projected (such as the first multimedia resource) can be determined first. When both the multimedia resource to be projected and the multimedia resource already projected are online resources, the process of determining whether the similarity of the first media asset meets the conditions for multi-channel projection will begin. This application, by determining the resource type of the multimedia resource in advance, can eliminate the need to determine whether local resources meet the conditions for multi-channel projection, thereby improving projection efficiency.

[0041] In some embodiments, the controller is further configured to: if the resource type of the first multimedia resource is a local resource, and / or the resource type of the second multimedia resource is a local resource, then control the first multimedia resource to exit the casting window and play the second multimedia resource in the first casting window.

[0042] Based on the above solution, when either the multimedia resource to be projected (i.e., the second multimedia resource) or the multimedia resource already projected (such as the first multimedia resource) is a local resource, there is no need to proceed with the process of determining whether the similarity of the first multimedia resource meets the multi-channel projection conditions. This application, by pre-determining the resource type of the multimedia resource, can substitute for a local resource when it is determined that a local resource exists, eliminating the need for further multi-channel projection condition determination and improving projection efficiency.

[0043] In some embodiments, after the controller executes the following steps: maintaining the first projection window in the projection interface to continue playing the first multimedia resource, and playing the second multimedia resource in the second projection window in the projection interface, it is further configured to: in response to receiving a third projection instruction sent by the first projection device for playing a third multimedia resource, determine the third media asset information corresponding to the third multimedia resource based on the third projection instruction; if, based on the first media asset information and the third media asset information, it is determined that the similarity of the second media asset satisfies the multi-channel projection condition, and based on the second media asset information and the third media asset information, it is determined that the similarity of the third media asset satisfies the multi-channel projection condition, and there is no idle projection window in the projection interface that has not played multimedia resources, then determine the third projection window among the multiple projection windows included in the projection interface; maintain the corresponding multimedia resource in the projection windows other than the third projection window in the projection interface to continue playing, and play the third multimedia resource in the third projection window.

[0044] Based on the above solution, when there are no idle projection windows on the display device's projection interface, if the first projection device initiates projection of a third multimedia resource, then if a similar multimedia resource exists among the already played multimedia resources, the third multimedia resource will be projected in place of the similar multimedia resource; if no similar multimedia resource exists among the already played multimedia resources, one projection window will be selected to play the third multimedia resource, while other projection windows will continue playing the corresponding multimedia resource. This application, when there are no idle projection windows on the projection interface, can determine the projection window for the multimedia resource to be projected according to preset rules, thereby ensuring that the display device can always project and play the user's latest projected multimedia resource, improving the user experience.

[0045] In some embodiments, the controller performs the function of determining a third projection window among multiple projection windows included in the projection interface. Specifically, it is configured to: determine any one of the multiple projection windows as the third projection window; or, determine the third projection window among the multiple projection windows based on the projection time of each projection window in the multiple projection windows; or, in response to receiving a window selection instruction, determine the projection window corresponding to the window selection instruction as the third projection window.

[0046] Based on the above solutions, this application provides multiple methods for determining the projection window of a third multimedia resource, thereby determining the most suitable projection window for the third multimedia resource, ensuring that the display device can always project and play the latest multimedia resource projected by the user, and improving the user experience.

[0047] In some embodiments, before the controller executes a first casting instruction sent by the first casting device for playing a first multimedia resource, it is further configured to: launch the multi-cast application in response to receiving a launch operation for the multi-cast application.

[0048] Based on the above solution, before casting the first multimedia resource, the display device can have already started the multi-cast application, that is, entered the multi-cast mode. Therefore, when casting the second multimedia resource, the display device does not need to enter the multi-cast mode again, but can directly execute multi-cast, which improves the casting efficiency.

[0049] In some embodiments, if the controller determines that the similarity of the first media asset satisfies the multi-channel projection conditions based on the first media asset information and the second media asset information, then it maintains the first projection window in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface. Specifically, this is configured as follows: if it is determined that the similarity of the first media asset satisfies the multi-channel projection conditions based on the first media asset information and the second media asset information, then a projection selection window is displayed; in response to receiving a user's selection operation on the first option in the projection selection window, the controller maintains the first projection window in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface.

[0050] Based on the above solution, this application can display a casting selection window before determining whether to add casting windows for multi-channel casting based on the user's selection. Multi-channel casting is only executed when the user confirms it, thus avoiding the situation where multi-channel casting still occurs even when the user wants to perform a substitution casting, and also preventing user errors and improving user experience.

[0051] In some embodiments, the controller is further configured to: in response to receiving a user's selection operation on the second option in the casting selection window, control the first multimedia resource to exit the casting from the first casting window and play the second multimedia resource in the first casting window; or, in response to receiving a user's selection operation on the third option in the casting selection window, maintain the first casting window in the casting interface to continue playing the first multimedia resource.

[0052] Based on the above solution, users can also choose to replace or cancel screen casting in the casting selection window according to their needs. The display device, based on the user's selection, controls the first multimedia resource to exit the first casting window and play the second multimedia resource in the first casting window; or, it cancels the casting of the second multimedia resource and continues playing the first multimedia resource in the first casting window. This application can determine the casting method according to user needs, providing users with more casting options and improving the user experience.

[0053] A second aspect of this application provides a display device, including a display and a controller. The display device is configured to display a projection interface. The controller is coupled to the display and configured to: in response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, acquire the first multimedia resource and play it in a first projection window of the projection interface; in response to receiving a second projection instruction from the first projection device for playing a second multimedia resource, acquire the second multimedia resource; if, based on the first and second multimedia resources, the similarity of the second multimedia resource satisfies the multi-channel projection condition, then the first multimedia resource continues to play in the first projection window of the projection interface, and the second multimedia resource is played in a second projection window of the projection interface.

[0054] The display device provided in this application embodiment, when receiving a first projection instruction from a first projection device and playing a first multimedia resource in a first projection window, upon receiving a second projection instruction from the first projection device (i.e., the same projection device), can determine whether the similarity of the second multimedia resource meets the multi-projection conditions based on the first and second multimedia resources. If the similarity of the second multimedia resource meets the multi-projection conditions, the display device can continue playing the first multimedia resource in the first projection window and play the second multimedia resource in another projection window (i.e., the second projection window) of the projection interface. The display device provided in this application embodiment enables the same projection device (such as a mobile phone) to perform multi-projection of multiple multimedia resources (such as video sources) on the same display device (such as a television device), improving the user experience.

[0055] A third aspect of this application provides a display device, including a display and a controller. The display device is configured to display a projection interface. The controller is coupled to the display and configured to: in response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, acquire the first multimedia resource and play the first multimedia resource in a first projection window of the projection interface; wherein the first projection instruction includes first title information of the first multimedia resource. In response to receiving a second projection instruction from the first projection device for playing a second multimedia resource, if it is determined based on the second projection instruction that the second projection instruction includes second title information of the second multimedia resource, then determine the similarity between the first title information and the second title information. If the similarity between the first title information and the second title information satisfies a multi-channel projection condition, then the first multimedia resource continues to play in the first projection window of the projection interface, and the second multimedia resource is played in the second projection window of the projection interface.

[0056] The display device provided in this application embodiment, when receiving a first casting command from a first casting device and playing a first multimedia resource in a first casting window, upon receiving a second casting command from the same first casting device, can determine the similarity between the first and second title information if the first casting command includes first title information of the first multimedia resource and the second casting command includes second title information of the second multimedia resource. When the similarity between the first and second title information satisfies the multi-casting condition, the display device can continue playing the first multimedia resource in the first casting window and play the second multimedia resource in another casting window (the second casting window) of the casting interface. The display device provided in this application embodiment enables the same casting device (such as a mobile phone) to perform multi-casting of multiple multimedia resources (such as video sources) on the same display device (such as a television device), improving the user experience.

[0057] A fourth aspect of this application provides a display device, including a display and a controller. The display device is configured to display a projection interface. The controller is coupled to the display and configured to: in response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, acquire the first multimedia resource and play the first multimedia resource in a first projection window of the projection interface. In response to receiving a second projection instruction from the first projection device for playing a second multimedia resource, if it is determined based on the second projection instruction that the second projection instruction does not include second title information of the second multimedia resource, then acquire the second multimedia resource. If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the second multimedia resource satisfies the multi-channel projection condition, then the first multimedia resource continues to play in the first projection window of the projection interface, and the second multimedia resource is played in a second projection window of the projection interface.

[0058] The display device provided in this application embodiment receives a first casting command from a first casting device and plays a first multimedia resource in a first casting window. When it receives a second casting command from the first casting device (i.e., the same casting device), if either the first or second casting command does not include title information, it determines whether the similarity of the second media resource meets the multi-casting conditions based on the first and second multimedia resources. If the similarity of the second media resource meets the multi-casting conditions, the display device can continue playing the first multimedia resource in the first casting window and play the second multimedia resource in another casting window (i.e., the second casting window) of the casting interface. The display device provided in this application embodiment enables the same casting device (such as a mobile phone) to perform multi-casting of multiple multimedia resources (such as video sources) on the same display device (such as a television device), improving the user experience. Attached Figure Description

[0059] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0060] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0061] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0062] Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0063] Figure 4A A schematic diagram illustrating a screen mirroring process provided for some embodiments of this application;

[0064] Figure 4B A schematic diagram illustrating a screen mirroring method provided in some embodiments of this application;

[0065] Figure 5A A schematic diagram illustrating information interaction during a screen mirroring process, provided for some embodiments of this application;

[0066] Figure 5B A schematic diagram of a screen projection interface provided for some embodiments of this application;

[0067] Figure 6 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application;

[0068] Figure 7 A schematic diagram illustrating information interaction in another screen projection process provided by some embodiments of this application;

[0069] Figure 8 A schematic diagram illustrating another screen projection interface provided in some embodiments of this application;

[0070] Figure 9 This is a schematic diagram illustrating information interaction in another screen projection process provided by some embodiments of this application;

[0071] Figure 10 A schematic diagram illustrating yet another screen projection method provided in some embodiments of this application;

[0072] Figure 11 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application;

[0073] Figure 12 A schematic diagram illustrating yet another screen projection interface provided in some embodiments of this application;

[0074] Figure 13 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application;

[0075] Figure 14 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application;

[0076] Figure 15 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application;

[0077] Figure 16 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application;

[0078] Figure 17 A schematic diagram illustrating another screen mirroring process provided for some embodiments of this application;

[0079] Figure 18 This is a schematic diagram illustrating yet another screen projection process provided in some embodiments of this application. Detailed Implementation

[0080] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0081] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0082] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0083] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0084] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0085] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0086] In some examples, display device 200 refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc. The embodiments of this application do not limit the type of display device 200.

[0087] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 for data exchange. In some embodiments, the mobile terminal 300 can have software applications installed on it and establish a communication connection with the display device 200 via a network communication protocol to achieve one-to-one control operations and data communication. Furthermore, audio and video content displayed on the mobile terminal 300 can be transmitted to the display device 200 for synchronized display.

[0088] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0089] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. For example, the display device 200 can communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0090] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0091] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0092] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0093] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0094] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0095] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0096] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0097] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0098] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0099] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0100] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0101] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0102] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0103] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0104] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0105] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0106] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0107] like Figure 3As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0108] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0109] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0110] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0111] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0112] As display devices (such as televisions) grow larger, the application of multi-channel projection is becoming increasingly widespread. Multi-channel projection allows multiple video sources to be projected simultaneously onto the large screen of a display device, enabling multiple users to watch their respective content on the same screen at the same time. DLNA (Digital Living Network Alliance) projection is a projection technology based on the DLNA protocol. DLNA projection allows users to transmit audio, video, and images pushed by the projection initiating device (hereinafter referred to as the projection device) to the projection receiving device (hereinafter referred to as the display device) via a wireless network, enabling the sharing and playback of multimedia content.

[0113] In some examples, DLNA screen mirroring distinguishes sessions based on Internet Protocol Address (IP). Screen mirroring devices with different IPs can perform multiple screen mirrorings on the same display device, but screen mirroring devices with the same IP cannot perform multiple screen mirrorings on the same display device. The DLNA protocol specifies that command interaction and events are based on short HTTP connections. Each command involves a separate HTTP request and response. The HTTP request does not carry information about the software used by the screen mirroring device; that is, the display device cannot distinguish which app on the screen mirroring device sent the screen mirroring command. Therefore, when different apps on the same screen mirroring device, or the same app on the same screen mirroring device, perform screen mirroring, the later screen mirroring will replace the previous screen mirroring from the same IP address screen mirroring device.

[0114] Figure 4A This is a schematic diagram illustrating a screen mirroring process provided for some embodiments of this application. For example, Figure 4A The screen mirroring process in the example uses a mobile phone as an example, with the screen mirroring interface of the display device consisting of two screen mirroring windows.

[0115] like Figure 4A As shown in (a), when neither mobile phone 1 nor mobile phone 2 initiates screen mirroring, neither of the two screen mirroring windows (such as the first screen mirroring window and the second screen mirroring window) on the screen mirroring interface of the display device plays the video source.

[0116] like Figure 4AAs shown in (b), when mobile phone 1 initiates screen mirroring of video source 1, the first mirroring window plays video source 1 pushed by mobile phone 1; when mobile phone 2 does not initiate screen mirroring, the second mirroring window does not play video source 1. Here, mobile phone 1 and mobile phone 2 are different mobile phones, meaning that the IP addresses of mobile phone 1 and mobile phone 2 are different.

[0117] like Figure 4A As shown in (c), when video source 1 is playing in the first casting window and mobile phone 1 initiates casting of video source 2 again, although the second casting window on the right side of the casting interface has no casting content, because the IP address of the second casting is the same as the IP address of the first casting, video source 1 will exit the casting from the first casting window, and video source 2 cast by mobile phone 1 in the first casting window will play. That is, when the same IP address performs two castings, the video source 2 cast in the second casting will replace the video source 1 cast in the first casting window, and the video source 2 cast by mobile phone 1 in the most recent casting will play.

[0118] like Figure 4A As shown in (d), when mobile phone 2 initiates the casting of video source 3, since there is no video source cast by IP 2 in the current casting window of the casting interface, and there is a second casting window on the right side of the casting interface that can be cast, the video source 2 pushed by mobile phone 2 can be played in the second casting window; at the same time, the first casting window continues to play the video source 2 pushed by mobile phone 1.

[0119] As can be seen from the above process, the screen casting solutions in the relevant technologies can only enable dual-channel screen casting of two video sources pushed by different screen casting devices on the display device, and cannot enable dual-channel screen casting of two video sources pushed by the same screen casting device on the display device.

[0120] Based on the above, it can be seen that when using DLNA for screen casting, if a user needs to cast multiple video sources simultaneously to the same display device, they must use multiple casting devices (such as mobile phones) to cast separately. It is impossible to cast multiple video sources from the same casting device to the same display device simultaneously. Furthermore, mobile video apps typically require a membership to watch. If a user wants to cast different video sources from the same video app to the same display device, they need to subscribe to memberships on different mobile phones, resulting in a poor user experience.

[0121] To address the aforementioned issues, this application provides a display device that, when playing a first multimedia resource projected by a first projection device in a first projection window, upon receiving a second projection instruction from the first projection device (i.e., the same projection device), can determine whether the similarity of the first media asset meets the multi-projection conditions based on the first media asset information in the first projection instruction and the second media asset information in the second projection instruction. If the first media asset similarity meets the multi-projection conditions, the display device can continue playing the first multimedia resource in the first projection window and play the second multimedia resource projected a second time in another projection window (i.e., the second projection window) of the projection interface. The display device provided in this application can simultaneously project multiple video sources pushed by the same projection device onto the display device when the media asset similarity meets the multi-projection conditions. In other words, the display device provided in this application supports multi-projection from the same projection device onto the display device, thus improving the user's projection experience.

[0122] Figure 4B This is a schematic diagram illustrating a screen mirroring method provided in some embodiments of this application. The following is in conjunction with... Figure 4B The screen projection method provided in this application embodiment will be described in detail. For example, this screen projection method can be implemented by the controller 250 in the display device 200. Figure 4B As shown, the screen projection method includes steps 410 to 430 as shown below.

[0123] Step 410: In response to receiving a first screen casting instruction from the first screen casting device for playing the first multimedia resource, play the first multimedia resource in the first screen casting window of the screen casting interface.

[0124] In some examples, display device 200 is a screen casting receiving device and screen casting sending device. Users can send screen casting commands to display device 200 through screen casting device. Display device 200 receives screen casting commands and plays the multimedia resources corresponding to the screen casting commands on display 260 according to the screen casting commands.

[0125] For example, the display device 200 can be a television, a projector, or a computer, and the projection device can be a smartphone, a computer, or other projection devices. This application does not limit the types of display devices and projection devices; the following embodiments use a television as an example and a mobile phone as a projection device for illustrative purposes.

[0126] For example, the display 260 of the display device 200 is used to display a projection interface. The projection interface may include at least one projection window, and each projection window is used to play multimedia resources pushed by the projection device. The multimedia resources may include video, audio, images, text, etc. This application embodiment does not limit the type of multimedia resources; the following embodiment uses video as an example for illustrative purposes.

[0127] In some examples, before the first casting device sends the first casting command, the display device may display the casting interface, or other interfaces, such as a media asset list page, a media asset playback page, or the interface of any application on the display device. When the display device displays the casting interface before the first casting device sends the first casting command, the casting interface may include at least one casting window. The at least one casting window may all be in an idle state (i.e., not playing the casting source), some casting windows may be in an idle state, or all windows may be in a casting state (i.e., playing the casting source).

[0128] For example, the first casting instruction can be a casting instruction sent by the first casting device to the display device 200 for the first casting, or it can be a casting instruction sent by the first casting device to the display device 200 for any subsequent casting. When the first casting instruction is a first casting instruction, no media data is being cast on the display device 200 before the first casting device sends the first casting instruction, such as at least one casting window on the casting interface being in an idle state. When the first casting instruction is any casting instruction, the display device 200 may already be playing the casting source before the first casting device sends the first casting instruction, such as the casting interface including casting windows in a casting state. The following embodiments use a first casting instruction as an example for illustrative explanation.

[0129] In some embodiments, prior to step 410, the method further includes: launching the multi-cast application in response to receiving a launch operation for the multi-cast application.

[0130] For example, the display device 200 may enter the multi-cast application before receiving the first casting command. For instance, the user can send a start command for the multi-cast application to the display device 200 through the control device 100 (such as a remote control), and the display device 200 will start the multi-cast application according to the start command; or, the user can also send a start command for the multi-cast application to the display device 200 through voice, which is not limited in this embodiment.

[0131] In some examples, the multi-cast application is an application for multi-channel screen casting within the display device 200. That is, when the multi-cast application is launched, the display device 200 can support multiple screen casting operations by the casting devices. Specifically, after the display device 200 launches the multi-cast application, the monitor 260 can display a casting interface, which may include one casting window or multiple casting windows.

[0132] For example, when the display device 200 receives the first projection instruction sent by the first projection device, the projection interface displayed on the display 260 (hereinafter referred to as the first projection interface) may include one projection window or multiple projection windows.

[0133] For example, if the first projection interface includes one projection window, i.e., the first projection window, then the first multimedia resource is played in the first projection window. If the first projection interface includes multiple projection windows, then one projection window is selected from the multiple projection windows as the first projection window, and the first multimedia resource is played in the first projection window. The first projection window can be any one of the multiple projection windows.

[0134] For example, before receiving the first casting instruction, the display device 200 may not need to launch the multi-cast application. In this case, in response to the first casting instruction, the first multimedia resource is played directly in the first casting window. At this time, the casting interface may only include one casting window, namely the first casting window. That is to say, when the casting interface includes one casting window, the display device 200 may or may not launch the multi-cast application.

[0135] In some examples, the first projection instruction is an instruction to instruct the display device 200 to play a first multimedia resource. After receiving the first projection instruction, the display device 200 parses the first projection instruction, obtains the first media resource information in the first projection instruction, and plays the first multimedia resource in the first projection window of the first projection interface according to the first media resource information.

[0136] For example, users can select the source of the video to be cast within the application of the casting device, and then select to cast to the display device in the casting options of the casting device, thereby triggering the sending of a casting command to the display device.

[0137] In some examples, the media asset information may include the title and casting address of the multimedia resource to be cast. The title may include the name, episode number, and brief description of the multimedia resource; the casting address may be the Uniform Resource Locator (URL) address corresponding to the multimedia resource to be cast. For example, the URL address may be the server address corresponding to the multimedia resource to be cast, and the display device 200 can obtain the multimedia resource to be cast from the server based on the URL address.

[0138] In some examples, before sending the first casting command, the first casting device can send a stop casting command to control it to exit the casting of the currently casting multimedia resource. Since the first casting command is the first casting attempt by the first casting device, and the display device 200 currently has no multimedia resource playing, there is no need to perform an exit casting operation. After receiving the first casting command, it plays the first multimedia resource in the first casting window. The casting command can be called the SetAVTransportURI command, and the stop casting command can be called the stop command.

[0139] Figure 5A This is a schematic diagram illustrating information interaction during a screen mirroring process, provided for some embodiments of this application. The following is in conjunction with... Figure 5A This section explains the initial screen mirroring process. It should be noted that... Figure 5A The first screen projection device is a mobile phone, and the display device 200 includes modules such as a protocol stack module, a screen projection session management module, a display interface module, and a player module, which will be used as an example for illustration.

[0140] like Figure 5A As shown, firstly, the mobile phone sends a stop command to the protocol stack module of the display device. Based on the received stop command, the protocol stack module obtains the mobile phone's IP address through the communication socket and sends the mobile phone's IP address and the stop command to the screen casting session management module. If the screen casting session management module detects that the mobile phone currently has no screen casting content based on the IP address, it does not perform any corresponding processing.

[0141] Next, the phone sends a SetAVTransportURI command to the protocol stack module. Based on the received SetAVTransportURI command, the protocol stack module obtains the phone's IP address via a communication socket and sends the phone's IP address and the SetAVTransportURI command to the screen mirroring session management module. If the screen mirroring session management module detects that the phone currently has no screen mirroring content, it creates a new screen mirroring session 1 and records the binding relationship between the IP address and session 1. Simultaneously, the screen mirroring session management module starts an Activity and passes session 1 to the display interface module. The display interface module creates a playback view component (such as SurfaceView1 or SurfaceView1) and binds it to session 1. The screen mirroring session management module creates player 1, passing the URL 1 of source 1 from the SetAVTransportURI command and the Surface1 of the playback view 1 created by the application to the player module; and stores the binding relationship between player 1, IP address, URL 1, and the Surface1 of playback view 1 in session 1. The player module decodes and plays source 1 and notifies the screen mirroring session management module of events such as preparation completion, first frame, and resolution change. The screen mirroring session management module determines the corresponding session 1 based on the binding relationship between the player and the session, and notifies the display interface module to adjust the display and layout, and passes session 1 and the corresponding event to the display interface module. The display interface module adjusts the interface layout based on the binding relationship between session 1 and View 1 to complete the playback of video source 1.

[0142] It should be noted that, Figure 5A This example illustrates how the screen-casting device may send a stop command (such as a stop command) before sending the screen-casting command (such as the SetAVTransportURI command). In other examples, depending on the screen-casting application, the screen-casting device may not send a stop command before sending the SetAVTransportURI command. When the screen-casting device does not send a stop command before sending the screen-casting command, it can be done through... Figure 5A Steps 5 through 17 are used for the initial screen mirroring, which will not be repeated here.

[0143] Step 420: In response to receiving a second projection instruction sent by the first projection device for playing the second multimedia resource, determine the second media resource information corresponding to the second multimedia resource based on the second projection instruction.

[0144] In some examples, after the display device plays the first multimedia resource in the first projection window of the projection interface (i.e., the first projection interface), the user can also send a second projection command to the display device 200 through the first projection device, i.e., to perform a second projection. The second projection command instructs the display device 200 to play the second multimedia resource. After receiving the second projection command, the display device 200 parses and processes the command to obtain the second multimedia resource information corresponding to it.

[0145] For example, the first multimedia resource and the second multimedia resource can be multimedia resources from different applications (hereinafter referred to as APPs) in the first screen projection device, or multimedia resources from the same APP in the first screen projection device. This application embodiment does not limit this.

[0146] For example, a user can select a first multimedia resource in a first app on the first casting device and send a first casting command to the display device 200 to play the first multimedia resource. After the first multimedia resource is played in the first casting window of the first casting interface, the user can select a second multimedia resource in a second app on the first casting device and send a second casting command to the display device 200 to play the second multimedia resource. The first app and the second app are different apps; for example, the first app could be the Tencent Video app on the first casting device, and the second app could be the iQiyi app on the first casting device. This application embodiment does not limit the types of the first app and the second app.

[0147] For example, a user can select a first multimedia resource in the first app of the first screen casting device and send a first screen casting command to the display device 200 to play the first multimedia resource; after the first multimedia resource is played in the first screen casting window of the first screen casting interface, the user can continue to select a second multimedia resource in the first app of the first screen casting device and send a second screen casting command to the display device 200 to play the second multimedia resource.

[0148] Step 430: If, based on the first media asset information and the second media asset information, it is determined that the similarity of the first media asset satisfies the multi-channel projection conditions, then the first projection window in the projection interface continues to play the first multimedia resource, and the second multimedia resource is played in the second projection window in the projection interface.

[0149] For example, if the display device 200 has already started the multi-cast application before receiving the second casting instruction, and the casting interface displays multiple casting windows, then in response to the second casting instruction, the second multimedia resource can be played in the idle casting window (the second casting window) among the multiple casting windows where no casting source is playing; or, if the display device 200 has already started the multi-cast application before receiving the second casting instruction, and the casting interface displays one casting window, then in response to the second casting instruction, a new second casting window can be created and the second multimedia resource can be played in the second casting window.

[0150] If the display device 200 has not started the multi-cast application before receiving the second casting instruction, the display device 200 may start the multi-cast application in response to the second casting instruction and display the casting interface (hereinafter referred to as the second casting interface) when it receives the second casting instruction. The second casting interface may include multiple casting windows, including the first casting window and the second casting window.

[0151] In some examples, the number of casting windows in the first and second casting interfaces may be the same or different. For example, if the display device 200 has already launched the multi-cast application before receiving the first casting instruction, and the first casting interface includes multiple casting windows, then the number of casting windows in the second casting interface is the same as that in the first casting interface. If the display device 200 launches the multi-cast application before receiving the first casting instruction, but the displayed first casting interface includes only one casting window, or if the display device 200 launches the multi-cast application after receiving the second casting instruction, then the number of casting windows in the second casting interface is different from that in the first casting interface.

[0152] For example, the first projection interface may include a first projection window for playing a first multimedia resource, and the second projection interface may include a first projection window for playing a first multimedia resource and a second projection window for playing a second multimedia resource; or, the first projection interface may include a first projection window for playing a first multimedia resource and an idle second projection window, and the second projection interface may include a first projection window for playing a first multimedia resource and a second projection window for playing a second multimedia resource.

[0153] Figure 5B This is a schematic diagram of a screen mirroring interface provided for some embodiments of this application, such as... Figure 5B As shown in (a), the first projection interface 50 includes only one projection window, namely the first projection window 50a, which plays the first multimedia resource. After the second projection, as shown in (a), Figure 5B As shown in (c), the size and layout of the first projection window 50a are adjusted, and the first multimedia resource is continuously played in the first projection window 51a in the second projection interface 51, while the second multimedia resource is played in the second projection window 51b.

[0154] like Figure 5B As shown in (b), the first projection interface 50 includes multiple projection windows, namely a first projection window 50a and a second projection window 50b. The first projection window 50a plays the first multimedia resource, while the second projection window 50b is in an idle state. After the second projection, as shown in (b), Figure 5B As shown in (c), there is no need to adjust the size and layout of the first projection window 50a and the second projection window 50b. The first projection window 50a in the second projection interface 51 continuously plays the first multimedia resource, and the second projection window 50b plays the second multimedia resource.

[0155] For example, before performing step 430, it can be further determined whether the screen-sharing devices that send the first screen-sharing instruction (i.e., the first screen-sharing) and the second screen-sharing instruction (i.e., the second screen-sharing) are the same screen-sharing device.

[0156] For example, if the screen mirroring device that sends the first screen mirroring command and the screen mirroring device that sends the second screen mirroring command are the same screen mirroring device, then continue to execute step 430. If the screen mirroring device that sends the first screen mirroring command and the screen mirroring device that sends the second screen mirroring command are different screen mirroring devices, then there is no need to execute step 430. The second multimedia resource can be played directly in another screen mirroring window of the screen mirroring interface. That is, different screen mirroring devices can directly perform multi-channel screen mirroring on the display device 200.

[0157] Figure 6 This is a schematic diagram illustrating another screen mirroring method provided in some embodiments of this application. For example... Figure 6 As shown, prior to step 430, the method further includes steps 610 to 630 as shown below.

[0158] Step 610: In response to the first screen mirroring command, determine the first device information of the screen mirroring device that sent the first screen mirroring command.

[0159] Step 620: In response to the second screen mirroring command, determine the second device information of the screen mirroring device that sent the second screen mirroring command.

[0160] It should be noted that step 610 can be executed after step 410 or after step 420, and step 620 can be executed after step 420. When both steps 610 and 620 are executed after step 420, this embodiment does not limit the order in which steps 610 and 620 are executed. This embodiment uses the example of step 610 being executed after step 410 and step 620 being executed after step 420 for illustrative purposes.

[0161] In some examples, after receiving a first projection instruction, the display device 200 can obtain and store the first device information of the projection device that sent the first projection instruction; after receiving a second projection instruction, it can obtain and store the second device information of the projection device that sent the second projection instruction. Then, the first device information and the second device information are compared.

[0162] In some examples, the device information of the screen-casting device may include the IP address of the screen-casting device and / or the Media Access Control Address (MAC) of the screen-casting device. The following embodiments use the IP address as an example for illustrative purposes, such as the first device information being a first IP address and the second device information being a second IP address.

[0163] Continue to refer to Figure 5A After receiving the first projection command, the protocol stack module of display device 200 obtains the first IP address of the projection device that sent the first projection command through the communication socket, and sends the first projection command (SetAVTransportURI) and the first IP address to the projection session management module. Similarly, as... Figure 7 As shown, after receiving the second screen projection command, the display device 200 can also obtain the second IP address of the screen projection device that sent the second screen projection command through the communication socket.

[0164] Step 630: Based on the first device information and the second device information, determine that both the screen projection device that sends the first screen projection command and the screen projection device that sends the second screen projection command are the first screen projection device.

[0165] In some examples, after obtaining the first device information (such as the first IP address) and the second device information (such as the second IP address), if the display device 200 determines that the first device information and the second device information are the same, that is, determines that the two screen projection devices are the same screen projection device, then it continues to execute step 430.

[0166] For example, if it is determined that the first device information and the second device information are different, that is, the two screen projection devices are not the same screen projection device, then according to the LDNA screen projection protocol, the display device 200 can continue to play the first multimedia resource in the first screen projection window and play the second multimedia resource in another screen projection window in the screen projection interface.

[0167] The following explanation addresses the scenario where both the first and second screen mirroring commands are sent from the first screen mirroring device.

[0168] In some examples, when the display device 200 determines that the two screen mirroring attempts are made by the same device, it can determine the similarity of the first media asset based on the first media asset information and the second media asset information. The first media asset information includes the first title information and / or the first screen mirroring address; the second media asset information includes the second title information and / or the second screen mirroring address.

[0169] For example, when the similarity of the first media resource meets the conditions for multi-channel projection, it is determined that the first multimedia resource and the second multimedia resource can be projected onto the display device 200.

[0170] In some embodiments, step 430 includes: determining the similarity type of the first media asset similarity based on the first media asset information and the second media asset information; if the similarity type of the first media asset similarity is a first type, then it is determined that the first media asset similarity meets the multi-channel projection condition. If the similarity type of the first media asset similarity is a second type, then it is determined that the first media asset similarity does not meet the multi-channel projection condition.

[0171] For example, a first type is used to indicate that the similarity of the first media asset is lower than a first similarity threshold, or that the first media asset information is not similar to the second media asset information. A second type is used to indicate that the similarity of the first media asset is higher than a second similarity threshold, or that the first media asset information is similar to the second media asset information. The first similarity threshold and the second similarity threshold may be the same or different.

[0172] In some embodiments, the similarity type of the first media asset similarity is a first type, including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to multimedia resources of different TV series. The similarity type of the first media asset similarity is a second type, including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to different multimedia resources of the same TV series or are the same multimedia resource with different media asset parameters. The first multimedia resource and the second multimedia resource can be media assets of different applications or media assets of the same application.

[0173] For example, when the first multimedia resource is a TV series and the second multimedia resource is a movie, the first multimedia resource and the second multimedia resource belong to multimedia resources of different TV series. That is, when the first multimedia resource and the second multimedia resource belong to different categories, they belong to multimedia resources of different TV series. When the first multimedia resource and the second multimedia resource belong to the same category, they may belong to multimedia resources of different TV series or they may belong to multimedia resources of the same TV series.

[0174] In some examples, when the first multimedia resource and the second multimedia resource belong to the same category, if the first multimedia resource and the second multimedia resource are not media assets of the same TV series (or movie), then the first multimedia resource and the second multimedia resource belong to multimedia resources of different series. If the first multimedia resource and the second multimedia resource are media assets of the same TV series (or the same movie), or if the first multimedia resource and the second multimedia resource are media assets of related TV series (or movies), then the first multimedia resource and the second multimedia resource belong to multimedia resources of the same series.

[0175] For example, the TV series "Empresses in the Palace" on Tencent Video APP and the TV series "Peppa Pig" on iQiyi APP (or Tencent Video APP) are different series; the TV series "Empresses in the Palace" on Tencent Video APP and the TV series "Empresses in the Palace" on iQiyi APP (or Tencent Video APP) are the same series.

[0176] For example, the movie "Detective Chinatown" on Tencent Video APP and the movie "A Chinese Odyssey" on iQiyi APP (or Tencent Video APP) are different series; the movie "Detective Chinatown" on Tencent Video APP and the movie "Detective Chinatown 2" on iQiyi APP (or Tencent Video APP) are the same series.

[0177] In other examples, multiple videos posted by the same user within the same app can also belong to the same series. For instance, in the Bilibili app, different videos posted by the same video blogger can belong to the same series.

[0178] For example, when the first media resource and the second multimedia resource are different multimedia resources of the same series, or when the first media resource and the second multimedia resource are the same multimedia resource with different media asset parameters, the similarity type of the first media asset similarity is the second type. Here, different multimedia resources of the same series can be different episodes of the same TV series or movie, and the media asset parameters can include media asset resolution.

[0179] For example, the similarity type between episode 1 and episode 2 of the TV series "Empresses in the Palace" is type 2, which is similar media asset; or, the similarity type between episode 1 of "Empresses in the Palace" at the first resolution and episode 1 of "Empresses in the Palace" at the second resolution is also type 2, which is similar media asset.

[0180] In some examples, when the first multimedia resource and the second multimedia resource are of the first type, these two sources are dissimilar. In this case, the similarity of the first media resource meets the conditions for multi-channel projection, and the display device 200 can perform multi-channel projection on the first multimedia resource and the second multimedia resource. When the first multimedia resource and the second multimedia resource are of the second type, these two sources are similar. In this case, the similarity of the first media resource does not meet the conditions for multi-channel projection, and the display device 200 does not perform multi-channel projection. Instead, it performs a projection replacement operation, removing the first multimedia resource from the first projection window and playing the second multimedia resource in the first projection window.

[0181] For example, when casting episode 1 of "Empresses in the Palace" to a display device, and then casting episode 5 of "Peppa Pig" to the display device, since episode 1 of "Empresses in the Palace" and episode 5 of "Peppa Pig" are not similar, the display device 200 can enter multi-channel casting. It can continue playing episode 1 of "Empresses in the Palace" in one casting window of the display device, while playing episode 5 of "Peppa Pig" in another casting window of the display device.

[0182] For example, if you cast episode 1 of "Empresses in the Palace" to a display device, and then select to cast episode 2 of "Empresses in the Palace" to the display device on the casting device, the display device 200 will not enter multi-channel casting because episode 1 and episode 2 are similar. Or, if you cast episode 1 of "Empresses in the Palace" at a resolution of 720P to a display device, and then select to cast episode 1 of "Empresses in the Palace" at a resolution of 1080P to the display device on the casting device, the display device 200 will not enter multi-channel casting because episode 1 at a resolution of 720P and episode 2 at a resolution of 1080P are similar.

[0183] In some embodiments, determining the similarity type of the first media asset similarity based on the first media asset information and the second media asset information includes: preprocessing the first title information in the first media asset information to obtain processed first title information; preprocessing the second title information in the second media asset information to obtain processed second title information; if the processed first title information and the processed second title information are different, then the similarity type of the first media asset similarity is determined to be a first type; if the processed first title information and the processed second title information are the same, then the first media asset similarity is determined to be a second type.

[0184] In some examples, the media asset information includes the title information of the multimedia resource. After determining the first media asset information and the second media asset information, the display device 200 can further obtain the first title information and the second title information, and preprocess the first title information and the second title information. The title information can be in string format.

[0185] For example, the preprocessing operation may include removing a first preset character from a first string corresponding to a first title information, and removing a first preset character from a second string corresponding to a second title information, and comparing the first string and the second string after removing the first preset character respectively.

[0186] The first preset character can include numeric characters and general characters. For example, numeric characters can include Arabic numerals, Chinese numerals, and English numerals, while general characters can include punctuation marks, spaces, etc.

[0187] In some examples, if the first string after removing the first preset character and the second string are different, the similarity type of the first media asset similarity is the first type; if the first string after removing the first preset character and the second string are the same, the similarity type of the first media asset similarity is the second type.

[0188] For example, the preprocessing operation may further include extracting substrings before and / or after a second preset character in the first string and the second string, i.e., the first substring and the second substring, and comparing whether the first substring and the second substring are consistent. If the first substring and the second substring are inconsistent, the similarity type of the first media asset similarity is determined to be a first type; if the first substring and the second substring are consistent, the similarity type of the first media asset similarity is determined to be a second type.

[0189] For example, the first multimedia resource is the TV series "Time is Just Right" on the iQiyi APP, and the first title information corresponding to the first media asset information is: "Time is Just Right Episode 1: Xu Meng'an's Company Begins Layoffs" (i.e., the first string). The second multimedia resource is the TV series "Time is Just Right" on the Tencent Video APP, and the second title information corresponding to the second media asset information is: "Episode 2: Time is Just Right" (i.e., the second string). Since the first substring before the second preset character "Episode 1" of the first string is "Time is Just Right", and the second substring after the second preset character "Episode 2" of the second string is also "Time is Just Right", the similarity type of the first media asset similarity is the second type, that is, the first multimedia resource and the second multimedia resource are similar.

[0190] For example, if it is determined that the similarity of the first media resource meets the conditions for multi-channel projection, the first multimedia resource continues to be played in the first projection window, and the second multimedia resource is played in the second projection window of the projection interface.

[0191] In some examples, when the projection interface includes multiple projection windows, a second multimedia resource can be played in a second projection window within the multiple projection windows; when the projection interface includes only one projection window, a second projection window can be added to the projection interface, and the second multimedia resource can be played in the added projection window. For example, the display device 200 can adjust the size and layout of the first projection window on the projection interface so that the projection interface can simultaneously include both the first and second projection windows, with the first projection window playing the first multimedia resource and the second projection window playing the second multimedia resource.

[0192] For example, the first screen-casting device may send a stop screen-casting command before sending the second screen-casting command, or it may not send a stop screen-casting command.

[0193] In some embodiments, when the first screen-casting device does not send a stop screen-casting command before sending the screen-casting command, the above step 430 includes: continuing to receive the first multimedia resource sent by the server corresponding to the first screen-casting address based on the first screen-casting address in the first screen-casting command; maintaining the playback of the first multimedia resource in the first screen-casting window, sending a first notification message to the first screen-casting device, and playing the second multimedia resource in the second screen-casting window.

[0194] The display device 200 can receive control operations from the first projection device on the second multimedia resource, and the first notification message is used to notify the first projection device that the first multimedia resource has exited projection.

[0195] In some embodiments, while the first multimedia resource continues to play in the first projection window, the binding relationship between the first projection device and the first multimedia resource can be released, and a first notification message can be sent to the first projection device; a binding relationship between the first projection device and the second multimedia resource can be created, and the second multimedia resource can be played in the second projection window, so that the first projection device can control the second multimedia resource.

[0196] For example, after receiving the second projection instruction, the display device 200 will notify the first projection device that the first multimedia resource has exited projection. However, the display device 200 can continue to obtain the first multimedia resource from the server corresponding to the first multimedia resource according to the first projection address (i.e., the first URL) in the first projection instruction, thereby maintaining the playback of the first multimedia resource in the first projection window.

[0197] In some examples, the server can be a cloud server, such as each application having its own server, or multiple applications corresponding to one server. This application embodiment does not limit this. The display device 200 can obtain the corresponding multimedia resources from the corresponding server based on the obtained projection address (i.e., URL).

[0198] For example, after receiving the second projection instruction, the display device 200 can send a first notification message to the first projection device to notify it that it has exited projection of the first multimedia resource. Simultaneously, the display device 200 releases the binding relationship between the first multimedia resource and the first projection device. The first notification message can be a stop event. The display device 200 can also play the second multimedia resource in the second projection window according to the second projection instruction and create a binding relationship between the second multimedia resource and the first projection device. In some examples, the binding relationship between the projection device and the multimedia resource can also be considered as the binding relationship between the projection device and the projection session corresponding to the multimedia resource.

[0199] In some examples, after the binding relationship between the first multimedia resource and the first projection device is removed, the first projection device cannot perform control operations on the first multimedia resource played in the first projection window on the display device 200. When the binding relationship between the second multimedia resource and the first projection device is created, the first projection device can perform control operations on the currently projected second multimedia resource.

[0200] In other words, when the display device 200 determines that the similarity of the first media resource meets the conditions for multi-channel projection, it can remove the binding relationship between the first projection device and the first multimedia resource of the previous projection, and create a binding relationship between the first projection device and the second multimedia resource of the current projection, so as to ensure that the first projection device can always control the playback of the multimedia resource of the current projection.

[0201] For example, the first screen-casting device may also send a stop screen-casting command before sending the second screen-casting command.

[0202] In some embodiments, prior to step 430 above, the method further includes: in response to receiving a stop casting command for stopping playback of the first multimedia resource, sending a second notification message to the first casting device; and releasing the binding relationship between the first casting device and the first multimedia resource. The second notification message is used by the first casting device to indicate that the first multimedia resource has exited casting.

[0203] For example, if the first projection device sends a stop projection command to the display device 200 before sending the second projection command, the display device 200 will release the binding relationship between the first projection device and the first multimedia resource according to the stop projection command.

[0204] For example, a user can select "Exit Screen Casting" in the screen casting options of the first screen casting device's app to send a stop screen casting command to the display device 200; or, when a user performs a screen casting operation on a second multimedia resource through the first screen casting device, the first screen casting device can automatically send a stop screen casting command to the display device 200.

[0205] For example, the second notification message sent according to the stop screen casting command can be the same as the first notification message sent according to the second screen casting command, such as both being stop event notifications.

[0206] In some embodiments, step 430 includes: continuing to receive the first multimedia resource sent by the server corresponding to the first projection address based on the first projection address in the first projection instruction; maintaining the playback of the first multimedia resource in the first projection window; creating a binding relationship between the first projection device and the second multimedia resource, and playing the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

[0207] In some examples, after the first projection device sends a stop projection command to the display device 200, the display device 200 can directly create a binding relationship between the first projection device and the second multimedia resource after receiving the second projection command sent by the first projection device, so that the first projection device can control the second multimedia resource.

[0208] It should be noted that when the first projection device does not send a stop projection command to the display device 200 before sending the second projection command, the display device 200 releases the binding relationship between the first multimedia resource and the first projection device according to the second projection command; when the first projection device sends a stop projection command to the display device 200 before sending the second projection command, the display device 200 releases the binding relationship between the first multimedia resource and the first projection device according to the stop projection command.

[0209] Figure 7 This is a schematic diagram illustrating information interaction in another screen projection process provided by some embodiments of this application. The following is in conjunction with... Figure 7 The second screen mirroring process will be explained. It should be noted that... Figure 7 The first screen projection device is a mobile phone, and the display device 200 includes modules such as a protocol stack module, a screen projection session management module, a display interface module, and a player module, which will be used as an example for illustration.

[0210] like Figure 7As shown, during the second screen mirroring, firstly, the mobile phone sends a stop command to the display device's protocol stack module. Based on the received stop command, the protocol stack module obtains the mobile phone's IP address via a communication socket and sends the IP address and the stop command to the screen mirroring session management module. The screen mirroring session management module detects that a dual-screen mirroring mode is currently in effect on the same mobile phone based on the IP address. Since a screen mirroring session 1 already exists for the current IP address, it unbinds the IP address from session 1. After unbinding the IP address from session 1, the screen mirroring session management module sends a stop event notification to the protocol stack module. The protocol stack module then sends this stop event notification to the mobile phone. Based on the stop event notification, the mobile phone exits the control page for the previous screen mirroring session, thus preventing further control operations on the previous screen mirroring session (i.e.,...). Figure 7 Steps 31-37 in the process.

[0211] Then, the mobile phone sends the SetAVTransportURI command to the protocol stack module. Based on the received SetAVTransportURI command, the protocol stack module obtains the mobile phone's IP address through the communication socket and sends the mobile phone's IP address and the SetAVTransportURI command to the screen projection session management module.

[0212] It should be noted that if the mobile phone sends the SetAVTransportURI command but not the stop command, steps 41 and 43 must be executed after step 40 to unbind the mobile phone from session 1. If the mobile phone sends the stop command before sending the SetAVTransportURI command, steps 41 to 43 do not need to be executed. Steps 41 to 43 are similar to steps 34 to 37 described above, and will not be repeated here. In other words, whether the mobile phone sends the stop command affects the timing of the screen mirroring session management module unbinding the IP address from session 1.

[0213] Next, if the casting session management module determines that source 2 cast from the same IP address is a similar source to source 1 in session 1, it exits playback in session 1. Simultaneously, based on the binding relationship between sessions and players, the casting session management module stops player 1 corresponding to session 1 and notifies the display interface module to exit playback display in session 1. The display interface module clears View1 and other displays, and re-layouts the interface (i.e.,...). Figure 7 Steps 44-47 in the text.

[0214] If the screen mirroring session management module determines that the video source 2 currently mirrored from the same IP address is dissimilar to video source 1 in session 1, then a new screen mirroring session 2 is created, and the binding relationship between the IP address and session 2 is recorded (i.e., Figure 7 Step 48). The subsequent playback process for video source 2 (steps 49 to 57) is the same as the steps for playing video source 1 described above. Figure 5A Steps 9 to 17 in the previous section are similar and will not be repeated here to avoid repetition.

[0215] In some examples, after the first multimedia resource is unbound from the first projection window, the first projection device cannot control the playback of the first multimedia resource. That is, the user cannot continue to control the playback of the first multimedia resource played in the first projection window through the first projection device, such as pausing, fast forwarding, rewinding, and exiting.

[0216] To ensure that users can control the playback of the unbound first multimedia resource, this application embodiment provides a menu display area on the screen projection interface. This menu display area may include multiple playback controls. Users can input control commands to each playback control through a control device (such as a remote control) to control the playback of the first multimedia resource.

[0217] For example, each projection window of the projection interface may be provided with a menu display area, the menu display area including at least one playback control control, the at least one playback control control including at least one of a progress adjustment control, a pause playback control, an exit projection control, and a full-screen playback control.

[0218] For example, the progress adjustment control is used to adjust the playback progress of multimedia resources playing in the casting window, including fast forward and rewind adjustments. The pause playback control is used to pause / cancel the playback of multimedia resources playing in the casting window. The exit casting control is used to exit the casting interface from the multimedia resources playing in the casting window. The full-screen playback control is used to play the multimedia resources playing in the casting window in full-screen mode on the casting interface.

[0219] In some examples, each projection window on the projection interface has a corresponding menu display area. Multimedia resources whose binding relationship has been broken can be controlled for playback via the playback controls in their respective menu display areas. In other examples, projection windows for multimedia resources whose binding relationship has not been broken can also have menu display areas, and these resources can also be controlled for playback via the playback controls in their respective menu display areas.

[0220] In some embodiments, the screen mirroring interface also includes a menu display area corresponding to each screen mirroring window. This menu display area can always be displayed at its corresponding position within the screen mirroring window (e.g., below, above, or to the side of the screen mirroring window), or it can be displayed only when the focus is switched to the screen mirroring window. For example, the screen mirroring interface can directly display the menu display area corresponding to each screen mirroring window, or the menu display area can be brought up using a focus switching command.

[0221] For example, the screen mirroring interface also includes a first menu display area corresponding to the first screen mirroring window. The first menu display area includes at least one first playback control control, which includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen mirroring control, and a first full-screen playback control.

[0222] In some examples, when the first multimedia resource played in the first projection window is unbound from the first projection device, the first projection device cannot control the playback of the first multimedia resource. In this case, the playback control of the first multimedia resource can be achieved through at least one first playback control control in the first menu display area corresponding to the first projection window.

[0223] In some embodiments, after step 430 above, the method further includes: adjusting the playback progress of the first multimedia resource in the first projection window in response to receiving a control instruction input by the control device to the first progress adjustment control; pausing the playback of the first multimedia resource in the first projection window in response to receiving a control instruction input by the control device to the first pause playback control; controlling the first multimedia resource to exit the projection window in response to receiving a control instruction input by the control device to the first exit projection control; and controlling the first multimedia resource to play in full screen on the projection interface in response to receiving a control instruction input by the control device to the first full-screen playback control.

[0224] In some examples, the first projection window of the projection interface plays a first multimedia resource, and the second projection window plays a second multimedia resource. The focus of the control device can currently be located in either the first or the second projection window. When the user needs to control the playback of the first multimedia resource through the control device, they can first switch the focus to the first projection window to bring up the first menu display area corresponding to the first projection window. Of course, the first menu display area can also always be displayed in the corresponding position of the first projection window.

[0225] For example, if the first menu display area is displayed below the first projection window, the user can use the control device to move the focus to any of the first playback control controls in the first menu display area to input control commands, thereby enabling the user to control the first multimedia resource to pause / cancel pause, adjust the progress, exit projection, and play in full screen.

[0226] In some examples, the display device 200 adjusts the playback progress of a first multimedia resource in the first projection window in response to receiving a control command input from the control device to the first progress adjustment control. For example, the control device can control the playback progress of the first multimedia resource to move forward or backward.

[0227] In some examples, the display device 200 pauses the playback of the first multimedia resource in the first projection window in response to receiving a control command input from the control device to the first pause playback control. For example, when the user inputs another control command to the first pause playback control via the control device, the paused first multimedia resource can be resumed (i.e., the pause can be canceled).

[0228] In some examples, the display device 200, in response to receiving a control instruction from the control device for the first exit casting control, controls the first multimedia resource to exit casting from the first casting window.

[0229] For example, when the first multimedia resource exits the casting process, the first casting window becomes an idle casting window. At this time, the first menu display area can remain displayed or be removed from the display. If the first menu display area is removed, it can be displayed again when a new multimedia resource is cast to the first casting window. As another example, when the first multimedia resource exits the casting process, the display of the first casting window can also be removed, the size of the second casting window can be adjusted, and only the second casting window can be displayed directly on the casting interface.

[0230] In some examples, the display device 200 controls the first multimedia resource to play in full screen on the projection interface in response to receiving a control instruction input by the control device to the first full-screen playback control.

[0231] For example, when a user inputs a control command to the first full-screen playback control through the control device, the display device 200 can adjust the size and layout of the first projection window to enlarge the first projection window and occupy the entire projection interface, and maintain the first projection window playing the first multimedia resource during the adjustment process.

[0232] For example, when the user inputs control commands to the first full-screen playback control again through the control device, the user can control the first multimedia resource to exit full-screen playback, that is, readjust the size and layout of the first projection window so that the projection interface re-enters multi-channel projection playback. Alternatively, the user can also control the first multimedia resource to exit full-screen through preset buttons (such as the back button, exit button) on the control device; this application embodiment does not limit this.

[0233] Figure 8 This is a schematic diagram illustrating another screen mirroring interface provided in some embodiments of this application. For example... Figure 8 As shown, the screen mirroring interface includes a first screen mirroring window and a second screen mirroring window; wherein, the first screen mirroring window plays a first multimedia resource sent by the first screen mirroring device, and the second screen mirroring device plays a second multimedia resource sent by the first screen mirroring device.

[0234] like Figure 8 As shown, taking the display of the menu area corresponding to the first projection window when the focus is switched to the projection window as an example, when the focus is switched to the first projection window via the control device, the first menu display area corresponding to the first projection window is displayed in the projection interface. The first menu display area includes multiple playback control controls, namely: full-screen playback control, rewind playback control (such as the first progress adjustment control), pause / cancel pause playback control, fast forward playback control (such as another first progress adjustment control), volume control control, and exit projection control.

[0235] In some embodiments, after step 430 above, the method further includes: in response to a playback control command received from the first projection device, performing a corresponding control operation on the second multimedia resource in the second projection window. The control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

[0236] In some examples, after the display device 200 establishes a binding relationship between the second multimedia resource and the first projection device, the user can control the playback of the second multimedia resource currently playing in the second projection window through the first projection device. For example, the user can control the playback progress, pause / cancel pause, volume, and exit projection of the second multimedia resource through the playback control items on the projection interface of the first projection device (such as a mobile phone).

[0237] In some embodiments, the projection interface further includes a second menu display area corresponding to the second projection window, and the second menu display area includes at least one second playback control control. The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit projection control, and a second full-screen playback control.

[0238] In some examples, in addition to controlling the playback of the second multimedia resource played in the second projection window through the first projection device, the playback of the second multimedia resource can also be controlled through the second menu display area corresponding to the second projection window.

[0239] In some embodiments, in response to receiving a focus switching operation sent by a control device, the control focus is moved between a first projection window and a second projection window; when the focus moves to the second projection window, a second menu display area corresponding to the second projection window is displayed.

[0240] In some embodiments, in response to receiving a control instruction input by the control device to the second progress adjustment control, the playback progress of the second multimedia resource in the second projection window is adjusted; in response to receiving a control instruction input by the control device to the second pause playback control, the playback of the second multimedia resource in the second projection window is paused; in response to receiving a control instruction input by the control device to the second exit projection control, the second multimedia resource is controlled to exit projection from the second projection window; and in response to receiving a control instruction input by the control device to the second full-screen playback control, the second multimedia resource is controlled to play in full-screen mode on the projection interface.

[0241] In some examples, when controlling the playback of a second multimedia resource via a control device, it is necessary to move the focus of the control device to the second projection window. When the focus moves to the second projection window, a second menu display area can be brought up. By inputting control commands through the control device to at least one playback control control in the second menu display area, the playback control of the second multimedia resource can be achieved.

[0242] It should be noted that the control method of the second menu display area is similar to that of the first menu display area mentioned above, and will not be repeated here to avoid repetition.

[0243] The screen projection method provided in this application allows for the following: For a first multimedia resource whose binding relationship has been removed, a first menu display area can be set up, and control commands can be input to at least one first playback control control in the first menu display area via a control device to achieve playback control of the first multimedia resource. For a second multimedia resource whose binding relationship has been created, playback control can be achieved either through the first screen projection device or by inputting control commands to at least one second playback control control in the second menu display area via a control device.

[0244] In some embodiments, after step 430, the method further includes: in response to receiving a control instruction input by the control device to at least one second playback control control, performing a corresponding control operation on the second multimedia resource in the second projection window; and sending playback information of the second multimedia resource to the first projection device so that the first projection device updates the playback progress, playback duration, and playback status of the second multimedia resource according to the playback information.

[0245] In some embodiments, in response to receiving an acquisition request from a first projection device, playback information of a second multimedia resource bound to the first projection device is determined; and the playback information of the second multimedia resource is sent to the first projection device. The playback information includes at least one of the following: playback progress, playback duration, and playback status of the second multimedia resource.

[0246] In some examples, the display device 200 may proactively send playback information of the second multimedia resource to the first projection device so that the first projection device can update the playback of the second multimedia resource; or, the first projection device may proactively obtain playback information of the second multimedia resource from the display device 200 and update the playback of the second multimedia resource based on the obtained playback progress, playback duration, and playback status of the second multimedia resource.

[0247] Figure 9 This is a schematic diagram illustrating information interaction in another screen projection process provided by some embodiments of this application. The following is in conjunction with... Figure 9 This section explains the playback controls during the screen mirroring process. It should be noted that... Figure 9 The first screen projection device is a mobile phone, and the display device 200 includes modules such as a protocol stack module, a screen projection session management module, a display interface module, and a player module, which will be used as an example for illustration.

[0248] in, Figure 9 The image shows the process of controlling the playback of the first multimedia resource in the first projection window via a mobile phone during the first screen projection process.

[0249] like Figure 9 As shown, the mobile phone can send pause (hereinafter referred to as Pause) and progress (hereinafter referred to as Seek) commands to the protocol stack module of the display device 200. The protocol stack module obtains the mobile phone's IP address through the communication socket and sends the mobile phone's IP address and Pause, Seek, and other commands to the screen projection session management module. The screen projection session management module finds the corresponding player 1 according to the session relationship, performs Pause and Seek control, and notifies the display interface module to display the corresponding status, progress, etc., and transmits session 1. The display interface module adjusts the progress bar, play button, and other controls corresponding to View1 (i.e., Figure 9Steps 18 to 23 in the process.

[0250] For example, the mobile phone can periodically send commands such as GetPositionInfo to the protocol stack module to obtain playback progress and duration information. The protocol stack module obtains the mobile phone's IP address through a communication socket and sends the mobile phone's IP address and GetPositionInfo and GetTransportInfo commands to the screen mirroring session management module. The screen mirroring session management module finds the corresponding player 1 based on the session relationship, reads the playback progress, duration, and playback status from the display interface module, and returns the read playback progress, duration, and playback status to the protocol stack module. The protocol stack module then returns the information to the mobile phone, which updates the playback progress, duration, and playback status information (i.e.,...). Figure 9 Steps 24 to 30 in the process.

[0251] The screen projection method provided in this application embodiment allows a first projection device to proactively obtain playback information of a second multimedia resource with an established binding relationship from a display device and update that playback information. The display device can also proactively send playback information of the second multimedia resource with an established binding relationship to the first projection device, thereby achieving consistency in the playback information of multimedia resources on the projection device and the display device, and improving the user experience.

[0252] The following explains the case where the similarity type of the first media asset is the second type, meaning that the similarity of the second media asset does not meet the conditions for multi-channel projection.

[0253] Figure 10 A schematic diagram illustrating yet another screen mirroring method provided in some embodiments of this application, such as... Figure 10 As shown, after step 420 above, the method further includes steps 440 and 450.

[0254] Step 440: If the similarity type of the first media asset is the second type, then it is determined that the similarity of the first media asset does not meet the conditions for multi-channel projection.

[0255] Step 450: Control the first multimedia resource to exit the first projection window and play the second multimedia resource in the first projection window.

[0256] In some examples, if the similarity type of the first media asset is type two, meaning the first media asset's similarity does not meet the multi-channel casting conditions, then the first multimedia resource is similar to the second multimedia resource. In this case, the second multimedia resource can replace the playback of the first multimedia resource. That is, a substitution casting operation is performed.

[0257] For example, when it is determined that the second multimedia resource and the first multimedia resource are different episodes of the same series, or different resolutions, the first multimedia resource can be controlled to be cast out of the first casting window, and the second multimedia resource can be played in the first casting window.

[0258] In some examples, when it is determined that the similarity of the first media asset does not meet the conditions for multi-channel casting, the number and layout of the casting windows in the casting interface do not need to be changed. That is, the casting interface can still display the first casting interface, and only the playback content in the first casting window is replaced.

[0259] The display device and screen casting method provided in this application embodiment, when playing a first multimedia resource cast by a first screen casting device in a first screen casting window, upon receiving a second screen casting command sent by the first screen casting device (i.e., the same screen casting device), can determine whether the similarity of the first media asset meets the multi-channel screen casting conditions based on the first media asset information in the first screen casting command and the second media asset information in the second screen casting command. If the similarity of the first media asset meets the multi-channel screen casting conditions, the display device can continue playing the first multimedia resource in the first screen casting window and play the second multimedia resource cast a second time in another screen casting window (i.e., the second screen casting window) of the screen casting interface. The display device provided in this application embodiment can simultaneously cast multiple video sources pushed by the same screen casting device to the display device when the media asset similarity of multiple video sources pushed by the same screen casting device meets the multi-channel screen casting conditions. That is, the display device provided in this application embodiment supports multi-channel screen casting by the same screen casting device on the display device, which can improve the user's screen casting experience.

[0260] Figure 11 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application, such as... Figure 11 As shown, step 430 above includes steps 1110 to 1120 as shown below. After step 1110, the method further includes steps 1130 and 1140.

[0261] Step 1110: If, based on the first media asset information and the second media asset information, it is determined that the similarity of the first media asset meets the conditions for multi-channel projection, then the projection selection window is displayed.

[0262] In some examples, before determining that the similarity of the first media resource meets the conditions for multi-channel projection and before projecting the second multimedia resource, the display device 200 can also control the monitor 260 to display a projection selection window on the projection interface. This projection selection window prompts the user whether they are sure they want to perform multi-channel projection and receives the user's selection for simultaneous multi-channel projection.

[0263] For example, the screen mirroring selection window may include at least one option, and the user can further determine whether to perform multi-channel screen mirroring by selecting at least one option. The screen mirroring selection window can be displayed on top of multiple screen mirroring windows in the screen mirroring interface.

[0264] In some examples, the multiple options in the screen mirroring selection window may include a first option, a second option, and a third option. The first option may be an option instructing the user to agree to multi-way screen mirroring, the second option may be an option instructing the user to refuse multi-way screen mirroring, and the third option may be an option instructing the user to cancel the current screen mirroring.

[0265] It should be noted that the screen casting selection window may also include only the first option and the second option, or the first option and the third option. This application embodiment does not limit this. The screen casting selection window in this application embodiment includes the first option, the second option and the third option as an example for illustrative purposes.

[0266] In other examples, the screen casting selection window may also include a prompt message to guide the user to make the appropriate selection for multi-screen casting.

[0267] Step 1120: In response to receiving the user's selection operation of the first option in the screen casting selection window, the first screen casting window in the screen casting interface continues to play the first multimedia resource, and the second multimedia resource is played in the second screen casting window in the screen casting interface.

[0268] In some examples, when the user selects the first option via the control device, it indicates that the user needs to continue performing multi-screen projection. Therefore, the display device 200 can continue playing the first multimedia resource in the first projection window and play the second multimedia resource in the second projection window.

[0269] For example, the first option could be "OK", "Yes", or "Agree", indicating that the user allows multi-screen projection.

[0270] Step 1130: In response to receiving the user's selection operation of the second option in the screen casting selection window, control the first multimedia resource to exit the screen casting from the first screen casting window, and play the second multimedia resource in the first screen casting window.

[0271] In some examples, upon receiving a selection of a second option from the user via the control device, it indicates that the user has abandoned the multi-casting operation; that is, the user wishes to replace the currently playing first multimedia resource with the second multimedia resource currently being cast. Therefore, the display device 200 can control the first multimedia resource to exit the first casting window and play the second multimedia resource in the first casting window.

[0272] For example, the second option could be "Refuse", "No", or "NO", indicating that the user has given up on multi-screen projection.

[0273] Step 1140: In response to receiving the user's selection of the third option in the screen casting selection window, the first screen casting window in the screen casting interface continues to play the first multimedia resource.

[0274] In some examples, when the user selects a third option via the control device, it indicates that the user does not want to continue casting the second multimedia resource, that is, the user wants to cancel casting the second multimedia resource. Therefore, the display device 200 can continue playing the first multimedia resource in the first casting window.

[0275] For example, the second option could be "Cancel" or "Exit," indicating that the user can cancel casting the second multimedia resource.

[0276] In some examples, the screen casting selection window can be removed from the screen casting interface after the user has made a selection of at least one option in the screen casting selection window.

[0277] Figure 12 This is a schematic diagram illustrating yet another screen projection interface provided in some embodiments of this application. For example... Figure 12 As shown, the screen casting interface includes a screen casting selection window, which can be displayed on top of the first and second screen casting windows.

[0278] like Figure 12 As shown, the screen mirroring selection window includes a prompt message and three option controls. The prompt message is "Continue multi-screen mirroring?". The "OK" control corresponds to the first option, the "Reject" control corresponds to the second option, and the "Cancel" control corresponds to the third option.

[0279] For example, when the user moves the focus box to the "OK" control via the control device, the casting selection window exits the display, the first casting window continues playing the first multimedia resource, and the second casting window plays the second multimedia resource. When the user moves the focus box to the "Decline" control via the control device, the casting selection window exits the display, the first casting window stops playing the first multimedia resource, and the second multimedia resource begins playing. When the user moves the focus box to the "Cancel" control via the control device, the casting selection window exits the display, and the first casting window continues playing the first multimedia resource.

[0280] It should be noted that, Figure 12The screen mirroring interface in this example includes a first screen mirroring window and a second screen mirroring window. When the user selects "Decline" or "Cancel," the screen mirroring interface can cancel the second screen mirroring window and enlarge the first screen mirroring window. In some examples, the screen mirroring interface may only include the first screen mirroring window, and after the user selects the "OK" control, the second screen mirroring window is added, and the size and position of the first screen mirroring window are adjusted.

[0281] The screen casting method provided in this application, when the conditions for multi-channel screen casting are met, can provide users with a selectable screen casting option window, and determine whether to perform multi-channel screen casting based on the user's selection, thereby improving the user experience. It also avoids situations where multi-channel screen casting still occurs when the user wants to switch channels, and can prevent accidental screen casting operations by the user.

[0282] Figure 13 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application, such as... Figure 13 As shown, prior to step 430 above, the method further includes steps 1310 to 1330 as shown below.

[0283] Step 1310: Determine the resource type of the first multimedia resource based on the first screen casting address in the first screen casting instruction, and determine the resource type of the second multimedia resource based on the second screen casting address in the second screen casting instruction.

[0284] In some examples, the screen casting command sent by the screen casting device to the display device 200 includes a screen casting address. The screen casting address (i.e., URL) can be a unique identifier of the multimedia resource on the server. The display device 200 can access and play the video through the screen casting address.

[0285] In some examples, resource types include online resources and local resources. Online resources, also known as server resources, have a casting address that directly points to the storage location of the multimedia resource on the server. Local resources refer to audio, video, images, and files that have been downloaded to the casting device. The casting process does not involve accessing external servers, and the casting address does not point to a URL of a network resource but to the local address of the casting device.

[0286] For example, the resource type of a multimedia resource can be distinguished as an online resource or a local resource based on the projection address. For instance, the display device 200 can store the URL addresses corresponding to each application, as well as local URL addresses. For example, the display device 200 can store a mapping table between URL addresses and resource types.

[0287] For example, after the display device 200 determines the first projection address and the second projection address, it can determine the resource type of the first multimedia resource and the resource type of the second multimedia resource according to the correspondence table.

[0288] Step 1320: Are both the first multimedia resource and the second multimedia resource online resources?

[0289] For example, when the first multimedia resource is determined to be an online resource, the resource type of the second multimedia resource is determined. If the second multimedia resource is also an online resource, then step 430 is executed.

[0290] For example, if it is determined that the first multimedia resource is an online resource and the second multimedia resource is a local resource, or if it is determined that the first multimedia resource is a local resource, then step 1330 is executed. It should be noted that if the first multimedia resource is determined to be a local resource, then there is no need to determine the resource type of the second multimedia resource again, and step 1330 is executed directly.

[0291] Step 1330: Control the first multimedia resource to exit the first projection window and play the second multimedia resource in the first projection window.

[0292] In some examples, if either the resource type of the first multimedia resource or the resource type of the second multimedia resource is a local resource, then multi-channel casting will not be performed; instead, a replacement casting operation will be performed. In other words, local resources do not support multi-channel casting.

[0293] For example, if the first multimedia resource currently being played in the first projection window is a local resource, then the next multimedia resource to be projected, whether it is an online resource or a local resource, will replace the first multimedia resource. That is, the display device 200 can exit the projection of the first multimedia resource from the first projection window and play the second multimedia resource in the first projection window.

[0294] For example, if the first multimedia resource being played in the current first casting window is an online resource, and the next multimedia resource to be cast is a local resource, the substitution casting operation will still be performed.

[0295] It should be noted that step 430 has already been described in the above embodiments, and will not be repeated here to avoid repetition.

[0296] The screen casting method provided in this application determines the resource type of the multimedia resource based on the screen casting address in the media asset information. The display device only performs multi-channel screen casting when both the already cast multimedia resource and the multimedia resource to be cast are online resources. When one of the already cast multimedia resource and the multimedia resource to be cast is a local resource, the display device adopts the substitution screen casting principle, and the multimedia resource to be cast replaces the playback of the already cast multimedia resource.

[0297] Figure 14 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application, such as... Figure 14 As shown, after step 430 above, the method further includes steps 1410 to 1430 as shown below.

[0298] Step 1410: In response to receiving a third projection instruction sent by the first projection device for playing a third multimedia resource, determine the third media resource information corresponding to the third multimedia resource based on the third projection instruction.

[0299] It should be noted that the process of determining the third media asset information corresponding to the third multimedia resource in step 1410 is similar to the process of determining the second media asset information corresponding to the second multimedia resource in step 420 above. To avoid repetition, it will not be described again here.

[0300] Step 1420: If, based on the first media asset information and the second media asset information, it is determined that the similarity of the second media asset satisfies the multi-channel projection condition, and based on the second media asset information and the third media asset information, it is determined that the similarity of the third media asset satisfies the multi-channel projection condition, and there is no idle projection window with unplayed multimedia resources in the projection interface, then the third projection window is determined from the multiple projection windows included in the projection interface.

[0301] In some examples, after determining the third media asset information corresponding to the third multimedia resource, the third media asset information can be compared with the first media asset information corresponding to the first multimedia resource that has already been projected, and the second media asset information corresponding to the second multimedia resource, and the similarity between the second media asset and the third media asset can be determined.

[0302] It should be noted that the determination process of the second and third media asset similarities is similar to that of the first media asset similarity in the above embodiments. To avoid repetition, it will not be described again here.

[0303] In some examples, step 1420 involves determining the media asset similarity between the third media asset information and the first and second media asset information, respectively. If the second media asset similarity satisfies the multi-channel projection condition (e.g., the third multimedia resource is not similar to the first multimedia resource), and the third media asset similarity satisfies the multi-channel projection condition (e.g., the third multimedia resource is not similar to the second multimedia resource), then it is further determined whether there is an idle projection window among the multiple projection windows in the projection interface. An idle projection window indicates a projection window that is not currently playing multimedia resources.

[0304] It should be noted that one can first determine whether the similarity between the second and third media assets satisfies the multi-channel projection conditions. Once it is determined that both the second and third media asset similarities satisfy the multi-channel projection conditions, then it can be determined whether there are any idle projection windows among the multiple projection windows on the monitor. Alternatively, one can first determine whether there are any idle projection windows among the multiple projection windows on the monitor, and then determine whether the similarity between the second and third media assets satisfies the multi-channel projection conditions. This application does not limit the execution order of this process.

[0305] For example, when it is determined that the similarity of the second media asset and the similarity of the third media asset both meet the multi-channel projection conditions, and there is at least one idle projection window on the projection interface, then a projection window for playing the third multimedia resource is determined in at least one projection window.

[0306] In some examples, if there is an idle projection window among multiple projection windows, the first and second projection windows continue to play the current multimedia resources, while the third multimedia resource is played in the idle projection window.

[0307] In other examples, if there are multiple idle projection windows, the third multimedia resource can be played in any of the multiple idle projection windows, or the projection window for playing the third multimedia resource can be determined according to the user's selection.

[0308] For example, if there are no idle casting windows among the multiple casting windows, the third multimedia resource cannot be cast. In this case, it is necessary to determine the third casting window for playing the third multimedia resource from the casting windows that are currently playing the multimedia resource (i.e., the first casting window and the second casting window).

[0309] In some embodiments, determining a third projection window among multiple projection windows includes: determining any projection window among the multiple projection windows as the third projection window; or, determining a third projection window among the multiple projection windows based on the projection time of each projection window in the multiple projection windows; or, in response to receiving a window selection instruction, determining the projection window corresponding to the window selection instruction as the third projection window.

[0310] In some examples, the third projection window can be any of the first and second projection windows; alternatively, the third projection window can be the earliest (or latest) projection window projected from the first and second projection windows; or, the third projection window can be a projection window selected by the user. For example, the user can select the projection window to be replaced as the third projection window by controlling the device's focus movement.

[0311] In other examples, if the similarity of the second or third media asset does not meet the multi-casting conditions, for example, if the second media asset similarity does not meet the multi-casting conditions (i.e., the third multimedia resource is similar to the first multimedia resource), then the first multimedia resource is controlled to exit the casting from the first casting window, and the third multimedia resource is played in the first casting window. As another example, if the third media asset similarity does not meet the multi-casting conditions (i.e., the third multimedia resource is similar to the second multimedia resource), then the second multimedia resource is controlled to exit the casting from the second casting window, and the third multimedia resource is played in the second casting window.

[0312] Step 1430: Continue playing the corresponding multimedia resources in the multiple projection windows except for the third projection window, and play the third multimedia resources in the third projection window.

[0313] In some examples, when there are no idle casting windows and a third casting window is identified among multiple casting windows that are already playing multimedia resources, the multimedia resource being played in the third casting window can be exited from casting, and the third multimedia resource can be played, while other casting windows continue to play the currently cast multimedia resource.

[0314] For example, when the first projection window is determined to be the third projection window, the first multimedia resource can be exited from the first projection window and the third multimedia resource can be played in the first projection window, while the second projection window continues to play the second multimedia resource.

[0315] The screen casting method provided in this application embodiment, when the multi-channel screen casting conditions are met and there are no idle screen casting windows, can determine a screen casting window for the multimedia resource to be cast in multiple screen casting windows of the screen casting interface. The determined screen casting window is used for replacement screen casting, while other screen casting windows continue to play the original multimedia resource.

[0316] Figure 15 A schematic diagram illustrating another screen mirroring method provided in some embodiments of this application, such as... Figure 15 As shown, the screen mirroring method includes steps 1510 to 1530 as illustrated below. It should be noted that... Figure 15 The provided screen mirroring methods and Figure 4B The main difference between the two methods lies in the process of determining the similarity of media assets.

[0317] Step 1510: In response to receiving a first projection instruction sent by the first projection device for playing the first multimedia resource, the first multimedia resource is obtained and played in the first projection window of the projection interface.

[0318] In some examples, after receiving the first projection instruction, the display device 200 can obtain the first multimedia resource from the corresponding server according to the first projection address in the first projection instruction; at the same time, it plays the obtained first multimedia resource in the first projection window of the projection interface.

[0319] Step 1520: In response to receiving a second projection instruction from the first projection device for playing the second multimedia resource, acquire the second multimedia resource.

[0320] In some examples, after receiving the second projection instruction, the display device 200 can retrieve the second multimedia resource from the corresponding server based on the second projection address in the second projection instruction. For example, when the second multimedia resource is a video, the video data can be retrieved from the server.

[0321] Step 1530: If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth multimedia resource satisfies the multi-channel projection condition, then the first multimedia resource continues to play in the first projection window in the projection interface, and the second multimedia resource is played in the second projection window in the projection interface.

[0322] In some examples, the fourth media asset similarity is used to characterize the similarity between the first multimedia resource and the second multimedia resource. For example, a subset of data frames (such as the first data frame) in the first multimedia resource can be compared with a subset of data frames (such as the second data frame) in the second multimedia resource. When the overlap between the first and second data frames is lower than a first preset overlap, the fourth media asset similarity satisfies the multi-channel projection condition; when the overlap between the first and second data frames is higher than the second preset overlap, the fourth media asset similarity does not satisfy the multi-channel projection condition. The data frames can be at least one of video data, audio data, image data, and text information.

[0323] For example, the similarity between the first multimedia resource and the second multimedia resource, i.e., the fourth media asset similarity, can be determined by a trained machine learning model (such as a similarity model). For instance, the first and second data frames can be input into the similarity model, which can output a target overlap score. This target overlap score is then compared with a first overlap score threshold and a second overlap score threshold to determine whether the fourth media asset similarity meets the multi-channel projection conditions. Alternatively, the similarity model can directly output the result of whether the fourth media asset similarity meets the multi-channel projection conditions; this embodiment of the application does not limit this approach.

[0324] The screen casting method provided in this application can determine the similarity of a fourth media resource by obtaining the specific content of the first and second multimedia resources. When the similarity of the fourth media resource meets the conditions for multi-channel screen casting, a multi-channel screen casting operation is performed; when the similarity of the fourth media resource does not meet the conditions for multi-channel simultaneous screen casting, a substitution screen casting operation is performed.

[0325] Figure 16 This is a schematic diagram illustrating a screen mirroring method provided in some embodiments of this application, such as... Figure 16 As shown, the screen mirroring method includes steps 1610 to 1630 as illustrated below. It should be noted that... Figure 16 The provided screen mirroring methods and Figure 4B and Figure 15 The main difference between the two methods lies in the process of determining similarity.

[0326] Step 1610: In response to receiving a first projection instruction sent by the first projection device for playing the first multimedia resource, the first multimedia resource is obtained and played in the first projection window of the projection interface.

[0327] The first screen projection instruction includes the first title information of the first multimedia resource.

[0328] In some examples, the casting command sent by the casting device may or may not include title information. For instance, whether the casting command includes title information may depend on the app containing the multimedia resource; some apps send casting commands that include title information, while others do not.

[0329] For example, the title information may include the name, number of episodes, and brief description of the multimedia resource, but this application embodiment does not limit this.

[0330] Step 1620: In response to receiving a second projection instruction sent by the first projection device for playing a second multimedia resource, determine whether the second projection instruction includes the second title information of the second multimedia resource.

[0331] In some examples, after receiving the second projection instruction, the display device 200 can determine whether the second projection instruction includes the second title information of the second multimedia resource.

[0332] For example, if it is determined that the second screen casting instruction includes the second title information of the second multimedia resource based on the second screen casting instruction, then step 1630 is executed; if it is determined that the second screen casting instruction does not include the second title information of the second multimedia resource based on the second screen casting instruction, then step 1650 is executed.

[0333] Step 1630: Determine the similarity between the first title information and the second title information.

[0334] In some examples, when both the first and second screen mirroring commands include title information, the similarity between the first and second title information can be determined, and it can be determined whether the similarity between the first and second title information satisfies the multi-screen mirroring conditions.

[0335] Step 1640: If the similarity between the first title information and the second title information satisfies the multi-channel projection condition, then the first projection window in the projection interface continues to play the first multimedia resource, and the second multimedia resource is played in the second projection window in the projection interface.

[0336] For example, the first title information and the second title information are preprocessed to obtain the processed first title information and the processed second title information; if the processed first title information and the processed second title information are different, it is determined that the similarity between the first title information and the second title information meets the multi-channel projection condition; if the processed first title information and the processed second title information are the same, it is determined that the similarity between the first media assets does not meet the multi-channel projection condition.

[0337] Step 1650: Obtain the second multimedia resource.

[0338] In some examples, when the first screen casting instruction includes title information but the second screen casting instruction does not, the second multimedia resource can be obtained based on the second screen casting address in the second screen casting instruction, and based on the first multimedia resource and the second multimedia resource, it can be determined whether the similarity of the fourth media resource between the first multimedia resource and the second multimedia resource satisfies the multi-channel screen casting condition.

[0339] Step 1660: If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth multimedia resource satisfies the multi-channel projection condition, then the first multimedia resource continues to play in the first projection window in the projection interface, and the second multimedia resource is played in the second projection window in the projection interface.

[0340] It should be noted that steps 1650 to 1660 are similar to steps 1520 to 1530 in the above embodiments, and will not be repeated here to avoid repetition.

[0341] Figure 17 This is a schematic diagram illustrating another screen mirroring process provided for some embodiments of this application. For example, Figure 17 The screen mirroring process in the example uses a mobile phone as an example, with the screen mirroring interface of the display device consisting of two screen mirroring windows.

[0342] like Figure 17 As shown in (a), after mobile phone 1 initiates the screen casting of video source 1, the first screen casting window of the screen casting interface can play video source 1.

[0343] In some examples, taking IP1 as the IP address of mobile phone 1, when mobile phone 1 initiates screen mirroring of video source 2 again, it first checks whether there is a video source playing on the current IP1. Since there is video source 1 playing on the same IP as video source 2, it is necessary to further determine whether video source 1 and video source 2 are similar video sources.

[0344] like Figure 17 As shown in (b), if source 1 and source 2 are similar sources, source 2 will replace source 1, that is, source 1 will exit playback from the first casting window and source 2 will be played in the first casting window.

[0345] like Figure 17 As shown in (c), if source 1 and source 2 are not similar sources, source 2 will be played in another casting window on the casting interface, i.e., the second casting window, to achieve simultaneous playback of source 1 and source 2. At the same time, the IP address of mobile phone 1 can be unbound from the previously cast source 1 and bound to the newly cast source 2. At this time, casting control commands sent from mobile phone 1, such as play, pause, progress adjustment, and playback time point acquisition, will be transmitted to source 2. Source 1 will no longer have any protocol interaction with mobile phone 1. That is, from the perspective of mobile phone 1, the casting of source 1 has been exited.

[0346] Therefore, as can be seen from the above process, the screen casting method provided in this application embodiment can simultaneously cast two video sources pushed by one mobile phone to a display device in a dual-channel manner. It should be noted that the second casting window can be an idle window on the casting interface where no video source is playing, or it can be a newly created casting window to achieve multi-channel casting.

[0347] Figure 17 This is a schematic diagram illustrating another screen mirroring process provided for some embodiments of this application. For example, Figure 17 The screen mirroring process in the example uses a mobile phone as an example, with the screen mirroring interface of the display device consisting of two screen mirroring windows.

[0348] In some examples, in the screen mirroring interface, the first screen mirroring window plays video source 1 pushed by phone 1, and the second screen mirroring window plays video source 2 pushed by phone 1 (e.g.) Figure 17 In (c) of the above, when phone 1 initiates screen mirroring of video source 3 again, a similarity comparison can be performed between video source 3 pushed by phone 1 and video sources 1 and 2 pushed by phone 1. If video sources 1 and 3 pushed by phone 1 are similar video sources, video source 1 will be exited from screen mirroring, and video source 3 will be played in the first screen mirroring window. If video sources 1 and 2 are not similar to video source 3, one of the video sources will be selected for replacement according to the preset replacement logic. The preset replacement logic can be to replace the earliest screen mirrored video source, or the user can choose which video source to replace.

[0349] like Figure 18 As shown in (a), when source 2 and source 3 are similar sources, and source 1 and source 3 are not similar sources, source 2 will be exited from the second casting window and source 3 will be played in the second casting window.

[0350] like Figure 18 As shown in (b), when neither source 1 nor source 2 is similar to source 3, source 3 can replace source 1, which was cast to the earliest screen. That is, source 1 is exited from the first screen casting window and source 3 is played in the first screen casting window.

[0351] like Figure 18 As shown in (c), after source 3 replaces source 1, if mobile phone 2 initiates screen casting of source 4, it will still replace the earliest screen casting source 2 with source 4 according to the preset replacement principle. That is, source 2 will exit the playback from the second screen casting window and source 4 will be played in the second screen casting window.

[0352] Therefore, as can be seen from the above process, the screen casting method provided in this application embodiment can not only realize multi-channel screen casting of video sources pushed by multiple mobile phones, but also realize multi-channel screen casting of multiple video sources pushed by one mobile phone.

[0353] The screen casting method provided in this application can determine whether a first multimedia resource and a second multimedia resource meet the multi-channel casting conditions based on whether title information is included in the first and second screen casting instructions sent by the first screen casting device. When the first and second screen casting instructions include title information, the similarity between the two title information is determined to meet the multi-channel casting conditions; when one of the first and second screen casting instructions does not include title information, the similarity of a fourth media resource can be determined based on the first and second multimedia resources to meet the multi-channel casting conditions. If the multi-channel casting conditions are met, the multi-channel casting operation is performed.

[0354] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the content of this disclosure, thereby enabling those skilled in the art to better utilize the embodiments.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the projection interface; The controller, coupled to the display, is configured to: In response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, the first multimedia resource is played in a first projection window in the projection interface; wherein, the first projection instruction includes first media resource information corresponding to the first multimedia resource; In response to receiving a second projection instruction sent by the first projection device for playing a second multimedia resource, the second media resource information corresponding to the second multimedia resource is determined based on the second projection instruction; If, based on the first media asset information and the second media asset information, it is determined that the similarity of the first media asset is lower than the first similarity threshold, then it is determined that the multi-channel projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

2. The display device according to claim 1, characterized in that, Before the controller executes the determination that the multi-channel projection conditions are met, it is also configured to: In response to the first screen mirroring command, determine the first device information of the screen mirroring device that sent the first screen mirroring command; In response to the second screen mirroring command, determine the second device information of the screen mirroring device that sent the second screen mirroring command; Based on the first device information and the second device information, it is determined that both the screen projection device that sends the first screen projection command and the screen projection device that sends the second screen projection command are the first screen projection device.

3. The display device according to claim 1, characterized in that, The screen projection interface also includes a first menu display area corresponding to the first screen projection window. The first menu display area includes at least one first playback control control. The at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control command from the control device for the first progress adjustment control, the playback progress of the first multimedia resource in the first projection window is adjusted; or, In response to receiving a control command from the control device for the first pause playback control, the playback of the first multimedia resource in the first projection window is paused; or, In response to receiving a control command from the control device for the first exit projection control, the first multimedia resource is controlled to exit projection from the first projection window; or, In response to receiving a control command from the control device for the first full-screen playback control, the first multimedia resource is controlled to play in full-screen mode on the projection interface.

4. The display device according to claim 1, characterized in that, After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to the playback control command received from the first projection device, a corresponding control operation is performed on the second multimedia resource in the second projection window; wherein the control operation includes at least one of playback progress adjustment operation, pause operation and volume adjustment operation.

5. The display device according to claim 1, characterized in that, The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control instruction from the control device for the at least one second playback control control, the corresponding control operation is performed on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first projection device so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

6. The display device according to claim 5, characterized in that, Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, it is further configured to: In response to receiving a focus switching operation sent by the control device, the control focus moves between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

7. The display device according to claim 6, characterized in that, The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, specifically configured as follows: In response to receiving a control command from the control device for the second progress adjustment control, the playback progress of the second multimedia resource in the second projection window is adjusted; In response to receiving a control command from the control device for the second pause playback control, the playback of the second multimedia resource in the second projection window is paused; In response to receiving a control command from the control device for the second exit screen mirroring control, the second multimedia resource is controlled to exit screen mirroring from the second screen mirroring window; In response to receiving a control command from the control device for the second full-screen playback control, the second multimedia resource is controlled to play in full-screen mode on the projection interface.

8. The display device according to claim 1, characterized in that, The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window of the projection interface, specifically configured as follows: Based on the first screen casting address in the first screen casting instruction, continue to receive the first multimedia resources sent by the server corresponding to the first screen casting address; Continue playing the first multimedia resource in the first projection window, send a first notification message to the first projection device, and play the second multimedia resource in the second projection window; The display device can receive control operations from the first projection device on the second multimedia resource, and the first notification message is used to notify the first projection device that the first multimedia resource has exited projection.

9. The display device according to claim 8, characterized in that, The controller is configured to maintain playback of the first multimedia resource in the first projection window, send a first notification message to the first projection device, and play the second multimedia resource in the second projection window. Continue playing the first multimedia resource in the first projection window, unbind the first projection device from the first multimedia resource, and send the first notification message to the first projection device; A binding relationship is created between the first projection device and the second multimedia resource, and the second multimedia resource is played in the second projection window so that the first projection device can control the second multimedia resource.

10. The display device according to claim 1, characterized in that, Before the controller executes the response to receiving the second projection instruction sent by the first projection device for playing the second multimedia resource, it is further configured to: In response to receiving a stop screen casting command for stopping the playback of the first multimedia resource, a second notification message is sent to the first screen casting device; wherein, the second notification message is used to notify the first screen casting device that the first multimedia resource has exited screen casting; Remove the binding relationship between the first screen projection device and the first multimedia resource.

11. The display device according to claim 10, characterized in that, The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window of the projection interface, specifically configured as follows: Based on the first screen casting address in the first screen casting instruction, continue to receive the first multimedia resources sent by the server corresponding to the first screen casting address; Continue playing the first multimedia resource in the first projection window; A binding relationship is created between the first projection device and the second multimedia resource, and the second multimedia resource is played in the second projection window so that the first projection device can control the second multimedia resource.

12. The display device according to any one of claims 1-11, characterized in that, The controller is also configured to: In response to receiving an acquisition request sent by the first screen projection device, the playback information of the second multimedia resource bound to the first screen projection device is determined; The playback information of the second multimedia resource is sent to the first projection device; wherein the playback information includes at least one of the playback progress, playback duration and playback status of the second multimedia resource.

13. The display device according to claim 1, characterized in that, The controller executes the step of determining that the similarity of the first media asset is lower than a first similarity threshold based on the first media asset information and the second media asset information, specifically configured as follows: Based on the first media asset information and the second media asset information, determine the similarity type of the first media asset similarity; If the similarity type of the first media asset similarity is the first type, then it is determined that the similarity of the first media asset is lower than the first similarity threshold.

14. The display device according to claim 13, characterized in that, The similarity type of the first media asset similarity is the first type, which includes: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to multimedia resources of different dramas.

15. The display device according to claim 13, characterized in that, The controller is also configured to: If the similarity type of the first media asset similarity is the second type, then it is determined that the similarity of the first media asset is higher than the second similarity threshold; Control the first multimedia resource to exit the first projection window and play the second multimedia resource in the first projection window.

16. The display device according to claim 15, characterized in that, The similarity type of the first media asset similarity is the second type, which includes: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to different multimedia resources of the same drama series or the same multimedia resource with different media asset parameters.

17. The display device according to claim 14 or 16, characterized in that, The controller executes the determination of the similarity type of the first media asset similarity, specifically configured as follows: The first title information in the first media asset information is preprocessed to obtain the processed first title information; The second title information in the second media asset information is preprocessed to obtain the processed second title information; If the processed first title information and the processed second title information are different, then the similarity type of the first media asset similarity is determined to be the first type; If the processed first title information and the processed second title information are the same, then the similarity type of the first media asset similarity is determined to be the second type.

18. The display device according to any one of claims 1-11, characterized in that, Before the controller executes the determination that the multi-channel projection conditions are met, it is also configured to: Based on the first screen casting address in the first screen casting instruction, the resource type of the first multimedia resource is determined; Based on the second screen casting address in the second screen casting instruction, determine the resource type of the second multimedia resource; If both the resource type of the first multimedia resource and the resource type of the second multimedia resource are online resources, then based on the first media asset information and the second media asset information, it is determined whether the similarity of the first media asset meets the conditions for multi-channel projection.

19. The display device according to claim 18, characterized in that, The controller is also configured to: If the resource type of the first multimedia resource is a local resource, and / or the resource type of the second multimedia resource is a local resource, then the first multimedia resource is controlled to exit the casting window and the second multimedia resource is played in the first casting window.

20. The display device according to any one of claims 1-11, characterized in that, After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a third projection instruction sent by the first projection device for playing a third multimedia resource, the third media resource information corresponding to the third multimedia resource is determined based on the third projection instruction. If, based on the first media asset information and the third media asset information, it is determined that the similarity of the second media asset satisfies the multi-channel projection condition, and based on the second media asset information and the third media asset information, it is determined that the similarity of the third media asset satisfies the multi-channel projection condition, and there is no idle projection window with unplayed multimedia resources in the projection interface, then the third projection window is determined among the multiple projection windows included in the projection interface. The corresponding multimedia resources continue to play in the projection windows other than the third projection window in the projection interface, and the third multimedia resources are played in the third projection window.

21. The display device according to claim 20, characterized in that, The controller is configured to determine the third projection window from among the multiple projection windows included in the projection interface, specifically as follows: Choose any one of the multiple projection windows as the third projection window; or... The third projection window is determined from the plurality of projection windows based on the projection time of each projection window; or, In response to receiving a window selection instruction, the projection window corresponding to the window selection instruction is determined as the third projection window.

22. The display device according to any one of claims 1-11, characterized in that, Before the controller executes the first screen casting instruction sent by the first screen casting device for playing the first multimedia resource, it is further configured to: In response to receiving a launch operation for the multi-cast application, the multi-cast application is launched.

23. The display device according to any one of claims 1-11, characterized in that, The controller executes the determination that the multi-channel projection conditions are met, maintains the first projection window in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window of the projection interface, specifically configured as follows: If the conditions for multi-channel screen mirroring are met, the screen mirroring selection window will be displayed; In response to receiving a user's selection of the first option in the screen casting selection window, the first screen casting window in the screen casting interface continues to play the first multimedia resource, and the second multimedia resource is played in the second screen casting window in the screen casting interface.

24. The display device according to claim 23, characterized in that, The controller is also configured to: In response to receiving a user's selection operation on the second option in the screen casting selection window, the system controls the first multimedia resource to exit the screen casting from the first screen casting window and plays the second multimedia resource in the first screen casting window; or, In response to receiving a user's selection of the third option in the screen casting selection window, the first screen casting window in the screen casting interface continues to play the first multimedia resource.

25. A display device, characterized in that, include: The monitor is configured to display the projection interface; The controller, coupled to the display, is configured to: In response to receiving a first screen projection instruction sent by the first screen projection device for playing a first multimedia resource, the first multimedia resource is obtained and played in the first screen projection window in the screen projection interface; In response to receiving a second projection instruction sent by the first projection device for playing a second multimedia resource, the second multimedia resource is acquired; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth multimedia resource is lower than the first similarity threshold, then it is determined that the multi-channel projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

26. The display device according to claim 25, characterized in that, The screen projection interface also includes a first menu display area corresponding to the first screen projection window. The first menu display area includes at least one first playback control control. The at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control command from the control device for the first progress adjustment control, the playback progress of the first multimedia resource in the first projection window is adjusted; or, In response to receiving a control command from the control device for the first pause playback control, the playback of the first multimedia resource in the first projection window is paused; or, In response to receiving a control command from the control device for the first exit projection control, the first multimedia resource is controlled to exit projection from the first projection window; or, In response to receiving a control command from the control device for the first full-screen playback control, the first multimedia resource is controlled to play in full-screen mode on the projection interface.

27. The display device according to claim 25, characterized in that, The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window of the projection interface, specifically configured as follows: In response to the playback control command received from the first projection device, a corresponding control operation is performed on the second multimedia resource in the second projection window; wherein the control operation includes at least one of playback progress adjustment operation, pause operation and volume adjustment operation.

28. The display device according to claim 25, characterized in that, The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control instruction from the control device for the at least one second playback control control, the corresponding control operation is performed on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first projection device so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

29. The display device according to claim 28, characterized in that, Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, it is further configured to: In response to receiving a focus switching operation sent by the control device, the control focus moves between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

30. The display device according to claim 29, characterized in that, The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, and is configured to: In response to receiving a control command from the control device for the second progress adjustment control, the playback progress of the second multimedia resource in the second projection window is adjusted; In response to receiving a control command from the control device for the second pause playback control, the playback of the second multimedia resource in the second projection window is paused; In response to receiving a control command from the control device for the second exit screen mirroring control, the second multimedia resource is controlled to exit screen mirroring from the second screen mirroring window; In response to receiving a control command from the control device for the second full-screen playback control, the second multimedia resource is controlled to play in full-screen mode on the projection interface.

31. A display device, characterized in that, include: The monitor is configured to display the projection interface; The controller, coupled to the display, is configured to: In response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, the system acquires the first multimedia resource and plays the first multimedia resource in a first projection window in the projection interface; wherein the first projection instruction includes first title information of the first multimedia resource; In response to receiving a second projection instruction for playing a second multimedia resource sent by the first projection device, if it is determined based on the second projection instruction that the second projection instruction includes the second title information of the second multimedia resource, then the similarity between the first title information and the second title information is determined; If the similarity between the first title information and the second title information is lower than the first similarity threshold, then the multi-screen projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

32. The display device according to claim 31, characterized in that, The screen projection interface also includes a first menu display area corresponding to the first screen projection window. The first menu display area includes at least one first playback control control. The at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control command from the control device for the first progress adjustment control, the playback progress of the first multimedia resource in the first projection window is adjusted; or, In response to receiving a control command from the control device for the first pause playback control, the playback of the first multimedia resource in the first projection window is paused; or, In response to receiving a control command from the control device for the first exit projection control, the first multimedia resource is controlled to exit projection from the first projection window; or, In response to receiving a control command from the control device for the first full-screen playback control, the first multimedia resource is controlled to play in full-screen mode on the projection interface.

33. The display device according to claim 31, characterized in that, The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window of the projection interface, specifically configured as follows: In response to the playback control command received from the first projection device, a corresponding control operation is performed on the second multimedia resource in the second projection window; wherein the control operation includes at least one of playback progress adjustment operation, pause operation and volume adjustment operation.

34. The display device according to claim 31, characterized in that, The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control instruction from the control device for the at least one second playback control control, the corresponding control operation is performed on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first projection device so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

35. The display device according to claim 34, characterized in that, Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, it is further configured to: In response to receiving a focus switching operation sent by the control device, the control focus moves between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

36. The display device according to claim 35, characterized in that, The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, and is configured to: In response to receiving a control command from the control device for the second progress adjustment control, the playback progress of the second multimedia resource in the second projection window is adjusted; In response to receiving a control command from the control device for the second pause playback control, the playback of the second multimedia resource in the second projection window is paused; In response to receiving a control command from the control device for the second exit screen mirroring control, the second multimedia resource is controlled to exit screen mirroring from the second screen mirroring window; In response to receiving a control command from the control device for the second full-screen playback control, the second multimedia resource is controlled to play in full-screen mode on the projection interface.

37. A display device, characterized in that, include: The monitor is configured to display the projection interface; The controller, coupled to the display, is configured to: In response to receiving a first screen projection instruction sent by the first screen projection device for playing a first multimedia resource, the first multimedia resource is obtained and played in the first screen projection window in the screen projection interface; In response to receiving a second screen projection instruction sent by the first screen projection device for playing a second multimedia resource, if it is determined based on the second screen projection instruction that the second screen projection instruction does not include the second title information of the second multimedia resource, then the second multimedia resource is obtained; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth multimedia resource is lower than the first similarity threshold, then it is determined that the multi-channel projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

38. The display device according to claim 37, characterized in that, The screen projection interface also includes a first menu display area corresponding to the first screen projection window. The first menu display area includes at least one first playback control control. The at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control command from the control device for the first progress adjustment control, the playback progress of the first multimedia resource in the first projection window is adjusted; or, In response to receiving a control command from the control device for the first pause playback control, the playback of the first multimedia resource in the first projection window is paused; or, In response to receiving a control command from the control device for the first exit projection control, the first multimedia resource is controlled to exit projection from the first projection window; or, In response to receiving a control command from the control device for the first full-screen playback control, the first multimedia resource is controlled to play in full-screen mode on the projection interface.

39. The display device according to claim 37, characterized in that, The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window of the projection interface, specifically configured as follows: In response to the playback control command received from the first projection device, a corresponding control operation is performed on the second multimedia resource in the second projection window; wherein the control operation includes at least one of playback progress adjustment operation, pause operation and volume adjustment operation.

40. The display device according to claim 37, characterized in that, The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control. After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and then plays the second multimedia resource in the second projection window of the projection interface, it is further configured to: In response to receiving a control instruction from the control device for the at least one second playback control control, the corresponding control operation is performed on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first projection device so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

41. The display device according to claim 40, characterized in that, Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, it is further configured to: In response to receiving a focus switching operation sent by the control device, the control focus moves between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

42. The display device according to claim 41, characterized in that, The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for the at least one second playback control control, and is configured to: In response to receiving a control command from the control device for the second progress adjustment control, the playback progress of the second multimedia resource in the second projection window is adjusted; In response to receiving a control command from the control device for the second pause playback control, the playback of the second multimedia resource in the second projection window is paused; In response to receiving a control command from the control device for the second exit screen mirroring control, the second multimedia resource is controlled to exit screen mirroring from the second screen mirroring window; In response to receiving a control command from the control device for the second full-screen playback control, the second multimedia resource is controlled to play in full-screen mode on the projection interface.

43. A screen projection method, characterized in that, include: In response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, the first multimedia resource is played in a first projection window in the projection interface; wherein, the first projection instruction includes first media resource information corresponding to the first multimedia resource; In response to receiving a second projection instruction sent by the first projection device for playing a second multimedia resource, the second media resource information corresponding to the second multimedia resource is determined based on the second projection instruction; If, based on the first media asset information and the second media asset information, it is determined that the similarity of the first media asset is lower than the first similarity threshold, then it is determined that the multi-channel projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

44. A screen projection method, characterized in that, include: In response to receiving a first screen projection instruction sent by the first screen projection device for playing a first multimedia resource, the first multimedia resource is obtained and played in the first screen projection window in the screen projection interface; In response to receiving a second projection instruction sent by the first projection device for playing a second multimedia resource, the second multimedia resource is acquired; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the second multimedia resource is lower than the first similarity threshold, then it is determined that the multi-channel projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

45. A screen projection method, characterized in that, include: In response to receiving a first projection instruction from a first projection device for playing a first multimedia resource, the system acquires the first multimedia resource and plays the first multimedia resource in a first projection window in the projection interface; wherein the first projection instruction includes first title information of the first multimedia resource; In response to receiving a second projection instruction for playing a second multimedia resource sent by the first projection device, if it is determined based on the second projection instruction that the second projection instruction includes the second title information of the second multimedia resource, then the similarity between the first title information and the second title information is determined; If the similarity between the first title information and the second title information is lower than the first similarity threshold, then the multi-screen projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

46. ​​A screen projection method, characterized in that, include: In response to receiving a first screen projection instruction sent by the first screen projection device for playing a first multimedia resource, the first multimedia resource is obtained and played in the first screen projection window in the screen projection interface; In response to receiving a second screen projection instruction sent by the first screen projection device for playing a second multimedia resource, if it is determined based on the second screen projection instruction that the second screen projection instruction does not include the second title information of the second multimedia resource, then the second multimedia resource is obtained; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the second multimedia resource is lower than the first similarity threshold, then it is determined that the multi-channel projection conditions are met, and the first projection window in the projection interface continues to play the first multimedia resource, while the second multimedia resource is played in the second projection window in the projection interface.

Images