Display device and screen projection method

Abstract

The embodiment of the invention provides a display device and a screen projection method, the display device plays a first multimedia resource in a first screen projection window in a screen projection interface in response to a received first screen projection instruction sent by a first screen projection device and used for playing the first multimedia resource; in response to a received second screen projection instruction sent by the first screen projection equipment and used for playing a second multimedia resource, determining second media asset information corresponding to the second multimedia resource based on the second screen projection instruction; if it is determined that the first media resource similarity meets the multi-path screen projection condition based on the first media resource information and the second media resource information, the first multimedia resource is continuously played in a first screen projection window in the screen projection interface, and the second multimedia resource is played in a second screen projection window in the screen projection interface. According to the embodiment of the invention, the same screen projection device can perform multi-path screen projection on the same display device, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a screen projection method. Background Art

[0002] With the development of communication technology, most display devices (such as televisions) have screen projection functions, and users can project source content (such as audio and video) on electronic devices (such as mobile phones) to display devices for playback. The same display device can support the projection of source content on different electronic devices. However, when the user wants to project different source content on the same electronic device to the same display device for playback, the display device will replace the source of the previous projection with the second projection, which cannot meet the user's needs for multi-channel projection through the same electronic device, affecting the user experience. Summary of the invention

[0003] In order to solve the above problems, the embodiments of the present application provide a display device and a screen projection method, which can meet the needs of users to perform multi-channel screen projection through the same screen projection device and improve the user experience. Specifically:

[0004] In a first aspect, an embodiment of the present application provides a display device, comprising a display and a controller. The display device is configured to display a projection interface. The controller is coupled to the display and is configured to: in response to receiving a first projection instruction for playing a first multimedia resource sent by a first projection device, play the first multimedia resource in a first projection window in the projection interface; wherein the first projection instruction includes the first media information corresponding to the first multimedia resource. In response to receiving a second projection instruction for playing a second multimedia resource sent by the first projection device, determine the second media information corresponding to the second multimedia resource based on the second projection instruction. If it is determined that the similarity of the first media meets the multi-channel projection condition based on the first media information and the second media information, the first projection window in the projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second projection window in the projection interface.

[0005] Based on the above scheme, when the similarity of the media resources of the two screen projections meets the multi-channel screen projection conditions, the display device can continue to play the first multimedia resource in the first screen projection window, and play the second multimedia resource of the second screen projection in another screen projection window (i.e., the second screen projection window) of the screen projection interface, thereby realizing multi-channel screen projection on the same display device through the same screen projection device.

[0006] In some embodiments, before the controller determines that the similarity between the first media information and the second media information meets the multi-way screen projection condition, it is also configured to: determine the first device information of the projection device that sends the first screen projection instruction in response to the first screen projection instruction; determine the second device information of the projection device that sends the second screen projection instruction in response to the second screen projection instruction; based on the first device information and the second device information, determine that the projection device that sends the first screen projection instruction and the projection device that sends the second screen projection instruction are both the first screen projection device.

[0007] Based on the above scheme, before the display device performs multi-channel screen projection, it can first determine whether the screen projection device for the second projection is the same as the screen projection device for the previous projection. When it is determined that the device for the two projections is the same, continue to perform subsequent judgments on whether the similarity of the first media asset meets the multi-channel screen projection conditions. When it is determined that the device for the two projections is not the same, multi-channel screen projection can be performed in accordance with the DLNA protocol.

[0008] In some embodiments, the projection interface further includes a first menu display area corresponding to the first projection window, the first menu display area includes at least one first playback control control, and the at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit projection control, and a first full-screen playback control. After the controller executes to maintain the first projection window in the projection interface and continue to play the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, it is also configured to: in response to receiving a control instruction of the control device to the first progress adjustment control, adjust the playback progress of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device to the first pause playback control, pause the playback of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device to the first exit projection control, control the first multimedia resource to exit projection from the first projection window; or, in response to receiving a control instruction of the control device to the first full-screen playback control, control the first multimedia resource to play in full screen in the projection interface.

[0009] Based on the above scheme, when the second projection window of the projection interface plays the second multimedia resource, the first projection device cannot continue to control the playback of the first multimedia resource played in the first projection window. Therefore, the control device can be used to input control instructions to at least one first playback control control in the first menu display area corresponding to the first projection window, thereby realizing control over the playback progress adjustment, pause, exit projection, and full-screen playback of the first multimedia resource.

[0010] In some embodiments, after the controller executes to maintain the first projection window in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, it is also configured to: in response to the playback control instruction received from the first projection device, perform corresponding control operations on the second multimedia resource in the second projection window; wherein the control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

[0011] Based on the above scheme, when the second projection window of the projection interface plays the second multimedia resource, the first projection device can be used to adjust the playback progress, pause and volume of the second multimedia resource played in the second projection window, thereby facilitating the user to control the playback of the first multimedia resource according to needs.

[0012] In some embodiments, the projection interface also includes a second menu display area corresponding to the second projection window, and the second menu display area includes at least one second playback control control. After the controller executes to maintain the first projection window in the projection interface to continue to play the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, it is also configured to: in response to receiving a control instruction of the control device to at least one second playback control control, perform a corresponding control operation on the second multimedia resource in the second projection window; send playback information of the second multimedia resource to the first projection device, so that the first projection device updates the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

[0013] Based on the above scheme, after the second projection window of the projection interface plays the second multimedia resource, the user can also input a control instruction to at least one second playback control control in the second menu display area corresponding to the second projection window through the control device to realize playback control of the second multimedia resource. At the same time, the display device can send the playback information of the second multimedia resource to the first projection device, so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource, so as to realize the consistency of the playback of the second multimedia resource on the display device and the first projection device. In other words,

[0014] In combination with the above scheme, it can be seen that when the same projection device performs multiple projections on the display device, the user can perform playback control operations on the second multimedia resource (such as the media resource that the projection device projected most recently) through the projection device, and can also perform playback control operations on the second multimedia resource through the control device; while for the first multimedia resource (such as the media resource that the projection device projected not most recently), the user can only perform playback control operations on the first multimedia resource through the control device, and cannot perform playback control operations on the first multimedia resource through the projection device.

[0015] In some embodiments, before the controller executes a corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for at least one second playback control control, the controller is also configured to: in response to receiving a focus switching operation sent by the control device, control the focus to move between the first projection window and the second projection window; when the focus moves to the second projection window, display the second menu display area corresponding to the second projection window.

[0016] Based on the above scheme, when the playback progress of the second multimedia resource is controlled by the control device, it is necessary to first switch the focus of the salary device to the second projection window. When the focus falls on the second projection window, the projection interface can display the second menu display area corresponding to the second projection window. After the second menu display area is displayed, a control instruction can be input to at least one second playback control control in the second menu display area through the control device to perform corresponding playback control on the second multimedia resource in the second projection window.

[0017] In some embodiments, at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit projection control, and a second full-screen playback control. The controller executes a corresponding control operation on the second multimedia resource in the second projection window in response to receiving a control instruction from the control device for at least one second playback control control, and is specifically configured as follows: in response to receiving a control instruction from the control device for the second progress adjustment control, adjusting the playback progress of the second multimedia resource in the second projection window; in response to receiving a control instruction from the control device for the second pause playback control, pausing the playback of the second multimedia resource in the second projection window; in response to receiving a control instruction from the control device for the second exit projection control, controlling the second multimedia resource to exit projection from the second projection window; in response to receiving a control instruction from the control device for the second full-screen playback control, controlling the second multimedia resource to play full screen in the projection interface.

[0018] Based on the above scheme, after the second projection window of the projection interface plays the second multimedia resource, the user can input control instructions to at least one second playback control control in the second menu display area corresponding to the second projection window through the control device as needed to execute controls such as adjustment of the playback progress, pause, exit of projection, and full-screen playback of the first multimedia resource.

[0019] In some embodiments, the controller executes to maintain the first projection window in the projection interface to continue playing the first multimedia resource, and to play the second multimedia resource in the second projection window in the projection interface. It is specifically configured as follows: based on the first projection address in the first projection instruction, continue to receive the first multimedia resource sent by the server corresponding to the first projection address; maintain the first multimedia resource in the first projection window, send a first notification message to the first projection device, and play the second multimedia resource in the second projection window; wherein the display device can receive the control operation of the first projection device on the second multimedia resource, and the first notification message is used to notify the first projection device that the first multimedia resource has exited the projection.

[0020] Based on the above scheme, after receiving the second projection instruction sent by the first projection device, the display device can send a first notification message to the first projection device to notify the first projection device that the first multimedia resource has exited projection. At the same time, in order to maintain the first multimedia resource in the first projection window, the display device can continue to obtain the first multimedia resource from the server and continue to play it according to the first projection address in the first projection instruction, and play the second multimedia resource in the second projection window, so that multiple multimedia resources of the same projection device can be projected on the display device in multiple ways.

[0021] In some embodiments, the controller executes to maintain the first multimedia resource in the first projection window, send a first notification message to the first projection device, and play the second multimedia resource in the second projection window, and is configured to: maintain the first multimedia resource in the first projection window, release the binding relationship between the first projection device and the first multimedia resource, and send a first notification message to the first projection device; create a binding relationship between the first projection device and the second multimedia resource, and play the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

[0022] Based on the above scheme, after receiving the second screen projection instruction sent by the first screen projection device, the display device can release the binding relationship between the first screen projection device and the first multimedia resource, and inform the first screen projection device of the first notification message that the first multimedia resource has exited the screen projection. At the same time, the display device creates a binding relationship between the first screen projection device and the second multimedia resource to ensure that the user can control the playback of the second multimedia resource through the first screen projection device.

[0023] In some embodiments, before the controller executes a second screen projection instruction for playing a second multimedia resource in response to receiving a second screen projection instruction sent by the first screen projection device, it is also configured to: send a second notification message to the first screen projection device in response to receiving a stop screen projection instruction for stopping playing the first multimedia resource; wherein the second notification message is used to notify the first screen projection device that the first multimedia resource has exited the screen projection; and release the binding relationship between the first screen projection device and the first multimedia resource.

[0024] Based on the above scheme, if the display device receives a stop screen projection instruction to stop playing the first multimedia resource before receiving the second screen projection instruction, the binding relationship between the first screen projection device and the first multimedia resource can be released, and the first screen projection device can be informed of the second notification message that the first multimedia resource has exited the screen projection, thereby facilitating the display device to play the second multimedia resource projected by the first screen projection device again in the second screen projection window, thereby realizing that multiple multimedia resources of the same screen projection device can be multi-channel projected on the display device.

[0025] In some embodiments, the controller executes to maintain the first projection window in the projection interface to continue playing the first multimedia resource, and to play the second multimedia resource in the second projection window in the projection interface. It is specifically configured as follows: based on the first projection address in the first projection instruction, continue to receive the first multimedia resource sent by the server corresponding to the first projection address; maintain the first multimedia resource in the first projection window; create a binding relationship between the first projection device and the second multimedia resource, and play the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

[0026] Based on the above scheme, after receiving the stop screen projection instruction, the display device can receive the second screen projection instruction sent by the first screen projection device, and create a binding relationship between the first screen projection device and the second multimedia resource according to the second screen projection instruction, so that the first screen projection device can control the second multimedia resource. At the same time, the second multimedia resource is played in the second screen projection window, realizing multi-channel screen projection of multiple multimedia resources of the same screen projection device on the display device.

[0027] In some embodiments, the controller is further configured to: determine the playback information of the second multimedia resource bound to the first screen projection device in response to receiving an acquisition request sent by the first screen projection device; send the playback information of the second multimedia resource to the first screen projection device; wherein the playback information includes at least one of the playback progress, playback duration and playback status of the second multimedia resource.

[0028] Based on the above scheme, the first projection device can actively send a request to the display device to obtain the playback information of the second multimedia resource, and the display device sends the playback information of the second multimedia resource to the first projection device according to the acquisition request, so that the first projection device can update the playback progress, playback duration and playback status of the second multimedia resource, thereby achieving consistency in the playback of the second multimedia resource on the display device and the first projection device.

[0029] In some embodiments, the controller executes, based on the first media asset information and the second media asset information, determining that the first media asset similarity satisfies the multi-screen projection condition, and is specifically configured as: based on the first media asset information and the second media asset information, determining the similarity type of the first media asset similarity; if the similarity type of the first media asset similarity is the first type, determining that the first media asset similarity satisfies the multi-screen projection condition; wherein the first type is used to indicate that the first media asset similarity is lower than a first similarity threshold.

[0030] Based on the above scheme, the display device determines whether the first media asset similarity satisfies the multi-channel screen projection condition according to the similarity type of the first media asset similarity. When the first media asset similarity is lower than the first similarity threshold, that is, the similarity between the first media asset information and the second media asset information is low, it is determined that the first media asset similarity satisfies the multi-channel screen projection condition, and multi-channel screen projection can be performed. Therefore, the display device of the present application can perform multi-channel screen projection on multiple multimedia resources with low similarity (or dissimilarity).

[0031] In some embodiments, the similarity type of the first media asset similarity is a first type including: a first multimedia resource corresponding to the first media asset information and a second multimedia resource corresponding to the second media asset information are multimedia resources of different dramas.

[0032] Based on the above scheme, when the first multimedia resource and the second multimedia resource are multimedia resources of different series, such as the first multimedia resource and the second multimedia resource are different or unrelated TV series (or movies), multi-channel screen projection of the first multimedia resource and the second multimedia resource can be realized.

[0033] In some embodiments, the controller is further configured to: if the similarity type of the first media asset similarity is the second type, determine that the first media asset similarity does not meet the multi-channel projection condition; wherein the second type is used to indicate that the first media asset similarity is higher than the second similarity threshold; control the first multimedia resource to exit the projection from the first projection window, and play the second multimedia resource in the first projection window.

[0034] Based on the above scheme, when the similarity type of the first media asset similarity is the second type, the first media asset similarity does not meet the multi-channel screen projection condition. In this case, the display device does not perform multi-channel screen projection, but performs replacement screen projection, that is, the first multimedia resource is replaced by the second multimedia resource for playback in the first screen projection window. Therefore, when the user needs to switch between different episodes or resolutions of the currently watched series (such as a TV series), the display device can directly replace the operation instead of multi-channel screen projection, thereby improving the user experience.

[0035] In some embodiments, the similarity type of the first media asset similarity is the second type including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information are different multimedia resources of the same drama or the same multimedia resource with different media asset parameters.

[0036] Based on the above solution, when the first multimedia resource and the second multimedia resource belong to different multimedia resources (such as different episodes) of the same series, or different media resource parameters (such as different resolutions), the similarity type of the first media resource similarity is the second type. Therefore, when the user needs to switch between different episodes or resolutions of the series (such as a TV series) currently being watched, the display device can directly replace the operation instead of multi-channel projection, thereby improving the user experience.

[0037] In some embodiments, the controller executes determination of the similarity type of the first media asset similarity, and is specifically configured to: pre-process the first title information in the first media asset information to obtain processed first title information; pre-process the second title information in the second media asset information to obtain processed second title information; if the processed first title information and the processed second title information are different, then determine that the similarity type of the first media asset similarity is the first type; if the processed first title information and the processed second title information are the same, then determine that the similarity type of the first media asset similarity is the second type.

[0038] Based on the above scheme, the title information (title) in the first media asset information and the second media asset information is preprocessed, and the two preprocessed title information are compared. If the two preprocessed title information are the same, it indicates that the first multimedia resource and the second multimedia resource are similar. If the two preprocessed title information are the same, it indicates that the first multimedia resource and the second multimedia resource are not similar. Since the title information corresponding to multimedia resources in different applications may be different, the title information can be preprocessed to remove irrelevant information in the title information (such as characters such as numbers and spaces), and the main information retained in the title information (such as name characters) is compared, so that the similarity type of the first media asset similarity can be more accurately determined.

[0039] In some embodiments, before the controller executes the determination based on the first media information and the second media information that the similarity of the first media resource meets the multi-screen projection condition, the controller is also configured to: determine the resource type of the first multimedia resource based on the first projection address in the first projection instruction; determine the resource type of the second multimedia resource based on the second projection address in the second projection instruction; if the resource type of the first multimedia resource and the resource type of the second multimedia resource are both online resources, then determine whether the similarity of the first media resource meets the multi-screen projection condition based on the first media information and the second media information.

[0040] Based on the above scheme, before judging whether the similarity of the first media asset meets the multi-channel projection conditions, the resource types of the multimedia resources to be projected (i.e., the second multimedia resources) and the multimedia resources that have been projected (such as the first multimedia resources) can be determined first. When the multimedia resources to be projected and the multimedia resources that have been projected are both online resources, the process of judging whether the similarity of the first media asset meets the multi-channel projection conditions will be entered. By judging the resource type of multimedia resources in advance, the present application can exclude the judgment of whether local resources meet the multi-channel projection conditions, thereby improving the projection efficiency.

[0041] In some embodiments, the controller is further configured to: if the resource type of the first multimedia resource is a local resource, and / or the resource type of the second multimedia resource is a local resource, control the first multimedia resource to exit the projection from the first projection window, and play the second multimedia resource in the first projection window.

[0042] Based on the above scheme, when one of the multimedia resources to be projected (i.e., the second multimedia resource) and the multimedia resources that have been projected (such as the first multimedia resource) is a local resource, there is no need to enter the process of determining whether the similarity of the first media resource meets the multi-channel projection conditions. This application determines the resource type of the multimedia resource in advance, and when it is determined that there are local resources, replacement projection can be performed, without the need to determine the multi-channel projection conditions, thereby improving the projection efficiency.

[0043] In some embodiments, after the controller executes to maintain the first projection window in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, it is also configured to: in response to receiving a third projection instruction for playing the third multimedia resource sent by the first projection device, determine the third media information corresponding to the third multimedia resource based on the third projection instruction; if it is determined based on the first media information and the third media information that the similarity of the second media meets the multi-channel projection condition, and based on the second media information and the third media information, it is determined that the similarity of the third media meets the multi-channel projection condition, and there is no idle projection window in the projection interface that does not play the multimedia resource, then determine the third projection window among the multiple projection windows included in the projection interface; maintain the projection windows other than the third projection window in the projection interface to continue playing the corresponding multimedia resources, and play the third multimedia resource in the third projection window.

[0044] Based on the above scheme, when there is no idle projection window on the projection interface of the display device, if the first projection device initiates projection of the third multimedia resource, then when there is a multimedia resource similar to the third multimedia resource among the multimedia resources that have been played, the third multimedia resource and the similar multimedia resource are replaced for projection; when there is no multimedia resource similar to the third multimedia resource among the multimedia resources that have been played, a projection window is determined in the projection windows that have been projected to play the third multimedia resource, and the other projection windows continue to play the corresponding multimedia resources. When there is no idle projection window on the projection interface, the present application can determine the projection window of the multimedia resource to be projected according to preset rules, thereby ensuring that the display device can always project and play the user's latest projected multimedia resource, thereby improving the user experience.

[0045] In some embodiments, the controller executes determining a third projection window among the multiple projection windows included in the projection interface, and is specifically configured to: determine any one of the multiple projection windows as the third projection window; or, determine the third projection window among the multiple projection windows based on the projection time of each projection window among the multiple projection windows; or, in response to receiving a window selection instruction, determine the projection window corresponding to the window selection instruction as the third projection window.

[0046] Based on the above scheme, the present application provides multiple methods for determining the projection window of the third multimedia resource, thereby determining the most suitable projection window for the third multimedia resource, ensuring that the display device can always project and play the user's latest projection multimedia resource, thereby improving the user experience.

[0047] In some embodiments, before the controller executes a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device in response to receiving the first screen projection instruction, it is also configured to: start the multi-projection application in response to receiving a start operation for the multi-projection application.

[0048] Based on the above scheme, before projecting the first multimedia resource, the display device may have started a multi-projection application, that is, entered the multi-channel projection mode. Therefore, when subsequently projecting the second multimedia resource, the display device no longer needs to enter the multi-channel projection mode, but can directly execute multi-channel projection, thereby improving the projection efficiency.

[0049] In some embodiments, if the controller determines that the similarity of the first media asset meets the multi-screen projection condition based on the first media asset information and the second media asset information, then the first multimedia resource is maintained in the first projection window in the projection interface to continue playing, and the second multimedia resource is played in the second projection window in the projection interface. Specifically, the controller is configured as follows: if the controller determines that the similarity of the first media asset meets the multi-screen projection condition based on the first media asset information and the second media asset information, then the projection selection window is displayed; in response to receiving a user selection operation on the first option in the projection selection window, the first multimedia resource is maintained in the first projection window in the projection interface to continue playing, and the second multimedia resource is played in the second projection window in the projection interface.

[0050] Based on the above scheme, before determining to perform multi-channel screen projection on the second multimedia resource, the present application can display a screen projection selection window to determine whether to add a screen projection window for multi-channel screen projection according to the user's selection. When the user determines to perform multi-channel screen projection, the multi-channel screen projection operation is performed, thereby avoiding the situation where the user still performs multi-channel screen projection when he wants to perform replacement screen projection, and also avoiding the user's misoperation, thereby improving the user experience.

[0051] In some embodiments, the controller is further configured to: in response to receiving a user's selection operation on the second option in the projection selection window, control the first multimedia resource to exit the projection from the first projection window, and play the second multimedia resource in the first projection window; or, in response to receiving a user's selection operation on the third option in the projection selection window, maintain the first projection window in the projection interface to continue playing the first multimedia resource.

[0052] Based on the above scheme, the user can also choose to replace or cancel the screen projection in the screen projection selection window according to the needs. The display device controls the first multimedia resource to exit the screen projection from the first screen projection window according to the user's choice, and plays the second multimedia resource in the first screen projection window; or cancels the screen projection of the second multimedia resource and continues to play the first multimedia resource in the first screen projection window. This application can determine the screen projection method according to user needs, provide users with more screen projection options, and improve user experience.

[0053] According to a second aspect of an embodiment of the present application, there is provided a display device, comprising a display and a controller. The display device is configured to display a screen projection interface. The controller is coupled to the display and is configured to: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, obtain the first multimedia resource, and play the first multimedia resource in a first screen projection window in the screen projection interface. In response to receiving a second screen projection instruction for playing a second multimedia resource sent by a first screen projection device, obtain the second multimedia resource. If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the second media resource meets the multi-channel screen projection condition, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

[0054] The display device provided in the embodiment of the present application can determine whether the similarity of the second media resource meets the multi-channel projection condition based on the first multimedia resource and the second multimedia resource when the display device receives the first projection instruction sent by the first projection device and plays the first multimedia resource in the first projection window. If the similarity of the second media resource meets the multi-channel projection condition, the display device can continue to play the first multimedia resource in the first projection window and play the second multimedia resource projected for the second time in another projection window (i.e., the second projection window) of the projection interface. The display device provided in the embodiment of the present application enables the same projection device (such as a mobile phone) to perform multi-channel projection of multiple multimedia resources (such as film sources) on the same display device (such as a television device), thereby improving user experience.

[0055] According to a third aspect of an embodiment of the present application, there is provided a display device, comprising a display and a controller. The display device is configured to display a screen projection interface. The controller is coupled to the display and is configured to: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, obtain the first multimedia resource, and play the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction includes the first title information of the first multimedia resource. In response to receiving a second screen projection instruction for playing a second multimedia resource sent by a first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction includes the second title information of the second multimedia resource, the similarity between the first title information and the second title information is determined. If the similarity between the first title information and the second title information meets the multi-channel screen projection condition, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

[0056] The display device provided in the embodiment of the present application receives a first screen projection instruction sent by a first screen projection device through the display device, and plays the first multimedia resource in the first screen projection window. When receiving a second screen projection instruction sent by the first screen projection device (i.e., the same screen projection device), if the first screen projection instruction includes the first title information of the first multimedia resource, and the second screen projection instruction includes the second title information of the second multimedia resource, the similarity between the first title information and the second title information can be determined. When the similarity between the first title information and the second title information meets the multi-screen projection condition, the display device can continue to play the first multimedia resource in the first screen projection window, and play the second multimedia resource projected for the second time in another screen projection window (i.e., the second screen projection window) of the screen projection interface. The display device provided in the embodiment of the present application enables the same screen projection device (such as a mobile phone) to perform multi-screen projection of multiple multimedia resources (such as film sources) on the same display device (such as a television device), thereby improving user experience.

[0057] A fourth aspect of an embodiment of the present application provides a display device, comprising a display and a controller. The display device is configured to display a screen projection interface. The controller is coupled to the display and is configured to: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, obtain the first multimedia resource, and play the first multimedia resource in the first screen projection window in the screen projection interface. In response to receiving a second screen projection instruction for playing a second multimedia resource sent by a first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction does not include the second title information of the second multimedia resource, then obtain the second multimedia resource. If it is determined based on the first multimedia resource and the second multimedia resource that the similarity of the second media resource meets the multi-channel screen projection condition, then the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

[0058] The display device provided in the embodiment of the present application receives a first projection instruction sent by a first projection device through the display device, and plays the first multimedia resource in the first projection window. When receiving a second projection instruction sent by the first projection device (i.e., the same projection device), if one of the first projection instruction or the second projection instruction does not include title information, then based on the first multimedia resource and the second multimedia resource, it is determined whether the similarity of the second media resource meets the multi-channel projection condition. If the similarity of the second media resource meets the multi-channel projection condition, the display device can continue to play the first multimedia resource in the first projection window, and play the second multimedia resource projected for the second time in another projection window (i.e., the second projection window) of the projection interface. The display device provided in the embodiment of the present application enables the same projection device (such as a mobile phone) to perform multi-channel projection of multiple multimedia resources (such as film sources) on the same display device (such as a television device), thereby improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0060] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0061] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0062] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0063] Figure 4A A schematic diagram of a screen projection process provided in some embodiments of the present application;

[0064] Figure 4B A schematic diagram of a screen projection method provided in some embodiments of the present application;

[0065] Figure 5A A schematic diagram of information interaction in a screen projection process provided in some embodiments of the present application;

[0066] Figure 5B A schematic diagram of a screen projection interface provided in some embodiments of the present application;

[0067] Figure 6 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0068] Figure 7 A schematic diagram of information interaction in another screen projection process provided in some embodiments of the present application;

[0069] Figure 8 A schematic diagram of another screen projection interface provided in some embodiments of the present application;

[0070] Fig. 9 A schematic diagram of information interaction in another screen projection process provided in some embodiments of the present application;

[0071] Fig.10 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0072] Fig.11 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0073] Fig.12 A schematic diagram of another screen projection interface provided in some embodiments of the present application;

[0074] Fig.13 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0075] Fig.14 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0076] Fig.15 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0077] Fig.16 A schematic diagram of another screen projection method provided in some embodiments of the present application;

[0078] Fig.17 A schematic diagram of another screen projection process provided in some embodiments of the present application;

[0079] Fig.18 A schematic diagram of another screen projection process provided for some embodiments of the present application. DETAILED DESCRIPTION

[0080] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0081] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0082] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0083] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0084] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0085] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0086] In some examples, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc. The embodiment of the present application does not limit the type of the display device 200.

[0087] The mobile terminal 300 can be used as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 for data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200 and communicate through a network communication protocol to achieve one-to-one control operations and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0088] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0089] like Figure 1 As also shown in FIG. 1 , the display device 200 also communicates data with the server 400 through various communication methods. For example, the display device 200 may be connected to the server 400 through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0090] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0091] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0092] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0093] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0094] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive and display an image signal output from the controller 250. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0095] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0096] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0097] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0098] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0099] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0100] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0101] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0102] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0103] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0104] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0105] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0106] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0107] like Figure 3As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0108] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0109] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0110] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0111] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0112] As the display screens of display devices (such as TVs) become larger and larger, the application of multi-channel screen projection is becoming more and more widespread. The multi-channel screen projection function can use the large screen of the display device to simultaneously project multiple film sources, allowing multiple users to use the same screen to watch their respective content of interest at the same time. DLNA (Digital Living Network Alliance) screen projection is a screen projection technology based on the DLNA protocol. DLNA screen projection allows users to transmit audio, video, pictures and other content pushed by the screen projection initiator device (hereinafter referred to as the screen projection device) to the screen projection receiving device (hereinafter referred to as the display device) through a wireless network to achieve the sharing and playback of multimedia content.

[0113] In some examples, DLNA screen projection uses the Internet Protocol Address (IP) as the dimension to distinguish sessions. Screen projection devices with different IPs can achieve multi-way screen projection on the same display device, while screen projection devices with the same IP cannot achieve multi-way screen projection on the same display device. Among them, the command interaction and events specified by the DLNA protocol are based on HTTP short links. One HTTP request and response is made for each command. The HTTP request does not carry the software information used by the screen projection device, that is, the display device cannot distinguish which APP of the screen projection device the sent screen projection command is sent from. Therefore, when different APPs of the same screen projection device, or the same APP of the same screen projection device, are casting the screen, the latter screen projection will replace the previous screen projection of the screen projection device with the same IP address.

[0114] Figure 4A A schematic diagram of a screen projection process provided in some embodiments of the present application. For example, Figure 4A The screen projection process in the example uses the screen projection interface of the display device including two screen projection windows, and the screen projection device is a mobile phone.

[0115] like Figure 4A As shown in (a), when neither mobile phone 1 nor mobile phone 2 initiates screen projection, the two projection windows (such as the first projection window and the second projection window) on the projection interface of the display device do not play the film source.

[0116] like Figure 4AAs shown in (b), when mobile phone 1 initiates screen casting of source 1, the first screen casting window plays source 1 pushed by mobile phone 1; mobile phone 2 does not initiate screen casting, and the second screen casting window does not play the source. Among them, mobile phone 1 and mobile phone 2 are different mobile phones, that is, the IP address of mobile phone 1 is different from the IP address of mobile phone 2.

[0117] like Figure 4A As shown in (c), when source 1 is played in the first projection window and mobile phone 1 initiates projection of source 2 again, although there is no projection content in the second projection window on the right side of the projection interface, since the IP of the second projection is the same as the IP of the previous projection, it will trigger source 1 to exit the projection from the first projection window, and the second projection of source 2 by mobile phone 1 will be played in the first projection window. That is, when the same IP is projected twice, the source 2 of the latter projection will replace the source 1 of the previous projection, and the source 2 of the most recent projection by mobile phone 1 will be played in the first projection window.

[0118] like Figure 4A As shown in (d), when mobile phone 2 initiates the projection of film source 3, since the film source projected by IP 2 is not played in the projection window of the current projection interface, and there is a second projection window on the right side of the projection interface, the film source 2 pushed by mobile phone 2 can be played in the second projection window; at the same time, the first projection window continues to play the film source 2 pushed by mobile phone 1.

[0119] It can be seen from the above process that the screen projection solution in the related technology can only realize dual-channel screen projection of two film sources pushed by different screen projection devices on the display device, and cannot realize dual-channel screen projection of two film sources pushed by the same screen projection device on the display device.

[0120] Combined with the above content, it can be seen that when the related technology uses DLNA for screen projection, if the user needs to simultaneously project multiple sources on the same display device, it is necessary to use multiple projection devices (such as mobile phones) to project the screen separately, and it is impossible to simultaneously project multiple sources on the same projection device on the display device. In addition, video APPs on mobile phones usually require membership to watch. In the related technology, if the user wants to project different sources in the same video APP on the same display device, it is necessary to activate membership on different mobile phones separately, which leads to a poor user experience.

[0121] In order to solve the above problems, an embodiment of the present application provides a display device, which can play the first multimedia resource projected by the first projection device in the first projection window, and when receiving the second projection instruction sent by the first projection device (i.e., the same projection device), can determine whether the similarity of the first media resource meets the multi-channel projection condition based on the first media resource information in the first projection instruction and the second media resource information in the second projection instruction. If the similarity of the first media resource meets the multi-channel projection condition, the display device can continue to play the first multimedia resource in the first projection window, and play the second multimedia resource projected for the second time in another projection window (i.e., the second projection window) of the projection interface. The display device provided by the embodiment of the present application can simultaneously project multiple film sources pushed by the same projection device on the display device when the similarity of the media resources of the multiple film sources pushed by the same projection device meets the multi-channel projection condition, that is, the display device provided by the embodiment of the present application supports the same projection device to perform multi-channel projection on the display device, which can improve the user's projection experience.

[0122] Figure 4B A schematic diagram of a screen projection method provided in some embodiments of the present application. Figure 4B , the screen projection method provided in the embodiment of the present application is described in detail. For example, the screen projection method can be implemented by the controller 250 in the display device 200. Figure 4B As shown, the screen projection method includes steps 410 to 430 as shown below.

[0123] Step 410, in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, playing the first multimedia resource in a first screen projection window in the screen projection interface.

[0124] In some examples, the display device 200 is a screen projection receiving device, and the screen projection device is a screen projection sending device. The user can send a screen projection instruction to the display device 200 through the screen projection device, and the display device 200 receives the screen projection instruction and plays the multimedia resources corresponding to the screen projection instruction on the display 260 according to the screen projection instruction.

[0125] For example, the display device 200 may be a television device, a projection device, a computer device, etc., and the projection device may be a smart phone, a computer device, or other projection devices, etc. The present application embodiment does not limit the types of display devices and projection devices. The following embodiment takes the display device 200 as a television and the projection device as a mobile phone as an example for illustrative description.

[0126] Exemplarily, the display 260 of the display device 200 is used to display a screen projection interface, and the screen projection interface may include at least one screen projection window, each screen projection window is used to play multimedia resources pushed by the screen projection device. Among them, multimedia resources may include video, audio, image, text, etc. The embodiment of the present application does not limit the type of multimedia resources. The following embodiment takes the multimedia resource as video as an example for exemplary description.

[0127] In some examples, before the first projection device sends the first projection instruction, the display device may display the projection interface, or may display other interfaces, such as a media resource list page, a media resource playback page, or an interface of any application on the display device. When the display device displays the projection interface before the first projection device sends the first projection instruction, the projection interface may include at least one projection window, and the at least one projection window may be in an idle state (i.e., the projection source is not being played), or some of the projection windows may be in an idle state, or all of the windows may be in a projection state (i.e., the projection source is being played).

[0128] Exemplarily, the first screen projection instruction may be a screen projection instruction for the first screen projection sent by the first screen projection device to the display device 200, or may be a screen projection instruction for any screen projection sent by the first screen projection device to the display device 200. When the first screen projection instruction is the first screen projection instruction, before the first screen projection device sends the first screen projection instruction, no media data is projected on the display device 200, such as at least one projection window on the projection interface is in an idle state. When the first screen projection instruction is any screen projection instruction, before the first screen projection device sends the first screen projection instruction, the display device 200 may already be playing a projection source, such as the projection interface includes a projection window in a projection state. The following embodiments are exemplified by taking the first screen projection instruction as the first screen projection instruction as an example.

[0129] In some embodiments, before step 410, the method further includes: in response to receiving a start operation for the multi-cast application, starting the multi-cast application.

[0130] Exemplarily, the display device 200 may enter the multi-cast application before receiving the first screen casting instruction. For example, the user may send a multi-cast application startup instruction to the display device 200 through the control device 100 (such as a remote control), and the display device 200 starts the multi-cast application according to the startup instruction; or the user may send a multi-cast application startup instruction to the display device 200 through voice, which is not limited in the embodiments of the present application.

[0131] In some examples, the multicast application is an application for performing multi-channel screen projection in the display device 200, that is, when the multicast application is started, the display device 200 can support the screen projection device to perform multi-channel screen projection operations. After the display device 200 starts the multicast application, the display 260 can display a screen projection interface, which can include one screen projection window or multiple screen projection windows.

[0132] Exemplarily, when the display device 200 receives the first screen projection instruction sent by the first screen projection device, the screen projection interface displayed on the display 260 (hereinafter referred to as the first screen projection interface) may include one screen projection window or multiple screen projection windows.

[0133] For example, if the first projection interface includes one projection window, namely the first projection window, the first multimedia resource is played in the first projection window. If the first projection interface includes multiple projection windows, one projection window is selected from the multiple projection windows as the first projection window, and the first multimedia resource is played in the first projection window. The first projection window can be any projection window among the multiple projection windows.

[0134] Exemplarily, before receiving the first screen projection instruction, the display device 200 may not need to start the multi-cast application. In this case, in response to the first screen projection instruction, the first multimedia resource is played directly in the first screen projection window. At this time, the screen projection interface may include only one screen projection window, namely the first screen projection window. In other words, when the screen projection interface includes one screen projection window, the display device 200 may start the multi-cast application or not start the multi-cast application.

[0135] In some examples, the first screen projection instruction is an instruction for instructing the display device 200 to play the first multimedia resource. After receiving the first screen projection instruction, the display device 200 parses the first screen projection instruction, obtains the first media resource information in the first screen projection instruction, and plays the first multimedia resource in the first screen projection window of the first screen projection interface according to the first media resource information.

[0136] For example, the user can select the film source to be projected in the application of the projection device, and select to project to the display device in the projection options of the projection device, thereby triggering the sending of the projection instruction to the display device.

[0137] In some examples, the media resource information may include the title information and the projection address of the multimedia resource to be projected. The title information may include the name, number of episodes, content introduction and other information of the multimedia resource; the projection address may be the Uniform Resource Locator (URL) address corresponding to the multimedia resource to be projected. For example, the URL address may be the server address corresponding to the multimedia resource to be projected, and the display device 200 may obtain the multimedia resource to be projected from the server according to the URL address.

[0138] In some examples, before sending the first projection instruction, the first projection device may first send a stop projection instruction to control the first projection device to exit the projection of the multimedia resource currently being projected. Since the first projection instruction is the first projection of the first projection device, the display device 200 currently has no multimedia resources being played, so there is no need to execute the exit projection operation. After receiving the first projection instruction, the first multimedia resource is played in the first projection window. Among them, the projection instruction can be called the SetAVTransportURI command, and the stop projection instruction can be called the stop command.

[0139] Figure 5A A schematic diagram of information interaction in a screen projection process provided by some embodiments of the present application. Figure 5A , the first screen projection process is explained. It should be noted that Figure 5A In the figure, the first screen projection device is a mobile phone, and the display device 200 includes a protocol stack module, a screen projection session management module, a display interface module, and a player module as an example for exemplary description.

[0140] like Figure 5A As shown, first, the mobile phone sends a stop command to the protocol stack module of the display device. The protocol stack module obtains the IP address of the mobile phone through the communication Socket based on the received stop command, and sends the mobile phone IP address and the stop command to the screen projection session management module. If the screen projection session management module detects that the mobile phone currently has no screen projection content based on the IP address, no corresponding processing is performed.

[0141] Next, the mobile phone sends the SetAVTransportURI command to the protocol stack module. The protocol stack module obtains the IP address of the mobile phone through the communication socket according to the received SetAVTransportURI command, and sends the mobile phone IP address and SetAVTransportURI command to the screen projection session management module. If the screen projection session management module detects that the mobile phone currently has no projection content, it creates a new screen projection session 1 and records the binding relationship between the IP address and session 1. At the same time, the screen projection session management module starts the Activity and passes session 1 to the display interface module. The display interface module creates a view component for playback (such as SurfaceView1 or TextureView1) and binds it to session 1. The screen projection session management module creates player 1, passes URL 1 of source 1 in the SetAVTransportURI command and Surface1 created by the application to play View1 to the player module; and forms a binding relationship between player 1, IP address, URL 1, and Surface1 playing View1 and stores it in session 1. The player module decodes and plays source 1, and notifies the screen projection session management module of events such as preparation completion, first frame, and resolution change. The projection session management module determines the corresponding session 1 according to the binding relationship between the player and the session, notifies the display interface module to adjust the display and layout, and passes session 1 and corresponding events to the display interface module. The display interface module adjusts the interface layout according to the binding relationship between session 1 and View1 to complete the playback of source 1.

[0142] It should be noted that Figure 5A The following example uses the example of sending a stop screen projection command (such as a stop command) before sending a screen projection command (such as a SetAVTransportURI command) to illustrate. In other examples, depending on the screen projection application, the screen projection device may not send a stop command before sending a SetAVTransportURI command. When the screen projection device does not send a stop screen projection command before sending a screen projection command, you can Figure 5A Perform the first screen projection by following steps 5 to 17 in the tutorial. I will not go into details here.

[0143] Step 420, in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, determine second media asset information corresponding to the second multimedia resource based on the second screen projection instruction.

[0144] In some examples, after the display device plays the first multimedia resource in the first projection window of the projection interface (i.e., the first projection interface), the user can also send a second projection instruction to the display device 200 through the first projection device, i.e., perform a second projection. The second projection instruction is used to instruct the display device 200 to play the second multimedia resource. After receiving the second projection instruction, the display device 200 parses the second projection instruction and obtains the second media resource information corresponding to the second multimedia resource.

[0145] Exemplarily, the first multimedia resource and the second multimedia resource may be multimedia resources in different applications (hereinafter referred to as APP) in the first projection device, or may be multimedia resources in the same APP in the first projection device. This embodiment of the application is not limited to this.

[0146] For example, the user can select a first multimedia resource in the first APP of the first projection device, and send a first projection instruction to play the first multimedia resource to the display device 200; after the first projection window of the first projection interface plays the first multimedia resource, the user can select a second multimedia resource in the second APP of the first projection device, and send a second projection instruction to play the second multimedia resource to the display device 200. The first APP and the second APP are different APPs, such as the first APP can be the Tencent Video APP in the first projection device, and the second APP can be the iQiyi APP in the first projection device. The embodiment of the present application does not limit the types of the first APP and the second APP.

[0147] For another example, the user can select a first multimedia resource in the first APP of the first projection device, and send a first projection instruction to play the first multimedia resource to the display device 200; after playing the first multimedia resource in the first projection window of the first projection interface, the user continues to select a second multimedia resource in the first APP of the first projection device, and sends a second projection instruction to play the second media resource to the display device 200.

[0148] Step 430: If, based on the first media resource information and the second media resource information, it is determined that the similarity of the first media resource meets the multi-channel projection condition, the first projection window in the projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second projection window in the projection interface.

[0149] Exemplarily, if the display device 200 has started a multi-cast application before receiving the second projection instruction, and the projection interface displays multiple projection windows, then in response to the second projection instruction, an idle projection window (second projection window) that is not playing a projection source in the multiple projection windows can play the second multimedia resource; alternatively, if the display device 200 has started a multi-cast application before receiving the second projection instruction, and the projection interface displays one projection window, then in response to the second projection instruction, a new second projection window can be created and the second multimedia resource can be played in the second projection window.

[0150] If the display device 200 has not started the multi-projection application before receiving the second screen projection instruction, the display device 200 may start the multi-projection application in response to the second screen projection instruction when receiving the second screen projection instruction, and display the screen projection interface (hereinafter referred to as the second screen projection interface). The second screen projection interface may include multiple screen projection windows, and the multiple screen projection windows include a first screen projection window and a second screen projection window.

[0151] In some examples, the number of projection windows in the first projection interface and the second projection interface may be the same or different. For example, if the display device 200 has started the multi-projection application before receiving the first projection instruction, and the first projection interface includes multiple projection windows, the number of projection windows in the second projection interface is the same as that in the first projection interface. If the display device 200 starts the multi-projection application before receiving the first projection instruction, but the displayed first projection interface includes one projection window, or the display device 200 starts the multi-projection application after receiving the second projection instruction, the number of projection windows in the second projection interface is different from that in the first projection interface.

[0152] For example, the first projection interface may include a first projection window for playing a first multimedia resource, and the second projection interface may include a first projection window for playing the first multimedia resource and a second projection window for playing the second multimedia resource; or, the first projection interface may include a first projection window for playing the first multimedia resource and an idle second projection window, and the second projection interface may include a first projection window for playing the first multimedia resource and a second projection window for playing the second multimedia resource.

[0153] Figure 5B A schematic diagram of a screen projection interface provided in some embodiments of the present application, such as Figure 5B As shown in (a) of FIG. 1 , the first projection interface 50 includes only one projection window, namely the first projection window 50a, and the first projection window 50a plays the first multimedia resource. Figure 5B As shown in (c), the size and layout of the first projection window 50a are adjusted, and the first projection window 51a in the second projection interface 51 continues to play the first multimedia resource, and the second projection window 51b plays the second multimedia resource.

[0154] like Figure 5B As shown in (b) of FIG. 1 , the first projection interface 50 includes multiple projection windows, namely a first projection window 50a and a second projection window 50b. The first projection window 50a plays the first multimedia resource, and the second projection window 50b is in an idle state. Figure 5B As shown in (c), there is no need to adjust the size and layout of the first projection window 50a and the second projection window 50b. The first projection window 50a in the second projection interface 51 continues to play the first multimedia resource, and the second projection window 50b plays the second multimedia resource.

[0155] Exemplarily, before executing step 430, it can be further determined whether the projection device that sends the first projection instruction (i.e., the first projection) and the projection device that sends the second projection instruction (i.e., the second projection) are the same projection device.

[0156] For example, if the projection device that sends the first projection instruction and the projection device that sends the second projection instruction are the same projection device, continue to execute step 430. If the projection device that sends the first projection instruction and the projection device that sends the second projection instruction are different projection devices, there is no need to execute step 430, and the second multimedia resource can be played directly in another projection window of the projection interface. That is, different projection devices can perform multi-channel projection directly on the display device 200.

[0157] Figure 6 A schematic diagram of another screen projection method provided in some embodiments of the present application. Figure 6 As shown, before step 430, the method further includes steps 610 to 630 as shown below.

[0158] Step 610, in response to the first screen projection instruction, determine the first device information of the screen projection device that sends the first screen projection instruction.

[0159] Step 620, in response to the second screen projection instruction, determine the second device information of the screen projection device that sends the second screen projection instruction.

[0160] It should be noted that step 610 may be performed after step 410 or after step 420, and step 620 may be performed after step 420. When both step 610 and step 620 are performed after step 420, the embodiment of the present application does not limit the order of execution of step 610 and step 620. The embodiment of the present application takes step 610 being performed after step 410 and step 620 being performed after step 420 as an example for exemplary description.

[0161] In some examples, after receiving the first screen projection instruction, the display device 200 can obtain the first device information of the screen projection device that sends the first screen projection instruction and store the first device information; after receiving the second screen projection instruction, the display device 200 can obtain the second device information of the screen projection device that sends the second screen projection instruction and store the second device information. Then, the first device information and the second device information are compared.

[0162] In some examples, the device information of the projection device may include the IP address of the projection device and / or the Media Access Control Address (MAC) of the projection device. The following embodiments are illustrative in that the device information is an IP address, such as the first device information is a first IP address and the second device information is a second IP address.

[0163] Continue to refer to Figure 5A After receiving the first screen projection instruction, the protocol stack module of the display device 200 obtains the first IP address of the screen projection device that sends the first screen projection instruction through the communication socket, and sends the first screen projection instruction (SetAVTransportURI) and the first IP address to the screen projection session management module. Figure 7 As shown, after receiving the second screen projection instruction, the display device 200 can also obtain the second IP address of the screen projection device that sends the second screen projection instruction through the communication Socket.

[0164] Step 630: Based on the first device information and the second device information, determine that the screen projection device that sends the first screen projection instruction and the screen projection device that sends the second screen projection instruction are both the first screen projection device.

[0165] In some examples, after the display device 200 obtains the first device information (such as the first IP address) and the second device information (such as the second IP address), if it is determined that the first device information and the second device information are the same, that is, it is determined that the projection device for the two screen projections is the same, then step 430 is continued.

[0166] For example, if it is determined that the first device information and the second device information are different, that is, the projection devices for the two projections are not the same projection device, then according to the LDNA projection protocol, the display device 200 can continue to play the first multimedia resource in the first projection window, and play the second multimedia resource in another projection window in the projection interface.

[0167] The following describes the situation where both the screen projection device that sends the first screen projection instruction and the second screen projection instruction are the first screen projection device.

[0168] In some examples, when the display device 200 determines that the screen projection device for the two screen projections is the same screen projection device, the first media similarity can be determined based on the first media information and the second media information. The first media information includes the first title information and / or the first screen projection address; the second media information includes the second title information and / or the second screen projection address.

[0169] For example, when the similarity of the first media resource meets the multi-screen projection condition, it is determined that the first multimedia resource and the second multimedia resource can realize multi-screen projection on the display device 200 .

[0170] In some embodiments, step 430 includes: determining the similarity type of the first media asset similarity based on the first media asset information and the second media asset information; if the similarity type of the first media asset similarity is the first type, determining that the first media asset similarity meets the multi-channel projection condition. If the similarity type of the first media asset similarity is the second type, determining that the first media asset similarity does not meet the multi-channel projection condition.

[0171] Exemplarily, the first type is used to indicate that the first media asset similarity is lower than the first similarity threshold, or the first media asset information is not similar to the second media asset information. The second type is used to indicate that the first media asset similarity is higher than the second similarity threshold, or the first media asset information is similar to the second media asset information. The first similarity threshold and the second similarity threshold may be the same or different.

[0172] In some embodiments, the similarity type of the first media asset similarity is a first type including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to multimedia resources of different episodes. The similarity type of the first media asset similarity is a second type including: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information belong to different multimedia resources of the same episode or the same multimedia resource with different media asset parameters. The first multimedia resource and the second multimedia resource may be media assets of different applications or media assets of the same application.

[0173] Exemplarily, when the first multimedia resource is a TV series and the second multimedia resource is a movie, the first multimedia resource and the second multimedia resource belong to multimedia resources of different series. That is, when the first multimedia resource and the second multimedia resource belong to different categories, the first multimedia resource and the second multimedia resource belong to multimedia resources of different series. When the first multimedia resource and the second multimedia resource belong to the same category, the first multimedia resource and the second multimedia resource may belong to multimedia resources of different series or may belong to multimedia resources of the same series.

[0174] In some examples, when the first multimedia resource and the second multimedia resource belong to the same category, if the first multimedia resource and the second multimedia resource are not media assets of the same TV series (or movie), then the first multimedia resource and the second multimedia resource belong to multimedia assets of different TV series. If the first multimedia resource and the second multimedia resource are media assets of the same TV series (or the same movie), or the first multimedia resource and the second multimedia resource are media assets of related TV series (or movies), then the first multimedia resource and the second multimedia resource belong to multimedia assets of the same TV series.

[0175] For example, the TV series "The Legend of Zhen Huan" in the Tencent Video APP and the TV series "Peppa Pig" in the iQiyi APP (or Tencent Video APP) are different series; the TV series "The Legend of Zhen Huan" in the Tencent Video APP and the TV series "The Legend of Zhen Huan" in the iQiyi APP (or Tencent Video APP) are the same series.

[0176] For another example, the movie "Detective Chinatown" in the Tencent Video APP and the movie "A Chinese Odyssey" in the iQiyi APP (or Tencent Video APP) are different series; the movie "Detective Chinatown" in the Tencent Video APP and the movie "Detective Chinatown 2" in the iQiyi APP (or Tencent Video APP) are the same series.

[0177] In other examples, multiple videos posted by the same user in the same APP can also belong to the same episode. For example, in the Bilibili APP, different videos posted by the same video blogger can belong to the same episode.

[0178] Exemplarily, when the first media resource and the second multimedia resource are different multimedia resources of the same series, or the first media resource and the second multimedia resource are the same multimedia resource with different media resource parameters, the similarity type of the first media resource similarity is the second type. The different multimedia resources of the same series may be different episodes of the same TV series or movie, and the media resource parameters may include media resource resolution.

[0179] For example, the similarity type between the first episode of the TV series "The Legend of Zhen Huan" and the second episode of "The Legend of Zhen Huan" is the second type, which is similar media assets; or, the similarity type between the first episode of "The Legend of Zhen Huan" at the first resolution and the first episode of "The Legend of Zhen Huan" at the second resolution is the second type, which is also similar media assets.

[0180] In some examples, when the first multimedia resource and the second multimedia resource are of the first type, the two sources are not similar. At this time, the similarity of the first media resource meets the multi-channel screen projection condition, and the display device 200 can perform multi-channel screen projection on the first multimedia resource and the second multimedia resource. When the first multimedia resource and the second multimedia resource are of the second type, the two sources are similar. At this time, the similarity of the first media resource does not meet the multi-channel screen projection condition, the display device 200 does not perform multi-channel screen projection, performs a screen projection replacement operation, exits the first multimedia resource from the first screen projection window, and plays the second multimedia resource in the first screen projection window.

[0181] For example, after projecting the first episode of "The Legend of Zhen Huan" on the display device, when you choose to project the fifth episode of "Peppa Pig" on the display device, since the first episode of "The Legend of Zhen Huan" and the fifth episode of "Peppa Pig" are not similar, the display device 200 can enter multi-channel projection and continue to play the first episode of "The Legend of Zhen Huan" in one projection window of the display device, while playing the fifth episode of "Peppa Pig" in another projection window of the display device.

[0182] For another example, after projecting the first episode of "The Legend of Zhen Huan" on the display device, when you choose to project the second episode of "The Legend of Zhen Huan" on the display device, since the first episode of "The Legend of Zhen Huan" and the second episode of "The Legend of Zhen Huan" are similar, the display device 200 does not enter the multi-channel projection; or, after projecting the first episode of "The Legend of Zhen Huan" with a resolution of 720P on the display device, when you choose to project the first episode of "The Legend of Zhen Huan" with a resolution of 1080P on the display device, since the first episode of "The Legend of Zhen Huan" with a resolution of 720P and the second episode of "The Legend of Zhen Huan" with a resolution of 1080P are similar, the display device 200 does not enter the multi-channel projection either.

[0183] In some embodiments, based on the first media asset information and the second media asset information, determining the similarity type of the first media asset similarity includes: preprocessing the first title information in the first media asset information to obtain processed first title information; preprocessing the second title information in the second media asset information to obtain processed second title information; if the processed first title information and the processed second title information are different, determining that the similarity type of the first media asset similarity is the first type; if the processed first title information and the processed second title information are the same, determining that the first media asset similarity is the second type.

[0184] In some examples, the media asset information includes the title information of the multimedia resource. After determining the first media asset information and the second media asset information, the display device 200 may further obtain the first title information and the second title information, and pre-process the first title information and the second title information. The title information may be in the form of a character string.

[0185] Exemplarily, the preprocessing operation may include removing a first preset character from a first string corresponding to the first title information, removing a first preset character from a second string corresponding to the second title information, and comparing the first string and the second string from which the first preset character is removed.

[0186] The first preset characters may include numeric characters and common characters. For example, numeric characters may include Arabic numerals, Chinese numerals, and English numerals, and common characters may include punctuation marks, spaces, and the like.

[0187] In some examples, if the first character string after removing the first preset character and the second character string are different, the similarity type of the first media asset similarity is the first type; if the first character string after removing the first preset character and the second character string are the same, the similarity type of the first media asset similarity is the second type.

[0188] Exemplarily, the preprocessing operation may further include extracting substrings before and / or after the second preset character in the first string and the second string, namely, the first substring and the second substring, and comparing whether the first substring and the second substring are consistent. If the first substring and the second substring are inconsistent, the similarity type of the first media asset similarity is determined to be the first type; if the first substring and the second substring are consistent, the similarity type of the first media asset similarity is determined to be the second type.

[0189] For example, the first multimedia resource is the TV series "Time is Right" in the iQiyi APP, and the first title information corresponding to the first media resource information is: "Time is Right Episode 1 Xu Mengan's company begins to lay off employees" (that is, the first character string), and the second multimedia resource is the TV series "Time is Right" in the Tencent Video APP, and the second title information corresponding to the second media resource information is: "Episode 2 Time is Right" (that is, the second character string). Since the first substring before the second preset character "Episode 1" of the first character string is "Time is Right", and the second substring after the second preset character "Episode 2" of the second character string is also "Time is Right", the similarity type of the first media resource similarity is the second type, that is, the first multimedia resource and the second multimedia resource are similar.

[0190] Exemplarily, if it is determined that the similarity of the first media resource meets the multi-channel projection condition, the first multimedia resource is continued to be played in the first projection window, and the second multimedia resource is played in the second projection window of the projection interface.

[0191] In some examples, when the projection interface includes multiple projection windows, the second multimedia resource can be played in the second projection window of the multiple projection windows; when the projection interface includes one projection window, a projection window (i.e., the second projection window) can be added to the projection interface, and the second multimedia resource can be played in the added projection window. For example, the display device 200 can adjust the size and layout of the first projection window in the projection interface, so that the projection interface can include the first projection window and the second projection window at the same time, and the first projection window plays the first multimedia resource, and the second projection window plays the second multimedia resource.

[0192] Exemplarily, the first screen projection device may send a stop screen projection instruction before sending the second screen projection instruction, or may not send a stop screen projection instruction.

[0193] In some embodiments, when the first screen projection device does not send a stop screen projection instruction before sending the screen projection instruction, the above step 430 includes: based on the first screen projection address in the first screen projection instruction, continue to receive the first multimedia resource sent by the server corresponding to the first screen projection address; maintain the first multimedia resource in the first screen projection window, send a first notification message to the first screen projection device, and play the second multimedia resource in the second screen projection window.

[0194] Among them, the display device 200 can receive the control operation of the first screen projection device on the second multimedia resource, and the first notification message is used to notify the first screen projection device that the first multimedia resource has exited the screen projection.

[0195] In some embodiments, while continuing to play the first multimedia resource in the first projection window, the binding relationship between the first projection device and the first multimedia resource can be released, and a first notification message can be sent to the first projection device; a binding relationship between the first projection device and the second multimedia resource is created, and the second multimedia resource is played in the second projection window, so that the first projection device can control the second multimedia resource.

[0196] Exemplarily, after receiving the second screen projection instruction, the display device 200 will notify the first screen projection device that the first multimedia resource has exited the screen projection, but the display device 200 can continue to obtain the first multimedia resource from the server corresponding to the first multimedia resource according to the first screen projection address (i.e., the first URL) in the first screen projection instruction, thereby maintaining the first multimedia resource in the first screen projection window.

[0197] In some examples, the server may be a cloud server, such as each application may correspond to its own server, or multiple applications may correspond to one server, which is not limited in the present embodiment. The display device 200 may obtain corresponding multimedia resources from the corresponding server according to the acquired projection address (i.e., URL).

[0198] Exemplarily, after receiving the second screen projection instruction, the display device 200 may send a first notification message to the first screen projection device to notify the first screen projection device that the display device 200 has exited the screen projection of the first multimedia resource. At the same time, the display device 200 releases the binding relationship between the first multimedia resource and the first screen projection device. The first notification message may be a stop event. The display device 200 may also play the second multimedia resource in the second screen projection window according to the second screen projection instruction, and create a binding relationship between the second multimedia resource and the first screen projection device. In some examples, the binding relationship between the screen projection device and the multimedia resource may also be considered as the binding relationship between the screen projection device and the screen projection session corresponding to the multimedia resource.

[0199] In some examples, after the binding relationship between the first multimedia resource and the first projection device is released, the first projection device cannot perform control operations on the first multimedia resource played in the first projection window on the display device 200. After the binding relationship between the second multimedia resource and the first projection device is created, the first projection device can perform control operations on the second multimedia resource currently projected.

[0200] That is to say, when the display device 200 determines that the similarity of the first media resource meets the multi-channel projection conditions, it can release the binding relationship between the first projection device and the first multimedia resource projected last time, and create a binding relationship between the first projection device and the second multimedia resource currently projected, ensuring that the first projection device can always control the playback of the multimedia resource currently projected.

[0201] Exemplarily, the first screen projection device may also send a stop screen projection instruction before sending the second screen projection instruction, and then send the second screen projection instruction.

[0202] In some embodiments, before the above step 430, the method further includes: in response to receiving a stop screen projection instruction for stopping playing the first multimedia resource, sending a second notification message to the first screen projection device; and releasing the binding relationship between the first screen projection device and the first multimedia resource. The second notification message is used by the first screen projection device to indicate that the first multimedia resource has exited screen projection.

[0203] Exemplarily, if the first screen projection device sends a stop screen projection instruction to the display device 200 before sending the second screen projection instruction, the display device 200 releases the binding relationship between the first screen projection device and the first multimedia resource according to the stop screen projection instruction.

[0204] For example, the user can choose to exit screen projection in the projection option on the APP of the first projection device to send a stop projection instruction to the display device 200; or, when the user performs a projection operation on the second multimedia resource through the first projection device, the first projection device can automatically send a stop projection instruction to the display device 200.

[0205] For example, the second notification message sent according to the stop screen projection instruction and the first notification message sent according to the second screen projection instruction can be the same, such as both are stop event notifications.

[0206] In some embodiments, step 430 includes: based on the first projection address in the first projection instruction, continuing to receive the first multimedia resource sent by the server corresponding to the first projection address; maintaining the first multimedia resource to continue playing in the first projection window; creating a binding relationship between the first projection device and the second multimedia resource, and playing the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

[0207] In some examples, after the first screen projection device sends a stop screen projection instruction to the display device 200, the display device 200 can directly create a binding relationship between the first screen projection device and the second multimedia resource after receiving the second screen projection instruction sent by the first screen projection device, so that the first screen projection device can control the second multimedia resource.

[0208] It should be noted that when the first screen projection device does not send a stop screen projection instruction to the display device 200 before sending the second screen projection instruction, the display device 200 releases the binding relationship between the first multimedia resource and the first screen projection device according to the second screen projection instruction; when the first screen projection device sends a stop screen projection instruction to the display device 200 before sending the second screen projection instruction, the display device 200 releases the binding relationship between the first multimedia resource and the first screen projection device according to the stop screen projection instruction.

[0209] Figure 7 A schematic diagram of information interaction in another screen projection process provided in some embodiments of the present application. Figure 7 The second screen projection process is described below. Figure 7 In the figure, the first screen projection device is a mobile phone, and the display device 200 includes a protocol stack module, a screen projection session management module, a display interface module, and a player module as an example for exemplary description.

[0210] like Figure 7As shown, during the second screen projection, first, the mobile phone sends a stop command to the protocol stack module of the display device. The protocol stack module obtains the IP address of the mobile phone through the communication Socket based on the received stop command, and sends the mobile phone IP address and the stop command to the screen projection session management module. The screen projection session management module detects that the mobile phone is currently in dual projection mode based on the IP address, and there is a screen projection session 1 at the current IP address, then releases the binding relationship between the IP address and session 1. After releasing the binding relationship between the IP address and session 1, the screen projection session management module sends a stop event event notification to the protocol stack module, and the protocol stack module sends the stop event event notification to the mobile phone. Based on the stop event event notification, the mobile phone exits the control page for the previous screen projection, and is unable to perform control operations on the previous screen projection (i.e. Figure 7 Step 31-Step 37).

[0211] Then, the mobile phone sends the SetAVTransportURI command to the protocol stack module. The protocol stack module obtains the IP address of the mobile phone through the communication Socket based on the received Set AVTransportURI command, and sends the mobile phone IP address and SetAVTrans portURI command to the screen projection session management module.

[0212] It should be noted that when the mobile phone sends the SetAVTransportURI command without sending the stop command, after step 40, it is necessary to continue to execute steps 41 and 43 to release the binding relationship between the mobile phone and session 1. When the mobile phone sends the stop command before sending the SetAVT ransportURI command, there is no need to execute steps 41 to 43. Among them, steps 41 to 43 are similar to the implementation methods of steps 34 to 37 above, and will not be repeated here. In other words, whether the mobile phone sends the stop command will affect the timing of the screen projection session management module to release the binding relationship between the IP and session 1.

[0213] Next, if the projection session management module determines that the source 2 of the current projection with the same IP is similar to the source 1 of session 1, the playback of session 1 is exited. At the same time, the projection session management module stops the player 1 corresponding to session 1 according to the binding relationship between the session and the player, and notifies the display interface module to exit the playback display of session 1. The display interface module cleans up the display of View1 and re-layouts the interface (i.e. Figure 7 44-47 in the process.

[0214] If the screen projection session management module determines that the source 2 of the current screen projection with the same IP is not similar to the source 1 of session 1, a new screen projection session 2 is created, and the binding relationship between the IP and session 2 is recorded (i.e. Figure 7 The subsequent playback process of source 2 (steps 49 to 57) is completed together with the above-mentioned steps of playing source 1 ( Figure 5A Steps 9 to 17) in are similar and will not be described again here to avoid repetition.

[0215] In some examples, after the first multimedia resource is unbound from the first projection window, the first projection device cannot control the playback of the first multimedia resource, that is, the user cannot continue to pause, fast forward, rewind, and exit the playback of the first multimedia resource played in the first projection window through the first projection device.

[0216] In order to ensure that the user can control the playback of the unbound first multimedia resource, the embodiment of the present application provides a menu display area on the screen projection interface. The menu display area may include multiple playback controls. The user can input control instructions to each playback control through a control device (such as a remote control) to achieve playback control of the first multimedia resource.

[0217] Exemplarily, each projection window of the projection interface can be provided with a corresponding menu display area, and the menu display area includes at least one playback control control, and the at least one playback control control includes at least one of a progress adjustment control, a pause playback control, an exit projection control, and a full-screen playback control.

[0218] For example, the progress adjustment control is used to adjust the playback progress of the multimedia resources played in the projection window, including fast forward adjustment and fast rewind adjustment. The pause playback control is used to pause / unpause the multimedia resources played in the projection window. The exit projection control is used to control the multimedia resources played in the projection window to exit the projection from the projection interface. The full-screen playback control is used to play the multimedia resources played in the projection window in full screen on the projection interface.

[0219] In some examples, each projection window on the projection interface is provided with a menu display area, and the multimedia resource whose binding relationship is released can be played back through the playback control in the corresponding menu display area. In other examples, the projection window corresponding to the multimedia resource whose binding relationship is not released can also be provided with a menu display area, and the multimedia resource whose binding relationship is not released can also be played back through the playback control in the corresponding menu display area.

[0220] In some embodiments, the screen projection interface also includes a menu display area corresponding to each screen projection window. The menu display area corresponding to each screen projection window can always be displayed at the corresponding position of the screen projection window (such as below the screen projection window, above the screen projection window, and to the side of the screen projection window), or the menu display area corresponding to the screen projection window can be displayed when the focus is switched to the screen projection window. For example, the screen projection interface can directly display the menu display area corresponding to each screen projection window, or the menu display area corresponding to each screen projection window can be called out through a focus switching instruction.

[0221] Exemplarily, the screen projection interface also includes a first menu display area corresponding to the first screen projection window, the first menu display area includes at least one first playback control control, and the at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control.

[0222] In some examples, when the first multimedia resource played by the first projection window is unbound from the first projection device, the first projection device cannot control the playback of the first multimedia resource. In this case, the playback of the first multimedia resource can be controlled through at least one first playback control control in the first menu display area corresponding to the first projection window.

[0223] In some embodiments, after step 430 above, the method further includes: in response to receiving a control instruction input by the control device to a first progress adjustment control, adjusting the playback progress of the first multimedia resource in the first projection window; in response to receiving a control instruction input by the control device to a first pause playback control, pausing the playback of the first multimedia resource in the first projection window; in response to receiving a control instruction input by the control device to a first exit projection control, controlling the first multimedia resource to exit projection from the first projection window; in response to receiving a control instruction input by the control device to a first full-screen playback control, controlling the first multimedia resource to play in full screen on the projection interface.

[0224] In some examples, the first projection window of the projection interface is playing the first multimedia resource, and the second projection window is playing the second multimedia resource. The focus of the control device can currently be located in the first projection window or the second projection window. When the user needs to control the playback of the first multimedia resource through the control device, the focus can be switched to the first projection window first to call out the first menu display area corresponding to the first projection window. Of course, the first menu display area can also always be displayed at the corresponding position of the first projection window.

[0225] For example, taking the first menu display area displayed below the first projection window as an example, the user can use the control device to move the focus to any first playback control control in the first menu display area to input control instructions, thereby pausing / unpausing, adjusting the progress, exiting projection, and controlling full-screen playback of the first multimedia resource.

[0226] In some examples, the display device 200 adjusts the playback progress of the first multimedia resource in the first projection window in response to receiving a control instruction input by the control device to the first progress adjustment control. For example, the control device can control the playback progress of the first multimedia resource to move forward or backward.

[0227] In some examples, the display device 200 pauses the playback of the first multimedia resource in the first projection window in response to receiving a control instruction input by the control device to the first pause playback control. For example, when the user inputs a control instruction to the first pause playback control again through the control device, the playback of the paused first multimedia resource can be controlled to resume (i.e., unpause).

[0228] In some examples, the display device 200 controls the first multimedia resource to exit the projection from the first projection window in response to receiving a control instruction input by the control device to the first exit projection control.

[0229] For example, when the first multimedia resource exits the screen projection, the first screen projection window is changed to an idle screen projection window. At this time, the first menu display area can be always displayed or can exit the display. If the first menu display area exits the display, then when a new multimedia resource is projected to the first screen projection window, the first menu display area can be displayed again. For another example, when the first multimedia resource exits the screen projection, the display of the first screen projection window can also be exited, the size of the second screen projection window can be adjusted, and only the second screen projection window can be displayed directly on the screen projection interface.

[0230] In some examples, the display device 200 controls the full-screen playback of the first multimedia resource on the projection interface in response to receiving a control instruction input by the control device to the first full-screen playback control.

[0231] For example, when a user inputs a control instruction to the first full-screen playback control through the control device, the display device 200 can adjust the size and layout of the first projection window to enlarge the first projection window and occupy the entire projection interface. During the adjustment of the first projection window, the first projection window is maintained to play the first multimedia resource.

[0232] For another example, when the user inputs a control instruction to the first full-screen playback control again through the control device, the first multimedia resource can be controlled to exit full-screen playback, that is, the size and layout of the first projection window are readjusted so that the projection interface re-enters the multi-channel projection playback. Alternatively, the user can also control the first multimedia resource to exit full-screen by using preset buttons (such as the return button, the exit button) on the control device, and the embodiments of the present application are not limited to this.

[0233] Figure 8 A schematic diagram of another screen projection interface provided in some embodiments of the present application. Figure 8 As shown, the screen projection interface includes a first screen projection window and a second screen projection window; wherein, the first screen projection window plays the first multimedia resource sent by the first screen projection device, and the second screen projection device plays the second multimedia resource sent by the first screen projection device.

[0234] like Figure 8 As shown, taking the case where the menu display area corresponding to the projection window is displayed when the focus is switched to the projection window as an example, when the focus frame is switched to the first projection window through the control device, the first menu display area corresponding to the first projection window is displayed in the projection interface. Among them, the first menu display area includes multiple playback control controls, and the multiple playback control controls are: full screen playback control, fast rewind playback control (such as the first progress adjustment control), pause / unpause playback control, fast forward playback control (such as another first progress adjustment control), volume control control, and exit projection control.

[0235] In some embodiments, after step 430, the method further includes: in response to the received playback control instruction sent by the first screen projection device, performing a corresponding control operation on the second multimedia resource in the second screen projection window. The control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

[0236] In some examples, after the display device 200 creates a binding relationship between the second multimedia resource and the first projection device, the user can control the playback of the second multimedia resource currently played in the second projection window through the first projection device. For example, the user can use the playback control items on the projection interface of the first projection device (such as a mobile phone) to control the playback progress, pause / unpause, volume, exit projection, etc. of the second multimedia resource.

[0237] In some embodiments, the screen projection interface further includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control. The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit screen projection control, and a second full-screen playback control.

[0238] In some examples, in addition to controlling the playback of the second multimedia resource played in the second projection window through the first projection device, the playback of the second multimedia resource can also be controlled through the second menu display area corresponding to the second projection window.

[0239] In some embodiments, in response to receiving a focus switching operation sent by a control device, the focus is controlled to move between the first projection window and the second projection window; when the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

[0240] In some embodiments, in response to receiving a control instruction input by the control device to a second progress adjustment control, the playback progress of the second multimedia resource in the second projection window is adjusted; in response to receiving a control instruction input by the control device to a second pause playback control, the playback of the second multimedia resource in the second projection window is paused; in response to receiving a control instruction input by the control device to a second exit projection control, the second multimedia resource is controlled to exit the projection from the second projection window; in response to receiving a control instruction input by the control device to a second full-screen playback control, the second multimedia resource is controlled to play in full screen on the projection interface.

[0241] In some examples, when controlling the playback of the second multimedia resource through the control device, it is necessary to move the focus to the second projection window through the control device. When the focus is moved to the second projection window, the second menu display area can be called up, and the playback of the second multimedia resource can be controlled by inputting a control instruction of at least one playback control control in the second menu display area through the control device.

[0242] It should be noted that the control method of the second menu display area is similar to that of the first menu display area, and will not be described again here to avoid repetition.

[0243] The screen projection method provided in the embodiment of the present application can set a first menu display area for the first multimedia resource that has been unbound, and input a control instruction to at least one first playback control control in the first menu display area through a control device, thereby achieving playback control of the first multimedia resource. For the second multimedia resource that has been bound, playback control can be performed through the first screen projection device, or control instructions can be input to at least one second playback control control in the second menu display area through a control device, thereby achieving playback control of the second multimedia resource.

[0244] In some embodiments, after step 430, the method further includes: in response to receiving a control instruction input by the control device to at least one second playback control control, performing a corresponding control operation on the second multimedia resource in the second projection window; sending playback information of the second multimedia resource to the first projection device, so that the first projection device updates the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

[0245] In some embodiments, in response to receiving an acquisition request sent by the first screen projection device, determining the playback information of the second multimedia resource bound to the first screen projection device; and sending the playback information of the second multimedia resource to the first screen projection device. The playback information includes at least one of the playback progress, playback duration, and playback status of the second multimedia resource.

[0246] In some examples, the display device 200 can actively send the playback information of the second multimedia resource to the first projection device so that the first projection device can update the playback of the second multimedia; or, the first projection device can also actively obtain the playback information of the second multimedia resource from the display device 200, and update the playback of the second multimedia according to the obtained playback progress, playback duration, and playback status of the second multimedia resource.

[0247] Fig. 9 A schematic diagram of information interaction in another screen projection process provided in some embodiments of the present application. Fig. 9 The following describes the playback control during screen projection. Fig. 9 In the figure, the first screen projection device is a mobile phone, and the display device 200 includes a protocol stack module, a screen projection session management module, a display interface module, and a player module as an example for exemplary description.

[0248] in, Fig. 9 What is shown is the process of controlling the playback of the first multimedia resource played in the first screen projection window through the mobile phone during the first screen projection process.

[0249] like Fig. 9 As shown, the mobile phone can send pause (hereinafter referred to as Pause) instructions and jump progress (hereinafter referred to as Seek) and other commands to the protocol stack module of the display device 200. The protocol stack module obtains the IP address of the mobile phone through the communication Socket, and sends the mobile phone IP address and Pause, Seek and other commands to the screen projection session management module. The screen projection session management module finds the corresponding player 1 according to the session relationship, performs Pause and Seek control, and notifies the display interface module to display the corresponding status, progress, etc., and transmits session 1. The display interface module adjusts the progress bar, play button and other controls corresponding to View1 (i.e. Fig. 918 to 23 in the description).

[0250] For example, the mobile phone can also periodically send commands such as obtaining playback progress (hereinafter referred to as GetPositionInfo) and obtaining playback duration (hereinafter referred to as GetTransportInfo) to the protocol stack module to obtain playback progress, duration and other information. The protocol stack module obtains the IP address of the mobile phone through the communication Socket, and sends the mobile phone IP address and commands such as GetPositionInfo and GetTransportInfo to the screen projection session management module. The screen projection session management module finds the corresponding player 1 according to the session relationship, reads the playback progress, duration, playback status, etc. from the display interface module, and returns the read playback progress, duration, and playback status to the protocol stack module, and then returns to the mobile phone through the protocol stack module. The mobile phone updates the playback progress, duration, playback status and other information (i.e. Fig. 9 24 to 30 in the process).

[0251] In the screen projection method provided in the embodiment of the present application, the first screen projection device can actively obtain the playback information of the second multimedia resource with which a binding relationship has been established from the display device, and update the playback information of the second multimedia resource. The display device can also actively send the playback information of the second multimedia resource with which a binding relationship has been established to the first screen projection device, thereby achieving consistency in the playback information of the multimedia resources on the screen projection device and the display device, and improving the user experience.

[0252] The following describes a situation where the similarity type of the first media asset similarity is the second type, that is, the second media asset similarity does not meet the multi-channel screen projection condition.

[0253] Fig.10 A schematic diagram of another screen projection method provided in some embodiments of the present application, such as Fig.10 As shown, after the above step 420 , the method further includes steps 440 and 450 .

[0254] Step 440: If the first media asset similarity type is the second type, it is determined that the first media asset similarity does not meet the multi-screen projection condition.

[0255] Step 450, control the first multimedia resource to exit the first projection window, and play the second multimedia resource in the first projection window.

[0256] In some examples, if the similarity type of the first media asset similarity is the second type, that is, the first media asset similarity does not meet the multi-channel screen casting condition, then the first multimedia resource is similar to the second multimedia resource, in which case the second multimedia resource can replace the playback of the first multimedia resource, that is, perform a replacement screen casting operation.

[0257] For example, when it is determined that the second multimedia resource and the first multimedia resource are different episodes of the same series, or have different resolutions, the first multimedia resource can be controlled to be projected from the first projection window, and the second multimedia resource can be played in the first projection window.

[0258] In some examples, when it is determined that the similarity of the first media asset does not meet the multi-channel projection conditions, the number and layout of the projection windows in the projection interface may not need to change, that is, the projection interface may still continue to display the first projection interface, and only the playback content in the first projection window may be replaced.

[0259] The display device and screen projection method provided in the embodiment of the present application can determine whether the similarity of the first media asset meets the multi-channel projection condition based on the first media asset information in the first projection instruction and the second media asset information in the second projection instruction when the second projection instruction sent by the first projection device (i.e., the same projection device) is received by playing the first multimedia resource projected by the first projection device in the first projection window. If the similarity of the first media asset meets the multi-channel projection condition, the display device can continue to play the first multimedia resource in the first projection window, and play the second multimedia resource projected for the second time in another projection window (i.e., the second projection window) of the projection interface. The display device provided in the embodiment of the present application can simultaneously project multiple film sources pushed by the same projection device on the display device when the similarity of the media assets of the multiple film sources pushed by the same projection device meets the multi-channel projection condition. That is, the display device provided in the embodiment of the present application supports the same projection device to perform multi-channel projection on the display device, which can improve the user's projection experience.

[0260] Fig.11 A schematic diagram of another screen projection method provided in some embodiments of the present application, such as Fig.11 As shown, the above step 430 includes steps 1110 to 1120 as shown below. After step 1110, the method further includes steps 1130 and 1140.

[0261] Step 1110: If it is determined based on the first media asset information and the second media asset information that the first media asset similarity satisfies the multi-screen projection condition, a screen projection selection window is displayed.

[0262] In some examples, before determining that the similarity of the first media resource meets the multi-channel screen projection condition and performing screen projection on the second multimedia resource, the display device 200 may also control the display 260 to display a screen projection selection window on the screen projection interface. The screen projection selection window is used to prompt the user whether to confirm that multi-channel screen projection will be performed and receive the user's selection of multi-channel same screen.

[0263] Exemplarily, the screen projection selection window may include at least one option, and the user may further determine whether to perform multi-channel screen projection by selecting at least one option. The screen projection selection window may be displayed on the upper layer of multiple screen projection windows on the screen projection interface.

[0264] In some examples, the multiple options in the screen projection selection window may include a first option, a second option, and a third option. The first option may be an option indicating that the user agrees to perform multi-channel screen projection, the second option is an option indicating that the user refuses multi-channel screen projection, and the third option is an option indicating that the user cancels the current screen projection.

[0265] It should be noted that the screen projection selection window may also include only the first option and the second option, or the first option and the third option. The embodiment of the present application does not limit this. The embodiment of the present application takes the example that the screen projection selection window includes the first option, the second option and the third option for illustrative explanation.

[0266] In other examples, the screen projection selection window may also include prompt information, which is used to prompt the user to make corresponding selections for multi-channel screen projection.

[0267] Step 1120, in response to receiving the user's selection operation on the first option in the projection selection window, maintain the first projection window in the projection interface to continue playing the first multimedia resource, and play the second multimedia resource in the second projection window in the projection interface.

[0268] In some examples, when a selection operation of the first option is received by the user through the control device, it indicates that the user needs to continue to perform the multi-channel screen projection operation. Therefore, the display device 200 can continue to play the first multimedia resource in the first screen projection window and play the second multimedia resource in the second screen projection window.

[0269] For example, the first option may be “OK,” “Yes,” or “Agree,” etc., indicating that the user allows multi-channel screen projection.

[0270] Step 1130, in response to receiving a user's selection operation on the second option in the screen projection selection window, controlling the first multimedia resource to exit the first screen projection window, and playing the second multimedia resource in the first screen projection window.

[0271] In some examples, when a selection operation of the second option input by the user through the control device is received, it indicates that the user abandons the multi-channel screen projection operation, that is, the user wants to replace the first multimedia resource being played with the second multimedia resource currently being projected. Therefore, the display device 200 can control the first multimedia resource to exit the projection from the first projection window, and play the second multimedia resource in the first projection window.

[0272] For example, the second option may be “Reject”, “No”, or “NO”, etc., indicating that the user gives up on multi-channel screen projection.

[0273] Step 1140, in response to receiving the user's selection operation on the third option in the screen projection selection window, maintaining the first screen projection window in the screen projection interface to continue playing the first multimedia resource.

[0274] In some examples, when a selection operation of the third option is received by the user through the control device, it indicates that the user does not want to continue to project the second multimedia resource, that is, the user wants to cancel the projection of the second multimedia resource. Therefore, the display device 200 can maintain the first projection window and continue to play the first multimedia resource.

[0275] For example, the second option may be “Cancel” or “Exit”, etc., indicating that the user cancels the screen projection of the second multimedia resource.

[0276] In some examples, after a user performs a selection operation on at least one option in the projection selection window, the projection selection window can exit the projection interface.

[0277] Fig.12 A schematic diagram of another screen projection interface provided in some embodiments of the present application. Fig.12 As shown, the screen projection interface includes a screen projection selection window, and the screen projection selection window can be displayed on the upper layer of the first screen projection window and the second screen projection window.

[0278] like Fig.12 As shown, the screen projection selection window includes prompt information and three option controls, wherein the prompt information is "Do you want to continue with multi-channel screen projection?"; the "OK" control in the three option controls corresponds to the first option, the "Reject" control corresponds to the second option, and the "Cancel" control corresponds to the third option.

[0279] For example, when the user moves the focus frame to the "OK" control through the control device, the projection selection window exits the display, the first projection window continues to play the first multimedia resource, and the second projection window plays the second multimedia resource. When the user moves the focus frame to the "Reject" control through the control device, the projection selection window exits the display, the first projection window exits the playback of the first multimedia resource, and plays the second multimedia resource. When the user moves the focus frame to the "Cancel" control through the control device, the projection selection window exits the display, and the first projection window continues to play the first multimedia resource.

[0280] It should be noted that Fig.12The screen projection interface in the example includes the first screen projection window and the second screen projection window. When the user selects "Reject" and "Cancel", the screen projection interface can cancel the second screen projection window and enlarge the first screen projection window. In some examples, the screen projection interface can also include only the first screen projection window. After the user selects the "Confirm" control, the second screen projection window is added, and the size and position of the first screen projection window are adjusted.

[0281] The screen projection method provided in the embodiment of the present application can provide the user with a screen projection option window for selection when it is determined that the multi-channel screen projection conditions are met, and determine whether to perform multi-channel screen projection based on the user's selection, thereby improving the user experience. At the same time, it can also avoid the situation where multi-channel screen projection is still performed when the user wants to change, and can avoid some wrong screen projection operations of the user.

[0282] Fig.13 A schematic diagram of another screen projection method provided in some embodiments of the present application, such as Fig.13 As shown, before the above step 430, the method also includes steps 1310 to 1330 as shown below.

[0283] Step 1310, determine the resource type of the first multimedia resource based on the first projection address in the first projection instruction, and determine the resource type of the second multimedia resource based on the second projection address in the second projection instruction.

[0284] In some examples, the projection instruction sent by the projection device to the display device 200 includes a projection address. The projection address (ie, URL) may be a unique identifier of the multimedia resource on the server. The display device 200 may access and play the video through the projection address.

[0285] In some examples, resource types include online resources and local resources. Among them, online resources can also be called server resources, and the screen projection address of online resources directly points to the storage location of multimedia resources on the server; local resources refer to audio, video, pictures, and files that have been downloaded in the screen projection device. The screen projection process does not involve access to external servers, and the screen projection address does not point to a URL of a network resource, but to the local address of the screen projection device.

[0286] Exemplarily, the resource type of the multimedia resource can be distinguished as an online resource or a local resource according to the projection address. For example, the display device 200 can store URL addresses corresponding to each application and local URL addresses, such as the display device 200 can store a correspondence table between URL addresses and resource types.

[0287] For example, after the display device 200 determines the first projection address and the second projection address, it can determine the resource type of the first multimedia resource and the resource type of the second multimedia resource according to the correspondence table.

[0288] Step 1320: Check whether the first multimedia resource and the second multimedia resource are both online resources.

[0289] For example, when it is determined that the first multimedia resource is an online resource, the resource type of the second multimedia resource is determined. If the second multimedia resource is also an online resource, step 430 is executed.

[0290] For example, when it is determined that the first multimedia resource is an online resource and the second multimedia resource is a local resource, or when it is determined that the first multimedia resource is a local resource, step 1330 is executed. It should be noted that if the first multimedia resource is determined to be a local resource, there is no need to determine the resource type of the second multimedia resource again, and step 1330 is directly executed.

[0291] Step 1330, control the first multimedia resource to exit the first projection window, and play the second multimedia resource in the first projection window.

[0292] In some examples, as long as there is a local resource in the resource type of the first multimedia resource and the resource type of the second multimedia resource, the multi-channel screen projection operation is not performed, but the replacement screen projection operation is performed. In other words, the local resource does not support the multi-channel screen projection function.

[0293] For example, if the first multimedia resource currently played in the first projection window is a local resource, the next second multimedia resource to be projected, whether it is an online resource or a local resource, will replace the first multimedia resource, that is, the display device 200 can exit the first multimedia resource from the first projection window and play the second multimedia resource in the first projection window.

[0294] For another example, if the first multimedia resource currently played in the first projection window is an online resource, and when the second multimedia resource to be projected next is a local resource, the replacement projection operation is still performed.

[0295] It should be noted that step 430 has been described in the above embodiment and will not be described again here to avoid repetition.

[0296] The screen projection method provided in the embodiment of the present application determines the resource type of the multimedia resource according to the screen projection address in the media resource information, and the display device performs multi-channel screen projection only when both the multimedia resource that has been projected and the multimedia resource to be projected are online resources. When there is a local resource in the multimedia resource that has been projected and the multimedia resource to be projected, the display device adopts the principle of replacement screen projection, and the multimedia resource to be projected replaces the playback of the multimedia resource that has been projected.

[0297] Fig.14 A schematic diagram of another screen projection method provided in some embodiments of the present application, such as Fig.14 As shown, after the above step 430, the method further includes steps 1410 to 1430 as shown below.

[0298] Step 1410, in response to receiving a third screen projection instruction for playing a third multimedia resource sent by the first screen projection device, determine third media resource information corresponding to the third multimedia resource based on the third screen projection instruction.

[0299] It should be noted that the process of determining the third media information corresponding to the third multimedia resource in step 1410 is similar to the process of determining the second media information corresponding to the second multimedia resource in step 420 above, and will not be repeated here to avoid repetition.

[0300] Step 1420: If, based on the first media resource information and the second media resource information, it is determined that the similarity of the second media resource meets the multi-channel screen projection condition, and based on the second media resource information and the third media resource information, it is determined that the similarity of the third media resource meets the multi-channel screen projection condition, and there is no idle screen projection window in the screen projection interface that does not play multimedia resources, then the third screen projection window is determined among the multiple screen projection windows included in the screen projection interface.

[0301] In some examples, after determining the third media information corresponding to the third multimedia resource, the third media information can be compared with the first media information corresponding to the first multimedia resource that is currently projected, and the second media information corresponding to the second multimedia resource, and the second media similarity and the third media similarity can be determined.

[0302] It should be noted that the determination process of the second media asset similarity and the third media asset similarity is similar to the determination process of the first media asset similarity in the above embodiment, and will not be described again here to avoid repetition.

[0303] In some examples, step 1420 is to determine the media similarity between the third media asset information and the first media asset information and the second media asset information. If the second media asset similarity satisfies the multi-channel projection condition (such as the third multimedia resource is not similar to the first multimedia resource), and the third media asset similarity satisfies the multi-channel projection condition (such as the third multimedia resource is not similar to the second multimedia resource), then the projection interface further includes whether there is an idle projection window among the multiple projection windows. Among them, the idle projection window is used to indicate a projection window that is not currently playing a multimedia resource.

[0304] It should be noted that it is possible to first determine whether the similarity between the second media asset and the third media asset meets the multi-channel projection condition. When it is determined that the similarity between the second media asset and the third media asset both meet the multi-channel projection condition, it is then determined whether there is an idle projection window among the multiple projection windows of the display. Alternatively, it is also possible to first determine whether there is an idle projection window among the multiple projection windows of the display, and then determine whether the similarity between the second media asset and the third media asset meets the multi-channel projection condition. This application does not limit the execution order of this process.

[0305] Exemplarily, when it is determined that the second media asset similarity and the third media asset similarity both meet the multi-channel projection conditions, and there is at least one idle projection window in the projection interface, a projection window for playing the third multimedia resource is determined in the at least one projection window.

[0306] In some examples, if there is an idle projection window among multiple projection windows, the first projection window and the second projection window are maintained to continue playing the current multimedia resources, and the third multimedia resource is played in the idle projection window.

[0307] In other examples, if there are multiple idle projection windows among the multiple projection windows, the third multimedia resource can be played in any of the multiple idle projection windows, or the projection window for playing the third multimedia resource can be determined according to the user's selection.

[0308] Exemplarily, if there is no idle projection window among multiple projection windows, the third multimedia resource cannot be projected. In this case, it is necessary to determine the third projection window that plays the third multimedia resource among the projection windows that are playing the multimedia resources (i.e., the first projection window and the second projection window).

[0309] In some embodiments, determining a third projection window among multiple projection windows includes: determining any one of the multiple projection windows as the third projection window; or, determining the third projection window among the multiple projection windows based on the projection time of each projection window among the multiple projection windows; or, in response to receiving a window selection instruction, determining the projection window corresponding to the window selection instruction as the third projection window.

[0310] In some examples, the third projection window can be any one of the first projection window and the second projection window; or, the third projection window can also be the earliest (or latest) projection window between the first projection window and the second projection window; or, the third projection window can also be the projection window selected by the user. For example, the user can select the projection window to be replaced as the third projection window by moving the focus of the control device.

[0311] In other examples, when it is determined that the similarity of the second media asset or the similarity of the third media asset does not meet the multi-channel projection condition, for example, if the similarity of the second media asset does not meet the multi-channel projection condition (that is, the third multimedia asset is similar to the first multimedia asset), the first multimedia asset is controlled to exit the projection from the first projection window, and the third multimedia asset is played in the first projection window. For another example, if the similarity of the third media asset does not meet the multi-channel projection condition (that is, the third multimedia asset is similar to the second multimedia asset), the second multimedia resource is controlled to exit the projection from the second projection window, and the third multimedia resource is played in the second projection window.

[0312] Step 1430: Continue playing corresponding multimedia resources in the projection windows other than the third projection window among the multiple projection windows, and play the third multimedia resource in the third projection window.

[0313] In some examples, when there are no idle projection windows and a third projection window is determined among the projection windows that are already playing multimedia resources, the multimedia resources being played in the third projection window can be exited from projection and the third multimedia resources can be played, while other projection windows continue to play the currently projected multimedia resources.

[0314] For example, when it is determined that the first projection window is the third projection window, the first multimedia resource can be exited from the first projection window, and the third multimedia resource can be played in the first projection window, while the second projection window continues to play the second multimedia resource.

[0315] The screen projection method provided in the embodiment of the present application can determine a projection window for the multimedia resources to be projected among multiple projection windows in the projection interface when the multi-channel projection conditions are met and there is no idle projection window. The determined projection window is used for replacement projection, and other projection windows continue to play the original multimedia resources.

[0316] Fig.15 A schematic diagram of another screen projection method provided in some embodiments of the present application, such as Fig.15 As shown, the screen projection method includes steps 1510 to 1530 as shown below. It should be noted that, Fig.15 The screen projection method provided is Figure 4B The main difference between the two screen casting methods lies in the process of determining the similarity of media assets.

[0317] Step 1510, in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, obtaining the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface.

[0318] In some examples, after receiving the first screen projection instruction, the display device 200 can obtain the first multimedia resource from the corresponding server according to the first screen projection address in the first screen projection instruction; at the same time, the obtained first multimedia resource is played in the first screen projection window of the screen projection interface.

[0319] Step 1520, in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, obtain the second multimedia resource.

[0320] In some examples, after receiving the second screen projection instruction, the display device 200 can obtain the second multimedia resource from the corresponding server according to the second screen projection address in the second screen projection instruction. For example, when the second multimedia resource is a video, the data of the video can be obtained from the server.

[0321] Step 1530: If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth media resource meets the multi-channel projection condition, the first multimedia resource is continued to be played in the first projection window in the projection interface, and the second multimedia resource is played in the second projection window in the projection interface.

[0322] In some examples, the fourth media asset similarity is used to characterize the similarity between the first multimedia resource and the second multimedia resource. For example, some data frames in the first multimedia resource (such as the first data frame) can be compared with some data frames in the second multimedia resource (such as the second data frame). When the overlap between the first data frame and the second data frame is lower than the first preset overlap, the fourth media asset similarity meets the multi-channel projection condition; when the overlap between the first data frame and the second data frame is higher than the second preset overlap, the fourth media asset similarity does not meet the multi-channel projection condition. The data frame can be at least one of video data, audio data, picture data, and text information.

[0323] Exemplarily, the similarity between the first multimedia resource and the second multimedia resource, i.e., the similarity of the fourth media asset, can be determined by a trained machine learning model (such as a similarity model). For example, the first data frame and the second data frame can be input into the similarity model, and the similarity model can output the target overlap, and compare the output target overlap with the first overlap threshold and the second overlap threshold to determine whether the similarity of the fourth media asset meets the multi-channel projection condition. Alternatively, the similarity model can also directly output the result of whether the similarity of the fourth media asset meets the multi-channel projection condition, which is not limited to this embodiment of the present application.

[0324] The screen projection method provided in the embodiment of the present application can determine the similarity of the fourth media resource by obtaining the specific content of the first multimedia resource and the second multimedia resource. When the similarity of the fourth media resource meets the multi-channel screen projection condition, the multi-channel screen projection operation is performed; when the similarity of the fourth media resource does not meet the multi-channel same-screen condition, the replacement screen projection operation is performed.

[0325] Fig.16 A schematic diagram of a screen projection method provided in some embodiments of the present application, such as Fig.16 As shown, the screen projection method includes steps 1610 to 1630 as shown below. It should be noted that, Fig.16 The screen projection method provided is Figure 4B and Fig.15 The main difference between the projection screen methods also lies in the process of determining the similarity.

[0326] Step 1610, in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, obtaining the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface.

[0327] The first screen projection instruction includes the first title information of the first multimedia resource.

[0328] In some examples, the screen projection instruction sent by the screen projection device may include title information or may not include title information. For example, whether the screen projection instruction includes title information may be related to the APP where the multimedia resource is located. The screen projection instructions sent by some APPs include title information, while the screen projection instructions sent by some APPs do not include title information.

[0329] For example, the title information may include information such as the name, number of episodes, and introduction of the multimedia resource, which is not limited in the embodiments of the present application.

[0330] Step 1620, in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, determine whether the second screen projection instruction includes second title information of the second multimedia resource.

[0331] In some examples, after receiving the second screen projection instruction, the display device 200 may determine, based on the second screen projection instruction, whether the second screen projection instruction includes second title information of the second multimedia resource.

[0332] For example, if it is determined based on the second screen projection instruction that the second screen projection instruction includes the second title information of the second multimedia resource, execute step 1630; if it is determined based on the second screen projection instruction that the second screen projection instruction does not include the second title information of the second multimedia resource, execute step 1650.

[0333] Step 1630: Determine the similarity between the first title information and the second title information.

[0334] In some examples, when both the first screen projection instruction and the second screen projection instruction include title information, the similarity between the first title information and the second title information can be determined, and it can be determined whether the similarity between the first title information and the second title information meets the multi-channel screen projection conditions.

[0335] Step 1640: If the similarity between the first title information and the second title information meets the multi-channel projection condition, the first projection window in the projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second projection window in the projection interface.

[0336] Exemplarily, the first title information and the second title information are preprocessed to obtain processed first title information and processed second title information; if the processed first title information and the processed second title information are different, it is determined that the similarity between the first title information and the second title information meets the multi-channel projection condition; if the processed first title information and the processed second title information are the same, it is determined that the similarity between the first media asset does not meet the multi-channel projection condition.

[0337] Step 1650, obtaining a second multimedia resource.

[0338] In some examples, when the first screen projection instruction includes title information but the second screen projection instruction does not include title information, the second multimedia resource can be obtained according to the second screen projection address in the second screen projection instruction, and based on the first multimedia resource and the second multimedia resource, it is determined whether the fourth media resource similarity between the first multimedia resource and the second multimedia resource meets the multi-channel screen projection condition.

[0339] Step 1660: If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth media resource meets the multi-channel projection condition, the first multimedia resource is continued to be played in the first projection window in the projection interface, and the second multimedia resource is played in the second projection window in the projection interface.

[0340] It should be noted that step 1650 to step 1660 are similar to step 1520 to step 1530 in the above embodiment, and will not be described again here to avoid repetition.

[0341] Fig.17 A schematic diagram of another screen projection process provided in some embodiments of the present application. For example, Fig.17 The screen projection process in the example uses the screen projection interface of the display device including two screen projection windows, and the screen projection device is a mobile phone.

[0342] like Fig.17 As shown in (a), after mobile phone 1 initiates screen projection of film source 1, the first screen projection window of the screen projection interface can play film source 1.

[0343] In some examples, taking the IP of mobile phone 1 as IP1, when mobile phone 1 initiates screen projection of source 2 again, it first checks whether there is a source being played at the current IP 1. Since there is source 1 playing at the same IP as source 2, it is necessary to further determine whether source 1 and source 2 are similar sources.

[0344] like Fig.17 As shown in (b), if source 1 and source 2 are similar sources, source 2 will replace source 1, that is, source 1 will exit playback from the first projection window, and source 2 will be played in the first projection window.

[0345] like Fig.17 As shown in (c), if source 1 and source 2 are not similar sources, source 2 is played in another projection window of the projection interface, i.e., the second projection window, to achieve simultaneous playback of source 1 and source 2. At the same time, the IP 1 of mobile phone 1 can be unbound from the previously projected source 1, and a binding relationship can be established with the latest projected source 2. At this time, the projection control instructions sent from mobile phone 1, such as play, pause, progress adjustment, playback time point acquisition, etc., will be passed to source 2, and source 1 will no longer interact with mobile phone 1 in any protocol, that is, for mobile phone 1, the projection of source 1 has been exited.

[0346] Therefore, through the above process, it can be seen that the screen projection method provided in the embodiment of the present application can realize dual-channel screen projection of two film sources pushed by one mobile phone on the display device at the same time. It should be noted that the second screen projection window can be an idle window on the screen projection interface that does not play a film source, or it can be a newly created screen projection window to achieve multi-channel screen projection.

[0347] Fig.17 A schematic diagram of another screen projection process provided in some embodiments of the present application. For example, Fig.17 The screen projection process in the example uses the screen projection interface of the display device including two screen projection windows, and the screen projection device is a mobile phone.

[0348] In some examples, in the screen projection interface, the first screen projection window plays the movie source 1 pushed by mobile phone 1, and the second screen projection window plays the movie source 2 pushed by mobile phone 1 (such as Fig.17 In (c)), when mobile phone 1 initiates the screen projection of film source 3 again, the similarity of film source 3 pushed by mobile phone 1 can be compared with film source 1 and film source 2 pushed by mobile phone 1. If film source 1 and film source 3 pushed by mobile phone 1 are similar sources, film source 1 will be removed from the screen projection, and film source 3 will be played in the first screen projection window. If both film source 1 and film source 2 are not similar to film source 3, one of the film sources will be selected for replacement according to the preset replacement logic. Among them, the preset replacement logic can be to replace the earliest projected source, or the user chooses which source to replace.

[0349] like Fig.18 As shown in (a), when film source 2 and film source 3 are similar film sources, and film source 1 and film source 3 are not similar film sources, film source 2 is exited from the second projection window, and film source 3 is played in the second projection window.

[0350] like Fig.18 As shown in (b), when both source 1 and source 2 are not similar sources to source 3, source 3 can replace source 1 which is projected earliest, that is, source 1 is exited from the first projection window, and source 3 is played in the first projection window.

[0351] like Fig.18 As shown in (c), after source 3 replaces source 1, if mobile phone 2 initiates screen projection of source 4, source 4 will still replace source 2, which was projected earliest, according to the preset replacement principle, that is, source 2 will be exited from the second projection window, and source 4 will be played in the second projection window.

[0352] Therefore, through the above process, it can be seen that the screen projection method provided in the embodiment of the present application can not only realize multi-channel screen projection of film sources pushed by multiple mobile phones, but also realize multi-channel screen projection of multiple film sources pushed by one mobile phone.

[0353] The screen projection method provided in the embodiment of the present application can determine whether the first multimedia resource and the second multimedia resource meet the multi-channel screen projection condition according to whether the first screen projection instruction and the second screen projection instruction sent by the first screen projection device include title information. When the first screen projection instruction and the second screen projection instruction include title information, determine whether the similarity between the two title information meets the multi-channel screen projection condition; when one of the first screen projection instruction and the second screen projection instruction does not include title information, it can be determined based on the first multimedia resource and the second multimedia resource whether the similarity of the fourth media resource meets the multi-channel screen projection condition. If the multi-channel screen projection condition is met, perform the multi-channel screen projection operation.

[0354] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of this disclosure, so that those skilled in the art can better use the embodiments.

Claims

1. A display device, characterized in that: include: A display configured to display a screen projection interface; A controller is coupled to the display and is configured to: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, playing the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction includes first media resource information corresponding to the first multimedia resource; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, determining second media resource information corresponding to the second multimedia resource based on the second screen projection instruction; If, based on the first media information and the second media information, it is determined that the similarity of the first media resource meets the multi-channel screen projection condition, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

2. The display device according to claim 1, characterized in that Before the controller performs the step of determining that the similarity between the first media resource information and the second media resource information satisfies the multi-screen projection condition, the controller is further configured to: In response to the first screen projection instruction, determining first device information of a screen projection device that sends the first screen projection instruction; In response to the second screen projection instruction, determining second device information of the screen projection device that sends the second screen projection instruction; Based on the first device information and the second device information, it is determined that the screen projection device that sends the first screen projection instruction and the screen projection device that sends the second screen projection instruction are both the first screen projection device.

3. The display device according to claim 1, characterized in that The screen projection interface also includes a first menu display area corresponding to the first screen projection window, the first menu display area includes at least one first playback control control, and the at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction of the control device on the first progress adjustment control, adjusting the playback progress of the first multimedia resource in the first projection window; or, In response to receiving a control instruction from the control device to the first pause play control, pausing the play of the first multimedia resource in the first screen projection window; or, In response to receiving a control instruction from the control device to exit the first screen projection control, controlling the first multimedia resource to exit screen projection from the first screen projection window; or, In response to receiving a control instruction from the control device to the first full-screen playback control, the first multimedia resource is controlled to play full screen on the projection interface.

4. The display device according to claim 1, characterized in that After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to the received playback control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; wherein the control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

5. The display device according to claim 1, characterized in that The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction from a control device on the at least one second playback control component, performing a corresponding control operation on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first screen projection device, so that the first screen projection device updates the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

6. The display device according to claim 5, characterized in that Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, the controller is further configured to: In response to receiving a focus switching operation sent by the control device, controlling the focus to move between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

7. The display device according to claim 6, characterized in that The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit screen casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, and is specifically configured as follows: In response to receiving a control instruction from the control device on the second progress adjustment control, adjusting the playback progress of the second multimedia resource in the second projection window; In response to receiving a control instruction from the control device to the second pause play control, pausing the play of the second multimedia resource in the second screen projection window; In response to receiving a control instruction from the control device to the second exit screen projection control, controlling the second multimedia resource to exit screen projection from the second screen projection window; In response to receiving a control instruction from the control device to the second full-screen playback control, the second multimedia resource is controlled to play full screen on the projection interface.

8. The display device according to claim 1, characterized in that The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, and is specifically configured as follows: Based on the first screen projection address in the first screen projection instruction, continue to receive the first multimedia resource sent by the server corresponding to the first screen projection address; Maintaining the first multimedia resource in the first projection window, sending a first notification message to the first projection device, and playing the second multimedia resource in the second projection window; Among them, the display device can receive the control operation of the first screen projection device on the second multimedia resource, and the first notification message is used to notify the first screen projection device that the first multimedia resource has exited screen projection.

9. The display device according to claim 8, characterized in that The controller executes to continue playing the first multimedia resource in the first screen projection window, sends a first notification message to the first screen projection device, and plays the second multimedia resource in the second screen projection window, and is configured as follows: Maintaining the first multimedia resource in the first screen projection window, releasing the binding relationship between the first screen projection device and the first multimedia resource, and sending the first notification message to the first screen projection device; Create a binding relationship between the first screen projection device and the second multimedia resource, and play the second multimedia resource in the second screen projection window, so that the first screen projection device can control the second multimedia resource.

10. The display device according to claim 1, characterized in that Before the controller executes the second screen projection instruction for playing the second multimedia resource in response to receiving the second screen projection instruction sent by the first screen projection device, the controller is further configured to: In response to receiving a stop screen projection instruction for stopping playing the first multimedia resource, sending a second notification message to the first screen projection device; wherein the second notification message is used to notify the first screen projection device that the first multimedia resource has exited screen projection; Release the binding relationship between the first screen projection device and the first multimedia resource.

11. The display device according to claim 10, characterized in that The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, and is specifically configured as follows: Based on the first screen projection address in the first screen projection instruction, continue to receive the first multimedia resource sent by the server corresponding to the first screen projection address; Maintaining the first projection window and continuing to play the first multimedia resource; Create a binding relationship between the first screen projection device and the second multimedia resource, and play the second multimedia resource in the second screen projection window, so that the first screen projection device can control the second multimedia resource.

12. The display device according to any one of claims 1 to 11, characterized in that: The controller is also configured to: In response to receiving the acquisition request sent by the first screen projection device, determining the playback information of the second multimedia resource bound to the first screen projection device; Send playback information of the second multimedia resource to the first screen projection device; wherein the playback information includes at least one of the playback progress, playback duration and playback status of the second multimedia resource.

13. The display device according to claim 1, characterized in that The controller performs the step of determining, based on the first media asset information and the second media asset information, that the first media asset similarity satisfies the multi-screen projection condition, and is specifically configured as follows: Determining a similarity type of the first media asset similarity based on the first media asset information and the second media asset information; If the similarity type of the first media asset similarity is the first type, it is determined that the first media asset similarity meets the multi-screen projection condition; wherein the first type is used to indicate that the first media asset similarity is lower than a first similarity threshold.

14. The display device according to claim 13, characterized in that The similarity type of the first media asset similarity being a first type includes: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information are multimedia resources of different dramas.

15. The display device according to claim 13, characterized in that The controller is also configured to: If the similarity type of the first media asset similarity is the second type, it is determined that the first media asset similarity does not meet the multi-screen projection condition; wherein the second type is used to indicate that the first media asset similarity is higher than a second similarity threshold; Control the first multimedia resource to exit screen projection from the first screen projection window, and play the second multimedia resource in the first screen projection window.

16. The display device according to claim 15, characterized in that The similarity type of the first media asset similarity being the second type includes: the first multimedia resource corresponding to the first media asset information and the second multimedia resource corresponding to the second media asset information are different multimedia resources of the same drama or the same multimedia resource with different media asset parameters.

17. The display device according to claim 14 or 16, characterized in that: The controller performs the step of determining the similarity type of the first media asset similarity, and is specifically configured as follows: Preprocessing the first title information in the first media asset information to obtain processed first title information; Preprocessing the second title information in the second media asset information to obtain processed second title information; If the processed first title information and the processed second title information are different, determining that the similarity type of the first media asset similarity is the first type; If the processed first title information and the processed second title information are the same, it is determined that the similarity type of the first media asset similarity is the second type.

18. The display device according to any one of claims 1 to 11, characterized in that: Before the controller performs the step of determining, based on the first media asset information and the second media asset information, that the first media asset similarity satisfies the multi-screen projection condition, the controller is further configured to: Determining a resource type of the first multimedia resource based on the first screen projection address in the first screen projection instruction; Determining a resource type of the second multimedia resource based on the second screen projection address in the second screen projection instruction; If the resource type of the first multimedia resource and the resource type of the second multimedia resource are both online resources, it is determined whether the first media resource similarity meets the multi-screen projection condition based on the first media resource information and the second media resource information.

19. The display device according to claim 18, characterized in that The controller is also configured to: If the resource type of the first multimedia resource is a local resource, and / or the resource type of the second multimedia resource is a local resource, the first multimedia resource is controlled to exit the first projection window, and the second multimedia resource is played in the first projection window.

20. The display device according to any one of claims 1 to 11, characterized in that: After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a third screen projection instruction for playing a third multimedia resource sent by the first screen projection device, determining third media resource information corresponding to the third multimedia resource based on the third screen projection instruction; If it is determined based on the first media asset information and the third media asset information that the second media asset similarity satisfies the multi-channel screen casting condition, and it is determined based on the second media asset information and the third media asset information that the third media asset similarity satisfies the multi-channel screen casting condition, and there is no idle screen casting window in the screen casting interface that does not play multimedia resources, then a third screen casting window is determined from the multiple screen casting windows included in the screen casting interface; Maintain the projection windows other than the third projection window in the projection interface to continue playing the corresponding multimedia resources, and play the third multimedia resource in the third projection window.

21. The display device according to claim 20, characterized in that The controller performs the step of determining a third projection window from the plurality of projection windows included in the projection interface, and is specifically configured as follows: Determine any one of the plurality of projection windows as the third projection window; or, Determine the third screen projection window in the multiple screen projection windows according to the screen projection time of each screen projection window in the multiple screen projection windows; or, In response to receiving a window selection instruction, the projection window corresponding to the window selection instruction is determined as the third projection window.

22. The display device according to any one of claims 1 to 11, characterized in that: Before the controller executes the first screen projection instruction for playing the first multimedia resource in response to receiving the first screen projection device, the controller is further configured to: In response to receiving a start operation on a multi-cast application, the multi-cast application is started.

23. The display device according to any one of claims 1 to 11, characterized in that: The controller executes the step of maintaining the first projection window in the projection interface to continue playing the first multimedia resource, and playing the second multimedia resource in the second projection window in the projection interface if it is determined based on the first media resource information and the second media resource information that the first media resource similarity satisfies the multi-channel projection condition, and is specifically configured as follows: If it is determined based on the first media asset information and the second media asset information that the first media asset similarity satisfies the multi-channel screen projection condition, a screen projection selection window is displayed; In response to receiving a user's selection operation on the first option in the projection selection window, the first projection window in the projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second projection window in the projection interface.

24. The display device according to claim 23, characterized in that The controller is also configured to: In response to receiving a user's selection operation on a second option in the screen projection selection window, controlling the first multimedia resource to exit the first screen projection window, and playing the second multimedia resource in the first screen projection window; or, In response to receiving a user selection operation on the third option in the screen projection selection window, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource.

25. A display device, characterized in that: include: A display configured to display a screen projection interface; A controller is coupled to the display and is configured to: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, acquiring the second multimedia resource; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth media resource meets the multi-channel screen projection conditions, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

26. The display device according to claim 25, characterized in that The screen projection interface also includes a first menu display area corresponding to the first screen projection window, the first menu display area includes at least one first playback control control, and the at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction of the control device on the first progress adjustment control, adjusting the playback progress of the first multimedia resource in the first projection window; or, In response to receiving a control instruction from the control device to the first pause play control, pausing the play of the first multimedia resource in the first screen projection window; or, In response to receiving a control instruction from the control device to exit the first screen projection control, controlling the first multimedia resource to exit screen projection from the first screen projection window; or, In response to receiving a control instruction from the control device to the first full-screen playback control, the first multimedia resource is controlled to play full screen on the projection interface.

27. The display device according to claim 25, characterized in that The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, and is specifically configured as follows: In response to the received playback control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; wherein the control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

28. The display device according to claim 25, characterized in that The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction from a control device on the at least one second playback control component, performing a corresponding control operation on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first screen projection device, so that the first screen projection device updates the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

29. The display device according to claim 28, characterized in that Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, the controller is further configured to: In response to receiving a focus switching operation sent by the control device, controlling the focus to move between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

30. The display device according to claim 29, characterized in that The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit screen casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, and is configured to: In response to receiving a control instruction from the control device on the second progress adjustment control, adjusting the playback progress of the second multimedia resource in the second projection window; In response to receiving a control instruction from the control device to the second pause play control, pausing the play of the second multimedia resource in the second screen projection window; In response to receiving a control instruction from the control device to the second exit screen projection control, controlling the second multimedia resource to exit screen projection from the second screen projection window; In response to receiving a control instruction from the control device to the second full-screen playback control, the second multimedia resource is controlled to play full screen on the projection interface.

31. A display device, characterized in that: include: A display configured to display a screen projection interface; A controller is coupled to the display and is configured to: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction includes first title information of the first multimedia resource; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction includes second title information of the second multimedia resource, then determining a similarity between the first title information and the second title information; If the similarity between the first title information and the second title information meets the multi-channel screen projection conditions, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

32. The display device according to claim 31, characterized in that The screen projection interface also includes a first menu display area corresponding to the first screen projection window, the first menu display area includes at least one first playback control control, and the at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction of the control device on the first progress adjustment control, adjusting the playback progress of the first multimedia resource in the first projection window; or, In response to receiving a control instruction from the control device to the first pause play control, pausing the play of the first multimedia resource in the first screen projection window; or, In response to receiving a control instruction from the control device to exit the first screen projection control, controlling the first multimedia resource to exit screen projection from the first screen projection window; or, In response to receiving a control instruction from the control device to the first full-screen playback control, the first multimedia resource is controlled to play full screen on the projection interface.

33. The display device according to claim 31, characterized in that The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, and is specifically configured as follows: In response to the received playback control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; wherein the control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

34. The display device according to claim 31, characterized in that The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction from a control device on the at least one second playback control component, performing a corresponding control operation on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first screen projection device, so that the first screen projection device updates the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

35. The display device according to claim 34, characterized in that Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, the controller is further configured to: In response to receiving a focus switching operation sent by the control device, controlling the focus to move between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

36. The display device according to claim 35, characterized in that The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit screen casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, and is configured to: In response to receiving a control instruction from the control device on the second progress adjustment control, adjusting the playback progress of the second multimedia resource in the second projection window; In response to receiving a control instruction from the control device to the second pause play control, pausing the play of the second multimedia resource in the second screen projection window; In response to receiving a control instruction from the control device to the second exit screen projection control, controlling the second multimedia resource to exit screen projection from the second screen projection window; In response to receiving a control instruction from the control device to the second full-screen playback control, the second multimedia resource is controlled to play full screen on the projection interface.

37. A display device, characterized in that: include: A display configured to display a screen projection interface; A controller is coupled to the display and is configured to: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction does not include second title information of the second multimedia resource, acquiring the second multimedia resource; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the fourth media resource meets the multi-channel screen projection conditions, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

38. The display device according to claim 37, characterized in that The screen projection interface also includes a first menu display area corresponding to the first screen projection window, the first menu display area includes at least one first playback control control, and the at least one first playback control control includes at least one of a first progress adjustment control, a first pause playback control, a first exit screen projection control, and a first full-screen playback control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction of the control device on the first progress adjustment control, adjusting the playback progress of the first multimedia resource in the first projection window; or, In response to receiving a control instruction from the control device to the first pause play control, pausing the play of the first multimedia resource in the first screen projection window; or, In response to receiving a control instruction from the control device to exit the first screen projection control, controlling the first multimedia resource to exit screen projection from the first screen projection window; or, In response to receiving a control instruction from the control device to the first full-screen playback control, the first multimedia resource is controlled to play full screen on the projection interface.

39. The display device according to claim 37, characterized in that The controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource, and plays the second multimedia resource in the second projection window in the projection interface, and is specifically configured as follows: In response to the received playback control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; wherein the control operation includes at least one of a playback progress adjustment operation, a pause operation, and a volume adjustment operation.

40. The display device according to claim 37, characterized in that The screen projection interface also includes a second menu display area corresponding to the second screen projection window, and the second menu display area includes at least one second playback control control; After the controller executes the first projection window maintained in the projection interface to continue playing the first multimedia resource and plays the second multimedia resource in the second projection window in the projection interface, the controller is further configured to: In response to receiving a control instruction from a control device on the at least one second playback control component, performing a corresponding control operation on the second multimedia resource in the second projection window; The playback information of the second multimedia resource is sent to the first screen projection device, so that the first screen projection device updates the playback progress, playback duration and playback status of the second multimedia resource according to the playback information.

41. The display device according to claim 40, characterized in that Before the controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, the controller is further configured to: In response to receiving a focus switching operation sent by the control device, controlling the focus to move between the first projection window and the second projection window; When the focus moves to the second projection window, the second menu display area corresponding to the second projection window is displayed.

42. The display device according to claim 41, characterized in that The at least one second playback control control includes at least one of a second progress adjustment control, a second pause playback control, a second exit screen casting control, and a second full-screen playback control; The controller executes the corresponding control operation on the second multimedia resource in the second projection window in response to receiving the control instruction of the control device on the at least one second playback control control, and is configured to: In response to receiving a control instruction from the control device on the second progress adjustment control, adjusting the playback progress of the second multimedia resource in the second projection window; In response to receiving a control instruction from the control device to the second pause play control, pausing the play of the second multimedia resource in the second screen projection window; In response to receiving a control instruction from the control device to the second exit screen projection control, controlling the second multimedia resource to exit screen projection from the second screen projection window; In response to receiving a control instruction from the control device to the second full-screen playback control, the second multimedia resource is controlled to play full screen on the projection interface.

43. A screen projection method, characterized in that: include: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, playing the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction includes first media resource information corresponding to the first multimedia resource; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, determining second media resource information corresponding to the second multimedia resource based on the second screen projection instruction; If, based on the first media information and the second media information, it is determined that the similarity of the first media resource meets the multi-channel screen projection condition, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

44. A screen projection method, characterized in that: include: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, acquiring the second multimedia resource; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the second media resource meets the multi-channel screen projection condition, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

45. A screen projection method, characterized in that: include: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction includes first title information of the first multimedia resource; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction includes second title information of the second multimedia resource, then determining a similarity between the first title information and the second title information; If the similarity between the first title information and the second title information meets the multi-channel screen projection conditions, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

46. ​​A screen projection method, characterized in that: include: In response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource, and playing the first multimedia resource in a first screen projection window in the screen projection interface; In response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction does not include second title information of the second multimedia resource, acquiring the second multimedia resource; If, based on the first multimedia resource and the second multimedia resource, it is determined that the similarity of the second media resource meets the multi-channel screen projection condition, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

Images