Display device and screen mirroring method

Abstract

Disclosed in the present application are a display device and a screen mirroring method. The method comprises: in response to receiving a first screen mirroring instruction which is sent by a first screen mirroring device and is used for playing a first multimedia resource, a display device playing the first multimedia resource in a first screen mirroring window in a screen mirroring interface; in response to receiving a second screen mirroring instruction which is sent by the first screen mirroring device and is used for playing a second multimedia resource and on the basis of the second screen mirroring instruction, determining second media resource information corresponding to the second multimedia resource; and if it is determined, on the basis of first media resource information and the second media resource information, that a first media resource similarity satisfies a multi-channel screen mirroring condition, continuing to play the first multimedia resource in the first screen mirroring window in the screen mirroring interface, and also playing the second multimedia resource in a second screen mirroring window in the screen mirroring interface. The embodiments of the present application enable the same screen mirroring device to perform multi-channel screen mirroring on the same display device, thereby improving the user experience.

Description

Display device and screen projection method

[0001] Cross-reference to Related Applications

[0002] This application claims priority to Chinese Patent Application No. 202411352203.7, filed on September 26, 2024, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0003] The present application relates to the technical field of display devices, and in particular to a display device and a screen projection method. BACKGROUND

[0004] With the development of communication technology, most display devices (such as televisions) have a screen projection function, and users can project the content (such as audio and video) of a piece of source on an electronic device (such as a mobile phone) onto a display device for playing. The same display device can support the screen projection of different pieces of source content on different electronic devices. However, when a user wants to project different pieces of source content on the same electronic device onto the same display device for playing, the display device will replace the piece of source content of the first screen projection with the piece of source content of the second screen projection, which cannot meet the user's demand for multi-path screen projection through the same electronic device, and affects the user experience. SUMMARY

[0005] According to some embodiments of the present application, a display device can include a display, a memory, and at least one processor; wherein the display can be configured to display a screen projection interface; the memory can be configured to store computer programs or instructions; the at least one processor is connected with the memory and coupled with the display, and can be configured to execute the computer programs or instructions to make the display device: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, play the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction can include first media asset information corresponding to the first multimedia resource; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, determine second media asset information corresponding to the second multimedia resource based on the second screen projection instruction; if it is determined that a first media asset similarity degree satisfies a multi-path screen projection condition based on the first media asset information and the second media asset information, maintain the first multimedia resource to continue playing in the first screen projection window in the screen projection interface, and play the second multimedia resource in a second screen projection window in the screen projection interface.

[0006] According to some embodiments of the present application, a display device is provided, which can include a display, a memory and at least one processor; wherein the display can be configured to display a screen projection interface; the memory can be configured to store computer programs or instructions; the at least one processor is connected with the memory and coupled with the display, and can be configured to execute the computer programs or instructions to enable the display device to: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquire the first multimedia resource and play the first multimedia resource in a first screen projection window in the screen projection interface; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, acquire the second multimedia resource; if a second media asset similarity based on the first multimedia resource and the second multimedia resource satisfies a multi-path screen projection condition, maintain the first multimedia resource to continue playing in the first screen projection window in the screen projection interface, and play the second multimedia resource in a second screen projection window in the screen projection interface.

[0007] According to some embodiments of the present application, a display device is provided, which can include a display, a memory and at least one processor; wherein the display can be configured to display a screen projection interface; the memory can be configured to store computer programs or instructions; the at least one processor is connected with the memory and coupled with the display, and can be configured to execute the computer programs or instructions to enable the display device to: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquire the first multimedia resource and play the first multimedia resource in a first screen projection window in the screen projection interface; wherein the first screen projection instruction can include first title information of the first multimedia resource; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if the second screen projection instruction includes second title information of the second multimedia resource based on the second screen projection instruction, determine a similarity between the first title information and the second title information; if the similarity between the first title information and the second title information satisfies a multi-path screen projection condition, maintain the first multimedia resource to continue playing in the first screen projection window in the screen projection interface, and play the second multimedia resource in the second screen projection window in the screen projection interface.

[0008] According to some embodiments of the present application, a display device is provided, which can include a display, a memory and at least one processor; wherein the display can be configured to display a screen projection interface; the memory can be configured to store computer programs or instructions; the at least one processor is connected with the memory and coupled with the display, and can be configured to execute the computer programs or instructions to enable the display device to: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquire the first multimedia resource and play the first multimedia resource in a first screen projection window in the screen projection interface; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction does not include second title information of the second multimedia resource, acquire the second multimedia resource; and if it is determined based on the first multimedia resource and the second multimedia resource that a second media asset similarity meets a multi-path screen projection condition, maintain the first multimedia resource to continue being played in the first screen projection window in the screen projection interface and play the second multimedia resource in a second screen projection window in the screen projection interface.

[0009] According to some embodiments of the present application, a screen projection method for a display device is provided, which can include: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, playing the first multimedia resource in a first screen projection window in a screen projection interface; wherein the first screen projection instruction includes first media asset information corresponding to the first multimedia resource; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, determining second media asset information corresponding to the second multimedia resource based on the second screen projection instruction; and if it is determined based on the first media asset information and the second media asset information that a first media asset similarity meets a multi-path screen projection condition, maintaining the first multimedia resource to continue being played in the first screen projection window in the screen projection interface and playing the second multimedia resource in a second screen projection window in the screen projection interface.

[0010] According to some embodiments of the present application, a screen projection method for a display device is provided, which can include: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource and playing the first multimedia resource in a first screen projection window in a screen projection interface; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, acquiring the second multimedia resource; and if it is determined based on the first multimedia resource and the second multimedia resource that a second media asset similarity meets a multi-path screen projection condition, maintaining the first multimedia resource to continue being played in the first screen projection window in the screen projection interface and playing the second multimedia resource in a second screen projection window in the screen projection interface.

[0011] According to some embodiments of the present application, a screen projection method for a display device is provided, which can include: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource and playing the first multimedia resource in a first screen projection window in a screen projection interface; wherein the first screen projection instruction comprises first title information of the first multimedia resource; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction comprises second title information of the second multimedia resource, determining a similarity between the first title information and the second title information; if the similarity between the first title information and the second title information satisfies a multi-path screen projection condition, maintaining the first screen projection window in the screen projection interface to continue playing the first multimedia resource, and playing the second multimedia resource in a second screen projection window in the screen projection interface.

[0012] According to some embodiments of the present application, a screen projection method for a display device is provided, which can include: in response to receiving a first screen projection instruction for playing a first multimedia resource sent by a first screen projection device, acquiring the first multimedia resource and playing the first multimedia resource in a first screen projection window in a screen projection interface; in response to receiving a second screen projection instruction for playing a second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction does not comprise second title information of the second multimedia resource, acquiring the second multimedia resource; if it is determined based on the first multimedia resource and the second multimedia resource that a second media asset similarity satisfies a multi-path screen projection condition, maintaining the first screen projection window in the screen projection interface to continue playing the first multimedia resource, and playing the second multimedia resource in a second screen projection window in the screen projection interface. BRIEF DESCRIPTION OF DRAWINGS

[0013] FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application;

[0014] FIG. 2 is a schematic diagram of a hardware configuration of a display device according to some embodiments of the present application;

[0015] FIG. 3 is a schematic diagram of a software configuration of a display device according to some embodiments of the present application;

[0016] FIG. 4A is a schematic diagram of a screen projection process according to some embodiments of the present application;

[0017] FIG. 4B is a schematic diagram of a screen projection method according to some embodiments of the present application;

[0018] FIG. 5A is a schematic diagram of information interaction of a screen projection process according to some embodiments of the present application;

[0019] FIG. 5B is a schematic diagram of a screen projection interface according to some embodiments of the present application;

[0020] FIG. 6 is a schematic diagram of another screen projection method according to some embodiments of the present application;

[0021] FIG. 7 is a schematic diagram of information interaction of another screen projection process according to some embodiments of the present application;

[0022] FIG. 8 is a schematic diagram of another screen projection interface according to some embodiments of the present application;

[0023] FIG. 9 is a schematic diagram of information interaction of yet another screen projection process according to some embodiments of the present application;

[0024] FIG. 10 is a schematic diagram of yet another screen projection method according to some embodiments of the present application;

[0025] FIG. 11 is a schematic diagram of still another screen projection method according to some embodiments of the present application;

[0026] FIG. 12 is a schematic diagram of yet another screen projection interface according to some embodiments of the present application;

[0027] FIG. 13 is a schematic diagram of still another screen projection method according to some embodiments of the present application;

[0028] FIG. 14 is a schematic diagram of still another screen projection method according to some embodiments of the present application;

[0029] FIG. 15 is a schematic diagram of still another screen projection method according to some embodiments of the present application;

[0030] FIG. 16 is a schematic diagram of still another screen projection method according to some embodiments of the present application;

[0031] FIG. 17 is a schematic diagram of another screen projection process according to some embodiments of the present application;

[0032] FIG. 18 is a schematic diagram of yet another screen projection process according to some embodiments of the present application. DETAILED DESCRIPTION

[0033] The embodiments will be described in detail below with reference to the drawings. When the description below refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise described. The implementations described in the following embodiments are not meant to represent all implementations consistent with the present disclosure. Rather, they are merely examples of implementations consistent with some aspects of the present disclosure as detailed in the claims. The drawings described below are merely some embodiments of the present disclosure and, as such, other drawings can be available to those of ordinary skill in the art without paying creative labor, based on these drawings.

[0034] It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the following description of the embodiments, and is not intended to limit the embodiments of the present application. Unless otherwise specified, these terms should be understood according to their ordinary and general meanings.

[0035] The terms "first", "second", "third", and the like in the specification and claims of the present application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchanged under appropriate circumstances. The terms "include" and "have" and any variations thereof are intended to cover but not exclusive inclusion, for example, a product or device including a series of components does not necessarily limit to all components clearly listed, but can include other components not clearly listed or inherent to these products or devices. The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or / and software code capable of performing functions related to the element.

[0036] FIG. 1 is a schematic diagram of an operating scenario between a display device and a control device according to some embodiments of the present application. As shown in FIG. 1, a user can operate the display device 200 through touch operation, mobile terminal 300 and control device 100. Among them, the control device 100 can be used to receive the operation instruction input by the user, and convert the operation instruction into a control instruction that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote controller, a stylus, a handle, etc.

[0037] In some embodiments, the display device 200 generally refers to a device with picture display and data processing capability. For example, the display device 200 can include but is not limited to a television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc. The type of display device 200 is not limited by the embodiments of the present application.

[0038] The mobile terminal 300 can serve as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also serve as a communication device for establishing a communication connection with the display device 200 to perform data interaction. In some embodiments, the mobile terminal 300 can install a software application with the display device 200, establish a communication connection through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0039] In some embodiments, the mobile terminal 300 or other electronic device can also simulate the function of the control device 100 by running an application program for controlling the display device 200.

[0040] As further shown in FIG. 1, the display device 200 can also communicate data with the server 400 through various communication means. For example, the display device 200 can establish a communication connection through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0041] In some embodiments, the display device 200 can provide a broadcast receiving television function, and can additionally provide a smart network television function with computer support, including but not limited to, a network television, a smart television, an interactive personality TV (IPTV), and the like.

[0042] FIG. 2 is a hardware configuration block diagram of a display device according to some embodiments of the present application.

[0043] In some embodiments, the display device 200 can include at least one of a tuning demodulator 210, a communication device 220, a detector 230, a device interface 240, at least one processor 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0044] In some embodiments, the detector 230 can be used to collect signals of an external environment or interaction with the outside. For example, the detector 230 can include a light receiver, which can be used to collect an ambient light intensity sensor; or the detector 230 can include an image collector, such as a camera, which can be used to collect an external environment scene, a user attribute, or a user interaction gesture; or the detector 230 can include a sound collector, such as a microphone, which can be used to receive external sound.

[0045] In some embodiments, the display 260 can include a display component for presenting a picture, and a driving component for driving the image display. The display 260 can be used to receive an image signal output from the at least one processor 250 and display the image signal. For example, the display 260 can be used to display video content, image content, and components of a menu control interface, a user control UI interface, and the like.

[0046] In some embodiments, the communication device 220 is a component for communicating with the external device or the server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 according to different supported communication manners. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth function.

[0047] The communication device 220 can connect the display device 200 with the external device or the server 400 in a communication connection manner through wireless or wired connection. The wired connection can connect the display device 200 with the external device through a data line, an interface, and the like. The wireless connection can connect the display device 200 with the external device through a wireless signal or a wireless network. The display device 200 can directly establish a connection relationship with the external device, or indirectly establish a connection relationship through a gateway, a router, a connection device, and the like.

[0048] In some embodiments, the at least one processor 250 can include at least one of a central processor, a video processor, an audio processor, a graphics processor, a power processor, a first interface to an n-th interface for input / output, and the like. The at least one processor 250 can control the operation of the display device and respond to the user's operation through various software control programs stored in the memory. The at least one processor 250 controls the overall operation of the display device 200.

[0049] In some embodiments, the at least one processor 250 and the tuner demodulator 210 can be located in different split devices, i.e., the tuner demodulator 210 can also be located in an external device of the main device where the at least one processor 250 is located, such as an external set-top box, and the like.

[0050] In some embodiments, the user can input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).

[0051] In some embodiments, the audio output device 270 can be a native loudspeaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device, the display device 200 can further be provided with an external audio output terminal, and the audio output device can be connected to the display device 200 through the external audio output terminal to output sound of the display device 200.

[0052] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0053] To perform user interaction, in some embodiments, the display device 200 can run an operating system. The operating system is a computer program used to manage and control hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface, for example, the operating system can directly control the display device to provide a user interface, or can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0054] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0055] The operating system can be divided into different modules or levels according to the functions implemented, for example, as shown in FIG. 3, in some embodiments, the system is divided into four layers, from top to bottom, the application layer (referred to as "application layer" for short), the application framework layer (referred to as "framework layer" for short), the system library layer and the kernel layer.

[0056] In some embodiments, the application layer can be used to provide services and interfaces for application programs, so that the display device 200 can run application programs and interact with users based on the application programs. At least one application program can be run in the application layer, which can be a window (Window) program, a system setting program or a clock program provided by the operating system, or an application program developed by a third-party developer. In specific implementation, the application programs in the application layer are not limited to the above examples.

[0057] The framework layer can provide an application programming interface (API) and a programming framework for the application program. The application framework layer can include some pre-defined functions. The application framework layer is equivalent to a processing center that decides which application program in the application layer to act. The application program can access the resources in the system and obtain the services of the system in the execution through the API interface.

[0058] As shown in FIG. 3, the application framework layer in some embodiments of the present application can include a view system, managers, a content provider, etc., wherein the view system can design and implement the interface and interaction of the application program, and the view system includes lists, grids, text boxes, buttons, etc. The managers can include at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager that can be used to provide the system service or the application with access to the system location service; a package manager that can be used to retrieve various information related to the application package currently installed on the device; a notification manager that can be used to control the display and clearing of notification messages; and a window manager that can be used to manage the icons, windows, toolbars, wallpapers and desktop components on the user interface.

[0059] In some embodiments, the activity manager can be used to manage the life cycle of each application program and the general navigation back function, such as controlling the exit, opening, back, etc. of the application program. The window manager can be used to manage all window programs, such as obtaining the size of the display screen, determining whether there is a status bar, locking the screen, intercepting the screen, controlling the display window change, such as reducing the display window, shaking the display, twisting the display, etc.

[0060] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to realize the functions of the framework layer.

[0061] In some embodiments, the kernel layer can be a functional layer between the hardware and the software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, memory management, etc. For example, as shown in FIG. 3, the kernel layer can be configured with a hardware driver, and the kernel layer can include at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), a power supply driver, etc.

[0062] It should be noted that the above examples are only a simple division of the operating system functions, and do not constitute a limitation on the specific operating system form of the display device in the embodiments of the present application. Depending on the function of the display device, the type of operating system, and other factors, the number and specific types of layers included in the operating system can take other forms.

[0063] With the increasing size of the display screen of the display device (such as a television), the application of the multi-path screen projection function is also becoming more and more widespread. The multi-path screen projection function can use the large size screen of the display device to simultaneously project multiple video sources, satisfying multiple users to simultaneously watch the content of their own interest on the same screen. DLNA (Digital Living Network Alliance) screen projection is a screen projection technology based on the DLNA protocol, and the DLNA screen projection allows a user to transmit the audio, video, and picture content pushed by a screen projection initiating device (hereinafter referred to as a screen projection device) to a screen projection receiving device (hereinafter referred to as a display device) through a wireless network, to realize the sharing and playing of multimedia content.

[0064] In some examples, the DLNA screen projection is dimensioned by the Internet Protocol Address (IP) for session differentiation. Screen projection devices with different IP addresses can implement multi-path screen projection on the same display device, and screen projection devices with the same IP address cannot implement multi-path screen projection on the same display device. Among them, the instruction interaction and events specified by the DLNA protocol are based on HTTP short links, and one instruction performs one HTTP request and response. The software information used by the screen projection device is not carried in the HTTP request, i.e., the display device cannot distinguish from which APP of the screen projection device the screen projection instruction is sent. Therefore, different APPs of the same screen projection device, or the same APP of the same screen projection device, when performing screen projection, the latter screen projection will replace the previous screen projection of the screen projection device with the same IP address.

[0065] FIG. 4A is a schematic diagram of a screen projection process according to some embodiments of the present application. For example, the screen projection process in FIG. 4A includes two screen projection windows in the screen projection interface of the display device, and the screen projection device is a mobile phone.

[0066] As shown in (a) of FIG. 4A, when neither the mobile phone 1 nor the mobile phone 2 initiates the screen projection, neither of the two screen projection windows (such as the first screen projection window and the second screen projection window) on the screen projection interface of the display device plays the video source.

[0067] As shown in (b) of FIG. 4A, when the mobile phone 1 initiates the screen projection of the video source 1, the first screen projection window plays the video source 1 pushed by the mobile phone 1; the mobile phone 2 does not initiate the screen projection, and the second screen projection window does not play the video source. The mobile phone 1 and the mobile phone 2 are different mobile phones, that is, the IP of the mobile phone 1 is different from the IP of the mobile phone 2.

[0068] As shown in (c) of FIG. 4A, in the case where the first screen projection window plays the video source 1 and the mobile phone 1 initiates the screen projection of the video source 2 again, although the second screen projection window on the right side of the screen projection interface has no screen projection content, the video source 1 will exit the screen projection from the first screen projection window and the video source 2 pushed by the mobile phone 1 for the second time will be played in the first screen projection window, because the IP of the second screen projection is consistent with the IP of the previous screen projection. That is, when the same IP is used for two times of screen projection, the video source 2 of the later screen projection will replace the video source 1 of the previous screen projection, and the video source 2 of the latest screen projection of the mobile phone 1 will be played in the first screen projection window.

[0069] As shown in (d) of FIG. 4A, when the mobile phone 2 initiates the screen projection of the video source 3, because there is no video source played by the IP 2 in the screen projection window of the current screen projection interface, and there is a second screen projection window on the right side of the screen projection interface that can be used for screen projection, the video source 2 pushed by the mobile phone 2 can be played in the second screen projection window; at the same time, the first screen projection window maintains playing the video source 2 pushed by the mobile phone 1.

[0070] As can be seen from the above process, the screen projection scheme in the related art can only realize the double-way screen projection of two video sources pushed by different screen projection devices on the display device, and cannot realize the double-way screen projection of two video sources pushed by the same screen projection device on the display device.

[0071] As can be seen from the above content, when the user needs to simultaneously project multiple video sources on the same display device in the related art, the user needs to use multiple screen projection devices (such as mobile phones) to respectively perform the screen projection, and cannot simultaneously project multiple video sources on the display device from the same screen projection device. Moreover, the video APP on the mobile phone usually needs to be opened to a member to be watched, and if the user wants to project different video sources in the same video APP on the same display device in the related art, the user needs to open the membership on different mobile phones, and the user experience is poor.

[0072] Based on this, the display device provided in the embodiments of the present application can determine whether the first media asset similarity satisfies the multi-path projection condition based on the first media asset information in the first projection instruction and the second media asset information in the second projection instruction when the second projection instruction sent by the first projection device (i.e., the same projection device) is received in the case that the first multimedia resource projected by the first projection device is played in the first projection window. If the first media asset similarity satisfies the multi-path projection condition, the display device can maintain playing the first multimedia resource in the first projection window and play the second multimedia resource projected for the second time in another projection window (i.e., the second projection window) of the projection interface. The display device provided in the embodiments of the present application can simultaneously project the media assets of multiple clips projected by the same projection device on the display device when the media asset similarity of the multiple clips projected by the same projection device satisfies the multi-path projection condition, that is, the display device provided in the embodiments of the present application supports multi-path projection of the same projection device on the display device, which can improve the projection experience of the user.

[0073] FIG. 4B is a schematic diagram of a projection method according to some embodiments of the present application. The projection method provided in the embodiments of the present application will be described in detail below in combination with FIG. 4B. For example, the projection method can be implemented by at least one processor 250 in the display device 200. As shown in FIG. 4B, the projection method includes the following steps 410 to 430.

[0074] Step 410: In response to receiving the first projection instruction for playing the first multimedia resource sent by the first projection device, playing the first multimedia resource in the first projection window in the projection interface.

[0075] In some examples, the display device 200 is a projection receiving device, and the projection device is a projection sending device. The user can send a projection instruction to the display device 200 through the projection device. The display device 200 receives the projection instruction and plays the multimedia resource corresponding to the projection instruction on the display 260 according to the projection instruction.

[0076] For example, the display device 200 can be a television device, a projection device, a computer device, or the like, and the projection device can be a mobile phone, a computer device, or other projection devices, etc. The embodiments of the present application do not limit the types of the display device and the projection device. The following embodiments take the display device 200 as a television and the projection device as a mobile phone as an example for illustration.

[0077] In some embodiments, the display 260 of the display device 200 can be configured to display a screen mirroring interface, which can include at least one screen mirroring window, each of which is used to play multimedia resources pushed by a screen mirroring device. The multimedia resources can include videos, audios, images, texts, etc., and the type of the multimedia resources is not limited in the embodiments of the present application. The following embodiments take videos as an example for illustrative purposes.

[0078] In some examples, before the first screen mirroring device sends the first screen mirroring instruction, the display device can display a screen mirroring interface, or can display other interfaces, such as a media list page, a media playing page, or an interface of any application program on the display device. When the display device displays the screen mirroring interface before the first screen mirroring device sends the first screen mirroring instruction, the screen mirroring interface can include at least one screen mirroring window, each of which can be in an idle state (i.e., not playing a screen mirroring video), or some of the screen mirroring windows can be in the idle state, or all the screen mirroring windows can be in a screen mirroring state (i.e., playing a screen mirroring video).

[0079] In some embodiments, the first screen mirroring instruction can be a first screen mirroring instruction sent by the first screen mirroring device to the display device 200, or can be a screen mirroring instruction sent by the first screen mirroring device to the display device 200 at any time. When the first screen mirroring instruction is the first screen mirroring instruction, no screen mirroring media data is displayed on the display device 200 before the first screen mirroring device sends the first screen mirroring instruction, such as the at least one screen mirroring window on the screen mirroring interface, each of which is in the idle state. When the first screen mirroring instruction is the screen mirroring instruction at any time, there can be a screen mirroring video being played on the display device 200 before the first screen mirroring device sends the first screen mirroring instruction, such as a screen mirroring window on the screen mirroring interface, which is in the screen mirroring state. The following embodiments take the first screen mirroring instruction as the first screen mirroring instruction for illustrative purposes.

[0080] In some embodiments, before step 410, the method can further include: in response to receiving a starting operation of the multi-screen application, starting the multi-screen application.

[0081] In some possible implementations, the display device 200 can enter the multi-screen application before receiving the first screen mirroring instruction. For example, the user can send a starting instruction of the multi-screen application to the display device 200 through the control device 100 (such as a remote controller), and the display device 200 starts the multi-screen application according to the starting instruction; or the user can send the starting instruction of the multi-screen application to the display device 200 through voice, and the present application does not limit this.

[0082] In some examples, the multi-casting application is an application for multi-casting in the display device 200, that is, when the multi-casting application is started, the display device 200 can support multi-casting of the casting device. Wherein, after the display device 200 starts the multi-casting application, the display 260 can display a casting interface, which can include one casting window or multiple casting windows.

[0083] Based on the above scheme, before casting the first multimedia resource, the display device can have started the multi-casting application, that is, entered the multi-casting mode, so that when casting the second multimedia resource subsequently, the display device does not need to enter the multi-casting mode again, but can directly perform multi-casting, thereby improving the casting efficiency.

[0084] In some possible implementations, when the display device 200 receives the first casting instruction sent by the first casting device, the casting interface (hereinafter referred to as the first casting interface) displayed on the display 260 can include one casting window or multiple casting windows.

[0085] For example, if the first casting interface includes one casting window, that is, the first casting window, the first multimedia resource is played in the first casting window. If the first casting interface includes multiple casting windows, one of the multiple casting windows is selected as the first casting window, and the first multimedia resource is played in the first casting window. The first casting window can be any one of the multiple casting windows.

[0086] In some possible implementations, before receiving the first casting instruction, the display device 200 can also not need to start the multi-casting application. In this case, in response to the first casting instruction, the first multimedia resource is directly played in the first casting window, and at this time, the casting interface can include only one casting window, that is, the first casting window. That is, when the casting interface includes one casting window, the display device 200 can start the multi-casting application or can not start the multi-casting application.

[0087] In some examples, the first casting instruction is an instruction that can be used to instruct the display device 200 to play the first multimedia resource. After receiving the first casting instruction, the display device 200 parses the first casting instruction, obtains the first media information in the first casting instruction, and plays the first multimedia resource in the first casting window of the first casting interface according to the first media information.

[0088] For example, the user can select the video source that needs to be cast by selecting the application program of the casting device, and select the display device as the casting target in the casting option of the casting device, so as to trigger the sending of the casting instruction to the display device.

[0089] In some examples, the media information can include title information and a screen mirroring address of the multimedia resource to be screen mirrored. The title information can include a name, an episode number, a content introduction, and the like of the multimedia resource. The screen mirroring address can be a uniform resource locator (URL) address corresponding to the multimedia resource to be screen mirrored. For example, the URL address can be a server address corresponding to the multimedia resource to be screen mirrored. The display device 200 can obtain the multimedia resource to be screen mirrored from the server according to the URL address.

[0090] In some examples, before sending the first screen mirroring instruction, the first screen mirroring device can send a stop screen mirroring instruction for controlling the first screen mirroring device to exit screen mirroring of the multimedia resource currently being screen mirrored. Since the first screen mirroring instruction is the first screen mirroring of the first screen mirroring device, the display device 200 currently has no multimedia resource being played, and thus there is no need to perform the operation of exiting screen mirroring. After receiving the first screen mirroring instruction, the first multimedia resource is played in the first screen mirroring window. The screen mirroring instruction can be referred to as a SetAVTransportURI instruction, and the stop screen mirroring instruction can be referred to as a stop instruction.

[0091] FIG. 5A is a schematic diagram of information interaction of a screen mirroring process according to some embodiments of the present application. The first screen mirroring process will be described below with reference to FIG. 5A. It should be noted that in FIG. 5A, the first screen mirroring device is taken as a mobile phone, and the display device 200 includes a protocol stack module, a screen mirroring session management module, a display interface module, a player module, and the like.

[0092] As shown in FIG. 5A, first, the mobile phone sends a stop instruction to the protocol stack module of the display device (step 1). The protocol stack module obtains the IP address of the mobile phone through a communication socket according to the received stop instruction (step 2), and sends the IP address of the mobile phone and the stop instruction to the screen mirroring session management module (step 3). If the screen mirroring session management module detects that the mobile phone currently has no screen mirroring content according to the IP address, no corresponding processing is performed (step 4).

[0093] Then, the mobile phone sends a SetAVTransportURI command to the protocol stack module (step 5), the protocol stack module acquires the IP address of the mobile phone through the communication Socket according to the received SetAVTransportURI command (step 6), and sends the IP address of the mobile phone and the SetAVTransportURI command to the screen projection session management module (step 7). If the screen projection session management module detects that the mobile phone currently does not project content, a new screen projection session 1 is created, and the binding relationship between the IP address and the session 1 is recorded (step 8). At the same time, the screen projection session management module starts an Activity, and passes the session 1 to the display interface module (step 9). The display interface module creates a playing view component (such as SurfaceView1 or TexureView1), and binds the view component with the session 1 (step 10). The screen projection session management module creates a player 1, passes the URL 1 of the clip source 1 in the SetAVTransportURI command and the Surface 1 of the playing View 1 created by the application to the player module (step 11), and stores the binding relationship between the player 1, the IP address, the URL 1, and the Surface 1 of the playing View 1 in the session 1 (step 12). The player module decodes the playing clip source 1 (step 13), and notifies the screen projection session management module of the preparation completion, the first frame, the resolution change, and the like (step 14). The screen projection session management module determines the corresponding session 1 according to the binding relationship between the player and the session (step 15), notifies the display interface module to adjust the display and the layout, and passes the session 1 and the corresponding event to the display interface module (step 16). The display interface module adjusts the interface layout according to the binding relationship between the session 1 and the View 1, and completes the playing of the clip source 1 (step 17).

[0094] It should be noted that FIG. 5A is described by taking an example in which the screen projection device sends a stop screen projection instruction (such as a stop command) before sending a screen projection instruction (such as a SetAVTransportURI command). In some other examples, the screen projection device can not send a stop command before sending a SetAVTransportURI command due to different screen projection applications. When the screen projection device does not send a stop screen projection instruction before sending a screen projection instruction, the first screen projection can be performed through steps 5 to 17 in FIG. 5A, which will not be described herein again.

[0095] In step 420, in response to receiving the second screen projection instruction for playing the second multimedia resource sent by the first screen projection device, second media asset information corresponding to the second multimedia resource is determined based on the second screen projection instruction.

[0096] In some examples, after the display device plays the first multimedia resource in the first projection window of the projection interface (i.e., the first projection interface), the user can also send a second projection instruction to the display device 200 through the first projection device, i.e., perform a second projection. The second projection instruction is used to instruct the display device 200 to play a second multimedia resource. After receiving the second projection instruction, the display device 200 obtains second media information corresponding to the second multimedia resource after analyzing and processing the second projection instruction.

[0097] In some possible embodiments, the first multimedia resource and the second multimedia resource can be multimedia resources in different application programs (hereinafter referred to as APPs) in the first projection device, or can be multimedia resources in the same APP in the first projection device. The embodiments of the present application do not limit this.

[0098] For example, the user can select a first multimedia resource in a first APP of the first projection device, and send a first projection instruction to play the first multimedia resource to the display device 200. After playing the first multimedia resource in the first projection window of the first projection interface, the user can select a second multimedia resource in a second APP of the first projection device, and send a second projection instruction to play the second multimedia resource to the display device 200. The first APP and the second APP are different APPs, for example, the first APP can be a Tencent video APP in the first projection device, and the second APP can be a iQIYI APP in the first projection device. The embodiments of the present application do not limit the types of the first APP and the second APP.

[0099] For another example, the user can select a first multimedia resource in a first APP of the first projection device, and send a first projection instruction to play the first multimedia resource to the display device 200. After playing the first multimedia resource in the first projection window of the first projection interface, the user continues to select a second multimedia resource in the first APP of the first projection device, and sends a second projection instruction to play the second multimedia resource to the display device 200.

[0100] In step 430, if it is determined that the first media similarity degree satisfies the multi-projection condition based on the first media information and the second media information, the first projection window in the projection interface is maintained to continue playing the first multimedia resource, and the second projection window in the projection interface is used to play the second multimedia resource.

[0101] In some possible embodiments, if the display device 200 has started the multi-casting application before receiving the second casting instruction, and the casting interface displays multiple casting windows, the idle casting window (the second casting window) in which the second multimedia resource is not played can play the second multimedia resource in response to the second casting instruction; or, if the display device 200 has started the multi-casting application before receiving the second casting instruction, and the casting interface displays one casting window, a second casting window can be newly created and the second multimedia resource can be played in the second casting window in response to the second casting instruction.

[0102] In some possible embodiments, if the display device 200 has not started the multi-casting application before receiving the second casting instruction, the display device 200 can start the multi-casting application in response to the second casting instruction when the second casting instruction is received, and display a casting interface (hereinafter referred to as a second casting interface). The second casting interface can include multiple casting windows, including the first casting window and the second casting window.

[0103] In some examples, the number of casting windows in the first casting interface and the second casting interface can be the same or different. For example, if the display device 200 has started the multi-casting application before receiving the first casting instruction, and the first casting interface includes multiple casting windows, the second casting interface can have the same number of casting windows as the first casting interface. If the display device 200 starts the multi-casting application before receiving the first casting instruction, but the first casting interface displayed includes one casting window, or the display device 200 starts the multi-casting application after receiving the second casting instruction, the second casting interface can have a different number of casting windows than the first casting interface.

[0104] For example, the first casting interface can include the first casting window playing the first multimedia resource, and the second casting interface can include the first casting window playing the first multimedia resource and the second casting window playing the second multimedia resource; or, the first casting interface can include the first casting window playing the first multimedia resource and the idle second casting window, and the second casting interface can include the first casting window playing the first multimedia resource and the second casting window playing the second multimedia resource.

[0105] FIG. 5B is a schematic diagram of a casting interface according to some embodiments of the present application. As shown in (a) of FIG. 5B, the first casting interface 50 can include only one casting window, i.e., the first casting window 50a, which can play the first multimedia resource. After the second casting is performed, as shown in (c) of FIG. 5B, the size and layout of the first casting window 50a are adjusted, and the first multimedia resource is continuously played in the first casting window 51a in the second casting interface 51, and the second multimedia resource is played in the second casting window 51b.

[0106] As shown in (b) of FIG. 5B, the first screen projection interface 50 can include a plurality of screen projection windows, which are respectively a first screen projection window 50a and a second screen projection window 50b. The first screen projection window 50a plays the first multimedia resource, and the second screen projection window 50b is in an idle state. After the second screen projection, as shown in (c) of FIG. 5B, the size and layout of the first screen projection window 50a and the second screen projection window 50b do not need to be adjusted. The first screen projection window 50a in the second screen projection interface 51 continuously plays the first multimedia resource, and the second screen projection window 50b plays the second multimedia resource.

[0107] In some possible implementation manners, before step 430 is performed, it can be further determined whether the screen projection devices that send the first screen projection instruction (i.e., the first screen projection) and the second screen projection instruction (i.e., the second screen projection) are the same screen projection device. For example, if the screen projection devices that send the first screen projection instruction and the second screen projection instruction are the same screen projection device, step 430 is continued to be performed. If the screen projection devices that send the first screen projection instruction and the second screen projection instruction are different screen projection devices, step 430 does not need to be performed, and the second multimedia resource is directly played in another screen projection window of the screen projection interface, that is, different screen projection devices can directly perform multi-screen projection on the display device 200, such as multi-screen projection according to the DLNA protocol.

[0108] FIG. 6 is a schematic diagram of another screen projection method provided by some embodiments of the present application. As shown in FIG. 6, before step 430, the method can further include steps 610 to 630 as shown below.

[0109] Step 610: In response to the first screen projection instruction, first device information of a screen projection device that sends the first screen projection instruction is determined.

[0110] Step 620: In response to the second screen projection instruction, second device information of a screen projection device that sends the second screen projection instruction is determined.

[0111] It should be noted that step 610 can be performed after step 410 or after step 420, and step 620 can be performed after step 420. When step 610 and step 620 are both performed after step 420, the present application does not limit the order in which step 610 and step 620 are performed. For example, step 610 is performed after step 410, and step 620 is performed after step 420.

[0112] In some examples, after receiving the first screen projection instruction, the display device 200 can acquire first device information of the screen projection device sending the first screen projection instruction, and store the first device information; after receiving the second screen projection instruction, the display device 200 can acquire second device information of the screen projection device sending the second screen projection instruction, and store the second device information. Then the first device information and the second device information are compared.

[0113] In some examples, the device information of the screen projection device can include an IP address of the screen projection device, and / or a Media Access Control Address (MAC) of the screen projection device. The following embodiments take the IP address as an example of the device information. For example, the first device information is a first IP address, and the second device information is a second IP address.

[0114] With reference to FIG. 5A, after receiving the first screen projection instruction, the protocol stack module of the display device 200 can acquire the first IP address of the screen projection device sending the first screen projection instruction through a communication Socket, and can send the first screen projection instruction (SetAVTransportURI) and the first IP address to the screen projection session management module. Similarly, as shown in FIG. 7, after receiving the second screen projection instruction, the display device 200 can also acquire the second IP address of the screen projection device sending the second screen projection instruction through a communication Socket.

[0115] At step 630, based on the first device information and the second device information, it is determined that the screen projection device sending the first screen projection instruction and the screen projection device sending the second screen projection instruction are both the first screen projection device.

[0116] In some examples, after acquiring the first device information (such as the first IP address) and the second device information (such as the second IP address), if it is determined that the first device information and the second device information are the same, that is, the screen projection devices for the two times of screen projection are the same screen projection device, then step 430 is continued to be executed.

[0117] For example, if it is determined that the first device information and the second device information are different, that is, the screen projection devices for the two times of screen projection are not the same screen projection device, then according to the LDNA screen projection protocol, the display device 200 can maintain the first screen projection window to continue playing the first multimedia resource, and play the second multimedia resource in another screen projection window in the screen projection interface.

[0118] The following describes a case where the screen projection devices sending the first screen projection instruction and the second screen projection instruction are both the first screen projection device.

[0119] In some examples, when the display device 200 determines that the two times of screen projection are performed by the same screen projection device, the display device 200 can determine the first media similarity based on the first media information and the second media information. The first media information includes the first title information and / or the first screen projection address. The second media information includes the second title information and / or the second screen projection address.

[0120] For example, when the first media similarity satisfies the multi-screen projection condition, the display device 200 can determine that the first multimedia resource and the second multimedia resource can perform multi-screen projection on the display device 200.

[0121] In some embodiments, the step 430 can include determining a similarity type of the first media similarity based on the first media information and the second media information. If the similarity type of the first media similarity is a first type, the display device 200 can determine that the first media similarity satisfies the multi-screen projection condition. If the similarity type of the first media similarity is a second type, the display device 200 can determine that the first media similarity does not satisfy the multi-screen projection condition.

[0122] In some possible implementations, the first type can be used to indicate that the first media similarity is lower than a first similarity threshold, or the first media information is not similar to the second media information. The second type can be used to indicate that the first media similarity is higher than a second similarity threshold, or the first media information is similar to the second media information. The first similarity threshold and the second similarity threshold can be the same or different.

[0123] In some embodiments, the similarity type of the first media similarity being the first type can include that the first multimedia resource corresponding to the first media information and the second multimedia resource corresponding to the second media information belong to multimedia resources of different episodes. The similarity type of the first media similarity being the second type can include that the first multimedia resource corresponding to the first media information and the second multimedia resource corresponding to the second media information belong to different multimedia resources of the same episode or the same multimedia resource with different media parameters. The first multimedia resource and the second multimedia resource can be media of different applications or media of the same application.

[0124] In some possible implementations, when the first multimedia resource is a TV series and the second multimedia resource is a movie, the first multimedia resource and the second multimedia resource belong to multimedia resources of different episodes. That is, when the first multimedia resource and the second multimedia resource belong to different categories, the first multimedia resource and the second multimedia resource belong to multimedia resources of different episodes. When the first multimedia resource and the second multimedia resource belong to the same category, the first multimedia resource and the second multimedia resource can belong to multimedia resources of different episodes or multimedia resources of the same episode.

[0125] In some examples, when the categories to which the first multimedia resource and the second multimedia resource belong are the same, if the first multimedia resource and the second multimedia resource are not media resources of the same TV series (or movie), the first multimedia resource and the second multimedia resource belong to multimedia resources of different episodes. If the first multimedia resource and the second multimedia resource are media resources of the same TV series (or movie), or, the first multimedia resource and the second multimedia resource are media resources of associated TV series (or movie), the first multimedia resource and the second multimedia resource belong to multimedia resources of the same episode.

[0126] For example, the TV series "The Empress Dowager" in the Tencent Video APP and the TV series "Piglet Pege" in the iQiyi APP (or the Tencent Video APP) are different episodes; the TV series "The Empress Dowager" in the Tencent Video APP and the TV series "The Empress Dowager" in the iQiyi APP (or the Tencent Video APP) are the same episode.

[0127] For another example, the movie "The Detective Story of Tangrenjie" in the Tencent Video APP and the movie "Big Talk West You" in the iQiyi APP (or the Tencent Video APP) are different episodes; the movie "The Detective Story of Tangrenjie" in the Tencent Video APP and the movie "The Detective Story of Tangrenjie 2" in the iQiyi APP (or the Tencent Video APP) are the same episode.

[0128] In other examples, multiple videos published by the same user in the same APP can also belong to the same episode. For example, in the Bilibili APP, different videos published by the same video blogger can belong to the same episode.

[0129] In some possible implementations, when the first media resource and the second multimedia resource are different multimedia resources of the same episode, or, the first media resource and the second multimedia resource are the same multimedia resource with different media parameters, the similarity type of the first media similarity is the second type. Wherein, the different multimedia resources of the same episode can be different episodes of the same TV series or movie, and the media parameters can include media resolution.

[0130] For example, the similarity type between the first episode of the TV series "The Empress Dowager" and the second episode of "The Empress Dowager" is the second type, which is similar media; or, the first episode of "The Empress Dowager" at the first resolution and the first episode of "The Empress Dowager" at the second resolution belong to the similarity type between them, which is also the second type, which is similar media.

[0131] In some examples, when the first multimedia resource and the second multimedia resource are of a first type, the two pieces of content are dissimilar, and the first content similarity satisfies the multi-screen projection condition, the display device 200 can perform multi-screen projection on the first multimedia resource and the second multimedia resource. When the first multimedia resource and the second multimedia resource are of a second type, the two pieces of content are similar, and the first content similarity does not satisfy the multi-screen projection condition, the display device 200 does not perform multi-screen projection, and performs a screen projection replacement operation to exit the first multimedia resource from the first screen projection window and play the second multimedia resource in the first screen projection window.

[0132] For example, when the first episode of Empress in the Palace is projected on the display device, and the fifth episode of Peppa Pig is selected to be projected on the display device on the screen projection device, since the first episode of Empress in the Palace and the fifth episode of Peppa Pig are dissimilar, the display device 200 can enter multi-screen projection, continue to play the first episode of Empress in the Palace in one screen projection window of the display device, and play the fifth episode of Peppa Pig in another screen projection window of the display device.

[0133] For another example, when the first episode of Empress in the Palace is projected on the display device, and the second episode of Empress in the Palace is selected to be projected on the display device on the screen projection device, since the first episode of Empress in the Palace and the second episode of Empress in the Palace are similar, the display device 200 does not enter multi-screen projection; or, when the first episode of Empress in the Palace with a resolution of 720P is projected on the display device, and the first episode of Empress in the Palace with a resolution of 1080P is selected to be projected on the display device on the screen projection device, since the first episode of Empress in the Palace with a resolution of 720P and the first episode of Empress in the Palace with a resolution of 1080P are similar, the display device 200 also does not enter multi-screen projection.

[0134] In some embodiments, based on the first content information and the second content information, the similarity type of the first content similarity can include: preprocessing the first title information in the first content information to obtain processed first title information; preprocessing the second title information in the second content information to obtain processed second title information; if the processed first title information and the processed second title information are different, determining that the similarity type of the first content similarity is a first type; and if the processed first title information and the processed second title information are the same, determining that the similarity type of the first content similarity is a second type.

[0135] In some examples, the content information can include title information of the multimedia resource. After determining the first content information and the second content information, the display device 200 can further obtain the first title information and the second title information, and preprocess the first title information and the second title information. The title information can be in the form of a string.

[0136] In some possible implementation, the preprocessing operation can include removing the first preset character in the first string corresponding to the first title information, and removing the first preset character in the second string corresponding to the second title information, and comparing the first string and the second string after removing the first preset character.

[0137] The first preset character can include, but is not limited to, a numeric character and a general character. For example, the numeric character can include Arabic numerals, Chinese numerals and English numerals, and the general character can include a punctuation mark, a space, etc.

[0138] In some examples, if the first string and the second string after removing the first preset character are different, the similarity type of the first media asset similarity is a first type; if the first string and the second string after removing the first preset character are the same, the similarity type of the first media asset similarity is a second type.

[0139] In some possible implementation, the preprocessing operation can further include extracting a first substring and a second substring before and / or after the second preset character in the first string and the second string, and comparing whether the first substring and the second substring are consistent. If the first substring and the second substring are inconsistent, it is determined that the similarity type of the first media asset similarity is a first type; if the first substring and the second substring are consistent, it is determined that the similarity type of the first media asset similarity is a second type.

[0140] For example, the first multimedia resource is a TV series "Time is Right" in the iQIY APP, the first title information corresponding to the first media asset information is "Time is Right Episode 1: Xu Mengan Company Starts to Lay off Employees" (i.e. the first string), the second multimedia resource is a TV series "Time is Right" in the Tencent Video APP, the second title information corresponding to the second media asset information is "Episode 2: Time is Right" (i.e. the second string), and the first substring before the second preset character "Episode 1" in the first string is "Time is Right", and the second substring after the second preset character "Episode 2" in the second string is also "Time is Right", so the similarity type of the first media asset similarity is the second type, i.e. the first multimedia resource and the second multimedia resource are similar.

[0141] Based on the above scheme, the title information in the first media asset information and the second media asset information is preprocessed, and the two preprocessed title information is compared. If the two preprocessed title information is the same, it indicates that the first multimedia resource and the second multimedia resource are similar, and if the two preprocessed title information is the same, it indicates that the first multimedia resource and the second multimedia resource are not similar. Since the title information corresponding to the multimedia resource in different application programs may be different, the preprocessing of the title information can remove the irrelevant information (such as numbers and spaces) in the title information, and by comparing the main information (such as name characters) retained in the title information, the similarity type of the first media asset similarity can be more accurately determined.

[0142] In some possible implementation manners, if it is determined that the first media asset similarity satisfies the multi-screen projection condition, the first multimedia resource continues to be played in the first projection window, and the second multimedia resource is played in the second projection window of the projection interface.

[0143] In some examples, when the projection interface includes a plurality of projection windows, the second multimedia resource can be played in a second projection window of the plurality of projection windows; when the projection interface includes one projection window, a projection window (i.e., a second projection window) can be added to the projection interface, and the second multimedia resource is played in the added projection window. For example, the display device 200 can adjust the size and layout of the first projection window in the projection interface, so that the first projection window and the second projection window can be included on the projection interface at the same time, and the first projection window plays the first multimedia resource and the second projection window plays the second multimedia resource.

[0144] In some possible implementation manners, the first projection device can send a stop projection instruction before sending the second projection instruction, or can not send the stop projection instruction.

[0145] In some embodiments, when the first projection device does not send a stop projection instruction before sending the projection instruction, the above step 430 can include: based on the first projection address in the first projection instruction, continuing to receive the first multimedia resource sent by the server corresponding to the first projection address; the first multimedia resource can be maintained in the first projection window, the first notification message is sent to the first projection device, and the second multimedia resource is played in the second projection window.

[0146] Wherein, the display device 200 can receive the control operation of the first projection device on the second multimedia resource, and the first notification message can be used to notify the first projection device that the first multimedia resource has exited the projection.

[0147] In some embodiments, when the first projection window continues to play the first multimedia resource, the binding relationship between the first projection device and the first multimedia resource can be released, and a first notification message can be sent to the first projection device; a binding relationship between the first projection device and a second multimedia resource can be created, and the second multimedia resource can be played in a second projection window, so that the first projection device can perform control operations on the second multimedia resource.

[0148] In some possible implementations, after receiving the second projection instruction, the display device 200 can continue to obtain the first multimedia resource from the server corresponding to the first multimedia resource according to the first projection address (i.e., the first URL) in the first projection instruction, although the display device 200 can notify the first projection device that the first multimedia resource has exited projection.

[0149] In some examples, the server can be a cloud server, and each application program can correspond to a respective server, or multiple application programs can correspond to one server, and the embodiments of the present application do not limit this. The display device 200 can obtain the corresponding multimedia resource from the corresponding server according to the obtained projection address (i.e., the URL).

[0150] In some possible implementations, after receiving the second projection instruction, the display device 200 can send a first notification message to the first projection device to notify the first projection device that the display device 200 has exited projection of the first multimedia resource. At the same time, the display device 200 can release the binding relationship between the first multimedia resource and the first projection device. The first notification message can be a stop event. The display device 200 can also play the second multimedia resource in the second projection window according to the second projection instruction, and create a binding relationship between the second multimedia resource and the first projection device. In some examples, the binding relationship between the projection device and the multimedia resource can also be considered as a binding relationship between the projection device and the projection session corresponding to the multimedia resource.

[0151] In some examples, after releasing the binding relationship between the first multimedia resource and the first projection device, the first projection device cannot perform control operations on the first multimedia resource played in the first projection window of the display device 200. After creating the binding relationship between the second multimedia resource and the first projection device, the first projection device can perform control operations on the currently projected second multimedia resource.

[0152] That is, when the display device 200 determines that the first media asset similarity meets the multi-screen projection condition, the display device 200 can release the binding relationship between the first projection device and the first multimedia resource projected last time, and create a binding relationship between the first projection device and the second multimedia resource currently projected, so as to ensure that the first projection device can always be able to play and control the multimedia resource currently projected.

[0153] In some possible implementation manners, the first projection device can further send a stop projection instruction before sending the second projection instruction.

[0154] In some embodiments, before the step 430, the method can further include: in response to receiving a stop projection instruction for stopping playing the first multimedia resource, sending a second notification message to the first projection device; and releasing the binding relationship between the first projection device and the first multimedia resource. The second notification message can be used by the first projection device to indicate that the first multimedia resource has exited the projection.

[0155] In some possible implementation manners, if the first projection device sends a stop projection instruction to the display device 200 before sending the second projection instruction, the display device 200 can release the binding relationship between the first projection device and the first multimedia resource according to the stop projection instruction.

[0156] For example, the user can send the stop projection instruction to the display device 200 by selecting the exit projection in the projection option on the APP of the first projection device; or the first projection device can automatically send the stop projection instruction to the display device 200 when the user performs the projection operation on the second multimedia resource through the first projection device.

[0157] For example, the second notification message sent according to the stop projection instruction and the first notification message sent according to the second projection instruction can be the same, such as both being stop event event notifications.

[0158] Based on the above scheme, if the display device receives a stop projection instruction for stopping playing the first multimedia resource before receiving the second projection instruction, the display device can release the binding relationship between the first projection device and the first multimedia resource, and send a second notification message to the first projection device that the first multimedia resource has exited the projection, so as to facilitate the display device to play the second multimedia resource projected by the first projection device again in the second projection window, thereby realizing that multiple multimedia resources of the same projection device can be projected in the display device.

[0159] In some embodiments, step 430 can include: based on the first screen projection address in the first screen projection instruction, continuing to receive the first multimedia resource sent by the server corresponding to the first screen projection address; maintaining the first multimedia resource playing in the first screen projection window; creating a binding relationship between the first screen projection device and the second multimedia resource, and playing the second multimedia resource in the second screen projection window, so that the first screen projection device can perform control operations on the second multimedia resource.

[0160] In some examples, after the first screen projection device sends the stop screen projection instruction to the display device 200, the display device 200 can directly create a binding relationship between the first screen projection device and the second multimedia resource after receiving the second screen projection instruction sent by the first screen projection device, so that the first screen projection device can perform control operations on the second multimedia resource.

[0161] It should be noted that when the first screen projection device does not send a stop screen projection instruction to the display device 200 before sending the second screen projection instruction, the display device 200 releases the binding relationship between the first multimedia resource and the first screen projection device according to the second screen projection instruction; when the first screen projection device sends a stop screen projection instruction to the display device 200 before sending the second screen projection instruction, the display device 200 releases the binding relationship between the first multimedia resource and the first screen projection device according to the stop screen projection instruction.

[0162] FIG. 7 is a schematic diagram of information interaction of another screen projection process according to some embodiments of the present application. The second screen projection process will be described below in conjunction with FIG. 7. It should be noted that in FIG. 7, the first screen projection device is taken as a mobile phone, and the display device 200 includes a protocol stack module, a screen projection session management module, a display interface module, a player module, and the like.

[0163] As shown in FIG. 7, in the second screen projection, first, the mobile phone sends a stop command to the protocol stack module of the display device (step 31), the protocol stack module acquires the IP address of the mobile phone through the communication Socket according to the received stop command (step 32), and sends the IP address of the mobile phone and the stop command to the screen projection session management module (step 33). The screen projection session management module detects that the current is in the same mobile phone dual projection mode according to the IP address, and the current IP address exists in the screen projection session 1, and then releases the binding relationship between the IP address and the session 1 (step 34). After releasing the binding relationship between the IP address and the session 1, the screen projection session management module sends a stop event event notification to the protocol stack module (step 35), and the protocol stack module sends the stop event event notification to the mobile phone (step 36). The mobile phone cannot perform control operations on the previous screen projection according to the stop event event notification (step 37).

[0164] Then, the mobile phone sends a SetAVTransportURI command to the protocol stack module (step 38), and the protocol stack module obtains the IP address of the mobile phone through the communication Socket according to the received SetAVTransportURI command (step 39), and sends the IP address of the mobile phone and the SetAVTransportURI command to the screen projection session management module (step 40).

[0165] It should be noted that when the mobile phone sends the SetAVTransportURI command without sending the stop command, after step 40 is executed, steps 41 and 43 are continued to be executed to release the binding relationship between the mobile phone and session 1. When the mobile phone sends the stop command before sending the SetAVTransportURI command, steps 41 to 43 do not need to be executed. Steps 41 to 43 are similar to the implementation of steps 34 to 37 described above, and will not be described here again. That is, whether the mobile phone sends the stop command will affect the timing of the screen projection session management module releasing the binding relationship between the IP and session 1.

[0166] Next, if the screen projection session management module determines that the current screen projection source 2 and the screen projection source 1 of session 1 are similar sources, the playing of session 1 is exited (step 44). At the same time, the screen projection session management module stops the player 1 corresponding to session 1 according to the binding relationship between the session and the player (step 45), and notifies the display interface module to exit the playing display of session 1 (step 46). The display interface module clears the display such as View 1 and re-performs the interface layout (step 47).

[0167] If the screen projection session management module determines that the current screen projection source 2 and the screen projection source 1 of session 1 are not similar sources, a new screen projection session 2 is created, and the binding relationship between the IP and session 2 is recorded (step 48). The subsequent playing process of the screen projection source 2 (steps 49 to 57) is similar to the playing process of the screen projection source 1 (steps 9 to 17 in FIG. 5A), and will not be described here again to avoid repetition.

[0168] In some examples, after the first multimedia resource and the first screen projection window are released from the binding relationship, the first screen projection device cannot control the playing of the first multimedia resource, that is, the user cannot continue to control the playing of the first multimedia resource played by the first screen projection window through the first screen projection device, such as pausing, fast forwarding, fast rewinding, and exiting.

[0169] To ensure that the user can play control the first multimedia resource that has been unbound, some embodiments of the application set a menu display area on the screen projection interface, which can include a plurality of play controls. The user can input a control instruction to each play control through a control device (such as a remote controller) to achieve play control of the first multimedia resource.

[0170] In some possible implementations, each screen projection window of the screen projection interface can be provided with a menu display area, which can include at least one play control control. The at least one play control control can include at least one of a progress adjustment control, a pause play control, an exit projection control, and a full-screen play control.

[0171] For example, the progress adjustment control can be used to adjust the play progress of the multimedia resource played in the screen projection window, which can include fast-forward adjustment and fast-rewind adjustment. The pause play control can be used to perform pause / cancel pause control on the multimedia resource played in the screen projection window. The exit projection control can be used to control the multimedia resource played in the screen projection window to exit projection from the screen projection interface. The full-screen play control can be used to perform full-screen play of the multimedia resource played in the screen projection window on the screen projection interface.

[0172] In some examples, each screen projection window on the screen projection interface is provided with a menu display area, and the multimedia resource that has been unbound can be played controlled through the play control in the corresponding menu display area. In other examples, the screen projection window corresponding to the multimedia resource that has not been unbound can also be provided with a menu display area, and the multimedia resource that has not been unbound can also be played controlled through the play control in the corresponding menu display area.

[0173] In some embodiments, the screen projection interface can also include a menu display area corresponding to each screen projection window. The menu display area corresponding to each screen projection window can always be displayed at a corresponding position of the screen projection window (such as below the screen projection window, above the screen projection window, or beside the screen projection window), or can be displayed when the focus is switched to the screen projection window. For example, the screen projection interface can directly display the menu display area corresponding to each screen projection window, or can call up the menu display area corresponding to each screen projection window through a focus switching instruction.

[0174] In some possible implementations, the screen projection interface can also include a first menu display area corresponding to the first screen projection window. The first menu display area can include at least one first play control control. The at least one first play control control can include at least one of a first progress adjustment control, a first pause play control, a first exit projection control, and a first full-screen play control.

[0175] In some examples, when the first multimedia resource played by the first projection window is unbound from the first projection device, the first projection device cannot control the playing of the first multimedia resource. In this case, the playing of the first multimedia resource can be controlled through at least one first playing control control in the first menu display area corresponding to the first projection window.

[0176] In some embodiments, after step 430, the method can further include: in response to receiving a control instruction of the control device input to the first progress adjustment control, adjusting the playing progress of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device input to the first pause playing control, pausing the playing of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device input to the first exit projection control, controlling the first multimedia resource to exit projection from the first projection window; or, in response to receiving a control instruction of the control device input to the first full screen playing control, controlling the first multimedia resource to play in full screen on the projection interface.

[0177] In some examples, the first projection window of the projection interface is playing the first multimedia resource, and the second projection window is playing the second multimedia resource. The focus of the control device can currently be located in the first projection window or the second projection window. When the user needs to control the playing of the first multimedia resource through the control device, the focus can be switched to the first projection window first to call out the first menu display area corresponding to the first projection window. Of course, the first menu display area can also be displayed at the corresponding position of the first projection window at all times.

[0178] For example, taking the display of the first menu display area below the first projection window as an example, the user can move the focus to any first playing control control in the first menu display area through the control device to input a control instruction, thereby realizing the control of the first multimedia resource, such as pausing / cancelling pausing, progress adjustment, exit projection, and full screen playing.

[0179] In some examples, the display device 200 can adjust the playing progress of the first multimedia resource in the first projection window in response to receiving a control instruction of the control device input to the first progress adjustment control. For example, the control device can control the playing progress of the first multimedia resource to advance or rewind.

[0180] In some examples, the display device 200 can pause the playing of the first multimedia resource in the first projection window in response to receiving a control instruction of the control device input to the first pause playing control. For example, when the user inputs a control instruction to the first pause playing control through the control device again, the playing of the first multimedia resource that has been paused can be controlled to resume (i.e., cancel pausing).

[0181] In some examples, the display device 200 can control the first multimedia resource to exit the screen projection from the first screen projection window in response to receiving the control instruction of the control device on the first exit screen projection control input.

[0182] For example, when the first multimedia resource exits the screen projection, the first screen projection window changes to an idle screen projection window, at this time, the first menu display area can be always displayed or can exit the display. If the first menu display area exits the display, the first menu display area can be displayed again when the first screen projection window is projected with a new multimedia resource. For another example, when the first multimedia resource exits the screen projection, the display of the first screen projection window can also be exited, the size of the second screen projection window is adjusted, and only the second screen projection window is displayed on the screen projection interface.

[0183] In some examples, the display device 200 can control the first multimedia resource to play in full screen on the screen projection interface in response to receiving the control instruction of the control device on the first full screen play control input.

[0184] For example, when the user inputs the control instruction on the first full screen play control through the control device, the display device 200 can adjust the size and layout of the first screen projection window to enlarge the first screen projection window and occupy the entire screen projection interface, and maintain the first screen projection window to play the first multimedia resource during the adjustment of the first screen projection window.

[0185] For another example, when the user inputs the control instruction on the first full screen play control through the control device again, the first multimedia resource can be controlled to exit the full screen play, that is, the size and layout of the first screen projection window are adjusted again so that the screen projection interface reenters the multi-way screen projection play. Alternatively, the user can also control the first multimedia resource to exit the full screen through a preset key (such as a back key, an exit key) on the control device, which is not limited in the embodiments of the present application.

[0186] FIG. 8 is a schematic diagram of another screen projection interface according to some embodiments of the present application. As shown in FIG. 8, the screen projection interface can include a first screen projection window and a second screen projection window; wherein the first screen projection window plays a first multimedia resource sent by a first screen projection device, and the second screen projection device plays a second multimedia resource sent by the first screen projection device.

[0187] As shown in FIG. 8, taking the example of displaying the menu display area corresponding to the screen projection window when the focus is switched to the screen projection window, when the focus frame is switched to the first screen projection window by the control device, the first menu display area corresponding to the first screen projection window is displayed in the screen projection interface. The first menu display area can include a plurality of play control controls, and the plurality of play control controls can be: a full-screen play control, a fast-rewind play control (such as a first progress adjustment control), a pause / cancel pause play control, a fast-forward play control (such as another first progress adjustment control), a volume control control, and a screen projection exit control.

[0188] In some embodiments, after step 430, the method can further include: in response to the received play control instruction sent by the first screen projection device, performing a corresponding control operation on the second multimedia resource in the second screen projection window. The control operation includes at least one of a play progress adjustment operation, a pause operation, and a volume adjustment operation.

[0189] In some examples, after the display device 200 creates the binding relationship between the second multimedia resource and the first screen projection device, the user can perform play control on the second multimedia resource currently played by the second screen projection window through the first screen projection device. For example, the user can control the play progress, pause / cancel pause, volume, screen projection exit, etc. of the second multimedia resource on the play control item on the screen projection interface of the first screen projection device (such as a mobile phone).

[0190] In some embodiments, the screen projection interface can further include a second menu display area corresponding to the second screen projection window, and the second menu display area can include at least one second play control control. The at least one second play control control can include at least one of a second progress adjustment control, a second pause play control, a second screen projection exit control, and a second full-screen play control.

[0191] In some examples, in addition to performing play control on the second multimedia resource played by the second screen projection window through the first screen projection device, play control can also be performed on the second multimedia resource through the second menu display area corresponding to the second screen projection window.

[0192] In some embodiments, the focus can be moved between the first screen projection window and the second screen projection window in response to receiving a focus switching operation sent by the control device; and the second menu display area corresponding to the second screen projection window is displayed when the focus is moved to the second screen projection window.

[0193] Based on the above scheme, when the playing progress of the second multimedia resource is controlled by the control device, the focus of the control device needs to be switched to the second screen projection window first. When the focus is on the second screen projection window, the screen projection interface can display the second menu display area corresponding to the second screen projection window. After the second menu display area is displayed, a control instruction can be input to at least one second playing control control of the second menu display area by the control device, so as to control the second multimedia resource in the second screen projection window to be played accordingly.

[0194] In some embodiments, the playing progress of the second multimedia resource in the second screen projection window can be adjusted in response to receiving a control instruction input by the control device to the second progress adjustment control; the playing of the second multimedia resource in the second screen projection window can be paused in response to receiving a control instruction input by the control device to the second pause playing control; the second multimedia resource can be controlled to exit the screen projection from the second screen projection window in response to receiving a control instruction input by the control device to the second exit screen projection control; and the second multimedia resource can be controlled to be played in full screen on the screen projection interface in response to receiving a control instruction input by the control device to the second full screen playing control.

[0195] Based on the above scheme, when the second screen projection window of the screen projection interface plays the second multimedia resource, a user can input a control instruction to at least one second playing control control of the second menu display area corresponding to the second screen projection window by the control device according to needs, so as to perform playing progress adjustment, pause, exit screen projection, full screen playing and other controls on the first multimedia resource.

[0196] In some examples, when the second multimedia resource is controlled by the control device, the focus needs to be moved to the second screen projection window by the control device. When the focus is moved to the second screen projection window, the second menu display area can be called out, and a control instruction input to at least one playing control control of the second menu display area by the control device can be used to control the playing of the second multimedia resource.

[0197] It should be noted that the second menu display area is similar to the control mode of the above-mentioned first menu display area, and details are not repeated here to avoid repetition.

[0198] According to the screen projection method provided by some embodiments of the present application, for the first multimedia resource that is unbound, a first menu display area can be set, and a control instruction can be input to at least one first playing control control of the first menu display area by the control device, so as to control the playing of the first multimedia resource. For the second multimedia resource that is bound, the playing can be controlled by the first screen projection device, or a control instruction can be input to at least one second playing control control of the second menu display area by the control device, so as to control the playing of the second multimedia resource.

[0199] In some embodiments, after step 430, the method can further include: in response to receiving a control instruction of the control device inputting at least one second play control control, performing a corresponding control operation on the second multimedia resource in the second projection window; and sending play information of the second multimedia resource to the first projection device, so that the first projection device updates the play progress, the play duration and the play state of the second multimedia resource according to the play information.

[0200] In some embodiments, in response to receiving the acquisition request sent by the first projection device, the play information of the second multimedia resource bound with the first projection device can be determined; and the play information of the second multimedia resource can be sent to the first projection device. The play information can include at least one of the play progress, the play duration and the play state of the second multimedia resource.

[0201] In some examples, the display device 200 can actively send the play information of the second multimedia resource to the first projection device to update the play of the second multimedia; or the first projection device can also actively acquire the play information of the second multimedia resource from the display device 200, and update the play of the second multimedia according to the acquired play progress, play duration and play state of the second multimedia.

[0202] Based on the above scheme, after the second projection window of the projection interface plays the second multimedia resource, the user can input a control instruction to at least one second play control control of the second menu display area corresponding to the second projection window through the control device to control the play of the second multimedia resource. At the same time, the display device can send the play information of the second multimedia resource to the first projection device to update the play progress, the play duration and the play state of the second multimedia resource, so as to realize the consistency of the play of the second multimedia resource on the display device and the first projection device. That is, it can be known from the above scheme that when the same projection device performs multi-way projection on the display device, the user can perform a play control operation on the second multimedia resource (such as the media asset recently projected by the projection device) through the projection device, or perform a play control operation on the second multimedia resource through the control device; and for the first multimedia resource (such as the media asset not recently projected by the projection device), the user can only perform a play control operation on the first multimedia resource through the control device, and cannot perform a play control operation on the first multimedia resource through the projection device.

[0203] FIG. 9 is a schematic diagram of information interaction of another screen projection process according to some embodiments of the present application. The following describes the play control in the screen projection process in combination with FIG. 9. It should be noted that the first screen projection device in FIG. 9 is a mobile phone, and the display device 200 includes a protocol stack module, a screen projection session management module, a display interface module, a player module, and the like.

[0204] In FIG. 9, the process is the process of playing the first multimedia resource played by the first screen projection window through the mobile phone in the first screen projection process.

[0205] As shown in FIG. 9, the mobile phone can send a pause (hereinafter referred to as Pause) instruction and a jump progress (hereinafter referred to as Seek) command and the like to the protocol stack module of the display device 200 (step 18). The protocol stack module obtains the IP address of the mobile phone through the communication Socket (step 19), and sends the IP address of the mobile phone and the Pause, Seek and the like to the screen projection session management module (step 20). The screen projection session management module finds the corresponding player 1 according to the session relationship, and performs the Pause and Seek control (step 21), and notifies the display interface module to display the corresponding state, progress and the like, and transmits the session 1 (step 22). The display interface module adjusts the progress bar, the play button and the like of the View 1 (step 23).

[0206] For example, the mobile phone can also send a GetPositionInfo command and a GetTransportInfo command and the like to the protocol stack module to obtain the play progress, duration and the like (step 24). The protocol stack module obtains the IP address of the mobile phone through the communication Socket (step 25), and sends the IP address of the mobile phone and the GetPositionInfo, GetTransportInfo and the like to the screen projection session management module (step 26). The screen projection session management module finds the corresponding player 1 according to the session relationship, reads the play progress, duration, play state and the like from the display interface module (step 27), and returns the read play progress, duration, play state and the like to the protocol stack module (step 28). The play progress, duration, play state and the like are returned to the mobile phone through the protocol stack module (step 29), and the mobile phone updates the play progress, duration, play state and the like (step 30).

[0207] According to the screen projection method provided in some embodiments of the present application, the first screen projection device can actively acquire the playing information of the second multimedia resource with which the binding relationship has been created from the display device, and update the playing information of the second multimedia resource. The display device can also actively send the playing information of the second multimedia resource with which the binding relationship has been created to the first screen projection device, so as to realize the consistency of the playing information of the multimedia resource on the screen projection device and the display device, and improve the user experience.

[0208] The similarity type of the first media asset similarity is the second type, i.e., the case where the first media asset similarity does not satisfy the multi-path screen projection condition.

[0209] FIG. 10 is a schematic diagram of another screen projection method according to some embodiments of the present application. As shown in FIG. 10, after the step 420, the method can further include a step 440 and a step 450.

[0210] In the step 440, if the similarity type of the first media asset similarity is the second type, it is determined that the first media asset similarity does not satisfy the multi-path screen projection condition.

[0211] In the step 450, the first multimedia resource is controlled to quit the screen projection from the first screen projection window, and the second multimedia resource is played in the first screen projection window.

[0212] In some examples, if the similarity type of the first media asset similarity is the second type, i.e., the first media asset similarity does not satisfy the multi-path screen projection condition, the first multimedia resource is similar to the second multimedia resource, and in this case, the second multimedia resource can replace the playing of the first multimedia resource. That is, the replacing screen projection operation is performed.

[0213] For example, when it is determined that the second multimedia resource and the first multimedia resource are different episodes of the same series, or different resolutions, the first multimedia resource can be controlled to quit the screen projection from the first screen projection window, and the second multimedia resource is played in the first screen projection window.

[0214] In some examples, when it is determined that the first media asset similarity does not satisfy the multi-path screen projection condition, the number and layout of the screen projection windows in the screen projection interface can not need to change, i.e., the screen projection interface can still display the first screen projection interface, and only the playing content in the first screen projection window is replaced.

[0215] The display device and the screen projection method provided in the embodiments of the present application can, in the case that the first screen projection device is playing the first multimedia resource in the first screen projection window, determine whether the first media similarity meets the multi-screen projection condition based on the first media information in the first screen projection instruction and the second media information in the second screen projection instruction when the second screen projection instruction sent by the first screen projection device (i.e., the same screen projection device) is received. If the first media similarity meets the multi-screen projection condition, the display device can continue playing the first multimedia resource in the first screen projection window and play the second multimedia resource projected for the second time in another screen projection window (i.e., the second screen projection window) of the screen projection interface. The display device provided in the embodiments of the present application can project the media of multiple pieces of source projected by the same screen projection device on the display device simultaneously when the media similarity of the multiple pieces of source projected by the same screen projection device meets the multi-screen projection condition, that is, the display device provided in the embodiments of the present application supports multi-screen projection of the same screen projection device on the display device, which can improve the screen projection experience of the user.

[0216] FIG. 11 is a schematic diagram of another screen projection method according to some embodiments of the present application. As shown in FIG. 11, the step 430 includes steps 1110 to 1120 shown as follows. After the step 1110, the method can further include steps 1130 and 1140.

[0217] In step 1110, if it is determined that the first media similarity meets the multi-screen projection condition based on the first media information and the second media information, a screen projection selection window is displayed.

[0218] In some examples, before determining that the first media similarity meets the multi-screen projection condition and projecting the second multimedia resource, the display device 200 can further control the display 260 to display a screen projection selection window on the screen projection interface. The screen projection selection window is used to prompt the user to determine whether to perform multi-screen projection and receive the selection of the user on the multi-screen projection.

[0219] For example, the screen projection selection window can include at least one option. The user can determine whether to perform multi-screen projection through the selection operation on the at least one option. The screen projection selection window can be displayed on the upper layer of the multiple screen projection windows of the screen projection interface.

[0220] In some examples, the multiple options of the screen projection selection window can include a first option, a second option and a third option. The first option can be an option indicating that the user agrees to perform multi-screen projection, the second option can be an option indicating that the user refuses multi-screen projection, and the third option can be an option indicating that the user cancels the current screen projection.

[0221] It should be noted that the screen projection selection window can also only include the first option and the second option, or the first option and the third option, and the embodiments of the present application are not limited thereto, and the embodiments of the present application are exemplarily described by taking the screen projection selection window including the first option, the second option and the third option as an example.

[0222] In some examples, the screen projection selection window can further include prompt information for prompting the user to make a corresponding selection of multi-screen projection.

[0223] In step 1120, in response to receiving the selection operation of the first option in the screen projection selection window by the user, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource, and the second screen projection window in the screen projection interface is used to play the second multimedia resource.

[0224] In some examples, when the selection operation of the first option input by the user through the control device is received, it indicates that the user needs to continue to perform the multi-screen projection operation, and therefore, the display device 200 can continue to play the first multimedia resource in the first screen projection window and play the second multimedia resource in the second screen projection window.

[0225] For example, the first option can be "Confirm", "Yes", "Agree", and the like, which represent the option of allowing the user to perform multi-screen projection.

[0226] Based on the above scheme, before determining to perform multi-screen projection on the second multimedia resource, the screen projection selection window can be displayed to determine whether to increase the screen projection window to perform multi-screen projection according to the selection of the user. When the user determines to perform multi-screen projection, the operation of multi-screen projection is performed, so that the situation that multi-screen projection is still performed when the user wants to perform replacement projection can be avoided, and the user's misoperation can also be avoided, and the user experience is improved.

[0227] In step 1130, in response to receiving the selection operation of the second option in the screen projection selection window by the user, the first multimedia resource is controlled to exit the screen projection from the first screen projection window, and the second multimedia resource is played in the first screen projection window.

[0228] In some examples, when the selection operation of the second option input by the user through the control device is received, it indicates that the user gives up to perform the multi-screen projection operation, that is, the user wants to replace the first multimedia resource being played with the second multimedia resource currently being projected. Therefore, the display device 200 can control the first multimedia resource to exit the screen projection from the first screen projection window, and play the second multimedia resource in the first screen projection window.

[0229] For example, the second option can be "Reject", "No", "NO", and the like, which represent the option of giving up multi-screen projection by the user.

[0230] Based on the above scheme, the user can also select to replace the screen projection or cancel the screen projection on the screen projection selection window according to the demand, and the display device controls the first multimedia resource to exit the screen projection from the first screen projection window according to the selection of the user, and plays the second multimedia resource in the first screen projection window; or, cancels the screen projection of the second multimedia resource, and maintains the first multimedia resource to continue playing in the first screen projection window. The application can determine the screen projection mode according to the demand of the user, provide more screen projection selection for the user, and improve the user experience.

[0231] In step 1140, the first screen projection window in the screen projection interface is maintained to continue playing the first multimedia resource in response to receiving the selection operation of the third option in the screen projection selection window by the user.

[0232] In some examples, when the selection operation of the third option input by the user through the control device is received, it indicates that the user does not want to continue the screen projection of the second multimedia resource, i.e., the user wants to cancel the screen projection of the second multimedia resource, therefore, the display device 200 can maintain the first screen projection window to continue playing the first multimedia resource.

[0233] For example, the second option can be "cancel" and "exit" and the like, which indicates the option of the user canceling the screen projection of the second multimedia resource.

[0234] In some examples, when the user performs the selection operation on at least one option in the screen projection selection window, the screen projection selection window can exit the display from the screen projection interface.

[0235] FIG. 12 is a schematic diagram of another kind of screen projection interface provided by some embodiments of the application. As shown in FIG. 12, the screen projection interface can include a screen projection selection window, which can be displayed on the upper layer of the first screen projection window and the second screen projection window.

[0236] As shown in FIG. 12, the screen projection selection window includes prompt information and three option controls, wherein the prompt information is "whether to continue the multi-screen projection?", the "confirm" control in the three option controls corresponds to the first option, the "reject" control corresponds to the second option, and the "cancel" control corresponds to the third option.

[0237] For example, when the user moves the focus frame to the "confirm" control through the control device, the screen projection selection window exits the display, the first screen projection window maintains playing the first multimedia resource, and the second screen projection window plays the second multimedia resource. When the user moves the focus frame to the "reject" control through the control device, the screen projection selection window exits the display, the first screen projection window exits the playing of the first multimedia resource, and plays the second multimedia resource. When the user moves the focus frame to the "cancel" control through the control device, the screen projection selection window exits the display, and the first screen projection window continues playing the first multimedia resource.

[0238] It should be noted that the screen projection interface in FIG. 12 is taken as an example including the first screen projection window and the second screen projection window, when the user selects "reject" and "cancel", the screen projection interface can cancel the second screen projection window and enlarge the first screen projection window. In some examples, the screen projection interface can also only include the first screen projection window, and after the user selects the "determine" control, the second screen projection window is added and the size and position of the first screen projection window are adjusted.

[0239] The screen projection method provided by the embodiments of the present application can provide a screen projection option window that can be selected by the user when it is determined that the multi-screen projection condition is met, and determine whether to perform multi-screen projection according to the user's selection, thereby improving the user experience. At the same time, it can also avoid the case that the user still performs multi-screen projection when he wants to replace, and can avoid some misprojection operations of the user.

[0240] FIG. 13 is a schematic diagram of another screen projection method according to some embodiments of the present application. As shown in FIG. 13, before the above step 430, the method can further include steps 1310 to 1330 as shown below.

[0241] In step 1310, the resource type of the first multimedia resource is determined based on the first screen projection address in the first screen projection instruction, and the resource type of the second multimedia resource is determined based on the second screen projection address in the second screen projection instruction.

[0242] In some examples, the screen projection instruction sent by the screen projection device to the display device 200 includes a screen projection address. The screen projection address (i.e. URL) can be a unique identifier of the multimedia resource on the server, and the display device 200 can access and play the video through the screen projection address.

[0243] In some examples, the resource type includes online resources and local resources. The online resource can also be referred to as a server resource, and the screen projection address of the online resource directly points to the storage location of the multimedia resource on the server; the local resource refers to the audio, video, picture and file etc. already downloaded in the screen projection device, and the screen projection process does not involve access to an external server, and the screen projection address does not point to a URL of a network resource, but to a local address of the screen projection device.

[0244] In some embodiments, the resource type of the multimedia resource can be distinguished as online resource or local resource according to the screen projection address. For example, the display device 200 can store the URL address corresponding to each application program and the local URL address, and the display device 200 can store a correspondence table between the URL address and the resource type.

[0245] For example, after the display device 200 determines the first and second screen projection addresses, the display device 200 can determine the resource types of the first and second multimedia resources according to the corresponding relationship table.

[0246] Step 1320: whether the first and second multimedia resources are both online resources.

[0247] For example, after determining that the first multimedia resource is an online resource, the display device 200 continues to determine the resource type of the second multimedia resource. If the second multimedia resource is also an online resource, the display device 200 continues to perform step 430.

[0248] For example, after determining that the first multimedia resource is an online resource and the second multimedia resource is a local resource, or after determining that the first multimedia resource is a local resource, the display device 200 performs step 1330. It should be noted that if the display device 200 determines that the first multimedia resource is a local resource, the display device 200 does not need to determine the resource type of the second multimedia resource again, and directly performs step 1330.

[0249] Step 1330: controlling the first multimedia resource to exit screen projection from the first screen projection window and playing the second multimedia resource in the first screen projection window.

[0250] In some examples, if there is only one local resource in the resource types of the first and second multimedia resources, the display device 200 does not perform the multi-screen projection operation, but performs a replacement screen projection operation. That is, the local resource does not support the multi-screen projection function.

[0251] For example, if the first multimedia resource currently played in the first screen projection window is a local resource, the second multimedia resource to be projected next, whether it is an online resource or a local resource, will replace the first multimedia resource. That is, the display device 200 can control the first multimedia resource to exit screen projection from the first screen projection window and play the second multimedia resource in the first screen projection window.

[0252] For another example, if the first multimedia resource currently played in the first screen projection window is an online resource, and the second multimedia resource to be projected next is a local resource, the display device 200 still performs the replacement screen projection operation.

[0253] It should be noted that step 430 has been described in the above examples, and thus will not be described here again to avoid repetition.

[0254] According to the screen projection method provided in some embodiments of the present application, the resource type of the multimedia resource can be determined according to the screen projection address in the media information, and the display device performs multi-screen projection only when both the already projected multimedia resource and the to-be-projected multimedia resource are online resources. When there is a local resource in the already projected multimedia resource and the to-be-projected multimedia resource, the display device adopts the replacement projection principle, and the to-be-projected multimedia resource replaces the playing of the already projected multimedia resource, and at this time, there is no need to enter the process of judging whether the first media similarity meets the multi-screen projection condition. According to the present application, the resource type of the multimedia resource is determined in advance, and when it is determined that there is a local resource, the replacement projection can be performed, and there is no need to judge the multi-screen projection condition, thereby improving the screen projection efficiency.

[0255] FIG. 14 is a schematic diagram of another screen projection method according to some embodiments of the present application. As shown in FIG. 14, after step 430, the method can further include steps 1410-1430 as shown below.

[0256] Step 1410: in response to receiving the third screen projection instruction for playing the third multimedia resource sent by the first screen projection device, determining third media information corresponding to the third multimedia resource based on the third screen projection instruction.

[0257] It should be noted that the process of determining the third media information corresponding to the third multimedia resource in step 1410 is similar to the process of determining the second media information corresponding to the second multimedia resource in step 420, and thus will not be described herein again to avoid repetition.

[0258] Step 1420: if it is determined that the second media similarity meets the multi-screen projection condition based on the first media information and the second media information, and the third media similarity meets the multi-screen projection condition based on the second media information and the third media information, and there is no idle screen projection window in which no multimedia resource is played in the screen projection interface, then determining the third screen projection window in the plurality of screen projection windows included in the screen projection interface.

[0259] In some examples, after determining the third media information corresponding to the third multimedia resource, the second media similarity and the third media similarity can be determined by comparing the third media information with the first media information corresponding to the first multimedia resource which has been projected and the second media information corresponding to the second multimedia resource.

[0260] It should be noted that the determination process of the second media similarity and the third media similarity is similar to the determination process of the first media similarity in the above embodiments, and thus will not be described herein again to avoid repetition.

[0261] In some examples, step 1420 is to determine media content similarity between the third media content and the first media content and the second media content respectively. If the second media similarity satisfies the multi-screen projection condition (e.g., the third multimedia resource is not similar to the first multimedia resource), and the third media similarity satisfies the multi-screen projection condition (e.g., the third multimedia resource is not similar to the second multimedia resource), it is further determined whether there is an idle screen projection window in the plurality of screen projection windows in the screen projection interface. The idle screen projection window can be used to represent a screen projection window that is currently not playing a multimedia resource.

[0262] It should be noted that, it can be determined whether the second media similarity and the third media similarity satisfy the multi-screen projection condition first, and when it is determined that the second media similarity and the third media similarity both satisfy the multi-screen projection condition, it is further determined whether there is an idle screen projection window in the plurality of screen projection windows of the display. Alternatively, it can also be determined whether there is an idle screen projection window in the plurality of screen projection windows of the display first, and then it is determined whether the second media similarity and the third media similarity satisfy the multi-screen projection condition. The execution order of the process is not limited in the present application.

[0263] In some embodiments, when it is determined that the second media similarity and the third media similarity both satisfy the multi-screen projection condition, and there is at least one idle screen projection window in the screen projection interface, a screen projection window for playing the third multimedia resource is determined in the at least one screen projection window.

[0264] In some examples, if there is one idle screen projection window in the plurality of screen projection windows, the first screen projection window and the second screen projection window can be maintained to continue playing the current multimedia resources, and the third multimedia resource can be played in the idle screen projection window.

[0265] In some examples, if there are a plurality of idle screen projection windows in the plurality of screen projection windows, the third multimedia resource can be played in any screen projection window of the plurality of idle screen projection windows, or the screen projection window for playing the third multimedia resource can be determined according to user selection.

[0266] If there is no idle screen projection window in the plurality of screen projection windows, the third multimedia resource cannot be projected, and in this case, a third screen projection window for playing the third multimedia resource needs to be determined in the screen projection window (i.e., the first screen projection window and the second screen projection window) that is playing the multimedia resource.

[0267] In some embodiments, determining the third screen projection window in the plurality of screen projection windows can include: any screen projection window in the plurality of screen projection windows can be determined as the third screen projection window; or the third screen projection window can be determined in the plurality of screen projection windows according to the screen projection time of each screen projection window in the plurality of screen projection windows; or the screen projection window corresponding to the window selection instruction can be determined as the third screen projection window in response to receiving the window selection instruction.

[0268] In some examples, the third projection window can be any one of the first projection window and the second projection window, or the third projection window can also be the projection window in which projection is performed earliest (or latest) among the first projection window and the second projection window, or the third projection window can also be the projection window selected by the user. For example, the user can select the projection window needed to be replaced as the third projection window by moving the focus of the control device.

[0269] Based on the above scheme, the present application provides various ways of determining the projection window of the third multimedia resource, so as to determine the most suitable projection window for the third multimedia resource, and ensure that the display device can always project and play the multimedia resource newly projected by the user, thereby improving the user experience.

[0270] In some examples, in a case where it is determined that the second media asset similarity or the third media asset similarity does not satisfy the multi-path projection condition, for example, if the second media asset similarity does not satisfy the multi-path projection condition (i.e., the third multimedia resource is similar to the first multimedia resource), the first multimedia resource is controlled to exit projection from the first projection window, and the third multimedia resource is played in the first projection window. For another example, if the third media asset similarity does not satisfy the multi-path projection condition (i.e., the third multimedia resource is similar to the second multimedia resource), the second multimedia resource is controlled to exit projection from the second projection window, and the third multimedia resource is played in the second projection window.

[0271] In step 1430, the projection windows other than the third projection window among the plurality of projection windows continue to play the corresponding multimedia resources, and the third multimedia resource is played in the third projection window.

[0272] In some examples, after the third projection window is determined among the plurality of projection windows in which the multimedia resources are played, and there is no idle projection window, the multimedia resource played in the third projection window can be exited from projection, and the third multimedia resource is played, and the other projection windows continue to maintain playing the currently projected multimedia resources.

[0273] For example, when the first projection window is determined as the third projection window, the first multimedia resource is exited from projection from the first projection window, and the third multimedia resource is played in the first projection window, and the second projection window maintains playing the second multimedia resource.

[0274] According to the projection method provided by some embodiments of the present application, when the multi-path projection condition is satisfied and there is no idle projection window, the projection window for the multimedia resource to be projected can be determined among the plurality of projection windows of the projection interface, the determined projection window replaces projection, and the other projection windows maintain playing the original multimedia resources.

[0275] FIG. 15 is a schematic diagram of another screen projection method according to some embodiments of the present application. As shown in FIG. 15, the screen projection method can include steps 1510-1530 as shown below. It should be noted that the main difference between the screen projection method in FIG. 15 and the screen projection method in FIG. 4B is the determination of the media asset similarity.

[0276] At step 1510, in response to receiving the first screen projection instruction sent by the first screen projection device for playing the first multimedia resource, the first multimedia resource is acquired and played in the first screen projection window in the screen projection interface.

[0277] In some examples, after the display device 200 acquires the first screen projection instruction, the display device 200 can acquire the first multimedia resource from the corresponding server according to the first screen projection address in the first screen projection instruction, and play the acquired first multimedia resource in the first screen projection window in the screen projection interface.

[0278] At step 1520, in response to receiving the second screen projection instruction sent by the first screen projection device for playing the second multimedia resource, the second multimedia resource is acquired.

[0279] In some examples, after the display device 200 acquires the second screen projection instruction, the display device 200 can acquire the second multimedia resource from the corresponding server according to the second screen projection address in the second screen projection instruction. For example, when the second multimedia resource is a video, the data of the video can be acquired from the server.

[0280] At step 1530, if the fourth media asset similarity based on the first multimedia resource and the second multimedia resource satisfies the multi-path screen projection condition, the first multimedia resource continues to be played in the first screen projection window in the screen projection interface, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

[0281] In some examples, the fourth media asset similarity can be used to represent the similarity between the first multimedia resource and the second multimedia resource. For example, a part of the data frames (e.g., a first data frame) in the first multimedia resource and a part of the data frames (e.g., a second data frame) in the second multimedia resource can be compared. When the coincidence degree of the first data frame and the second data frame is lower than a first preset coincidence degree, the fourth media asset similarity satisfies the multi-path screen projection condition. When the coincidence degree of the first data frame and the second data frame is higher than a second preset coincidence degree, the fourth media asset similarity does not satisfy the multi-path screen projection condition. The data frame can be at least one of video data, audio data, picture data, and text information.

[0282] In some possible implementation manners, the similarity between the first multimedia resource and the second multimedia resource, i.e., the fourth media similarity, can be determined by a trained machine learning model, such as a similarity model. For example, the first data frame and the second data frame can be input into the similarity model, the similarity model can output the target coincidence degree, and the output target coincidence degree can be compared with the first coincidence degree threshold and the second coincidence degree threshold, so as to determine whether the fourth media similarity meets the multi-screen projection condition. Alternatively, the similarity model can directly output a result of whether the fourth media similarity meets the multi-screen projection condition, which is not limited in the embodiments of the present application.

[0283] According to the multi-screen projection method provided in some embodiments of the present application, the fourth media similarity can be determined according to the specific content of the first multimedia resource and the second multimedia resource. When the fourth media similarity meets the multi-screen projection condition, the multi-screen projection operation is performed; and when the fourth media similarity does not meet the multi-screen projection condition, the replacement projection operation is performed.

[0284] FIG. 16 is a schematic diagram of a multi-screen projection method according to some embodiments of the present application. As shown in FIG. 16, the multi-screen projection method can include the following steps 1610 to 1630. It should be noted that the main difference between the multi-screen projection method in FIG. 16 and the multi-screen projection methods in FIG. 4B and FIG. 15 is the determination process of the similarity.

[0285] At step 1610, in response to receiving a first projection instruction for playing a first multimedia resource sent by a first projection device, a first multimedia resource is acquired, and the first multimedia resource is played in a first projection window in a projection interface.

[0286] The first projection instruction can include first title information of the first multimedia resource.

[0287] In some examples, the projection instruction sent by the projection device can include title information or can not include title information. For example, whether the projection instruction includes title information can be related to an APP in which the multimedia resource is located. The projection instruction sent by some APPs includes title information, and the projection instruction sent by some APPs does not include title information.

[0288] For example, the title information can include information such as a name of the multimedia resource, an episode number, and a brief introduction, which is not limited in the present application.

[0289] At step 1620, in response to receiving a second projection instruction for playing a second multimedia resource sent by the first projection device, it is determined whether the second projection instruction includes second title information of the second multimedia resource.

[0290] In some examples, after receiving the second screen projection instruction, the display device 200 can determine, based on the second screen projection instruction, whether the second screen projection instruction includes second title information of the second multimedia resource. For example, if it is determined, based on the second screen projection instruction, that the second screen projection instruction includes the second title information of the second multimedia resource, step 1630 is performed; if it is determined, based on the second screen projection instruction, that the second screen projection instruction does not include the second title information of the second multimedia resource, step 1650 is performed.

[0291] In step 1630, similarity of the first title information and the second title information is determined.

[0292] In some examples, when the title information is included in both the first screen projection instruction and the second screen projection instruction, the similarity of the first title information and the second title information can be determined, and it is determined whether the similarity of the first title information and the second title information satisfies the multi-screen projection condition.

[0293] In step 1640, if the similarity of the first title information and the second title information satisfies the multi-screen projection condition, the first screen projection window in the screen projection interface continues to play the first multimedia resource, and the second screen projection window in the screen projection interface plays the second multimedia resource.

[0294] In some possible embodiments, the first title information and the second title information can be preprocessed to obtain processed first title information and processed second title information; if the processed first title information and the processed second title information are different, it is determined that the similarity of the first title information and the second title information satisfies the multi-screen projection condition; if the processed first title information and the processed second title information are the same, it is determined that the similarity of the first title information and the second title information does not satisfy the multi-screen projection condition.

[0295] In step 1650, the second multimedia resource is obtained.

[0296] In some examples, when the first screen projection instruction includes the title information but the second screen projection instruction does not include the title information, the second multimedia resource can be obtained according to the second screen projection address in the second screen projection instruction, and it is determined whether a fourth multimedia similarity between the first multimedia resource and the second multimedia resource satisfies the multi-screen projection condition based on the first multimedia resource and the second multimedia resource.

[0297] In step 1660, if it is determined, based on the first multimedia resource and the second multimedia resource, that the fourth multimedia similarity satisfies the multi-screen projection condition, the first screen projection window in the screen projection interface continues to play the first multimedia resource, and the second screen projection window in the screen projection interface plays the second multimedia resource.

[0298] It should be noted that steps 1650 to 1660 are similar to steps 1520 to 1530 in the above embodiment, and thus will not be described here again to avoid repetition.

[0299] FIG. 17 is a schematic diagram of another screen projection process according to some embodiments of the present application. For example, the screen projection process in FIG. 17 takes the screen projection interface of the display device to include two screen projection windows, and the screen projection device is taken as a mobile phone as an example.

[0300] As shown in (a) of FIG. 17, after the mobile phone 1 initiates the screen projection of the video source 1, the first screen projection window of the screen projection interface can play the video source 1.

[0301] In some examples, taking the IP of the mobile phone 1 as IP1 as an example, when the mobile phone 1 initiates the screen projection of the video source 2 again, it is first checked whether there is a video source being played in the current IP 1. Since there is a video source 1 being played in the same IP as the video source 2, it is further determined whether the video source 1 and the video source 2 are similar video sources.

[0302] As shown in (b) of FIG. 17, if the video source 1 and the video source 2 are similar video sources, the video source 2 will replace the video source 1, that is, the video source 1 exits the play from the first screen projection window, and the video source 2 is played in the first screen projection window.

[0303] As shown in (c) of FIG. 17, if the video source 1 and the video source 2 are not similar video sources, the video source 2 is played in another screen projection window of the screen projection interface, that is, the second screen projection window, to realize the simultaneous play of the video source 1 and the video source 2. At the same time, the IP 1 of the mobile phone 1 can be unbound from the previously projected video source 1, and a binding relationship can be established with the newly projected video source 2. At this time, the screen projection control instructions such as play, pause, progress adjustment, and play time point acquisition sent from the mobile phone 1 are all transmitted to the video source 2, and the video source 1 no longer interacts with the mobile phone 1 in any protocol, that is, the screen projection of the video source 1 has exited for the mobile phone 1.

[0304] Therefore, it can be seen from the above process that the screen projection method provided by the embodiments of the present application can realize the simultaneous double-way screen projection of two video sources pushed by one mobile phone on the display device. It should be noted that the second screen projection window can be an idle window of the screen projection interface which does not play a video source, or a newly created screen projection window for realizing multi-way screen projection.

[0305] FIG. 17 is a schematic diagram of another screen projection process according to some embodiments of the present application. For example, the screen projection process in FIG. 17 takes the screen projection interface of the display device to include two screen projection windows, and the screen projection device is taken as a mobile phone as an example.

[0306] In some examples, in the case that the first casting window plays the first pushed video source 1 and the second casting window plays the second pushed video source 2 in the casting interface (as shown in (c) of FIG. 17), when the phone 1 initiates casting of the third pushed video source 3 again, the phone 1 pushed video source 3 can be compared with the phone 1 pushed video source 1 and the phone 1 pushed video source 2 for similarity. If the phone 1 pushed video source 1 and the phone 1 pushed video source 3 are similar video sources, the phone 1 pushed video source 1 is exited from casting, and the phone 1 pushed video source 3 is played in the first casting window. If the phone 1 pushed video source 1 and the phone 1 pushed video source 2 are both not similar to the phone 1 pushed video source 3, one of the video sources is selected to replace according to preset replacement logic. The preset replacement logic can be to replace the earliest cast video source, or the user can select which video source to replace.

[0307] As shown in (a) of FIG. 18, when the phone 1 pushed video source 2 and the phone 1 pushed video source 3 are similar video sources, and the phone 1 pushed video source 1 and the phone 1 pushed video source 3 are not similar video sources, the phone 1 pushed video source 2 is exited from playing in the second casting window, and the phone 1 pushed video source 3 is played in the second casting window.

[0308] As shown in (b) of FIG. 18, when the phone 1 pushed video source 1 and the phone 1 pushed video source 2 are both not similar to the phone 1 pushed video source 3, the phone 1 pushed video source 3 replaces the earliest cast video source, i.e., the phone 1 pushed video source 1 is exited from playing in the first casting window, and the phone 1 pushed video source 3 is played in the first casting window.

[0309] As shown in (c) of FIG. 18, after the phone 1 pushed video source 3 replaces the phone 1 pushed video source 1, if the phone 2 initiates casting of the phone 2 pushed video source 4, the phone 2 pushed video source 4 replaces the earliest cast video source, i.e., the phone 1 pushed video source 2 is exited from playing in the second casting window, and the phone 2 pushed video source 4 is played in the second casting window.

[0310] Therefore, it can be seen from the above process that the casting method provided by the embodiments of the present application can not only realize multi-casting of multiple pushed video sources of multiple phones, but also realize multi-casting of multiple pushed video sources of one phone.

[0311] According to the casting method provided by some embodiments of the present application, whether the first multimedia resource and the second multimedia resource satisfy the multi-casting condition can be determined according to whether the title information is included in the first casting instruction and the second casting instruction sent by the first casting device. When the title information is included in the first casting instruction and the second casting instruction, whether the similarity between the two title information satisfies the multi-casting condition is determined; when one of the first casting instruction and the second casting instruction does not include the title information, whether the fourth media similarity based on the first multimedia resource and the second multimedia resource satisfies the multi-casting condition is determined. In the case of satisfying the multi-casting condition, the multi-casting operation is performed.

[0312] For the sake of convenience, the foregoing description has been presented in terms of specific implementations. However, the foregoing discussion is not intended to limit the disclosure to the particular implementations described. Various modifications and changes can be made thereto by those of ordinary skill in the art having the benefit of the teachings presented herein. The implementations described above are chosen and described in order to best explain the principles of the disclosure and its best mode of operation.

Claims

1. A display device comprising: a display configured to display a screen mirroring interface; a memory configured to store computer programs or instructions; at least one processor coupled with the display, connected with the memory, and configured to execute the computer programs or instructions to cause the display device to: in response to receiving a first screen mirroring instruction for playing a first multimedia resource sent by a first screen mirroring device, play the first multimedia resource in a first screen mirroring window in the screen mirroring interface; wherein the first screen mirroring instruction comprises first media asset information corresponding to the first multimedia resource; in response to receiving a second screen mirroring instruction for playing a second multimedia resource sent by the first screen mirroring device, determine second media asset information corresponding to the second multimedia resource based on the second screen mirroring instruction; if it is determined that a first media asset similarity degree satisfies a multi-path screen mirroring condition based on the first media asset information and the second media asset information, maintain the first multimedia resource to continue being played in the first screen mirroring window in the screen mirroring interface, and play the second multimedia resource in a second screen mirroring window in the screen mirroring interface.

2. The display device of claim 1, wherein the at least one processor, before executing the determination that the first media asset similarity degree satisfies the multi-path screen mirroring condition, is further configured to execute the computer programs or instructions to cause the display device to: in response to the first screen mirroring instruction, determine first device information of the screen mirroring device sending the first screen mirroring instruction; in response to the second screen mirroring instruction, determine second device information of the screen mirroring device sending the second screen mirroring instruction; based on the first device information and the second device information, determine that the screen mirroring device sending the first screen mirroring instruction and the screen mirroring device sending the second screen mirroring instruction are both the first screen mirroring device.

3. The display device of claim 1, wherein the screen mirroring interface further comprises a first menu display area corresponding to the first screen mirroring window, and the first menu display area comprises at least one first play control control, and the at least one first play control control comprises at least one of a first progress adjustment control, a first pause play control, a first exit screen mirroring control, and a first full-screen play control; after the at least one processor executes the maintaining the first multimedia resource to continue being played in the first screen mirroring window in the screen mirroring interface and playing the second multimedia resource in the second screen mirroring window in the screen mirroring interface, the at least one processor is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving a control instruction of the control device on the first progress adjustment control, adjust a play progress of the first multimedia resource in the first screen mirroring window; or, in response to receiving the control instruction of the control device on the first pause playing control, pause playing of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device on the first exit screen mirroring control, control the first multimedia resource to exit screen mirroring from the first screen mirroring window; or, in response to receiving a control instruction of the control device on the first full-screen play control, control the first multimedia resource to play in full screen in the screen mirroring interface.

4. The display device of claim 1, wherein the at least one processor, after maintaining the first casting window in the casting interface to continue playing the first multimedia resource and playing the second multimedia resource in the second casting window in the casting interface, is further configured to execute the computer programs or instructions to cause the display device to: perform a control operation on the second multimedia resource in the second casting window in response to receiving a control instruction of the control device on the at least one second play control. In response to the received playing control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; and The control operation comprises at least one of a play progress adjustment operation, a pause operation and a volume adjustment operation.

5. The display device of claim 1, wherein the casting interface further comprises a second menu display area corresponding to a second casting window, and the second menu display area comprises at least one second play control. The at least one processor, after maintaining the first casting window in the casting interface to continue playing the first multimedia resource and playing the second multimedia resource in the second casting window in the casting interface, is further configured to execute the computer programs or instructions to cause the display device to: perform a control operation on the second multimedia resource in the second casting window in response to receiving a control instruction of the control device on the at least one second play control. Send play information of the second multimedia resource to the first casting device to cause the first casting device to update play progress, play duration and play state of the second multimedia resource according to the play information.

6. The display device of claim 5, wherein the at least one processor, before performing the control operation on the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the at least one second play control, is further configured to execute the computer programs or instructions to cause the display device to: control the focus to move between the first casting window and the second casting window in response to receiving a focus switching operation sent by the control device; and display the second menu display area corresponding to the second casting window when the focus moves to the second casting window.

7. The display device of claim 6, wherein the at least one second play control comprises at least one of a second progress adjustment control, a second pause play control, a second exit casting control and a second full screen play control. The at least one processor, before performing the control operation on the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the at least one second play control, is further configured to execute the computer programs or instructions to cause the display device to: adjust the play progress of the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the second progress adjustment control; and pause the play of the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the second pause play control. ​ ​ ​ ​ ​ In response to receiving the control instruction of the control device on the second exit projection control, control the second multimedia resource to exit projection from the second projection window; In response to receiving the control instruction of the control device on the second full-screen play control, control the second multimedia resource to play in full screen on the projection interface.

8. The display device of claim 1, wherein the at least one processor executes the maintaining the first projection window in the projection interface to continue playing the first multimedia resource and the second projection window in the projection interface to play the second multimedia resource is specifically configured to execute the computer programs or instructions to cause the display device to: continue to receive the first multimedia resource sent by a server corresponding to a first projection address based on the first projection address in the first projection instruction; maintain the first projection window to continue playing the first multimedia resource, send a first notification message to the first projection device, and play the second multimedia resource in the second projection window; The display device can receive control operations of the first projection device on the second multimedia resource, and the first notification message is used to notify the first projection device that the first multimedia resource has exited projection. wherein 9. The display device of claim 8, wherein the at least one processor executes the maintaining the first projection window to continue playing the first multimedia resource, sending a first notification message to the first projection device, and playing the second multimedia resource in the second projection window is configured to execute the computer programs or instructions to cause the display device to: maintain the first projection window to continue playing the first multimedia resource, release the binding relationship between the first projection device and the first multimedia resource, and send the first notification message to the first projection device; create a binding relationship between the first projection device and the second multimedia resource, and play the second multimedia resource in the second projection window, so that the first projection device can control the second multimedia resource.

10. The display device of claim 1, wherein the at least one processor, before executing the response to receiving the second projection instruction sent by the first projection device for playing the second multimedia resource, is further configured to execute the computer programs or instructions to cause the display device to: the second notification message is used to notify the first projection device that the first multimedia resource has exited projection; In response to receiving a stop screen projection instruction for stopping playing the first multimedia resource, a second notification message is sent to the first screen projection device; wherein release the binding relationship between the first projection device and the first multimedia resource.

11. The display device of claim 10, wherein the at least one processor executes the maintaining the first projection window in the projection interface to continue playing the first multimedia resource and the second projection window in the projection interface to play the second multimedia resource is specifically configured to execute the computer programs or instructions to cause the display device to: ​ continue to receive the first multimedia resource sent by a server corresponding to the first casting address based on the first casting address in the first casting instruction; maintain the first casting window to continue playing the first multimedia resource; create a binding relationship between the first casting device and the second multimedia resource, and play the second multimedia resource in the second casting window, so that the first casting device can control the second multimedia resource.

12. The display device of any one of claims 1-11, the at least one processor is further configured to execute the computer programs or instructions to cause the display device to: determine the playing information of the second multimedia resource bound with the first casting device in response to receiving the acquisition request sent by the first casting device; sending playing information of the second multimedia resource to the first screen projection device; wherein the playing information includes at least one of the playing progress, the playing time length and the playing state of the second multimedia resource.

13. The display device of claim 1, the at least one processor executes the based on the first media information and the second media information, determines that the first media similarity satisfies the multi-casting condition, and is specifically configured to execute the computer programs or instructions to cause the display device to: determine the similarity type of the first media similarity based on the first media information and the second media information; If the similarity type of the first media asset similarity is a first type, it is determined that the first media asset similarity satisfies the multi-screen projection condition; wherein, the first type is used to indicate that the first media similarity is lower than a first similarity threshold. 14.The display device of claim 13, wherein the similarity type of the first media asset similarity is a first type including: The first multimedia resource corresponding to the first media information and the second multimedia resource corresponding to the second media information belong to multimedia resources of different episodes.

15. The display device of claim 13, the at least one processor is further configured to execute the computer programs or instructions to cause the display device to: if the similarity type of the first media asset similarity is a second type, it is determined that the first media asset similarity does not satisfy the multi-screen projection condition; wherein, the second type is used to indicate that the first media similarity is higher than a second similarity threshold; control the first multimedia resource to exit casting from the first casting window, and play the second multimedia resource in the first casting window.

16. The display device of claim 15, a similarity type of the first media similarity is a second type comprising: The first multimedia resource corresponding to the first media information and the second multimedia resource corresponding to the second media information belong to different multimedia resources of the same episode or the same multimedia resource with different media parameters.

17. The display device of claim 14 or 16, the at least one processor executes the determines the similarity type of the first media similarity, and is specifically configured to execute the computer programs or instructions to cause the display device to: preprocess the first title information in the first media information to obtain processed first title information; preprocess the second title information in the second media information to obtain processed second title information; if the processed first title information and the processed second title information are different, it is determined that the similarity type of the first media similarity is the first type; if the processed first title information and the processed second title information are the same, it is determined that the similarity type of the first media similarity is the second type.

18. The display device of any of claims 1-11, wherein the at least one processor, after determining that the first media similarity satisfies the multi-casting condition based on the first media information and the second media information, is further configured to execute the computer programs or instructions to cause the display device to: determine a resource type of the first multimedia resource based on a first casting address in the first casting instruction; determine a resource type of the second multimedia resource based on a second casting address in the second casting instruction; and determine whether a second media similarity satisfies the multi-casting condition based on the first media information and the second media information, if the resource type of the first multimedia resource and the resource type of the second multimedia resource are both online resources.

19. The display device of claim 18, wherein the at least one processor is further configured to execute the computer programs or instructions to cause the display device to: control the first multimedia resource to exit casting from the first casting window and play the second multimedia resource in the first casting window, if the resource type of the first multimedia resource is a local resource and / or the resource type of the second multimedia resource is a local resource.

20. The display device of any of claims 1-11, wherein the at least one processor, after maintaining the first casting window in the casting interface to continue playing the first multimedia resource and playing the second multimedia resource in a second casting window in the casting interface, is further configured to execute the computer programs or instructions to cause the display device to: determine third media information corresponding to a third multimedia resource based on a third casting instruction for playing the third multimedia resource received from the first casting device; determine a third casting window in a plurality of casting windows included in the casting interface, if a second media similarity satisfies the multi-casting condition based on the first media information and the third media information, and a third media similarity satisfies the multi-casting condition based on the second media information and the third media information, and there is no idle casting window in the casting interface that does not play a multimedia resource; and maintain the casting windows in the casting interface other than the third casting window to continue playing corresponding multimedia resources and play the third multimedia resource in the third casting window.

21. The display device of claim 20, wherein the at least one processor, when determining the third casting window in the plurality of casting windows included in the casting interface, is specifically configured to execute the computer programs or instructions to cause the display device to: determine any of the plurality of casting windows as the third casting window; or determine the third casting window in the plurality of casting windows according to casting times of the casting windows in the plurality of casting windows; or determine the third casting window in the plurality of casting windows in response to receiving a window selection instruction.

22. The display device of any of claims 1-11, wherein the at least one processor, when determining the third casting window in the plurality of casting windows included in the casting interface, is specifically configured to execute the computer programs or instructions to cause the display device to: determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows; or determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows and a casting time of a fourth casting window in the plurality of casting windows; or determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows, a casting time of the fourth casting window in the plurality of casting windows, and a casting time of a fifth casting window in the plurality of casting windows.

23. The display device of any of claims 1-11, wherein the at least one processor, when determining the third casting window in the plurality of casting windows included in the casting interface, is specifically configured to execute the computer programs or instructions to cause the display device to: determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows and a casting time of a fourth casting window in the plurality of casting windows; or determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows, a casting time of the fourth casting window in the plurality of casting windows, and a casting time of a fifth casting window in the plurality of casting windows.

24. The display device of any of claims 1-11, wherein the at least one processor, when determining the third casting window in the plurality of casting windows included in the casting interface, is specifically configured to execute the computer programs or instructions to cause the display device to: determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows and a casting time of a fourth casting window in the plurality of casting windows; or determine the third casting window in the plurality of casting windows according to a casting time of the third casting window in the plurality of casting windows, a casting time of the fourth casting window in the plurality of casting windows, and a casting time of a fifth casting window in the plurality of casting windows. ​ ​ ​ ​ ​ ​ ​ 22.The display device of any of claims 1-11, wherein the at least one processor, before executing the computer programs or instructions to cause the display device to execute the response to receiving the first casting instruction for playing the first multimedia resource sent by the first casting device, is further configured to execute the computer programs or instructions to cause the display device to: start a multi-casting application in response to receiving a start operation on the multi-casting application. 23.The display device of any of claims 1-11, wherein the at least one processor, when the first media similarity satisfies the multi-casting condition based on the first media information and the second media information, is configured to execute the computer programs or instructions to cause the display device to: display a casting selection window if the first media similarity satisfies the multi-casting condition based on the first media information and the second media information; maintain the first casting window in the casting interface to continue playing the first multimedia resource and play the second multimedia resource in the second casting window in the casting interface in response to receiving a selection operation of a first option in the casting selection window by the user. 24.The display device of claim 23, wherein the at least one processor is further configured to execute the computer programs or instructions to cause the display device to: control the first multimedia resource to exit casting from the first casting window and play the second multimedia resource in the first casting window in response to receiving a selection operation of a second option in the casting selection window by the user; or maintain the first casting window in the casting interface to continue playing the first multimedia resource in response to receiving a selection operation of a third option in the casting selection window by the user. 25.A display device, comprising: a display configured to display a casting interface; a memory configured to store computer programs or instructions; at least one processor coupled to the display and connected to the memory, and configured to execute the computer programs or instructions to cause the display device to: obtain the first multimedia resource and play the first multimedia resource in a first casting window in the casting interface in response to receiving a first casting instruction for playing the first multimedia resource sent by a first casting device; obtain the second multimedia resource in response to receiving a second casting instruction for playing the second multimedia resource sent by the first casting device; maintain the first casting window in the casting interface to continue playing the first multimedia resource and play the second multimedia resource in a second casting window in the casting interface if a fourth media similarity satisfies a multi-casting condition based on the first multimedia resource and the second multimedia resource.

26. The display device of claim 25, wherein the screen projection interface further comprises a first menu display area corresponding to the first screen projection window, and the first menu display area comprises at least one first play control, and the at least one first play control comprises at least one of a first progress adjustment control, a first pause play control, a first exit projection control, and a first full screen play control. The at least one processor, in maintaining the first screen projection window in the screen projection interface to continue playing the first multimedia resource and playing the second multimedia resource in the second screen projection window in the screen projection interface, is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving a control instruction of the control device on the first progress adjustment control, adjust a play progress of the first multimedia resource in the first screen projection window; or, in response to receiving the control instruction of the control device on the first pause playing control, pause playing of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device on the first exit projection control, control the first multimedia resource to exit projection from the first screen projection window; or, in response to receiving a control instruction of the control device on the first full screen play control, control the first multimedia resource to play in full screen in the screen projection interface.

27. The display device of claim 25, wherein the at least one processor, in maintaining the first screen projection window in the screen projection interface to continue playing the first multimedia resource and playing the second multimedia resource in the second screen projection window in the screen projection interface, is specifically configured to execute the computer programs or instructions to cause the display device to: the control operation comprises at least one of a play progress adjustment operation, a pause operation, and a volume adjustment operation. In response to the received playing control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; and 28. The display device of claim 25, wherein the screen projection interface further comprises a second menu display area corresponding to the second screen projection window, and the second menu display area comprises at least one second play control; The at least one processor, in maintaining the first screen projection window in the screen projection interface to continue playing the first multimedia resource and playing the second multimedia resource in the second screen projection window in the screen projection interface, is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving a control instruction of the control device on the at least one second play control, perform a corresponding control operation on the second multimedia resource in the second screen projection window; and send play information of the second multimedia resource to the first screen projection device, so that the first screen projection device updates a play progress, a play duration, and a play state of the second multimedia resource according to the play information.

29. The display device of claim 28, wherein the at least one processor, in response to receiving a control instruction of the control device on the at least one second play control to perform a corresponding control operation on the second multimedia resource in the second screen projection window, is further configured to execute the computer programs or instructions to cause the display device to: ​ in response to receiving the focus switching operation sent by the control device, controlling the focus to move between the first projection window and the second projection window; in a case where the focus moves to the second projection window, displaying the second menu display area corresponding to the second projection window.

30. The display device of claim 29, wherein the at least one second playback control comprises at least one of a second progress adjustment control, a second pause playback control, a second exit projection control, and a second full-screen playback control. The at least one processor executes the response to receiving the control instruction of the control device on the at least one second playback control to perform a corresponding control operation on the second multimedia resource in the second projection window, and is configured to execute the computer program or instruction to cause the display device to: in response to receiving the control instruction of the control device on the second progress adjustment control, adjust the playback progress of the second multimedia resource in the second projection window; in response to receiving the control instruction of the control device on the second pause playback control, pause the playback of the second multimedia resource in the second projection window; in response to receiving the control instruction of the control device on the second exit projection control, control the second multimedia resource to exit projection from the second projection window; in response to receiving the control instruction of the control device on the second full-screen playback control, control the second multimedia resource to play in full screen on the projection interface.

31. A display device, comprising: a display configured to display a projection interface; a memory configured to store computer programs or instructions; at least one processor coupled with the display, connected with the memory, and configured to execute the computer programs or instructions to cause the display device to: in response to receiving a first projection instruction for playing a first multimedia resource sent by a first projection device, obtain the first multimedia resource and play the first multimedia resource in a first projection window in a projection interface; wherein the first projection instruction comprises first title information of the first multimedia resource; in response to receiving a second projection instruction for playing a second multimedia resource sent by the first projection device, if it is determined based on the second projection instruction that the second projection instruction comprises second title information of the second multimedia resource, then determine the similarity of the first title information and the second title information; if the similarity of the first title information and the second title information meets a multi-path projection condition, maintain the first projection window in the projection interface to continue playing the first multimedia resource, and play the second multimedia resource in a second projection window in the projection interface.

32. The display device of claim 31, wherein the screen projection interface further comprises a first menu display area corresponding to the first screen projection window, and the first menu display area comprises at least one first play control, and the at least one first play control comprises at least one of a first progress adjustment control, a first pause play control, a first exit projection control, and a first full screen play control. The at least one processor, in response to receiving a control instruction of the control device on the first progress adjustment control, is further configured to execute the computer programs or instructions to cause the display device to: adjust a play progress of the first multimedia resource in the first screen projection window; or, in response to receiving the control instruction of the control device on the first pause playing control, pause playing of the first multimedia resource in the first projection window; or, in response to receiving a control instruction of the control device on the first exit projection control, control the first multimedia resource to exit projection from the first screen projection window; or, or, in response to receiving a control instruction of the control device on the first full screen play control, control the first multimedia resource to play in full screen on the screen projection interface.

33. The display device of claim 31, wherein the at least one processor, in response to receiving a control instruction of the control device on the first progress adjustment control, is further configured to execute the computer programs or instructions to cause the display device to: In response to the received playing control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; and the control operation comprises at least one of a play progress adjustment operation, a pause operation, and a volume adjustment operation.

34. The display device of claim 31, wherein the screen projection interface further comprises a second menu display area corresponding to the second screen projection window, and the second menu display area comprises at least one second play control. The at least one processor, in response to receiving a control instruction of the control device on the at least one second play control, is further configured to execute the computer programs or instructions to cause the display device to: perform a corresponding control operation on the second multimedia resource in the second screen projection window; and send play information of the second multimedia resource to the first screen projection device, so that the first screen projection device updates a play progress, a play duration, and a play state of the second multimedia resource according to the play information.

35. The display device of claim 34, wherein the at least one processor, in response to receiving a control instruction of the control device on the at least one second play control, is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving the focus switching operation sent by the control device, controlling the focus to move between the first projection window and the second projection window; in a case where the focus moves to the second projection window, displaying the second menu display area corresponding to the second projection window.

36. The display device of claim 35, wherein the at least one second play control control comprises at least one of a second progress adjustment control, a second pause play control, a second exit projection control, and a second full screen play control. The at least one processor executes the response to receiving the control instruction of the control device to the at least one second play control control, and performs a corresponding control operation on the second multimedia resource in the second projection window, and is configured to execute the computer program or instruction to enable the display device to: in response to receiving the control instruction of the control device to the second progress adjustment control, adjust the play progress of the second multimedia resource in the second projection window; in response to receiving the control instruction of the control device to the second pause play control, pause the play of the second multimedia resource in the second projection window; in response to receiving the control instruction of the control device to the second exit projection control, control the second multimedia resource to exit projection from the second projection window; in response to receiving the control instruction of the control device to the second full screen play control, control the second multimedia resource to play in full screen on the projection interface.

37. A display device, comprising: a display configured to display a projection interface; a memory configured to execute a computer program or instruction; at least one processor coupled with the display and connected with the memory, and configured to execute the computer program or instruction to enable the display device to: in response to receiving a first projection instruction sent by a first projection device for playing a first multimedia resource, acquire the first multimedia resource and play the first multimedia resource in a first projection window in the projection interface; in response to receiving a second projection instruction sent by the first projection device for playing a second multimedia resource, if it is determined based on the second projection instruction that the second projection instruction does not include second title information of the second multimedia resource, acquire the second multimedia resource; if it is determined based on the first multimedia resource and the second multimedia resource that a fourth media asset similarity degree satisfies a multi-path projection condition, maintain the first multimedia resource to continue playing in the first projection window in the projection interface, and play the second multimedia resource in a second projection window in the projection interface.

38. The display device of claim 37, wherein the projection interface further comprises a first menu display area corresponding to the first projection window, and the first menu display area comprises at least one first play control control, and the at least one first play control control comprises at least one of a first progress adjustment control, a first pause play control, a first exit projection control, and a first full screen play control. The at least one processor, after maintaining the first projection window in the projection interface to continue playing the first multimedia resource and playing the second multimedia resource in the second projection window in the projection interface, is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving a control instruction of the control device on the first progress adjustment control, adjust the playing progress of the first multimedia resource in the first projection window; or, in response to receiving the control instruction of the control device on the first pause playing control, pause playing of the first multimedia resource in the first projection window; or, in response to receiving the control instruction of the control device on the first exit projection control, control the first multimedia resource to exit projection from the first projection window; or, in response to receiving the control instruction of the control device on the first full-screen playing control, control the first multimedia resource to play in full screen on the projection interface.

39. The display device of claim 37, the at least one processor, after maintaining the first projection window in the projection interface to continue playing the first multimedia resource and playing the second multimedia resource in the second projection window in the projection interface, is specifically configured to execute the computer programs or instructions to cause the display device to: In response to the received playing control instruction sent by the first screen projection device, a corresponding control operation is performed on the second multimedia resource in the second screen projection window; and The control operation includes at least one of a playing progress adjustment operation, a pause operation, and a volume adjustment operation.

40. The display device of claim 37, the projection interface further includes a second menu display area corresponding to a second projection window, and the second menu display area includes at least one second playing control control; The at least one processor, after maintaining the first projection window in the projection interface to continue playing the first multimedia resource and playing the second multimedia resource in the second projection window in the projection interface, is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving a control instruction of the control device on the at least one second playing control control, perform a corresponding control operation on the second multimedia resource in the second projection window; send playing information of the second multimedia resource to the first projection device, so that the first projection device updates the playing progress, playing time length, and playing state of the second multimedia resource according to the playing information.

41. The display device of claim 40, the at least one processor, before executing the computer programs or instructions to cause the display device to, in response to receiving a control instruction of the control device on the at least one second playing control control, perform a corresponding control operation on the second multimedia resource in the second projection window, is further configured to execute the computer programs or instructions to cause the display device to: in response to receiving a focus switching operation sent by the control device, control the focus to move between the first projection window and the second projection window; in a case where the focus moves to the second projection window, display the second menu display area corresponding to the second projection window.

42. The display device of claim 41, wherein the at least one second play control comprises at least one of a second progress adjustment control, a second pause play control, a second exit casting control, and a second full screen play control. The at least one processor performs the corresponding control operation on the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the at least one second play control, and is configured to execute the computer program or instruction to cause the display device to: adjust the play progress of the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the second progress adjustment control; pause the play of the second multimedia resource in the second casting window in response to receiving the control instruction of the control device on the second pause play control; control the second multimedia resource to exit casting from the second casting window in response to receiving the control instruction of the control device on the second exit casting control; control the second multimedia resource to play in full screen on the casting interface in response to receiving the control instruction of the control device on the second full screen play control.

43. A casting method for a display device, comprising: playing a first multimedia resource in a first casting window in a casting interface in response to receiving a first casting instruction for playing the first multimedia resource sent by a first casting device; wherein the first casting instruction comprises first media asset information corresponding to the first multimedia resource; determining second media asset information corresponding to a second multimedia resource based on a second casting instruction for playing the second multimedia resource sent by the first casting device in response to receiving the second casting instruction; if it is determined that a first media asset similarity satisfies a multi-casting condition based on the first media asset information and the second media asset information, maintaining the first multimedia resource to continue playing in the first casting window in the casting interface and playing the second multimedia resource in a second casting window in the casting interface.

44. A casting method for a display device, comprising: playing a first multimedia resource in a first casting window in a casting interface in response to receiving a first casting instruction for playing the first multimedia resource sent by a first casting device; and obtaining the first multimedia resource; obtaining a second multimedia resource in response to receiving a second casting instruction for playing the second multimedia resource sent by the first casting device; if it is determined that a second media asset similarity satisfies a multi-casting condition based on the first multimedia resource and the second multimedia resource, maintaining the first multimedia resource to continue playing in the first casting window in the casting interface and playing the second multimedia resource in a second casting window in the casting interface.

45. A casting method for a display device, comprising: In response to receiving the first screen projection instruction for playing the first multimedia resource sent by the first screen projection device, the first multimedia resource is acquired and played in the first screen projection window in the screen projection interface; wherein the first screen projection instruction comprises first title information of the first multimedia resource; In response to receiving the second screen projection instruction for playing the second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction comprises second title information of the second multimedia resource, the similarity of the first title information and the second title information is determined. If the similarity of the first title information and the second title information satisfies the multi-path screen projection condition, the first multimedia resource is maintained to continue playing in the first screen projection window in the screen projection interface, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

46. A screen projection method for a display device, comprising: In response to receiving the first screen projection instruction for playing the first multimedia resource sent by the first screen projection device, the first multimedia resource is acquired and played in the first screen projection window in the screen projection interface; In response to receiving the second screen projection instruction for playing the second multimedia resource sent by the first screen projection device, if it is determined based on the second screen projection instruction that the second screen projection instruction does not comprise second title information of the second multimedia resource, the second multimedia resource is acquired; If it is determined based on the first multimedia resource and the second multimedia resource that the second media asset similarity satisfies the multi-path screen projection condition, the first multimedia resource is maintained to continue playing in the first screen projection window in the screen projection interface, and the second multimedia resource is played in the second screen projection window in the screen projection interface.

Images