Screen projection method, system and electronic device

Abstract

The present application provides a screen projection method, system and electronic device. The method includes: the electronic device establishes a first screen projection connection with the target device based on the Miracast protocol, the electronic device mirrors and displays the first interface of the gallery application with the target device based on the first screen projection connection, the first interface displays a thumbnail of the first video, the electronic device receives a first operation of the user on the thumbnail of the first video, and in response to the first operation, the electronic device displays the second interface of the gallery application, the second interface includes control controls for the first video, and in response to the first operation, the electronic device establishes a second screen projection connection with the target device based on the DLNA protocol, and the electronic device instructs the target device to display the playback interface of the first video based on the second screen projection connection. By the user touching the thumbnail in the picture application list interface, the electronic device is triggered to automatically establish a DLNA connection with the receiving device of the screen projection, which reduces user operations and improves the user's playback experience.

Description

Technical Field

[0001] The present application relates to the field of terminal devices, and in particular to a screen projection method, system and electronic device. Background Art

[0002] Screen projection is an important function of electronic devices. Through the screen projection function, users can display the content on electronic devices with small screens, such as pictures, videos, etc., on large-screen electronic devices such as smart TVs for viewing. The Cast protocol (also known as the Miracast protocol) is a wireless screen projection protocol that supports mirroring mode. Electronic devices provide a system "wireless screen projection" entrance, and use the Cast protocol to mirror the content on the electronic device screen to the large screen. This screen projection method is called mirroring.

[0003] Currently, in mirroring mode, videos in the gallery app on an electronic device must be cast to a media app with a mirroring function, and then cast to the large screen through the media app's screen casting portal. This method is cumbersome and provides a poor user experience. Summary of the Invention

[0004] In order to solve the above technical problems, the present application provides a screen projection method, system and electronic device, which triggers the electronic device to automatically establish a DLNA connection with the receiving device of the screen projection by the user touching the thumbnail in the picture application list interface, thereby reducing user operations and improving the user's playback experience.

[0005] In the first aspect, the present application provides a screen projection method. The screen projection method includes: the electronic device establishes a first screen projection connection with the target device based on the Miracast protocol, and then, based on the first screen projection connection, the electronic device mirrors the first interface of the gallery application with the target device, and the first interface displays a thumbnail of the first video. Then, the electronic device receives the user's first operation on the thumbnail of the first video. In response to the first operation, the electronic device displays the second interface of the gallery application, and the second interface includes control controls for the first video. And, in response to the first operation, the electronic device establishes a second screen projection connection with the target device based on the Digital Living Network Alliance DLNA protocol. Then, based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video. In this way, by the user touching the thumbnail in the picture application list interface, the electronic device can be triggered to automatically establish a DLNA connection with the receiving device of the screen projection, which reduces user operations and improves the user's playback experience.

[0006] In one example, after the electronic device detects that the second screen projection connection is established, the first screen projection connection can be disconnected. When the electronic device detects that the second screen projection connection is disconnected, the first screen projection connection can be re-established with the target device.

[0007] In another example, a first screen projection connection and a second screen projection connection may exist simultaneously between the electronic device and the target device. In this case, it can be preset to prioritize screen projection through the second screen projection connection.

[0008] According to the first aspect, before the electronic device displays the second interface of the gallery application, the electronic device further includes: displaying a third interface indicating that the second screen projection connection is in progress. In this way, the interface during the second screen projection connection process can be presented to the user, allowing the user to intuitively understand the screen projection connection status.

[0009] According to the first aspect, after the electronic device instructs the target device to display the playback interface of the first video based on the second projection connection, the electronic device further includes: in response to the user's second operation on the second interface, the electronic device displays the large image interface of the first picture, the thumbnail of the first picture is displayed in the first interface, and the thumbnail of the first picture is adjacent to the thumbnail of the first video; the electronic device instructs the target device to display the first picture based on the second projection connection. In this way, when the electronic device is projecting a video in DLNA mode, the user can easily switch to the projection of other pictures in the gallery through operations such as sliding, without the user having to exit the video projection and then enter the picture projection, which reduces user operations and can improve the user experience.

[0010] According to the first aspect, after the electronic device instructs the target device to display the first image based on the second projection connection, the electronic device further includes: in response to the user performing a third operation on the large image interface of the first image that is opposite to the second operation, the electronic device displays the second interface; and based on the second projection connection, the electronic device instructs the target device to display the playback interface of the first video. In this way, after switching to the projection of another image in the gallery, the user can easily switch back to the original video projection by performing operations such as reverse swiping.

[0011] According to the first aspect, the method further includes: in response to a fourth operation of the user on the electronic device, the electronic device disconnects the second screen projection connection and the first screen projection connection with the target device. In this way, the user can conveniently exit the screen projection.

[0012] Exemplarily, the fourth operation may be clicking the wireless screen casting capsule and clicking the “wireless screen casting button” in the drop-down menu.

[0013] According to the first aspect, it also includes: the electronic device displays the large image interface of the first video in the gallery application; in response to the user's fifth operation on the large image interface of the first video, the electronic device displays a drop-down menu; in response to the user's sixth operation on the wireless screen projection icon in the drop-down menu, the electronic device establishes a second screen projection connection with the target device based on the DLNA protocol; in response to the sixth operation, the electronic device displays the second interface of the gallery application, the second interface including control controls for the first video; based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video. In this way, when the user turns on wireless screen projection in the large image interface of the gallery video, it can trigger the electronic device to automatically establish a DLNA connection, which is convenient and fast, and improves the user experience.

[0014] According to the first aspect, after the electronic device instructs the target device to display the playback interface of the first video based on the second screen projection connection, the electronic device further includes: in response to a seventh operation on the wireless screen projection capsule on the second interface, the electronic device disconnects the second screen projection connection with the target device; and in response to the seventh operation, the electronic device and the target device mirror the playback interface of the first video. In this way, by touching the wireless screen projection capsule, it is possible to conveniently exit the DLNA screen projection mode and return to the mirrored screen projection.

[0015] According to the first aspect, it also includes: the electronic device displays the large picture interface of the second video in the gallery application, the large picture interface of the second video includes the playback interface of the second video and the thumbnail of the second video, and the thumbnail includes the second picture captured from the second video and the cover of the second video; in response to the user's fifth operation on the large picture interface of the second video, the electronic device displays a drop-down menu; in response to the user's sixth operation on the wireless screen projection icon in the drop-down menu, the electronic device establishes a second screen projection connection with the target device based on the DLNA protocol; in response to the sixth operation, the electronic device displays the fifth interface of the gallery application, the fifth interface includes control controls for the second video and the thumbnail of the second video; based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the second video. In this way, the user turns on wireless screen projection in the large picture interface of the video of the gallery, which can trigger the electronic device to automatically establish a DLNA connection, which is convenient and fast, and improves the user experience.

[0016] According to the first aspect, after the electronic device instructs the target device to display the playback interface of the second video based on the second screen projection connection, the electronic device further includes: in response to the user's eighth operation on the second picture in the thumbnail of the second video on the fifth interface, the electronic device displays the large picture interface of the second picture, and the large picture interface of the second picture displays the thumbnail of the second video; in response to the eighth operation, the electronic device instructs the target device to display the second picture. In this way, during the screen projection process of recording multiple videos, the user can conveniently switch from screen projection of the video to screen projection of the video snapshot through the thumbnails of the recorded videos.

[0017] According to the first aspect, in response to the user's eighth operation on the second picture in the thumbnail of the second video on the fifth interface, after the electronic device displays the large picture interface of the second picture, it also includes: in response to the user's ninth operation on the cover of the second video in the thumbnail of the second video in the large picture interface of the second picture, the electronic device displays the fifth interface, the fifth interface includes control controls for the second video and the thumbnail of the second video; based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the second video from the first progress, the first progress being the playback progress of the second video displayed before the electronic device displays the large picture interface of the second picture. In this way, during the screen projection process of recording multiple videos, the user can conveniently switch from the projection of the captured picture of the video back to the projection of the video through the thumbnails of the recorded videos.

[0018] According to the first aspect, it also includes: the electronic device establishes a first screen projection connection with the target device based on the Miracast protocol; based on the first screen projection connection, the electronic device mirrors the sixth interface of the first video application with the target device, and the sixth interface displays the playback interface of the third video; receives the tenth operation of the user on the sixth interface; in response to the tenth operation, the electronic device displays the seventh interface, the seventh interface includes control controls for the third video, the tenth operation is to rotate the electronic device to a horizontal screen state, or the tenth operation is to touch the full-screen button on the sixth interface; in response to the tenth operation, the electronic device establishes a second screen projection connection with the target device based on the DLNA protocol; based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the third video. In this way, media applications have a DLNA screen projection entrance, and users can easily trigger DLNA screen projection in media applications, which provides convenience for users.

[0019] According to the first aspect, after the electronic device instructs the target device to display the playback interface of the third video based on the second screen projection connection, the electronic device further includes: in response to the user's eleventh operation on the seventh interface, the electronic device disconnects the second screen projection connection with the target device; the eleventh operation is to return to the previous interface, or the eleventh operation is to exit the first video application to the background; in response to the eleventh operation, the electronic device and the target device mirror the display of the third video. In this way, the user can easily exit DLNA screen projection and switch to mirrored screen projection during the DLNA screen projection process of the media application, providing convenience for the user.

[0020] According to the first aspect, before the electronic device disconnects the second screen projection connection with the target device, the electronic device further includes: displaying a query dialog box superimposed on the seventh interface, the query dialog box including a first button for instructing to exit DLNA screen projection; and in response to the user touching the first button, the electronic device disconnects the second screen projection connection with the target device. In this way, the user can learn how to exit DLNA screen projection according to the interface prompt information, which is intuitive, convenient, and quick, thereby improving the user experience.

[0021] According to the first aspect, the electronic device, based on the second screen projection connection, instructs the target device to display the playback interface of the first video, including: based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video from the beginning. In this way, the video is automatically played from the beginning after the screen projection, meeting the user's need to switch to the video projection to watch again.

[0022] According to the first aspect, the method further includes: receiving a twelfth operation of the user on the control control of the first video, the twelfth operation being used to adjust the playback progress of the first video to a second progress; and the electronic device, based on the second screen projection connection, instructing the target device to display the playback interface of the first video from the second progress. In this way, continuous playback of the video projection is achieved, meeting the user's need to switch to the video projection to continue watching.

[0023] In a second aspect, the present application provides a screen projection system, including a first electronic device and a second electronic device, wherein:

[0024] A first electronic device is configured to: establish a first screen casting connection with a second electronic device based on the Miracast protocol; based on the first screen casting connection, mirror display a first interface of a gallery application with the second electronic device, where the first interface displays a thumbnail of a first video; receive a first operation performed by a user on the thumbnail of the first video; in response to the first operation, display a second interface of the gallery application, where the second interface includes control controls for the first video; in response to the first operation, establish a second screen casting connection with the second electronic device based on the Digital Living Network Alliance (DLNA) protocol; based on the second screen casting connection, instruct the second electronic device to display a playback interface of the first video;

[0025] The second electronic device is configured to: after establishing a first screen casting connection with the first electronic device based on the Miracast protocol, mirror the first interface of the gallery application of the first electronic device based on the first screen casting connection; and after establishing a second screen casting connection with the first electronic device based on the DLNA protocol, display the playback interface of the first video based on the second screen casting connection. In this way, by a user touching a thumbnail in the image application list interface, the electronic device can be triggered to automatically establish a DLNA connection with the receiving device of the screen casting, reducing user operations and improving the user's playback experience.

[0026] On the third aspect, the present application provides a screen projection method, which includes: the electronic device displays a large picture interface of the first video in the gallery application; in response to the user's fifth operation on the large picture interface of the first video, the electronic device displays a drop-down menu; in response to the user's sixth operation on the wireless screen projection icon in the drop-down menu, the electronic device establishes a second screen projection connection with the target device based on the DLNA protocol; in response to the sixth operation, the electronic device displays the second interface of the gallery application, and the second interface includes control controls for the first video; based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video. In this way, by detecting that the large picture interface of the video of the picture application and the wireless screen projection function are turned on, the electronic device can be automatically triggered to establish a DLNA connection with the receiving device of the screen projection, which reduces user operations and improves the user's playback experience.

[0027] According to the third aspect, after the electronic device instructs the target device to display the playback interface of the first video based on the second projection connection, it also includes: in response to the seventh operation of the wireless projection capsule on the second interface, the electronic device disconnects the second projection connection with the target device; in response to the seventh operation, the electronic device and the target device mirror the display of the playback interface of the first video.

[0028] In a fourth aspect, the present application provides an electronic device comprising: a memory and a processor, the memory being coupled to the processor; the memory storing program instructions, which, when executed by the processor, enables the electronic device to execute the screen projection method described in any one of the first aspects.

[0029] In a fifth aspect, the present application provides a computer-readable storage medium, comprising a computer program. When the computer program runs on an electronic device, the electronic device executes the screen projection method described in any one of the aforementioned first aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 is a schematic structural diagram of an illustrative electronic device 100;

[0031] Figure 2 1 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application;

[0032] Figure 3 This is an example diagram illustrating the process of mirroring a video in the gallery in a scenario where mirroring is first turned on and then the gallery is entered;

[0033] Figure 4 This is a schematic diagram of the interface for exemplarily showing the process of turning on mobile phone mirroring and entering the gallery;

[0034] Figure 5 This is a schematic diagram showing an exemplary mirrored display of a list interface of a gallery on a smart TV screen;

[0035] Figure 6 This is a schematic diagram showing the mobile phone interface display process after a user touches a video thumbnail on the list interface of the gallery;

[0036] Figure 7 This is a schematic diagram illustrating an exemplary process of interface changes when sliding on a mobile phone screen during video projection;

[0037] Figure 8 This is an example diagram showing the process of mirroring a video in the gallery in a scenario where you first enter the gallery interface and then turn on mirroring.

[0038] Figure 9 This is an example diagram illustrating the process of canceling system screen projection in a scenario where a gallery video is projected via the DLNA protocol;

[0039] Figure 10 Schematic diagram of a video b played on a smart TV screen;

[0040] Figure 11 This is a schematic diagram of the interface for the gallery video screen casting process in an exemplary scenario of recording multiple results at once;

[0041] Figure 12 This is a schematic diagram of an interface for touching the thumbnails of multiple videos in a one-record-multiple-record scenario;

[0042] Figure 13 for Figure 12 Schematic diagram of the projection screen corresponding to each interface;

[0043] Figure 14 This is a schematic diagram of a remote control interface in an immersive state;

[0044] Figure 15 This is a schematic diagram of the interface of the screen projection process of the video application 1 shown as an example. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0046] The term "and / or" in this article is merely a description of the association relationship between associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0047] In the description and claims of the embodiments of this application, the terms "first" and "second" are used to distinguish different objects, rather than to describe a specific order of objects. For example, the terms "first target object" and "second target object" are used to distinguish different objects, rather than to describe a specific order of objects.

[0048] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0049] In the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. For example, "multiple processing units" means two or more processing units; "multiple systems" means two or more systems.

[0050] The Cast protocol and DLNA (DIGITAL LIVING NETWORK ALLIANCE) protocol are both wireless screen projection protocols that support the screen projection function.

[0051] The DLNA protocol only supports displaying cast media files and cannot display other content. The entry point for screen casting using the DLNA protocol is generally a media app, such as the Huawei Video app. Media apps have a cast icon set up. When the user touches the cast icon, the media app is triggered to cast the media file, such as a video, played in the media app via the DLNA protocol.

[0052] Among them, the Cast protocol supports mirror mode screen projection, which can mirror all display content on the electronic device screen on a large-screen device. The operation entry for screen projection using the Cast protocol is generally the operating system of the electronic device. Electronic devices such as mobile phones and tablets have a "wireless screen projection" icon set in the drop-down menu. The "wireless screen projection" icon is the entrance to the wireless screen projection of the electronic device. The user touches the "wireless screen projection" icon to trigger the system of the electronic device to project the screen through the Cast protocol.

[0053] In the related art, in the mirroring screen projection mode (i.e., the screen projection mode using the Cast protocol), if you want to cast a video in the mobile phone gallery to the large screen of the smart TV for playback, the operation process is as follows:

[0054] When the system's mirroring screen is turned on, touch the video in the phone's gallery image list, and the large video image will be displayed on the phone screen. At this time, the phone will cast the video cover on the TV through the DLNA protocol, and the video will not be played on the TV. The user further touches the play icon on the large video image, and the electronic device calls a media application with a screen casting function, such as calling the Huawei Video APP. The interface for playing the video of the Huawei Video APP is displayed on the electronic device screen. At this time, the phone uses the Cast protocol to mirror the phone screen on the smart TV. Subsequently, if the user touches the wireless screen casting icon on the interface for playing the video of the Huawei Video APP, the Huawei Video APP can cast the video on the TV through the DLNA protocol. Of course, the phone can also use the Cast protocol by default to mirror the video screen in the gallery application on the TV.

[0055] It can be seen that in the related art, if you want to cast and play videos in the gallery, the operations are complicated and cumbersome, which gives users a poor playback experience.

[0056] In addition, this process involves mirroring, and the user's operation information on the mobile phone may be projected onto the large screen for display, posing the risk of leaking user privacy.

[0057] In this embodiment, a video player is added to the Gallery app, which has the function of casting and playing videos in the Gallery via the DLNA protocol. With the video player in the Gallery and mirroring enabled, if a user touches a video in the picture list, the Gallery app can automatically switch the casting protocol from Cast to DLNA, and then cast the video to the large screen via DLNA, reducing user operations and improving the user's Gallery video playback experience.

[0058] In the embodiment of the present application, the source electronic device for screen projection can be a mobile phone, tablet, laptop or other electronic device with a smaller screen size (referred to as a small-screen electronic device), and the receiving electronic device for screen projection can be a smart TV or other electronic device with a larger screen size (referred to as a large-screen electronic device). Of course, these are merely examples, and the embodiment of the present application does not limit the specific type of electronic device.

[0059] In the embodiment of the present application, the electronic device needs to support two wireless screen projection protocols: DLNA protocol and Cast protocol.

[0060] The screen projection method in the embodiment of the present application can be applied to electronic devices such as mobile phones, tablets, and notebooks. The structure of the electronic device can be as follows: Figure 1 shown.

[0061] Figure 1 FIG1 is a schematic diagram of the structure of an electronic device 100. It should be understood that Figure 1The illustrated electronic device 100 is merely one example of an electronic device, and the electronic device 100 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. Figure 1 The various components shown in the drawings may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0062] See Figure 1 The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0063] The electronic device 100 implements its display functionality through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0064] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like. In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0065] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0066] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the present application, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0067] Figure 2 1 is a block diagram of the software structure of the electronic device 100 according to an embodiment of the present application.

[0068] The layered architecture of electronic device 100 divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system may include an application layer, an application framework layer, a system layer, and a kernel layer.

[0069] The application layer can include a series of application packages.

[0070] like Figure 2 As shown, the application package of the application layer of the electronic device 100 may include camera, gallery, video, WLAN, Bluetooth and other applications.

[0071] Among them, the camera application (hereinafter referred to as camera) can be used to take pictures, videos, etc.

[0072] Among them, the gallery application (hereinafter referred to as the gallery) can store media files such as pictures and videos.

[0073] Among them, the video application is used to play videos.

[0074] Among them, WLAN applications, Bluetooth applications, etc. are used to establish wireless connections.

[0075] like Figure 2 As shown, the application framework layer may include applications such as resource managers.

[0076] Among them, the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

[0077] like Figure 2 As shown, the system library may include multiple functional modules, such as media libraries.

[0078] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0079] The kernel layer is the layer between hardware and software.

[0080] like Figure 2 As shown, the kernel layer may include modules such as display driver, Wi-Fi driver, sensor driver, and audio driver.

[0081] It is understandable that Figure 2 The layers in the illustrated software structure and the components contained in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0082] The following uses the example of projecting the screen from a mobile phone to a smart TV to illustrate the embodiments of this application.

[0083] First, combine Figures 3 to 7 This section explains how to mirror a video in the gallery after first enabling mirroring and then accessing the gallery.

[0084] Figure 3 The application scenario of the screen projection process shown is: first turn on mirror projection and then enter the gallery to project the video in the gallery.

[0085] Figure 3 In the market, mobile phones and smart TVs all support DLNA protocol and Cast protocol.

[0086] See Figure 3 In this embodiment, the process of mirroring the screen and then entering the gallery to cast the video in the gallery may include the following steps:

[0087] S1. The mobile phone receives the user's touch operation of the "Wireless Screen Casting" icon in the drop-down menu and turns on the mirror screen casting function.

[0088] Figure 4 This is an example of the interface diagram for turning on mobile phone mirroring and entering the gallery. Figure 4, there is a "Wireless Screen Mirroring" icon in the drop-down menu of the mobile phone. Users can turn on the mirroring screen function by touching the "Wireless Screen Mirroring" icon. Figure 4 In the drop-down menu interface shown in Figure (a), the "Wireless Screen Casting" icon shows that the system wireless screen casting, i.e., the mirror screen casting function, is not currently enabled. The user touches (e.g., clicks) the "Wireless Screen Casting" icon, and the phone responds to the touch operation and pops up a list of available devices (here, devices that can cast screens) (not shown in the figure). After the user selects the target device in the list of available devices, such as a smart TV, the phone responds to the selection operation and turns on the mirror screen casting function. After the mirror screen casting function is turned on, the "Wireless Screen Casting" icon is as shown in the figure. Figure 4 When mirroring is enabled, the user can select the device to mirror from the list of available devices displayed on the phone interface. This will not be described in detail here.

[0089] S2. Receive an operation in which the user clicks on the gallery icon on the main interface of the mobile phone, and display a list interface of the gallery on the mobile phone screen.

[0090] exist Figure 4 On the main interface of the mobile phone shown in Figure (c), there is an icon of the gallery application (i.e., the gallery icon). The user touches the gallery icon to enter the internal interface of the gallery, such as the homepage of the gallery, or any interface in the gallery. Figure 4 As shown in Figure (d), the mobile phone can enter the list interface of the gallery (also called the photo interface), and the list interface of the gallery displays thumbnails of pictures and videos, including the thumbnail of video b.

[0091] Figure 4 A wireless screen projection capsule can also be displayed in the upper left corner of the interface displayed on the mobile phone screen shown in Figure (d). The wireless screen projection capsule is used to indicate that the system mirroring screen projection function of the mobile phone is turned on. It should be noted that if the system mirroring screen projection function of the mobile phone is not turned on, the wireless screen projection capsule will not be displayed on the interface displayed on the mobile phone screen. It should be noted that the user can also open a video from the album interface of the gallery, etc. This embodiment does not limit which interface of the gallery to open the video from.

[0092] S3. Project the list interface of the gallery onto the smart TV screen.

[0093] Figure 5 This is a schematic diagram showing an example of a mirrored display of a gallery list interface on a smart TV screen. Figure 5 When mirroring is on, the phone will mirror the gallery list displayed on the phone screen to the smart TV screen via the Cast protocol. Figure 4 When the interface shown in Figure (b) is displayed, the content displayed on the smart TV screen is as follows Figure 5It should be noted that after the "wireless screen projection" of the mobile phone is turned on, the mobile phone and the smart TV will start mirroring the screen instead of displaying Figure 5 Mirroring will start after you enter the list interface.

[0094] S4. Receive an operation in which the user touches the thumbnail of video b on the gallery list interface of the mobile phone, establish a DLNA connection with the smart TV, and display a "screen casting" interface.

[0095] Figure 6 This is a schematic diagram showing the process of the mobile phone interface displaying the video thumbnail after the user touches the video thumbnail on the list interface of the gallery. Figure 4 On the list interface shown in Figure (d), touch (e.g. click) the thumbnail of video b, the phone detects the touch operation and initiates a DLNA connection with the smart TV. At this time, the phone screen displays Figure 6 The "Casting" interface shown in Figure (a) indicates that the phone is connecting to the smart TV through DLNA.

[0096] like Figure 6 As shown in Figure (a), the "Casting" interface also displays a remote control, which is used to control video playback on the smart TV. Figure 6 In Figure (a), the remote control is provided with multiple virtual buttons, including play / pause, fast forward, fast rewind, volume up and volume down. Figure 6 In Figure (a), the remote control is unusable because the DLNA connection has not been established. Figure 6 As shown in Figure (a), the "Casting Screen" interface also displays a progress bar, which is also in an unusable state. Figure 6 The wireless screen projection capsule can also be displayed in Figure (a), which is used to indicate that the system mirroring screen projection function of the mobile phone is turned on. Figure 6 Figures (a) and (c) may be interfaces that are displayed for a very short time. Alternatively, in other embodiments of the present application, the electronic device may not display Figure 6 The interfaces shown in Figures (a) and (c) of .

[0097] S5. The smart TV displays a screen indicating that DLNA is connecting.

[0098] Display on mobile screen Figure 6 When the "Casting" interface is displayed as shown in Figure (a), the display on the smart TV screen is as follows Figure 6 As shown in Figure (c), when the user touches the video thumbnail in the gallery, the DLNA connection between the mobile phone and the smart TV is immediately triggered.

[0099] S6. When the mobile phone detects that the DLNA connection is established, the remote control interface is displayed on the mobile phone screen.

[0100] The DLNA connection is established and the phone screen displays Figure 6 As shown in Figure (b), the phone displays the remote control interface, which displays the remote control and progress bar. At this time, since the DLNA connection has been established, Figure 6 The remote control and progress bar in Figure (b) are both in a usable state. Figure 6 The state shown in Figure (b) is called the video large screen state. Figure 6 The remote control interface shown in Figure (b) is used to control the video playback of video b.

[0101] S7. The smart TV replays video b on the screen.

[0102] Display on mobile screen Figure 6 When the "Screen Casting" interface is displayed as shown in Figure (b), the display on the smart TV screen is as follows Figure 6 As shown in Figure (d). Figure 6 In Figure (d), the playback picture of video b is immersively displayed (e.g., full-screen display) on the smart TV screen, and video b is played from the beginning.

[0103] As can be seen from S4 to S7, in this embodiment of the present application, when mirroring is enabled, touching a video thumbnail in the gallery list interface automatically triggers a DLNA connection, allowing immersive video playback on the receiving device via the DLNA protocol. This eliminates the need for users to invoke other media applications or perform DLNA-related screen casting operations, reducing user effort and providing a more immersive visual experience for the user.

[0104] Since you can enter the full video image by touching the video thumbnail in the gallery list interface, Figure 6 The remote control interface shown in Figure (b) corresponds to the video large picture interface (the video large picture interface here refers to the interface that enlarges and displays the video cover on the mobile phone screen. This interface only has the video cover and the play icon, and does not display other pictures or video thumbnails). Therefore, it can be said that when mirroring is turned on, entering the video large picture will automatically trigger the DLNA connection, and the video will be automatically played immersively on the receiving device of the screen through the DLNA protocol. Of course, when mirroring is turned on, entering the video large picture will automatically trigger the DLNA connection, but the receiving device may not automatically play the video, but the user may click the play button (for example Figure 6 (b) to trigger video playback.

[0105] S8. Upon receiving a right-swiping operation from the user on the mobile phone screen, a large-image interface of image c is displayed.

[0106] Figure 7 Schematic diagram of the interface change process of sliding on the mobile phone screen during video projection. Figure 4 As shown in Figure (d), in the gallery list interface, the next picture after video b is picture c. When the user slides right on the phone screen, the phone responds to the right sliding operation and displays a large picture of picture c, as shown in Figure 5. Figure 7 As shown in Figure (a). At this time, the smart TV displays picture c

[0107] S9. The smart TV displays the image c on the screen.

[0108] When the large image of picture c is displayed on the mobile phone screen, the mobile phone uses the DLNA protocol to project picture c onto the smart TV screen. Figure 7 As shown in Figure (c).

[0109] It should be noted that if Figure 4 In the interface shown in Figure (d), the user touches the thumbnail of image c. In response to the touch operation, the mobile phone establishes a screen casting connection with the smart TV based on the DLNA protocol, and the electronic device displays image c based on the screen casting connection. That is, when the mobile phone has already enabled screen mirroring, the user touches the image in the list interface of the gallery application to automatically trigger the mobile phone to establish a screen casting connection with the smart TV based on the DLNA protocol. S10: Receive the user's left swipe operation on the mobile phone screen, and display the remote control interface of video b on the mobile phone screen.

[0110] Display on mobile screen Figure 7 In the case of the large image interface of picture c shown in Figure (a), the user slides to the left on the mobile phone screen. If the mobile phone detects that the current mobile phone is casting the screen in DLNA mode, the mobile phone responds to the left sliding operation and displays the remote control interface for controlling the playback of video b.

[0111] Display on mobile screen Figure 7 In the case of the large image interface of picture c shown in Figure (a), the user slides to the left on the mobile phone screen. If the mobile phone detects that the current mobile phone is not connected to any device for screen projection, the mobile phone responds to the left sliding operation and displays the large image interface of video b.

[0112] S11. The smart TV replays video b on the screen.

[0113] When the remote control interface for controlling video b is displayed on the mobile phone screen, the mobile phone plays the picture of video b on the smart TV screen through the DLNA protocol. It should be noted that no matter what progress video b has played before the user swipes right on the mobile phone screen in step S8, the smart TV will play video b from the beginning in step S11. Or, in an example, assuming that video b has played to progress 1 before the user swipes right on the mobile phone screen in step S8, if the user switches off the remote control interface (such as the preset time threshold) within a very short time (for example, less than or equal to the preset time threshold), Figure 6 (b)) Slide to the large picture interface (as shown in the figure Figure 7 (a)) and then slide back to the remote control interface (as shown in Figure 1). Figure 7 (b) in the figure), the smart TV can continue playing video b from progress 1. If it takes a long time (for example, longer than a preset time threshold) to slide from the remote control interface to the large picture interface and then slide back to the remote control interface, the smart TV can replay video b from the beginning.

[0114] Next, combine Figure 8 This section explains how to mirror a video in the gallery, first entering the gallery interface and then enabling mirroring.

[0115] Figure 8 This is an example diagram showing the process of projecting a video in the gallery in a scenario where you first enter the gallery's large image interface and then turn on mirroring.

[0116] Here, entering the large image interface of the gallery first and then turning on mirroring means that when the mirroring screen of the mobile phone is not turned on, entering the large image interface of a picture or video in the gallery, and then turning on the mirroring screen function of the mobile phone.

[0117] If the mirroring function of the phone is turned on, you can turn off the mirroring function of the phone first, then enter the gallery application, click the thumbnail of video b, and enter Figure 8 The video large image interface shown in Figure (a).

[0118] See Figure 8 ,like Figure 8 As shown in Figure (a), the video large picture interface is displayed on the screen of the mobile phone, and the mirror screen projection (such as wireless projection) of the mobile phone is in a closed state. When the user slides down on the mobile phone screen, the mobile phone responds to the user's sliding operation on the mobile phone screen and displays a drop-down menu interface with a "wireless projection" icon on the screen, as shown in Figure 1. Figure 8 As shown in Figure (b).

[0119] User in Figure 8Touch the "Wireless Screen Mirroring" icon in the drop-down menu shown in Figure (b) to turn on the mirroring screen function. After turning it on, the interface displayed on the phone screen is as follows Figure 8 As shown in Figure (c).

[0120] Then, the phone screen displays Figure 8 The interface shown in Figure (d) is Figure 8 The wireless screen projection dialog box pops up based on the interface shown in Figure (a) (that is, the wireless screen projection dialog box is superimposed on the Figure 8 (As shown in the interface of Figure (a)), the user can select the receiving device for screen projection in the wireless screen projection dialog box. Assuming that the Honor Smart Screen device selected by the user is a smart TV, in response to the user's operation of selecting the receiving device for screen projection in the wireless screen projection dialog box, the mobile phone turns on the wireless screen projection function. The gallery application monitors the broadcast of wireless screen projection and learns that the current wireless screen projection function has been turned on, and the gallery application detects that the current interface is the large video image interface in the gallery. In response to the fact that wireless screen projection is turned on and the current interface is the large video image interface in the gallery, the mobile phone automatically initiates a DLNA connection with the smart TV. At this time, the phone screen displays Figure 8 The "Casting" interface is shown in Figure (e). The "Casting" interface indicates that the phone is connecting to the smart TV through DLNA. Figure 8 Figure (e) shows the same Figure 6 The same as Figure (a), about Figure 8 Please refer to the above description for the detailed description of Figure (e). Figure 6 The description of Figure (a) will not be repeated here.

[0121] Figure 8 The list of available devices in (d) is a list of available screen projection receiving devices. Figure 8 Figure (d) shows only one available device, namely the Honor Smart Screen, but in other embodiments of the present application, there may be multiple available devices in the available device list.

[0122] The phone detects that the DLNA connection is established and the phone screen displays Figure 8 As shown in Figure (f), the phone is in remote control mode, with the remote control and progress bar displayed on the remote control interface. Since the DLNA connection has been established, Figure 8 The remote control and progress bar in Figure (f) are both in a usable state. Figure 8 Please refer to the above description for the detailed description of Figure (f) Figure 6 The description of Figure (b) will not be repeated here.

[0123] The following combination Figure 9 and Figure 10This section explains how to cancel system screen projection when gallery videos are projected via the DLNA protocol.

[0124] Figure 9 This is an example diagram showing the process of canceling system screen projection in the scenario where gallery videos are projected via the DLNA protocol.

[0125] See Figure 9 ,exist Figure 9 In the video large screen playback control state shown in Figure (a), the mobile phone displays the remote control interface, and the remote control interface also displays the wireless screen projection capsule. Figure 9 (a) shows the screen of video b playing on the smart TV. The large-screen video playback control state refers to the state where the phone is casting the screen to the smart TV via DLNA, the remote control interface is displayed on the phone screen, and the user can adjust the playback progress of video b using the remote control or the progress bar on the remote control interface.

[0126] If the user is Figure 9 Touch (for example, click) the wireless screen projection capsule on the interface shown in Figure (a), and the mobile phone responds to the touch operation, cancels the display of the wireless screen projection capsule on the mobile phone screen, and pops up the exit wireless screen projection dialog box, which is displayed on the upper layer of the remote control interface, that is, superimposed on the remote control interface, as shown in FIG. Figure 9 As shown in Figure (b). Figure 9 When you touch the wireless screen projection capsule on the interface shown in Figure (a), the display screen of the smart TV is as follows Figure 10 shown. Figure 10 Schematic diagram of a video b played on a smart TV screen, which is shown as an example. That is, the smart TV can pause the currently playing video and display the frame in the video when it is paused.

[0127] If the user is Figure 9 Touch the "Disconnect" option in the wireless screen projection dialog box on the interface shown in Figure (b). In response to the touch operation, the mobile phone turns off the system's mirroring function and disconnects the DLNA connection with the smart TV. The normal video playback interface is displayed on the mobile phone screen, as shown in the figure below. Figure 9 As shown in Figure (c), there is no wireless screen casting capsule on the video playback interface. In addition, after disconnecting the DLNA connection with the smart TV, the screen casting of video b on the smart TV stops.

[0128] Assume that the user is Figure 9 The moment when the wireless screen casting capsule is touched on the interface shown in Figure (a) is the 12th second of video b (corresponding to the 00:12 moment on the progress bar), then, Figure 9The progress bar of the video playback interface shown in FIG (c) also shows the playback progress of 00:12, and the mobile phone screen continues to play from the 00:12 moment of video b. Of course, in other embodiments of the present application, the mobile phone can also play video b from the beginning. Figure 9 In Figure (c), on the ordinary video playback interface, a pause button and a mute button are added to the progress bar, and the mute button in the figure shows that the current video is playing silently.

[0129] The following combination Figures 11 to 14 This section explains the screen projection process in the scenario of recording multiple screens at once.

[0130] One-shot means that during the process of shooting a video, the video screen is captured to obtain multiple captured pictures, and there is an association between these captured pictures and the video. For the convenience of description, this article refers to this video with captured pictures as one-shot video to distinguish it from ordinary videos. When entering the video large picture state of the one-shot video in the gallery, the thumbnail set of the one-shot video is displayed below the video playback interface, and the thumbnail set includes the video cover and captured pictures of the one-shot video. For example, Figure 11 As shown in Figure (a), when the mobile phone displays the playback interface of video b through the gallery application, the playback interface includes a first display frame for displaying the video b screen, and a toolbar with controls such as sharing and collection. The mobile phone can set a thumbnail set between the first display frame and the toolbar, and the thumbnail set includes a thumbnail of video b and thumbnails of snapshot pictures (such as picture b1 and picture b2). In this embodiment, the large video picture state refers to the state of displaying the playback picture of the video or the cover of the video on the mobile phone screen when the mobile phone has not established a screen projection connection with any device.

[0131] It is assumed herein that video b is a common video in the preceding embodiments, and video b is a multi-recorded video in the following embodiments.

[0132] Figure 11 This is an example interface diagram of the gallery video screen casting process in a scenario where one record and multiple results are obtained. Figure 11 When the system screen projection is not turned on, enter the video large picture interface of video b in the gallery (that is, the playback interface of video b), and the interface displayed on the phone is as follows Figure 11 As shown in Figure (a). On the video large image interface of the video b, thumbnails of the video b are also displayed above the work bar at the bottom of the mobile phone screen. These thumbnails include the video cover of the video b, the snapshot pictures b1 and the snapshot pictures b2 of the video b.

[0133] Next, the user slides down on the mobile phone screen, and the mobile phone responds to the downward sliding operation by displaying a drop-down menu on the mobile phone screen, such as Figure 11 As shown in Figure (b). The user touches the "Wireless Screen Mirroring" icon in the drop-down menu to turn on the mobile phone's system wireless screen mirroring function. For the corresponding interface, please refer to Figure 11 About (b) and (c). Figure 11 For detailed descriptions of FIG. (b) and FIG. (c), please refer to the aforementioned embodiments for Figure 8 The description of Figures (b) and (c) will not be repeated here.

[0134] Then, the phone screen displays Figure 11 The interface shown in Figure (d) is Figure 11 Based on the interface shown in Figure (a), a wireless screen casting dialog box pops up, in which the user can select the receiving device for screen casting. Assuming that the Honor Smart Screen device selected by the user is a smart TV, in response to the user's operation of selecting the receiving device for screen casting in the wireless screen casting dialog box, the mobile phone initiates a DLNA connection with the smart TV.

[0135] During the DLNA connection process, the phone screen displays Figure 11 The "Casting" interface is shown in Figure (e). The "Casting" interface indicates that the phone is connecting to the smart TV through DLNA. Figure 11 Figure (e) shows the same Figure 8 The difference is that Figure 11 The (e) figure also shows the "Ai One-Click Blockbuster" option, as well as Figure 11 Figure (e) also shows a thumbnail of the video b. The "Ai One-Click Blockbuster" option is used to generate a video with preset special effects based on video b.

[0136] After that, the phone detects that the DLNA connection is established and the phone screen displays Figure 11 As shown in Figure (f), the phone now displays the remote control interface, which displays the remote control and a progress bar. Since the DLNA connection has been established, Figure 11 In Figure (f), the remote control and progress bar are both in a usable state. Figure 11 Figure (f) is the same as the above Figure 8 The (f) figure is similar, except that Figure 11 The (f) figure also shows the "Ai One-Click Blockbuster" option, as well as Figure 11 FIG (f) also shows a thumbnail of the video b recorded in multiple ways. At this time, the smart TV displays the playback interface of the video b.

[0137] Figure 12 This is a schematic diagram of the interface during the process of touching the thumbnails of multiple recorded videos in a one-record-multiple-record scenario.

[0138] If the user is Figure 11 In the interface shown in Figure (f), the user touches the picture b1 in the thumbnail, for example, by clicking on the picture b1 in the thumbnail or sliding to the picture b1 in the thumbnail set. In response to the touch operation, the mobile phone displays a large picture interface of the picture b1 on the screen, and the thumbnail of the picture b1 is displayed vertically in the center, as shown in FIG. Figure 12 At this time, when the large picture interface of picture b1 is displayed on the mobile phone screen, the mobile phone displays picture b1 in full screen on the smart TV through the DLNA protocol. The display screen of the smart TV is as follows Figure 13 As shown in Figure (a). Figure 13 for Figure 12 Schematic diagram of the projection screen corresponding to each interface.

[0139] If the user is Figure 12 In the interface shown in Figure (a), touch the cover of video b in the thumbnail, for example, click the cover of video b in the thumbnail or slide to the cover of video b in the thumbnail set, and the mobile phone responds to the touch operation and displays the remote control interface, such as Figure 12 As shown in Figure (b), the phone continues to play the recorded video b on the smart TV via the DLNA protocol while the remote control interface is displayed on the phone. Of course, the phone and smart TV can also play the recorded video b again.

[0140] Figure 12 (b) The progress of the progress bar in the interface shown in Figure 1 is the same as Figure 11 The progress of the progress bar in the interface shown in Figure (f) is the same. That is, in the scenario of recording multiple videos in one go, when switching from the playback interface of the video of one go to the large picture interface of the snapshot of the video of one go, and then switching back to the playback interface of the video of one go, the video is played continuously from the progress before the switch, rather than playing from the beginning. This allows users to have a better screen casting experience in this scenario. Because in the scenario of recording multiple videos in one go, when users switch to the snapshot of the video during the video playback, they usually do not want to exit the video viewing, but just pause it. Therefore, continued playback is usually the playback method that users want. If playing from the beginning, users also need to remember the playback progress or watch it repeatedly, which affects the user experience.

[0141] It should be noted that the non-immersive remote control interface (e.g. Figure 11 (f) shown in the interface or Figure 8When the user taps an empty area on the interface (the area without function icons, options, or virtual buttons), the immersive remote control interface appears on the phone screen. When the user taps an empty area on the immersive remote control interface, the non-immersive remote control interface appears on the phone screen. In other words, by tapping an empty area, the remote control interface on the phone screen can be switched between the non-immersive and immersive states.

[0142] In the non-immersive state, the title bar at the top of the screen and the task bar at the bottom of the screen are displayed in the large picture interface (including the remote control interface). In the immersive state, the title bar at the top of the screen and the task bar at the bottom of the screen are not displayed in the large picture interface (including the remote control interface). Figure 14 The figure is a schematic diagram of a remote control interface in an immersive state.

[0143] It should be noted that in the "Multiple Recording" scenario, the remote control's immersive mode can hide or unlock the thumbnail gallery. In this scenario, the progress bar can move downward after the remote control enters immersive mode to ensure consistency with the remote control interface in standard video casting. Similarly, in this scenario, the progress bar can move upward after the remote control exits immersive mode.

[0144] It should be noted that the remote control interface during the projection process of the video in the gallery and the ordinary video can be the same. Figure 11 The interface shown in Figure (f) and Figure 8 The immersive state interfaces corresponding to the two interfaces shown in Figure (f) can be Figure 14 The interface shown.

[0145] The above is an embodiment of the present application for video screen projection in the gallery. The present application also proposes an embodiment of video screen projection for video applications.

[0146] As mentioned above, the system screen projection through the Cast protocol is mirror projection. The "wireless screen projection" provided by the drop-down menu of the mobile phone is mirror projection, and the screen projection method in various video applications installed on the mobile phone is DLNA (i.e., screen projection through the DLNA protocol). The DLNA screen projection in the video application can be achieved by clicking the screen projection button in the video application (such as Figure 15 ) is turned on.

[0147] Figure 15 This is a schematic diagram of the screen projection process of the video application 1. Figure 15 , Figure 15 Figure (a) shows the playback interface of the video application 1 when the mirror screen is turned on, and the screen casting button and the full screen button are displayed in the interface. Figure 15In the scenario shown in Figure (a), the mobile phone mirrors all the contents on the mobile phone screen to the smart TV.

[0148] In one example, a user Figure 15 In the interface shown in Figure (a), touch (e.g. click) the full screen button. In response to the touch operation, the mobile phone automatically establishes a DLNA connection with the smart TV. After the DLNA connection is established, the mobile phone casts the screen via DLNA, and the smart TV plays the video cast by the mobile phone. After the DLNA connection is established, the remote control interface is displayed in full screen on the mobile phone screen, as shown in the figure below. Figure 15 As shown in Figure (b).

[0149] In another example, the user Figure 15 Based on the interface shown in Figure (a), rotate the phone to landscape mode. In response to the phone being rotated to landscape mode, the phone automatically establishes a DLNA connection with the smart TV. After the DLNA connection is established, the phone casts the screen via DLNA, and the smart TV plays the video cast by the phone. After the DLNA connection is established, the remote control interface is displayed in full screen on the phone screen, as shown in the following example: Figure 15 As shown in Figure (b).

[0150] Figure 15 The arrow in the upper left corner of (b) is the return button. Figure 15 Based on the interface shown in Figure (b), the user clicks the return button, and the phone responds to the operation by popping up a query dialog box on the phone screen. The query dialog box is displayed on Figure 15 The upper layer of the interface shown in Figure (b) of the query dialog box. The "Exit" button and the "Continue" button are displayed in the query dialog box. If the user touches the "Exit" button, the mobile phone responds to the operation of touching the "Exit" button and returns to the mirroring state, that is, the mobile phone continues to play the video on the smart TV in the mirroring mode. If the user touches the "Continue" button, the mobile phone responds to the operation of touching the "Continue" button and continues to play the video in the DLNA mode.

[0151] In another example, Figure 15 Based on the interface shown in Figure (b), the user retreats the video application 1 to the background. In response to the video application 1 retreating to the background, the mobile phone pops up a query dialog box on the mobile phone screen. The query dialog box is displayed on Figure 15 The upper layer of the interface shown in Figure (b) of the query dialog box. The "Exit" button and the "Continue" button are displayed in the query dialog box. If the user touches the "Exit" button, the mobile phone responds to the operation of touching the "Exit" button and returns to the mirroring state, that is, the mobile phone continues to play the video on the smart TV in the mirroring mode. If the user touches the "Continue" button, the mobile phone responds to the operation of touching the "Continue" button and continues to play the video in the DLNA mode.

[0152] As can be seen from the above, the embodiment of the present application enables independent DLNA screen casting entrances for the gallery application and other media applications, which can realize convenient and fast screen casting. At the same time, since the DLNA screen casting method only supports the casting of media files and cannot display other operation content, it can better protect user privacy.

[0153] It should be noted that the various embodiments described above using mobile phones as an example can also be applied to other electronic devices with screen projection functions that support the Cast protocol and DLNA protocol besides mobile phones. Similarly, the receiving device of the screen projection can also be other electronic devices besides smart TVs, and the embodiments of this application are not limited thereto.

[0154] An embodiment of the present application also provides an electronic device, which includes a memory and a processor. The memory is coupled to the processor, and the memory stores program instructions. When the program instructions are executed by the processor, the electronic device performs the screen projection method performed by the aforementioned electronic device.

[0155] It is understandable that, in order to implement the above functions, the electronic device includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0156] This embodiment also provides a computer storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the screen projection method in the above-mentioned embodiment.

[0157] This embodiment also provides a computer program product. When the computer program product runs on a computer, it enables the computer to execute the above-mentioned related steps to implement the screen projection method in the above-mentioned embodiment.

[0158] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the screen projection method in the above-mentioned method embodiments.

[0159] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0160] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0161] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0162] Units described as separate components may or may not be physically separate, and components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0163] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0164] Any content of each embodiment of this application, as well as any content of the same embodiment, can be freely combined. Any combination of the above content is within the scope of this application.

[0165] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0166] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

[0167] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner, or can be implemented by a processor executing a software instruction. The software instruction can be composed of corresponding software modules, and the software module can be stored in a random access memory (Random Access Memory, RAM), a flash memory, a read-only memory (Read Only Memory, ROM), an erasable programmable read-only memory (Erasable Programmable ROM, EPROM), an electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disc (CD-ROM) or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0168] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented using hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. The storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0169] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A screen projection method, characterized in that: include: The electronic device establishes a first screen projection connection with the target device based on the Miracast protocol; The electronic device mirrors a first interface of a gallery application with the target device based on the first screen projection connection, wherein a first thumbnail of a first video and a thumbnail of a first picture are displayed on the first interface, and the thumbnail of the first picture is adjacent to the first thumbnail of the first video; The electronic device receives a first operation of a user on a first thumbnail of the first video; wherein the first operation is an operation of the user touching the first thumbnail; In response to the first operation, the electronic device displays a second interface of a gallery application, where the second interface includes a first control control for the first video, where the first control control is in an unusable state; In response to the first operation, the electronic device establishes a second screen projection connection with the target device based on the Digital Living Network Alliance (DLNA) protocol; The electronic device instructs the target device to display a playback interface of the first video based on the second screen projection connection; After establishing the second screen projection connection, the electronic device switches from the second interface to the third interface of the gallery application, where the third interface includes a second control of the first video, a first video cover, and a first video picture, where the first video picture is a picture captured in the first video, and the second control is a control in a usable state; When a sliding operation of the user on the third interface is detected, the electronic device displays a large image interface of the first image; and, based on the second screen projection connection, the electronic device instructs the target device to display the first image; When the electronic device detects a user's touch operation on the first video picture on the third interface, it displays a large-image interface of the first video picture; wherein the large-image interface of the first video picture includes a second thumbnail of the first video; and, based on the second projection connection, the electronic device instructs the target device to display the first video picture.

2. The method according to claim 1, characterized in that Before the electronic device displays the second interface of the gallery application, the method further includes: The electronic device displays an interface indicating that the second screen projection connection is in progress.

3. The method according to claim 1, characterized in that After the electronic device instructs the target device to display the first image based on the second screen projection connection, the electronic device further includes: In response to a third operation performed by the user on the large-image interface of the first image that is opposite to the sliding operation, the electronic device displays an interface including a second control control of the first video; Based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video.

4. The method according to claim 1, wherein Also includes: In response to a fourth operation of the user on the electronic device, the electronic device disconnects the second screen projection connection and the first screen projection connection with the target device.

5. The method according to claim 4, characterized in that Also includes: The electronic device displays a large image interface of the first video in the gallery application; In response to a fifth operation of the user on the large image interface of the first video, the electronic device displays a drop-down menu; In response to a sixth operation of the user on the wireless screen projection icon in the drop-down menu, the electronic device establishes the second screen projection connection with the target device based on the DLNA protocol; In response to the sixth operation, the electronic device displays a second interface of a gallery application, where the second interface includes control controls for the first video; Based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video.

6. The method according to claim 1, characterized in that After the electronic device instructs the target device to display the playback interface of the first video based on the second screen projection connection, the method further includes: In response to a seventh operation on the wireless screen casting capsule on the interface of the second control control including the first video, the electronic device disconnects the second screen casting connection with the target device; In response to the seventh operation, the electronic device and the target device mirror each other to display the playback interface of the first video.

7. The method according to claim 4, characterized in that Also includes: The electronic device displays a large image interface of the second video in the gallery application, where the large image interface of the second video includes a playback interface of the second video and a thumbnail of the second video, where the thumbnail includes a second picture captured from the second video and a cover of the second video; In response to a fifth operation of the user on the large image interface of the second video, the electronic device displays a drop-down menu; In response to a sixth operation of the user on the wireless screen projection icon in the drop-down menu, the electronic device establishes the second screen projection connection with the target device based on the DLNA protocol; In response to the sixth operation, the electronic device displays a fifth interface of the gallery application, where the fifth interface includes control controls for the second video and a thumbnail of the second video; Based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the second video.

8. The method according to claim 7, characterized in that After the electronic device instructs the target device to display the playback interface of the second video based on the second screen projection connection, the electronic device further includes: In response to an eighth operation performed by the user on the second picture in the thumbnail of the second video on the fifth interface, the electronic device displays a large-image interface of the second picture, where the large-image interface of the second picture displays the thumbnail of the second video; In response to the eighth operation, the electronic device instructs the target device to display the second picture.

9. The method according to claim 8, characterized in that In response to the user performing an eighth operation on the second picture in the thumbnail of the second video on the fifth interface, after the electronic device displays a large picture interface of the second picture, the method further includes: In response to a ninth operation performed by the user on the cover of the second video in the thumbnail of the second video in the large-image interface of the second picture, the electronic device displays the fifth interface, where the fifth interface includes control controls for the second video and the thumbnail of the second video; Based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the second video starting from the first progress, where the first progress is the playback progress of the second video displayed before the electronic device displays the large image interface of the second image.

10. The method according to claim 4, characterized in that Also includes: The electronic device establishes the first screen projection connection with the target device based on the Miracast protocol; The electronic device, based on the first screen projection connection, mirrors and displays the sixth interface of the first video application with the target device, and the sixth interface displays the playback interface of the third video; receiving a tenth operation by the user on the sixth interface; In response to the tenth operation, the seventh interface of the electronic device includes a control control for the third video, the tenth operation is rotating the electronic device to a horizontal state, or the tenth operation is touching a full-screen button on the sixth interface; In response to the tenth operation, the electronic device establishes the second screen projection connection with the target device based on the DLNA protocol; Based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the third video.

11. The method according to claim 10, characterized in that After the electronic device instructs the target device to display the playback interface of the third video based on the second screen projection connection, the electronic device further includes: In response to the user's eleventh operation on the seventh interface, the electronic device disconnects the second screen projection connection with the target device, and the eleventh operation is returning to the previous interface, or the eleventh operation is retreating the first video application to the background; In response to the eleventh operation, the electronic device and the target device mirror-display the third video.

12. The method according to claim 11, characterized in that Before the electronic device disconnects the second screen projection connection with the target device, the method further includes: The electronic device displays a query dialog box superimposed on the seventh interface, wherein the query dialog box includes a first button for instructing to exit DLNA screen projection; In response to the user touching the first button, the electronic device disconnects the second screen projection connection with the target device.

13. The method according to claim 1, wherein The electronic device instructing the target device to display a playback interface of the first video based on the second screen projection connection, including: Based on the second screen projection connection, the electronic device instructs the target device to start displaying the playback interface of the first video from the beginning.

14. The method according to claim 1, wherein Also includes: receiving a twelfth operation of a control control on the first video by the user, wherein the twelfth operation is used to adjust the playback progress of the first video to a second progress; Based on the second screen projection connection, the electronic device instructs the target device to display the playback interface of the first video from the second progress.

15. A screen projection system, characterized in that: The device comprises a first electronic device and a second electronic device, wherein: The first electronic device is used to Establishing a first screen projection connection with a second electronic device based on the Miracast protocol; Based on the first screen projection connection, mirroring the first interface of the gallery application with the second electronic device, where the first interface displays a first thumbnail of the first video and a thumbnail of the first picture, and the thumbnail of the first picture is adjacent to the first thumbnail of the first video; Receiving a first operation of a user on a first thumbnail of the first video; wherein the first operation is an operation of the user touching the first thumbnail; In response to the first operation, displaying a second interface of the gallery application, the second interface including a first control control for the first video, the first control control being in an unusable state; In response to the first operation, establishing a second screen projection connection with the second electronic device based on the Digital Living Network Alliance (DLNA) protocol; Based on the second screen projection connection, instructing the second electronic device to display a playback interface of the first video; After establishing the second screen projection connection, switching from the second interface to the third interface of the gallery application, the third interface includes the second control control of the first video, the first video cover and the first video picture, the first video picture is a picture captured in the first video, and the second control control is a control control in a usable state; When a sliding operation of the user on the third interface is detected, a large image interface of the first image is displayed; and based on the second screen projection connection, the second electronic device is instructed to display the first image; Upon detecting a user touch operation on the first video image on the third interface, displaying a large image interface of the first video image; wherein the large image interface of the first video image includes a second thumbnail of the first video; and, based on the second screen projection connection, instructing the second electronic device to display the first video image; The second electronic device is configured to: After establishing the first screen projection connection with the first electronic device based on the Miracast protocol, mirroring and displaying the first interface of the gallery application of the first electronic device based on the first screen projection connection; After establishing the second screen projection connection with the first electronic device based on the DLNA protocol, displaying a playback interface of the first video based on the second screen projection connection; After establishing the second screen projection connection with the first electronic device based on the DLNA protocol, displaying the first picture based on the second screen projection connection; After establishing the second screen projection connection with the first electronic device based on the DLNA protocol, the first video picture is displayed based on the second screen projection connection.

16. An electronic device, characterized in that: include: a memory and a processor, the memory being coupled to the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the screen projection method described in any one of claims 1-14.

17. A computer-readable storage medium comprising a computer program, characterized in that When the computer program runs on an electronic device, the electronic device executes the screen projection method as described in any one of claims 1 to 14.

Images