Screen projection display method and electronic equipment

Abstract

The invention provides a screen projection display method and electronic equipment, and relates to the technical field of screen projection, in the process of screen projection from first electronic equipment to second electronic equipment, different-source screen projection can be quickly switched to homologous screen projection without disconnecting the connection between the first electronic equipment and the second electronic equipment, the user operation is simplified, and the user experience is improved. And the man-machine interaction efficiency is improved. According to the specific scheme, a first electronic device displays a first screen projection interface, the first screen projection interface comprises a preset function control and first screen projection content projected by a second electronic device, and the first screen projection content is different from content displayed on a display screen of the second electronic device; in response to the triggering operation on the preset function control, the first electronic equipment sends a switching request to the second electronic equipment and sends a reverse control instruction; the first electronic equipment displays a second projection screen interface, the second projection screen interface comprises second projection screen content projected by the second electronic equipment, and the second projection screen content is the same as the content of the second interface.

Description

[0001] This application is a divisional application. The application number of the original application is 202310809333.8, and the original application date is 2023.06.30. The entire content of the original application is incorporated into this application by reference. Technical Field

[0002] The embodiments of the present application relate to the field of screen projection technology, and in particular to a screen projection display method and electronic device. Background Art

[0003] With the development of electronic technology and mobile Internet, a user can have more electronic devices such as mobile phones, tablet computers, personal computers (PCs), smart home devices (such as TVs), etc. Among them, multiple electronic devices of a user can be interconnected. For example, a user's mobile phone and PC can be connected, and the screen content of the mobile phone can be projected on the PC to show the advantages of a large screen.

[0004] In the above example, the mobile phone projects the screen to the PC. The mobile phone can support two screen projection modes: heterogeneous screen projection and homogeneous screen projection. When the user uses the mobile phone to project the screen from heterogeneous sources, if the user wants to switch from heterogeneous screen projection to homogeneous screen projection, the user needs to manually disconnect the heterogeneous homogeneous screen projection, and then use the mobile phone to establish the homogeneous screen projection connection with the PC. The operation is complicated and the human-computer interaction efficiency is low. Summary of the invention

[0005] The embodiments of the present application provide a screen projection and display method and an electronic device. During the process of projecting the screen from a first electronic device to a second electronic device, it is possible to quickly switch from heterogeneous screen projection to homogeneous screen projection without disconnecting the connection between the first electronic device and the second electronic device, thereby simplifying user operations and improving human-computer interaction efficiency.

[0006] In a first aspect, a screen projection display method is provided, which is applied to a first electronic device, and the method includes: the first electronic device displays a first screen projection interface, the first screen projection interface includes preset function controls and first screen projection content projected by a second electronic device, and the first screen projection content is different from the content displayed on the display screen of the second electronic device, that is, the screen projection mode of the first electronic device and the second electronic device is heterogeneous same screen.

[0007] The first electronic device receives a trigger operation of a preset function control by a user; in response to the trigger operation, the first electronic device sends a switching request to the second electronic device and sends a reverse control instruction; wherein the reverse control instruction corresponds to the preset function control and is used to trigger the second electronic device to display a second interface on the display screen of the second electronic device.

[0008] The first electronic device displays a second projection interface, which includes second projection content projected by the second electronic device. The second projection content is the same as the content of the second interface, that is, the projection method of the first electronic device and the second electronic device is the same source projection.

[0009] To sum up, according to the solution of the present application, since a preset function control is set on the first screen projection interface of the first electronic device, when the user's trigger operation acts on the preset function control, during the screen projection process between the first electronic device and the second electronic device, the screen projection can be quickly switched from heterogeneous source projection to homogeneous source projection, which simplifies user operation and improves human-computer interaction efficiency.

[0010] Optionally, the preset function control may be a control at a fixed position in the first projection interface of the first electronic device.

[0011] Optionally, the preset function control may be a floating window, a floating button or a floating icon displayed on the first projection interface of the first electronic device.

[0012] In a possible implementation of the first aspect, the first projection content is the same as the content drawn on the virtual display of the second electronic device. That is, the second electronic device projects the content drawn on the virtual display onto the first electronic device, so that the first electronic device displays the first projection content on the first projection interface.

[0013] In a possible implementation of the first aspect, the first projection screen interface includes a navigation bar, and the navigation bar includes a Home key and a Recent key; when the preset function control is the Home key, the reverse control instruction corresponds to the Home key. In this way, after the second electronic device receives the reverse control instruction, the main interface is displayed on the display screen of the second electronic device.

[0014] Alternatively, when the preset function control is the Recent key, the reverse control instruction corresponds to the Recent key. In this way, after the second electronic device receives the reverse control instruction, the main interface is displayed on the display screen of the second electronic device.

[0015] Optionally, the navigation bar also includes a Back key; when the preset function control is the Back key, the reverse control instruction corresponds to the Back key. In this way, after the second electronic device receives the reverse control instruction, it is displayed on the display screen of the second electronic device, and the first electronic device returns from the current projection interface to the last projection interface.

[0016] Optionally, when the user's trigger operation acts on the preset function control, the first electronic device can send a switching request to the second electronic device without sending a reverse control instruction. In this way, after receiving the switching request, the second electronic device draws the content of the current interface on the virtual display and projects the content drawn on the virtual display to the first electronic device.

[0017] In a possible implementation of the first aspect, before the first electronic device sends a reverse control instruction to the second electronic device, the method also includes: the first electronic device receives a notification message from the second electronic device, where the notification message is used to instruct the second electronic device to switch from heterogeneous screen projection to homogeneous screen projection.

[0018] In a second aspect, a screen projection display method is provided, which is applied to a second electronic device. The method includes: the second electronic device sends a first screen projection content to the first electronic device, and the first screen projection content is different from the content of the first interface displayed on the display screen of the second electronic device, that is, the screen projection method of the second electronic device and the first electronic device is heterogeneous screen projection.

[0019] The second electronic device receives a switching request from the first electronic device, and receives a reverse control instruction from the first electronic device; in response to the reverse control instruction, the second electronic device displays a second interface on a display screen.

[0020] In response to the switching request, the second electronic device sends a second projection screen content to the first electronic device. The second projection screen content is the same as the content of the second interface, that is, the projection mode of the second electronic device and the first electronic device is the same source projection.

[0021] To summarize, using the solution of the present application, after the second electronic device receives a switching request from the first electronic device and receives a reverse control instruction from the first electronic device, the second electronic device first displays the second interface on the display screen, and then projects the content of the second interface (i.e., the second projection content) to the first electronic device; in this way, during the screen projection process between the first electronic device and the second electronic device, it is possible to quickly switch from heterogeneous screen projection to homogeneous screen projection, which simplifies user operations and improves human-computer interaction efficiency.

[0022] In a possible implementation of the second aspect, the second electronic device sends the first screen projection content to the first electronic device, including: the second electronic device receives a screen projection request from the first electronic device, where the screen projection request is used to request the second electronic device to project the screen to the first electronic device.

[0023] In response to the screen projection request, the second electronic device creates a virtual display and moves the interface of the target application to the virtual display for drawing; wherein the configuration information of the virtual display includes: the screen projection mode corresponding to the virtual display is heterogeneous screen projection, and homogeneous screen projection is allowed.

[0024] The second electronic device sends the first screen projection content to the first electronic device based on the content drawn on the virtual display.

[0025] In this implementation, since the second electronic device sets the corresponding configuration information when creating the virtual display, that is, the projection mode of the virtual display is set to heterogeneous projection and homogeneous projection is allowed, the second electronic device can switch from heterogeneous projection to homogeneous projection.

[0026] In a possible implementation of the second aspect, after the second electronic device creates a virtual display, the method further includes: the second electronic device sets a first flag, and the first flag is used to indicate that the screen projection mode of the second electronic device and the first electronic device is heterogeneous screen projection.

[0027] In a possible implementation of the second aspect, after the second electronic device receives a switching request from the first electronic device, the method further includes: the second electronic device stacks the content of the interface of the target application drawn on the virtual display to the display screen of the second electronic device; the second electronic device modifies the first flag bit to a second flag bit, and the second flag bit is used to indicate that the screen projection mode of the second electronic device and the first electronic device is the same source screen projection.

[0028] In a possible implementation of the second aspect, the method also includes: the second electronic device performs a first operation after creating a virtual display; wherein the first operation includes: the second electronic device determines, based on an identifier of the virtual display, that the virtual display is a display corresponding to heterogeneous screen projection; and, when the display screen of the second electronic device is locked, the virtual display is not locked, thereby prohibiting the screen projection interface of the first electronic device from being in a locked state.

[0029] In a possible implementation of the second aspect, before the second electronic device receives a reverse control instruction from the first electronic device, the method also includes: the second electronic device sends a notification message to the first electronic device, where the notification message is used to instruct the second electronic device to switch from heterogeneous screen projection to homogeneous screen projection.

[0030] According to a third aspect, a screen projection display method is provided, which is applied to a system including a first electronic device and a second electronic device, the method including: the first electronic device receives first screen projection content from the second electronic device, and displays a first screen projection interface, the first screen projection interface including preset function controls and first screen projection content, and the first screen projection content is different from the content of the first interface displayed on the display screen of the second electronic device.

[0031] The first electronic device receives a trigger operation of a preset function control by a user; in response to the trigger operation, the first electronic device sends a switching request to the second electronic device and sends a reverse control instruction, which corresponds to the preset function control.

[0032] In response to the reverse control instruction, the second electronic device displays a second interface on the display screen; in response to the switching request, the second electronic device sends the second projection content to the first electronic device; the second electronic device displays the second projection interface, the second projection interface includes the second projection content, and the second projection content is the same as the content of the second interface.

[0033] In a possible implementation manner of the third aspect, the first projection content is the same as the content drawn by the second electronic device on the virtual display.

[0034] In a possible implementation of the third aspect, the first projection interface includes a navigation bar, the navigation bar includes a Home key and a Recent key; the preset function control is the Home key, and the second interface is the main interface; or, the preset function control is the Recent key, and the second interface is a multi-tasking interface.

[0035] In a possible implementation of the third aspect, a first electronic device sends a reverse control instruction to a second electronic device, including: a notification message from the second electronic device to the first electronic device, the notification message being used to instruct the second electronic device to switch from heterogeneous screen projection to homogeneous screen projection; in response to the notification message, the first electronic device sends a reverse control instruction to the second electronic device.

[0036] In a fourth aspect, an electronic device is provided, which has the function of implementing any one of the methods in the first aspect, and the function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0037] In a fifth aspect, an electronic device is provided, comprising: a memory and one or more processors, the memory being used to store computer-executable instructions, and when the electronic device is running, the processor executes the computer-executable instructions stored in the memory so that the electronic device executes any of the methods described in the first aspect above; or, executes any of the methods described in the second aspect above.

[0038] In a sixth aspect, a screen projection display system is provided, comprising: a first electronic device for executing any one of the methods in the first aspect above, and a second electronic device for executing any one of the methods in the second aspect above.

[0039] In a seventh aspect, a chip system is provided, which is applied to the electronic device described in the fourth aspect or the fifth aspect. The chip system includes a processor and an interface, wherein the interface is used to receive instructions and transmit them to at least one processor; at least one processor executes the instructions so that the electronic device executes the method described in any one of the first aspects above; or executes the method described in any one of the second aspects above.

[0040] In an eighth aspect, a computer-readable storage medium is provided, wherein instructions are stored in the computer-readable storage medium, and when the computer-readable storage medium is run on a computer, the computer can execute any of the methods described in the first aspect above; or, execute any of the methods described in the second aspect above.

[0041] In a ninth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute any of the methods described in the first aspect; or, to execute any of the methods described in the second aspect.

[0042] Among them, the technical effects brought about by any implementation method in the above-mentioned third to ninth aspects can refer to the technical effects brought about by different implementation methods in the first or second aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Figure 1A A schematic diagram of an interface in a heterogeneous screen projection scenario provided in an embodiment of the present application;

[0044] Figure 1B A schematic diagram of an interface in another heterogeneous screen projection scenario provided in an embodiment of the present application;

[0045] Figure 1C A schematic diagram of an interface in another heterogeneous screen projection scenario provided in an embodiment of the present application;

[0046] Figure 1D A schematic diagram of an interface in a same-source screen projection scenario provided in an embodiment of the present application;

[0047] Figure 2A A schematic diagram of an interface for establishing heterogeneous screen projection provided in an embodiment of the present application;

[0048] Figure 2B A schematic diagram of another interface for establishing heterogeneous screen projection provided in an embodiment of the present application;

[0049] Figure 2C A schematic diagram of an interface for switching from heterogeneous screen projection to homogeneous screen projection provided in an embodiment of the present application;

[0050] Figure 2D Another schematic diagram of an interface for switching from heterogeneous screen projection to homogeneous screen projection provided in an embodiment of the present application;

[0051] Figure 3 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0052] Figure 4 A schematic diagram of a software framework of an electronic device provided in an embodiment of the present application;

[0053] Figure 5A A schematic diagram of a flow chart of a screen projection display method provided in an embodiment of the present application;

[0054] Figure 5B A schematic diagram of a process for establishing heterogeneous screen projection provided in an embodiment of the present application;

[0055] Figure 6 A schematic diagram of another process of establishing heterogeneous screen projection provided in an embodiment of the present application;

[0056] Figure 7 A schematic diagram of another process of establishing heterogeneous screen projection provided in an embodiment of the present application;

[0057] Figure 8 A schematic diagram of a process of switching from heterogeneous screen projection to homogeneous screen projection provided in an embodiment of the present application;

[0058] Fig. 9 Another schematic diagram of a process of switching from heterogeneous screen projection to homogeneous screen projection provided in an embodiment of the present application;

[0059] Fig.10 A schematic diagram of the structure of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0060] In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or. For example, A / B can mean A or B. The “and / or” in this article is merely a way to describe the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0061] The following terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more.

[0062] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0063] The present application embodiment provides a screen projection system, such as Figure 1A or Figure 1B As shown, the screen projection system 100 may include a remote device 101 and a local device 102. The remote device 101 may be a second electronic device, and the local device 102 may be a first electronic device.

[0064] The remote device 101 and the local device 102 can establish a connection via wired or wireless means. Based on the established connection, the remote device 101 and the local device 102 can be used together. Specifically, the remote device 101 can be used as a screen projection device, and the local device 102 is the screen projection device; the remote device 101 can project the screen content of the remote device 101 to the local device 102 for display through the screen projection application.

[0065] In a specific implementation, the remote device 101 can be a mobile phone, tablet computer, handheld computer, PC, cellular phone, personal digital assistant (PDA), wearable device (such as smart watch), smart home device (such as TV), car computer, game console, and augmented reality (AR) / virtual reality (VR) device and other devices including display screens. The local device 202 can be a mobile phone, tablet computer, laptop computer, PC, smart TV, projector and other devices including display screens. It should be noted that the device forms of the remote device 101 and the local device 102 can be the same or different. For example, Figure 1A As shown, the remote device 101 may be a mobile phone, and the local device 102 may be a laptop computer. Figure 1BAs shown, the remote device 101 may be a mobile phone, and the local device 102 may be a tablet computer. For another example, the remote device 101 and the local device 102 are both mobile phones.

[0066] Generally speaking, the local device 102 is a large-screen device, while the remote device 101 has a smaller screen size. Figure 1A The screen size of the local device 102 (such as a laptop) is shown to be larger than the screen size of the remote device 101 (such as a mobile phone). Figure 1B The screen size of the local device 102 (such as a tablet computer) is shown to be larger than the screen size of the remote device 101 (such as a mobile phone). In this way, the remote device 101 projects the screen content onto the local device 102 for display, which can not only reduce the impact of the screen size limitation of the remote device 101 on the user's visual experience, but also reflect the advantages of a large screen.

[0067] In the embodiment of the present application, when the remote device 101 and the local device 202 establish a connection in a wireless manner, the wireless communication protocol adopted may be a Wi-Fi protocol, a Bluetooth protocol, a ZigBee protocol, a near field communication (NFC) protocol, various cellular network protocols, etc., which are not specifically limited here. The wired connection between the remote device 201 and the local device 102 may include: a universal serial bus (USB) connection and a high definition multimedia interface (HDMI). In the following embodiments, the method of the embodiment of the present application is introduced by taking the remote device 101 and the local device 102 establishing a connection in a wireless manner as an example.

[0068] The above-mentioned remote device 101 and local device 102 can be touch screen devices or non-touch screen devices. In the embodiment of the present application, the remote device 101 and the local device 102 are terminals that can run operating systems, install applications, and have displays (or display screens). Among them, the operating systems of the remote device 101 and the local device 102 can be Android systems, iOS systems, Windows systems, Mac systems, Linux systems, etc., and the embodiments of the present application do not make specific restrictions here. The operating systems of the remote device and the local device can be the same or different.

[0069] The embodiment of the present application provides a screen projection display method, which can be applied to the above-mentioned screen projection system. Through this method, in the process of screen projection from the remote device 101 to the local device 102, it is possible to quickly switch from heterogeneous screen projection to homogeneous screen projection without disconnecting the connection established between the remote device 101 and the local device 102, thereby simplifying user operations and improving human-computer interaction efficiency.

[0070] The following embodiments introduce homologous screen projection and heterologous screen projection in detail.

[0071] (1) Same source screen projection.

[0072] Same-source screen projection refers to mirroring the remote device 101 to the local device 102. In the same-source screen projection scenario, the display content of the screen projection window displayed by the local device 102 is the same as the content of the display interface of the remote device 101. In some embodiments, same-source screen projection can also be called mirror screen projection, full sharing screen projection, wireless display, etc.

[0073] For example, Figure 1A As shown, the display content of the projection window 110 displayed by the laptop (i.e., the local device 102) is the same as the content of the display interface of the mobile phone (i.e., the remote device 101). Figure 1B As shown, the display content of the screen projection window 120 displayed by the tablet computer (ie, the local device 102) is the same as the content of the display interface of the mobile phone (ie, the remote device 101). Figure 1C As shown, the display content of the projection window 130 displayed by the tablet computer (ie, the local device 102 ) is the same as the content of the display interface of the mobile phone (ie, the remote device 101 ).

[0074] Among them, the same-source screen projection described in the embodiment of the present application can specifically include the following three situations. In each case, the display content of the screen projection window displayed by the local device 102 is the same as the content of the display interface of the remote device 101.

[0075] Case (1):

[0076] The remote device 101 projects its screen to the local device 102 in landscape mode, and the local device 102 displays the projection window of the remote device 101 in a small window.

[0077] For example, Figure 1A As shown, the mobile phone is in landscape mode and the screen is projected onto the laptop computer. Figure 1A In the embodiment, the laptop computer displays the projection window 110 of the mobile phone in a small window, and the display content of the projection window 110 is the same as the content of the display interface of the mobile phone.

[0078] It should be noted that the local device 102 displays the projection window of the remote device 101 in a small window, which specifically means that the projection window occupies a part of the screen of the local device 102, and the other part of the screen displays the UI interface of the local device 102. Figure 1A As shown, a portion of the laptop screen is used to display the projection window 110, and another portion of the screen is used to display the desktop of the laptop.

[0079] It should be noted that the screen size of the local device 102 may be different from the screen size of the remote device 101, resulting in a different aspect ratio of the screen of the local device 102 and the screen of the remote device 101. Therefore, the local device 102 displays the projection content of the remote device 101 in full screen according to the aspect ratio of the screen of the remote device 101, which may cause distortion of the projection content. In the same-source projection scenario, the local device 102 displays the projection window of the remote device 101 in a small window, which can avoid the problem of distortion of the projection content in the projection window displayed by the local device 102 and ensure the user's visual experience during the projection process.

[0080] Case (2):

[0081] The remote device 101 projects its screen to the local device 102 in landscape mode, and the local device 102 displays the projection window of the remote device 101 in full window.

[0082] For example, Figure 1B As shown, the mobile phone is in landscape mode and the screen is projected onto the tablet computer. Figure 1B In the embodiment, the tablet computer displays the projection window 120 of the mobile phone in a full window, and the display content of the projection window 120 is the same as the content of the display interface of the mobile phone.

[0083] It should be noted that the local device 102 displays the projection window of the remote device 101 in full window, which specifically means that the projection window occupies the entire screen of the local device 102. Figure 1B As shown, the entire screen of the tablet computer is used to display the projection window 120.

[0084] It should be noted that, although the screen size of the local device 102 may be different from that of the remote device 101; however, the aspect ratio of the screen of the local device 102 may be similar to that of the screen of the remote device 101. For example, the aspect ratio of the screen of a tablet computer is similar to that of the screen of a mobile phone. Therefore, even if the local device 102 displays the projection content of the remote device 101 in full screen according to the aspect ratio of the screen of the remote device 101, there will be no problem of distortion of the projection content. Therefore, in the same-source projection scenario, the local device 102 can display the projection window of the remote device 101 in full window, and the user's visual experience during the projection process can still be guaranteed.

[0085] Case (3):

[0086] The remote device 101 projects its screen to the local device 102 in portrait mode, and the local device 102 displays the projection window of the remote device 101 in a small window.

[0087] For example, Figure 1C As shown, the mobile phone is in portrait mode and the screen is projected onto the tablet computer. Figure 1C In the embodiment, the tablet computer displays the projection window 130 of the mobile phone in a small window, and the display content of the projection window 130 is the same as the content of the display interface of the mobile phone.

[0088] It should be noted that in the same-source screen projection scenario, when the remote device 101 is in portrait mode, the local device 102 displays the projection window of the remote device 101 in a small window, which can avoid the problem of distortion of the projection content in the projection window displayed by the local device 102, and can ensure the user's visual experience during the screen projection process.

[0089] (2) Screen projection from different sources.

[0090] Heterogeneous screen projection refers to the remote device 101 generating a virtual display, generating (such as drawing and rendering) new projection data based on the virtual display, and transmitting the projection data to the local device 102. In other words, the projection window of the local device 102 only displays the projection content of the virtual display, and does not mirror the content of the main display screen of the remote device 101. In the heterogeneous screen projection scenario, the display content of the projection window displayed by the local device 102 is different from the content of the display interface on the main display screen of the remote device 101.

[0091] In some embodiments, heterogeneous screen projection can also be called application projection, network projection, online projection, digital living network alliance (DLAN) projection, non-mirror projection, etc.

[0092] For example, Figure 1D As shown, the mobile phone is in portrait mode and the screen is projected onto the tablet computer. Figure 1D In the embodiment, the tablet computer displays the projection window 140 of the mobile phone in full window, and the mobile phone displays the main interface. The display content of the projection window 140 is different from the content of the display interface of the mobile phone.

[0093] For example, after receiving the screen projection instruction, the mobile phone generates a virtual display and draws the content to be projected on the virtual display. Then, the mobile phone projects the content drawn on the virtual display to the tablet computer. After the tablet computer receives the content projected by the mobile phone, it can display Figure 1DThe projection window 140 is shown.

[0094] The screen projection command received by the mobile phone may be sent by the tablet computer or generated by the mobile phone itself. Figure 2A In the scenario shown, in response to the user clicking on "Notification Message 1", the tablet computer sends a screen projection instruction to the mobile phone to trigger the mobile phone to project the screen to the tablet computer using a heterogeneous screen projection method.

[0095] For example, in Figure 2B In the scenario shown, in response to the user's multi-finger swipe up operation, the mobile phone generates a screen projection instruction, which is used to instruct the mobile phone to project the screen to the tablet computer using a heterogeneous screen projection method.

[0096] In the heterogeneous screen projection scenario, the interface content displayed by the mobile phone is different from the content displayed in the projection window 140. For example, the mobile phone can display the main interface, or the mobile phone can display any application in one or more applications that have been recently run and not closed. Figure 1D As shown, the mobile phone can display the main interface.

[0097] Among them, when the user is using the electronic device, the electronic device may be in a horizontal screen state or a vertical screen state. The embodiments of the present application introduce the horizontal screen state and the vertical screen state of the electronic device. The display screen of the electronic device (including the folding screen in the unfolded state) may include four sides, including two longer sides that are parallel and equal to each other, which can be called the long sides of the display screen; the four sides also include two shorter sides that are parallel and equal to each other, which can be called the short sides of the display screen.

[0098] In the horizontal screen state, the long side of the display screen of the electronic device is parallel to the horizontal plane (that is, the angle between the long side of the display screen and the horizontal plane is 0), or the angle between the long side of the display screen and the horizontal plane is less than or equal to a preset value. In the vertical screen state, the long side of the display screen of the electronic device is substantially perpendicular to the horizontal plane, or the angle between the long side of the display screen and the horizontal plane is greater than a preset value. Among them, the preset value is less than or equal to 45°, and the specific value of the preset value can be set according to the actual application scenario. For example, the preset value can be 20°.

[0099] In the horizontal screen state, the display screen of the electronic device is basically in the shape of a horizontal strip; the height of the display screen of the electronic device is smaller than its width, and the aspect ratio of the display screen (i.e., the ratio of height to width) is less than 1. In the vertical screen state, the display screen of the electronic device is basically in the shape of a vertical strip; the height of the display screen of the electronic device is larger than its width, and the aspect ratio of the display screen (i.e., the ratio of height to width) is greater than 1.

[0100] The height of the display screen is the length of the side of the display screen with the larger angle with the horizontal plane, and the width of the display screen is the length of the side of the display screen with the smaller angle with the horizontal plane. The height of the display screen can also be understood as the longitudinal length of the display screen, the width of the display screen can also be understood as the lateral length of the display screen, and the aspect ratio of the display screen can also be understood as the aspect ratio of the display screen (i.e., the ratio of the longitudinal length to the lateral length).

[0101] The following embodiments describe in detail the scenario of quickly switching from heterogeneous screen projection to homogeneous screen projection.

[0102] It is understandable that in the heterogeneous screen projection scenario, the projection window of the local device 102 only displays the projection content of the virtual display, and will not mirror the content of the main display screen of the remote device 101. In other words, the projection window of the local device 102 only displays the projection interface for a certain application in the remote device 101 (such as a news interface, a video interface, etc.). In this case, in the relevant technology, if the user wants to view the UI interface of other applications of the remote device 101 on the local device 102, the user needs to first disconnect the heterogeneous screen projection connection established between the remote device 101 and the local device 102, and then re-establish the homogeneous screen projection connection between the remote device 101 and the local device 102.

[0103] For example, the projection window of the local device 102 displays the UI interface of the "instant messaging application", and the user chats with the contact on this UI interface. After the chat, when the user wants to use the local device 102 to open the browser application of the remote device 101 and query related information, the user needs to first disconnect the heterogeneous projection connection established between the remote device 101 and the local device 102, and then re-establish the homogeneous projection connection. In the homogeneous projection scenario, the user can open the browser application of the remote device 101 through the projection window displayed by the local device 102 and query related messages.

[0104] For another example, the projection window of the local device 102 displays the UI interface of the "News Application". When the user browses a certain news message, he wants to share the news message with contacts through the "Instant Messaging Application" of the remote device 101. In this case, the user needs to first disconnect the heterogeneous projection connection established between the remote device 101 and the local device 102, and then re-establish the homogeneous projection connection. In the homogeneous projection scenario, the user can open the "Instant Messaging Application" of the remote device 101 through the projection window displayed by the local device 102 to share the news message with the corresponding contacts.

[0105] In the above scenario, in order to meet the needs of users and improve the user experience of using the screen projection function, in the process of projecting the screen from the remote device 101 to the local device 102, there is an urgent need for a solution that can quickly switch from heterogeneous screen projection to homogeneous screen projection.

[0106] It should be noted that, based on the scenario involved in this embodiment, the remote device 101 and the local device 102 first perform screen projection through heterogeneous screen projection. Exemplarily, the remote device 101 can use Wi-Fi connection, Bluetooth connection, NFC communication, USB connection, HDMI connection and other methods to achieve heterogeneous screen projection with the local device 102. The following lists two specific implementation processes of heterogeneous screen projection between the remote device 101 and the local device 102.

[0107] Among them, the remote device 101 and the local device 102 can use the following two methods to achieve heterogeneous screen projection.

[0108] Method (1) uses Wi-Fi or Bluetooth connection to perform screen projection:

[0109] The remote device 101 and the local device 102 log in to the same device account, then turn on the function switch corresponding to "Notification Sharing" in the remote device 101, ensure that the Wi-Fi, Bluetooth, etc. of the remote device 101 are turned on, and turn on the switch of the application that needs to share the notification at the same time. In this way, the notification message received by the remote device 101 will be shared with the local device 102. In response to the user's click operation on the notification message on the local device 102, the remote device 101 establishes a connection with the local device 102 and pulls up the heterogeneous screen projection. That is, the remote device 101 uses the heterogeneous screen projection method to project the screen to the local device 102.

[0110] For example, Figure 2A As shown, after the mobile phone (i.e., remote device 101) and the laptop computer (i.e., local device 102) establish a "notification sharing" connection, the laptop computer can receive notification messages from the mobile phone. Figure 2A As shown, after the laptop receives the notification message 1 from the mobile phone, in response to the user's click operation on the notification message 1, the laptop displays a projection window 210. The projection window 210 includes the UI interface of the instant messaging application projected by the mobile phone. The user can chat with the contact Sam in the UI interface.

[0111] It is understandable that in the heterogeneous screen projection scenario, the mobile phone may not display the display content of the screen projection window 210. In this case, the mobile phone may display the main interface, or the mobile phone may display any application of one or more applications that have been recently run and not closed. Figure 2A As shown, the mobile phone can display the main interface.

[0112] Method (2): Use NFC connection to perform screen projection from different sources:

[0113] When the remote device 101 is close to the local device 101, in response to the user's operation for triggering the establishment of a heterogeneous screen projection connection, such as a multi-finger upward swipe operation, the remote device 101 establishes a connection with the local device 102 and starts the heterogeneous screen projection. That is, the remote device 101 projects the screen to the local device 102 in a heterogeneous screen projection manner.

[0114] For example, Figure 2B As shown, the mobile phone (i.e., the remote device 101) displays the UI interface of the "real-time news application". When the mobile phone is close to the laptop (i.e., the local device 102), in response to the user's multi-finger upward swipe operation on the mobile phone screen, the mobile phone projects the UI interface of the "real-time news application" onto the laptop's screen projection window 310 by drawing it on the virtual display. Since the screen projection method of the mobile phone and the laptop is heterogeneous screen projection. In this case, the mobile phone can exit the UI interface of the "real-time news application", for example, Figure 2B As shown, the mobile phone can display the main interface.

[0115] The following takes the heterogeneous screen projection scenarios involved in the above-mentioned methods (1) and (2) as an example to introduce in detail the specific implementation method of switching from heterogeneous screen projection to homogeneous screen projection.

[0116] Exemplarily, a preset function control may be set in the screen projection window displayed on the local device 102. The preset function control is used to trigger the screen projection mode of the mobile phone and the laptop to switch from heterogeneous screen projection to homogeneous screen projection. The preset function control may be a control displayed at a fixed position in the screen projection window of the local device 102. Alternatively, the preset function control may be a floating window, a floating button, or a floating icon displayed in the screen projection window of the local device 102.

[0117] Among them, the preset function controls displayed in the projection window of the local device 102 in the form of a floating window, a floating button or a floating icon can be semi-transparent. In this way, the visual interference of the preset function controls to the user can be reduced, and the user experience can be improved.

[0118] In some embodiments, the projection window also displays a navigation bar. Alternatively, in other embodiments, the projection window also displays a title bar. Figure 2A and Figure 2B As shown, a navigation bar 212 and a title bar 213 are displayed in the projection window 210 and the projection window 310 .

[0119] It should be noted that the navigation bar usually refers to the shortcut button bar at the bottom of the mobile phone screen, which usually appears at the bottom of the mobile phone screen in the form of virtual buttons. The navigation bar contains three buttons by default: Back button, Home button, and Recent button. The Back button is used to return to the previous interface, the Home button is used to return to the desktop, and the Recent button is used to display the recently used applications.

[0120] In this implementation, if Figure 2A and Figure 2B As shown, the navigation bar is not displayed at the bottom of the mobile phone screen, and the projection window 210 and the projection window 310 displayed by the laptop computer display a navigation bar 212. In other words, the navigation bar 212 is not drawn in the virtual display of the mobile phone. The Back button displayed in the navigation bar 212 can be Figure 2A and Figure 2B The triangular virtual button shown, the Home button can be Figure 2A and Figure 2B The circular virtual key shown, the Recent key can be Figure 2A and Figure 2B The rectangular button shown.

[0121] In some embodiments, Figure 2A and Figure 2B As shown, the title bar 213 is used to display the application name of the application being projected. Figure 2A and Figure 2B In the title bar 213, the application name of the target application (such as Figure 2A Display "Instant messaging apps", Figure 2B For example, the title bar 213 also includes a "hide button", a "zoom in button" and a "close button". The "hide button" is used to hide the projection window 210 in the taskbar at the bottom of the laptop screen. The "zoom in button" is used to trigger the laptop to display the projection window 210 in full window. The "close button" is used to trigger the laptop to close the projection window 210. It can be understood that in response to the user's operation on the "close button", the mobile phone stops projecting the screen to the laptop.

[0122] Exemplarily, the above-mentioned preset function controls can be Figure 2A and Figure 2B Any one of the Back key, the Home key, and the Recent key in the navigation bar 212 shown. Of course, the above navigation bar 212 may also include only one or two controls, and the above preset function control is one of the controls included in the navigation bar 212. For example, the above navigation bar 212 includes a Home key control, and the above preset function control may be the Home key.

[0123] Take the above preset function controls as Figure 2A and Figure 2B For example, in response to a user's operation on the Home key, such as a click operation, the Home key is displayed. Figure 2C As shown, the screen projection mode of the mobile phone and the laptop is switched from heterogeneous screen projection to homogeneous screen projection. For example, Figure 2C In the example, the laptop displays the projection window 220 of the mobile phone, and the display content of the projection window 220 is the same as the content of the display interface of the mobile phone. For example, the display content of the projection window 220 and the content of the display interface of the mobile phone are both the main interface of the mobile phone.

[0124] Take the above preset function controls as Figure 2A and Figure 2B Taking the Recent key in the navigation bar 212 as an example, in response to a user clicking the Recent key, as shown in FIG. Figure 2D As shown, the screen projection mode of the mobile phone and the laptop is switched from heterogeneous screen projection to homogeneous screen projection. For example, Figure 2D In the example, the laptop displays the projection window 230 of the mobile phone, and the display content of the projection window 230 is the same as the content of the display interface of the mobile phone. For example, the display content of the projection window 230 and the content of the display interface of the mobile phone are both the multitasking interface of the mobile phone.

[0125] That is to say, as a response to the user's operation of the preset function control, the mobile phone may no longer project the content drawn on the virtual display to the laptop, but instead project the content displayed on the main display of the mobile phone to the laptop, that is, switch from heterogeneous screen projection to homogeneous screen projection.

[0126] It should be noted that the preset function control can also be other forms of controls, as long as it can realize the function of switching the screen projection mode of the mobile phone and the laptop from heterogeneous screen projection to homogeneous screen projection. The above embodiments of the present application only take the preset function control as the Home key or the Recent key as an example, which does not constitute a limitation of the present application.

[0127] The following will describe the implementation of the embodiment of the present application in detail with reference to the accompanying drawings. Taking the above-mentioned remote device as a mobile phone as an example, the hardware structure of the remote device (such as electronic device 400) is introduced. Among them, the hardware structure of the local device can refer to the detailed description of the electronic device 400 in the embodiment of the present application, and the embodiment of the present application is not repeated here.

[0128] like Figure 3As shown, the electronic device 400 may include: a processor 410, an external memory interface 420, an internal memory 421, a universal serial bus (USB) interface 430, a charging management module 440, a power management module 441, a battery 142, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 170D, a sensor module 480, a positioning module 481, a button 490, a motor 491, an indicator 492, a camera 493, a display screen 494, and a subscriber identification module (SIM) card interface 495, etc.

[0129] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 400. In other embodiments, the electronic device 400 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0130] The processor 410 may include one or more processing units, for example, the processor 410 may include an application processor (AP), a modem processor (Modem), a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), an ADSP, a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0131] The controller may be the nerve center and command center of the electronic device 400. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0132] The processor 410 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may store instructions or data that the processor 410 has just used or cyclically used. If the processor 410 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 410, and thus improves the efficiency of the system.

[0133] In some embodiments, the processor 410 may include one or more interfaces. It is understood that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation on the electronic device 400. In other embodiments, the electronic device 400 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0134] The charging management module 440 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While the charging management module 440 charges the battery 442, it can also power the electronic device through the power management module 441.

[0135] The power management module 441 is used to connect the battery 442, the charging management module 440 and the processor 410. The power management module 441 receives input from the battery 442 and / or the charging management module 440 to power the processor 410, the internal memory 421, the external memory, the display screen 494, the camera 493, and the wireless communication module 460.

[0136] The wireless communication function of the electronic device 400 can be implemented through the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modem processor and the baseband processor.

[0137] The electronic device 400 implements the display function through a GPU, a display screen 494, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 494 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 410 may include one or more GPUs, which execute program instructions to generate or change display information.

[0138] The display screen 494 is used to display images, videos, etc. The display screen 494 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Mini-LED, Micro-OLED, Micro-OLED, quantum dot light-emitting diodes (QLED), etc.

[0139] The electronic device 400 can implement audio functions such as music playing and recording through the audio module 470 (such as the above-mentioned audio conversion module), the speaker 470A, the receiver 470B, the microphone 470C, the headphone interface 470D, and the application processor.

[0140] The audio module 470 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 470 can also be used to encode and decode audio signals. The speaker 470A, also called the "speaker", is used to convert audio electrical signals into sound signals. The receiver 470B, also called the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 470C, also called the "microphone" or "microphone", is used to convert sound signals into electrical signals. The headphone jack 470D is used to connect wired headphones.

[0141] The external memory interface 420 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 410 through the external memory interface 420 to implement a data storage function. For example, audio, video and other files are stored in the external memory card.

[0142] The internal memory 421 may be used to store computer executable program codes, which include instructions. The processor 410 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 421. For example, in an embodiment of the present application, the processor 410 may execute the instructions stored in the internal memory 421, and the internal memory 421 may include a program storage area and a data storage area.

[0143] The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 421 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0144] The buttons 490 include a power button, a volume button, etc. The motor 491 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 492 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc.

[0145] The SIM card interface 495 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device by inserting it into the SIM card interface 495 or pulling it out from the SIM card interface 495. The electronic device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 495 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 495 can also be compatible with different types of SIM cards. The SIM card interface 495 can also be compatible with external memory cards. The electronic device 400 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 400 uses an eSIM card, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 400 and cannot be separated from the electronic device 400.

[0146] The methods in the following embodiments can all be implemented in the electronic device 400 having the above hardware structure.

[0147] The software system of the electronic device 400 (such as the remote device 101 and the local device 102) can adopt a layered architecture, an event-driven architecture, a micro-core architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to illustrate the software structure of the remote device 101 or the local device 102.

[0148] Figure 4It is a software structure diagram of the remote device 101 and the local device 102 provided in the embodiment of the present application. The layered architecture can divide the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into three layers, from top to bottom, namely, the application layer (referred to as the application layer, Application), the application framework layer (referred to as the framework layer, Framework), and the kernel layer (Kernel, also known as the driver layer). For example, Figure 4 As shown, the remote device 101 may include an application layer 500 , a framework layer 501 and a driver layer 502 ; the local device 202 may include an application layer 510 , a framework layer 511 and a driver layer 512 .

[0149] The application layer can include a series of application packages. For example, Figure 4 The application layer 500 and the application layer 510 shown may include: common applications, screen projection management applications and system UI applications.

[0150] Ordinary applications may be applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and desktop launcher (Launcher). System UI applications may include status bar and navigation bar, etc. Screen projection management applications may include screen projection connection applications and screen projection display applications. Among them, the screen projection connection application is used to manage wired or wireless connections between devices (such as remote device 101 and local device 202) for screen projection. The screen projection display application is used to display the projection content or screen projection interface projected by the remote device 101 to the local device 102.

[0151] The framework layer provides application programming interface (API) and programming framework for the application layer applications. Figure 4 As shown, the framework layer may include a device virtual framework, a screen projection service, and a display management module. The device virtual framework is used to virtualize the hardware of the devices (such as the remote device 101 and the local device 202) in the screen projection scenario, thereby realizing the data transmission and reception between the remote device 101 and the local device 202. The screen projection service is used to manage the data communication from the remote device 101 to the local device 102 in the screen projection scenario. For example, Figure 4 As shown, the screen projection service can be used to manage the projection data transmitted from the remote device 101 to the local device 102. The projection data can include the audio and video data and layer data of the projection, which can also be called screen image data. The display management module of the remote device 101 is used to create a virtual display for the projection display.

[0152] The kernel layer is a layer between hardware and software. The kernel layer at least includes display driver, camera driver, audio driver, sensor driver, etc. The present application embodiment does not impose any restrictions on this.

[0153] It should be noted that, in actual implementation, the remote device 101 may be used as a screen projection end or as a screen projection end. Correspondingly, the local device 101 may be used as a screen projection end or as a screen projection end. In this case, the remote device 101 may include all the software modules shown in the above examples; the local device 102 may also include all the software modules shown in the above examples.

[0154] In the following embodiments, in combination with the above-mentioned heterogeneous screen projection scenario, the process of switching the remote device 101 and the local device 102 from heterogeneous screen projection to homogeneous screen projection is introduced. Figure 5A As shown, the process of switching from heterogeneous screen projection to homogeneous screen projection may include the following steps.

[0155] Step i: The remote device 101 receives a screen projection request (or also referred to as a screen projection instruction) from the local device 102, which is used to instruct the local device 102 to project the screen to the remote device 101 using a heterogeneous screen projection method.

[0156] Step ii: The remote device 101 sends the first projection content to the local device 102.

[0157] Exemplarily, after receiving the projection request, the remote device 101 creates a virtual display in response to the projection request and draws the content to be projected on the virtual display. Then, the remote device 101 projects the content on the virtual display (i.e., the first projection content) to the local device 102.

[0158] Step iii: The local device 102 displays a first screen projection interface, which includes a first screen projection content and preset function controls.

[0159] The preset function control is obtained after the local device 102 draws the first projection screen interface. For example, after receiving the first projection screen content, the local device 102 displays the first projection screen content on the first projection screen interface and draws it on the first projection screen interface.

[0160] Exemplarily, the first projection content is different from the content of the interface displayed on the display screen of the remote device 101. For example, the first projection content is Figure 1D The content displayed on the tablet computer in the projection window 140. Alternatively, the first projection content is Figure 2A The content displayed in the screen projection window 210 of the laptop in the first projection window is as follows: Figure 2BThe laptop computer in the projection window 310 displays the content.

[0161] The content of the interface displayed on the display screen of the remote device 101 is Figure 1D , Figure 2A , Figure 2B The content of the main interface displayed on the phone screen.

[0162] That is to say, in step i to step iii, the remote device 101 uses heterogeneous screen projection to project the first screen projection content to the local device 102.

[0163] Step iv: In response to the user's triggering operation on the preset function control, the local device 102 sends a switching request to the remote device 101 and sends a reverse control instruction.

[0164] The switching request is used to request the remote device 101 to switch from heterogeneous screen projection to homogeneous screen projection to project the screen to the local device 102. The reverse control instruction corresponds to the preset function control, and the reverse control instruction is used to trigger the remote device 101 to display the first interface on the display screen.

[0165] Exemplarily, when the preset function control is the Home key, the reverse control instruction is used to trigger the remote device 101 to display the main interface on the display screen; or, when the preset function control is the Recent key, the reverse control instruction is used to trigger the remote device 101 to display the multitasking interface on the display screen.

[0166] Step v: In response to the reverse control instruction, the remote device 101 displays the first interface on the display screen.

[0167] Step vi: In response to the switching request, the remote device 101 sends a second screen projection content to the local device 102, and the second screen projection content is the same as the content of the first interface.

[0168] For example, when the remote device 101 displays the first interface as the main interface on the display screen, the remote device 101 sends the content of the main interface (i.e., the second projection content) to the local device 102, so that the local device 102 displays the second projection content on the projection window. Figure 2C As shown, the remote device 101 (ie, mobile phone) displays the content of the first interface on the display screen, which is the same as the content displayed on the projection window 220 of the local device 102 (ie, laptop computer), both of which are the content of the main interface.

[0169] As another example, when the first interface displayed on the display screen of the remote device 101 is a multitasking interface, the remote device 101 sends the content of the multitasking interface (i.e., the second projection content) to the local device 102, so that the local device 102 displays the second projection content on the projection window. Figure 2DAs shown, the remote device 101 (ie, mobile phone) displays the content of the first interface on the display screen, which is the same as the content displayed on the projection window 230 by the local device 102 (ie, laptop computer), both of which are the content of the multi-tasking interface.

[0170] The following describes a specific implementation method for establishing heterogeneous screen projection between the remote device 101 and the local device 102. For example, Figure 5B As shown, the process of establishing heterogeneous screen projection between the remote device 101 and the local device 102 is as follows.

[0171] For example, see Figure 5B The process of heterogeneous screen projection can include the following three steps: (1) the process of "establishing a screen projection connection between the remote end and the local end"; (2) the process of "creating a virtual display on the remote device"; (3) the process of "transmitting screen projection data between the remote end and the local end".

[0172] The remote device 101 and the local device 102 can execute the above-mentioned (1) process of "establishing a remote-local screen projection connection" through the screen projection connection application in the application layer. The screen projection display application in the application layer, the screen projection service in the framework layer, and the display management module in the remote device 101 can support the remote device 101 to execute the above-mentioned (2) process of "creating a virtual display on the remote device". The remote device 101 and the local device 102 can execute the above-mentioned (3) process of "remote-local screen projection data transmission" through the screen projection display application in the application layer.

[0173] Among them, the embodiments of the present application are combined here Figure 4 The software architecture shown is illustrated with an example Figure 5B The three processes shown in FIG. Figure 6 As shown, the process mainly includes the following steps: ①. The screen projection connection application in the application layer 500 of the remote device 101 performs signaling interaction with the screen projection connection application in the application layer 510 of the local device 102 to establish a screen projection connection.

[0174] ②. The screen projection connection application in the application layer 500 of the remote device 101 initializes the device virtual framework in the framework layer 501 and creates the capability parameters of the remote device 101. Correspondingly, ②-1. The screen projection connection application in the application layer 510 of the local device 102 initializes the device virtual framework in the framework layer 511.

[0175] ③. The device virtual framework in the framework layer 501 of the remote device 101 starts the screen projection service in the framework layer 501 to obtain the screen projection data of the remote device 101. ④. The screen projection service in the framework layer 501 of the remote device 101 notifies the display management module in the framework layer 501 to create a virtual display. The display management module in the framework layer 501 creates a virtual display. ⑤. The display management module in the framework layer 501 of the remote device 101 notifies the screen projection display application in the application layer 500 that the virtual display is created successfully.

[0176] ⑥ The screen projection display application in the application layer 500 of the remote device 101 moves the target application (such as the "instant messaging application" projected from the mobile phone to the laptop computer) to the virtual display created by the framework layer 501. ⑦. The screen projection service in the framework layer 501 of the remote device 101 obtains the projection data (such as the screen image data of the "instant messaging application" interface projected to the laptop computer) from the virtual display created by the display management module of the framework layer 501. ⑧. The screen projection service in the framework layer 501 of the remote device 101 encodes the projection data and sends the encoded projection data to the screen projection service in the framework layer 511 of the local device 102. Correspondingly, ⑧-1. The screen projection service in the framework layer 501 of the remote device 101 notifies the device in the framework layer 501 that the virtual framework screen projection is successful.

[0177] ⑨. The device virtual framework in the framework layer 501 of the remote device 101 sends the capability parameters of the remote device 101 to the device virtual framework in the framework layer 511 of the local device 102.

[0178] The capability parameters described in the above embodiment may be used to reflect one or more of the display capability, audio capability and shooting capability of the remote device 101. Exemplarily, the above device virtual framework may be, for example, a distributed mobile sensing development platform (DMSDP).

[0179] For example, the capability parameter is used to reflect the audio capability of the remote device 101. In this case, the remote device 101 can create a virtual microphone and send the capability parameter corresponding to the virtual microphone to the local device 101. In this way, when the "instant messaging application" of the remote device 101 receives a voice message, the voice message can be projected to the local device 102 through the "notification sharing" method, and the local device 102 can play the voice message based on the capability parameter of the virtual microphone.

[0180] ⑩. The screen projection service in the framework layer 511 of the local device 102 decodes the projection data and sends the projection data to the projection display application in the application layer 510, so that the projection display application in the application layer 510 displays the projection content or projection interface.

[0181] The following examples describe the above method in detail. Figure 7 As shown, the remote device 101 and the local device 102 can perform the following steps to implement the above-mentioned processes (1)-(3).

[0182] Step a: The screen projection connection application of the remote device 101 establishes a screen projection connection with the screen projection connection application of the local device 102.

[0183] Exemplarily, step a may include steps a-1 to a-7.

[0184] Step a-1: The screen projection connection application of the remote device 101 initiates a create connection message to the screen projection connection application of the local device 102, which is used to notify the screen projection connection application of the local device 102 to create a screen projection connection.

[0185] Exemplarily, the message of step a-1 may be represented as: Open Session. For example, the message is used to notify the screen projection connection application of the local device 102 to open the notification message (or it can be understood as: open the session) and create a screen projection connection.

[0186] Step a-2: The screen projection connection application of the local device 102 replies a connection message to the screen projection connection application of the remote device 101 to inform the screen projection connection application of the remote device 102 that the screen projection connection can be established.

[0187] Exemplarily, the message of step a-2 may be expressed as: On Session Opened. For example, the message may be used to inform the screen projection connection application of the remote end 101 that the notification message (or session) has been opened and a screen projection connection may be established.

[0188] Step a-3: The screen projection connection application of the remote device 101 and the screen projection connection application of the local device 102 send device information to each other.

[0189] Exemplarily, the screen projection connection application of the remote device 101 sends the device information of the remote device 101 to the screen projection connection application of the local device 102. Correspondingly, the screen projection connection application of the local device 102 sends the screen projection connection application of the local device 102 to the screen projection connection application of the remote device 101. For example, the message of step a-3 can be expressed as: PairNotify.

[0190] The above device information includes but is not limited to: device account, device name, device ID, etc.

[0191] Step a-4: The screen projection connection application of the local device 102 sends a version negotiation request message to the screen projection connection application of the remote device 101, carrying a version data packet of the screen projection management application of the local device 102.

[0192] Exemplarily, step a-4 may be expressed as: Version Query Request.

[0193] Step a-5: The screen projection connection application of the remote device 101 replies with a version negotiation response message to the screen projection connection application of the local device 102, indicating that the version negotiation is successful and screen projection can be performed.

[0194] Exemplarily, step a-5 may be expressed as: Version Query Response.

[0195] Step a-6: The screen projection connection application of the local device 102 sends a screen projection request to the screen projection connection application of the remote device 101 to request the remote device 101 to perform screen projection.

[0196] Exemplarily, step a-6 may be expressed as: Hi Cast Start Request.

[0197] Step a-7: The screen projection connection application of the remote device 101 starts screen projection and sets the heterogeneous flag (or the first flag).

[0198] Exemplarily, the heterogeneous source flag can be used to indicate that the screen projection mode between the remote device 101 and the local device 102 is heterogeneous screen projection. For example, the screen projection connection application of the remote device 101 sets the heterogeneous source flag to "true".

[0199] Among them, step a-7 can be expressed as, for example: handle Share Screen Start set Async CastMode true.

[0200] It should be noted that the remote device 101 and the local device 102 establish a screen projection connection through the above steps a-1 to a-7, that is, the above (1) "remote-local device establishes a screen projection connection" process is implemented through steps a-1 to a-7.

[0201] Step b: The screen projection connection application of the remote device 101 starts the device virtual framework and calls the screen projection service of the remote device 101 to create a virtual Display.

[0202] Wherein, step b may be expressed as, for example: start DMSDP.

[0203] Step c: The screen projection service of the remote device 101 notifies the display management module to create a virtual display, which carries the attribute information required to create the virtual display and the heterogeneous flag.

[0204] Among them, the attribute information is used to indicate that the screen projection mode of the remote device 101 and the local device 102 is heterogeneous screen projection, and homogeneous screen projection is allowed.

[0205] Exemplarily, step c may be expressed as: create Virtual Display.

[0206] Step d: The display management module of the remote device 101 creates a virtual display.

[0207] Among them, the display management module of the remote device 101 creates a virtual display and can also perform the following operations: 1. The display management module determines that the screen projection mode of the remote device 101 and the local device 102 is heterogeneous projection according to the identification (such as ID) of the virtual display. 2. The display management module sets the virtual display not to lock the screen when the main display screen is locked. That is, when the main display screen is locked, the virtual display will not be locked. In this way, in the scenario of heterogeneous screen projection, the problem of locking the virtual display after the main display screen is locked can be solved.

[0208] Exemplarily, step d may be expressed as: on Display Added set Killed Flag setAsync PC Display ID set Wall paper Blur.

[0209] It should be noted that in the embodiment of the present application, since the remote device 101 modifies the attribute information of the virtual display to "the screen projection mode of the remote device 101 and the local device 102 is heterogeneous screen projection, and homogeneous screen projection is allowed" when creating the virtual display, and the above-mentioned operations 1 and 2 are also performed, the screen projection mode of the remote device 101 and the local device 102 can be quickly switched from heterogeneous screen projection to homogeneous screen projection.

[0210] In addition, the remote device 101 and the local device 102 create a virtual display through the above steps b to d, that is, the above process (2) "the remote device creates a virtual display" is implemented through steps b to d.

[0211] Step e: The display management module of the remote device 101 notifies the screen projection display application that the virtual display is created successfully.

[0212] Step f: The screen projection display application of the remote device 101 moves the target application to the virtual display.

[0213] The target application refers to the application corresponding to the screen content that the remote device 101 needs to project to the local device 102. For example, Figure 2A In the example, the application corresponding to the notification message 1 displayed on the laptop (ie, the local device 102) is the target application. Figure 2B In the example, the application corresponding to the interface currently displayed on the display screen of the mobile phone (ie, the remote device 101) is the target application.

[0214] Among them, step f can be expressed as: move Stack To Async Display, for example.

[0215] Step g: The screen projection service of the remote device 101 obtains the projection data from the virtual display created by the display management module and encodes the projection data.

[0216] Step h: The screen projection service of the remote device 101 sends the encoded screen projection data to the screen projection service of the local device 101.

[0217] Step j: The screen projection service of the local device 101 decodes the projection data and sends the decoded projection data to the screen projection display application of the local device 101, so that the screen projection display application displays the projection content or projection interface corresponding to the projection data.

[0218] It should be noted that the remote device 101 and the local device 102 transmit the projection data through the above steps e to j, that is, the above (3) "remote-local projection data transmission" process is implemented through steps e to j.

[0219] In the embodiment of the present application, the local device 102 can not only display the content projected by the remote device 101 in the projection window, but also display the preset function controls in the projection window. Taking the preset function controls included in the navigation bar as an example, in some embodiments, the navigation bar can also be displayed in the projection window. Figure 2A and Figure 2B As shown, the projection window 210 and the projection window 310 of the local device 102 (i.e., the laptop computer) display a navigation bar 212. The navigation bar 212 may include preset function controls, such as a Back key, a Home key, a Recent key, and the like.

[0220] In the following embodiments, the preset function control is taken as an example of the Home button to exemplify the method of quickly switching from heterogeneous screen projection to homogeneous screen projection.

[0221] For example, Figure 8 As shown, the screen projection mode of the remote device 101 and the local device 102 is switched from heterogeneous screen projection to homogeneous screen projection, which may include the following processes: (I) the process of "the local device 102 instructs the remote device 101 to switch from heterogeneous screen projection to homogeneous screen projection"; (II) the process of "the remote device 101 switches from heterogeneous screen projection to homogeneous screen projection"; (III) the process of "the remote device 101 and the local device 102 transmit screen projection data in the homogeneous screen projection scenario".

[0222] The remote device 101 and the local device 102 can execute the above-mentioned process (I) "the local device 102 instructs the remote device 101 to switch from heterogeneous screen projection to homogeneous screen projection" through the screen projection connection application in the application layer. The screen projection connection application in the application layer and the display management module in the framework layer in the remote device 101 can support the remote device 101 to execute the above-mentioned process (II) "the remote device 101 switches from heterogeneous screen projection to homogeneous screen projection". The remote device 101 and the local device 102 can execute the above-mentioned process (III) "the remote device 101 and the local device 102 transmit screen projection data in the homogeneous screen projection scenario" through the screen projection display application in the application layer and the screen projection service in the framework layer.

[0223] Among them, the embodiments of the present application are combined here Figure 4 The software architecture shown is illustrated with an example Figure 8 The three processes shown in FIG. Fig. 9 As shown, the process mainly includes the following steps.

[0224] Step 1: The screen projection connection application of the local device 102 sends a switching request to the screen projection connection application of the remote device 101, requesting the remote device 101 to switch from heterogeneous screen projection to homogeneous screen projection.

[0225] For example, in combination with the above Figure 2A The projection window 201 and Figure 2B The projection window 310 shown, the projection window 210 and the projection window 310 include a Home button. In response to the user's operation of the Home button, the projection connection application of the local device 102 sends a switching request to the projection connection application of the remote device 101.

[0226] For example, step 1 may be expressed as: switch To Sync Cast Request.

[0227] Step 2: The screen projection display application of the remote device 101 moves the target application from the virtual display to the main display screen.

[0228] Wherein, step 2 can be represented as, for example: move Stack To Default Display. The remote device 101 moving the target application stack to the main display screen can be understood as displaying the interface of the target application on the main display screen. Figure 2C As shown, the remote device 101 (i.e., the mobile phone) displays the interface of the desktop application on the main display screen. Figure 2D As shown, the remote device 101 (ie, a mobile phone) displays the interface of the multi-tasking application on the main display screen.

[0229] Step 3: The screen projection connection application of the remote device 101 switches from heterogeneous screen projection to homogeneous screen projection, and modifies the heterogeneous flag (the modified heterogeneous flag can be called the second flag).

[0230] Exemplarily, the screen projection connection application of the remote device 101 sets the heterogeneous source flag to "false" to indicate that the screen projection mode of the remote device 101 and the local device 102 is the same-source screen projection.

[0231] For example, step 3 can be expressed as: set Async Cast mode false.

[0232] Step 4: The screen projection connection application of the remote device 101 notifies the display management module, and the screen projection mode of the remote device 101 and the local device 102 is switched to the same-source screen projection, and a different-source flag is sent.

[0233] Exemplarily, step 4 may be expressed as: set Async Cast mode false.

[0234] Step 5: The display management module of the remote device 101 deletes the ID corresponding to the virtual display and clears the heterogeneous source flag.

[0235] Exemplarily, step 5 may be represented as: set Killed Flag set Async PC Display ID.

[0236] Step 6: The screen projection connection application of the remote device 101 replies to the screen projection connection application of the local device 102, and the screen projection mode of the remote device 101 and the local device 102 is switched to same-source screen projection.

[0237] Exemplarily, step 6 may be expressed as: switch To Sync Cast Response.

[0238] Step 7: The screen projection display application of the local device 102 sends a reverse control instruction (or reverse control instruction) of the Home button to the screen projection service of the remote device 101, which is used to instruct the remote device 101 to display the desktop application.

[0239] After the remote device 101 receives the reverse control instruction of the Home button, as a response to the reverse control instruction, the remote device 101 may display the main interface, that is, the interface of the desktop application, on the main display screen.

[0240] Exemplarily, step 7 may be expressed as: HW_VIRTUAL_KEY_CMD_HOME / HW_VIRTUAL_KEY_CMD_RECENT.

[0241] Step 8: The screen projection service of the remote device 101 re-detects the set heterogeneous flag.

[0242] Exemplarily, if the screen projection service of the remote device 101 does not detect the set heterogeneous flag, it means that the screen projection mode of the remote device 101 and the local device 102 is the same-source screen projection.

[0243] For example, step 8 may be expressed as: check And set Async Cast Mode.

[0244] Step 9: The screen projection display application of the remote device 101 projects the content displayed on the main display screen to the screen projection display application of the local device 102, so that the screen projection display application of the local device 102 displays the projected content.

[0245] For example, since the screen projection mode of the remote device 101 and the local device 102 is switched from heterogeneous screen projection to homogeneous screen projection, the screen projection display application of the remote device 101 can project the content displayed on the main display screen to the screen projection display application of the local device through the screen projection mode of homogeneous screen projection. It can be understood that the content projected to the local device 102 at this time is the interface of the desktop application.

[0246] It can be understood that after the screen projection mode of the remote device 101 and the local device 102 is switched from heterogeneous screen projection to homogeneous screen projection, the content displayed by the remote device 101 and the content displayed in the projection window of the local device 102 become mirror images (which can be understood as the same content).

[0247] It should be noted that the above embodiments are described by taking the preset function control as the Home button as an example. When the preset function control is other controls, the reverse control instruction sent is the corresponding instruction. For example, when the preset function control is the icon of the "instant messaging application", the reverse control instruction sent by the local device 101 to the remote device 102 is the instruction corresponding to the icon, that is, instructing the remote device 102 to display the interface of the "instant messaging application" (i.e., the first interface).

[0248] In some embodiments, after the local device 102 receives a trigger operation on a preset function control by a user, the local device 102 needs to send a switching request and a reverse control instruction to the remote device 101 .

[0249] In other embodiments, after the local device 102 receives the user's trigger operation on the preset function control, the local device 102 only needs to send a switching request to the remote device 101. In this case, the remote device 101 can directly project the content displayed on the current interface to the local device 101. For example, in a heterogeneous screen projection scenario, the remote device 101 displays the interface of the video application on the display screen, and the local device 102 displays the interface of the "instant messaging application" in the projection window. In this way, after the local device 102 receives the user's trigger operation on the preset function control, the local device 102 sends a switching request to the remote device 101. In response to the switching request, the remote device 101 switches from heterogeneous screen projection to homogeneous screen projection, and projects the content of the interface of the currently displayed video application to the local device 102, so that the projection window of the local device 102 displays the content of the video application.

[0250] To sum up, by adopting the solution of the present application, by setting preset function controls in the screen projection window, it is possible to quickly switch the screen projection mode of the remote device and the local device from heterogeneous screen projection to homogeneous screen projection without disconnecting the connection between the remote device and the local device, thereby simplifying user operations and improving human-computer interaction efficiency.

[0251] It should be noted that the contents recorded in each embodiment of the present application can explain the technical solutions in other embodiments of the embodiments of the present application, and the technical features recorded in each embodiment can also be applied in other embodiments and combined with the technical features in other embodiments to form a new solution. The present application only exemplarily lists several embodiments for illustration, and does not mean that the present application is limited to this.

[0252] The present application embodiment provides an electronic device, which may be the above-mentioned remote device 101 or the local device 102; the electronic device may include: a memory and one or more processors; the memory stores computer program code, the computer program code includes computer instructions, and when the computer instructions are executed by the processor, the electronic device executes each function or step executed in the above-mentioned remote device 101 or the local device 102. The structure of the electronic device can refer to the above-mentioned Figure 3 The structure of the electronic device 400 is shown.

[0253] The present application also provides a chip system, which is applied to the remote device 101 or the local device 102. Fig.10As shown, the chip system 1100 includes at least one processor 1101 and at least one interface circuit 1102. The processor 1101 may be Figure 3 The processor 410 is shown. The interface circuit 1102 may be, for example, an interface circuit between the processor 410 and an external memory; or an interface circuit between the processor and the internal memory 421 .

[0254] The processor 1101 and the interface circuit 1102 can be interconnected via lines. For example, the interface circuit 1102 can be used to receive signals from other devices (such as the memory of the electronic device 400). For another example, the interface circuit 1102 can be used to send signals to other devices (such as the processor 1101). Exemplarily, the interface circuit 1102 can read instructions stored in the memory and send the instructions to the processor 1101. When the instructions are executed by the processor 1101, the electronic device can execute the various functions or steps executed in the remote device 101 or the local device 102 in the above-mentioned embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.

[0255] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes each function or step executed in the remote device 101 or the local device 102 in the above method embodiment.

[0256] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute each function or step executed in the remote device 101 or the local device 102 in the above method embodiment.

[0257] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules according to the system, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0258] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0259] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0260] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0261] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0262] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A screen projection display method, characterized in that: Applied to a system including a first electronic device and a second electronic device, the method includes: The first electronic device receives the first screen projection content from the second electronic device and displays a first screen projection interface, where the first screen projection interface includes preset function controls and the first screen projection content, and the first screen projection content is different from the content of the first interface displayed on the display screen of the second electronic device; The first electronic device receives a triggering operation of the preset function control by a user; In response to the triggering operation, the second electronic device displays a second interface on a display screen and sends a second screen projection content to the first electronic device; The first electronic device displays a second screen projection interface, and the second screen projection interface includes the second screen projection content, and the second screen projection content is the same as the content of the second interface.

2. The method according to claim 1, characterized in that: In response to the triggering operation, the electronic device displays a second interface on a display screen, and sends a second screen projection content to the first electronic device, including: In response to the trigger operation, the first electronic device sends a switching request to the second electronic device and sends a reverse control instruction; the reverse control instruction corresponds to the preset function control; In response to the reverse control instruction, the electronic device displays a second interface on a display screen; In response to the switching request, the second electronic device sends a second screen projection content to the first electronic device.

3. The method according to claim 1 or 2, characterized in that: The first screen projection content is the same as the content drawn by the second electronic device on the virtual display.

4. The method according to any one of claims 1 to 3, characterized in that The first screen projection interface includes a navigation bar, and the navigation bar includes a Home key and a Recent key; The preset function control is the Home button, and the second interface is the main interface; or The preset function control is the Recent key, and the second interface is a multi-tasking interface.

5. The method according to any one of claims 1 to 4, characterized in that The first electronic device sending a reverse control instruction to the second electronic device includes: A notification message from the second electronic device to the first electronic device, wherein the notification message is used to instruct the second electronic device to switch from heterogeneous screen projection to homogeneous screen projection; In response to the notification message, the first electronic device sends a reverse control instruction to the second electronic device.

6. The method according to any one of claims 1 to 5, characterized in that The first electronic device receiving the first screen projection content from the second electronic device includes: The first electronic device sends a screen projection request to the second electronic device, where the screen projection request is used to request the second electronic device to project the screen to the first electronic device; In response to the screen projection request, the second electronic device creates a virtual display, and moves the interface of the target application to the virtual display for drawing; wherein the configuration information of the virtual display includes: the screen projection mode corresponding to the virtual display is heterogeneous screen projection, and homogeneous screen projection is allowed; The second electronic device sends the first screen projection content to the first electronic device based on the content drawn on the virtual display; The first electronic device receives the first screen projection content from the second electronic device.

7. The method according to claim 6, characterized in that After the second electronic device creates the virtual display, the method further includes: The second electronic device sets a first flag bit, and the first flag bit is used to indicate that the screen projection mode of the second electronic device and the first electronic device is heterogeneous screen projection.

8. The method according to claim 7, characterized in that After the first electronic device sends a switching request to the second electronic device, the method further includes: The second electronic device stacks the content of the interface of the target application drawn on the virtual display to the display screen of the second electronic device; The second electronic device modifies the first flag bit to a second flag bit, and the second flag bit is used to indicate that the screen projection mode of the second electronic device and the first electronic device is the same-source screen projection.

9. The method according to any one of claims 6 to 8, characterized in that: The method further comprises: After creating the virtual display, the second electronic device performs a first operation; Among them, the first operation includes: the second electronic device determines that the virtual display is the display corresponding to the heterogeneous screen projection based on the identifier of the virtual display; and when the display screen of the second electronic device is locked, the virtual display is not locked, which is used to prohibit the screen projection interface of the first electronic device from being in a locked state.

10. An electronic device, characterized in that: The electronic device comprises: memory and one or more processors; The memory stores computer program code, which includes computer instructions. When the computer instructions are executed by the processor, the electronic device executes the method as claimed in any one of claims 1 to 9.

11. A screen projection display system, characterized in that: include: A first electronic device and a second electronic device for executing the method according to any one of claims 1 to 9.

12. A chip system, characterized in that: Applied in electronic equipment, the chip system includes: at least one processor and an interface; The interface is used to receive instructions and transmit them to the at least one processor; the at least one processor executes the instructions so that the electronic device executes the method as described in any one of claims 1-9.

13. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 9.

Images