Screen projection display method and related electronic equipment
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-25
- Publication Date
- 2026-04-14
AI Technical Summary
The content projected in the floating window obstructs the original user interface of the electronic device, especially affecting the user browsing experience on devices with smaller screens.
The received projection content is displayed on electronic devices in a split-screen or floating manner. The appropriate display method is selected according to the device status to ensure that the original screen display is not affected.
It reduces the obstruction of the original screen by the projected content, improves the user browsing experience, and increases screen utilization and user interactivity.
Smart Images

Figure CN121866534A_ABST
Abstract
Description
Screen projection display methods and related electronic devices Technical Field
[0001] This application relates to the field of terminals, and more particularly to a screen projection display method and related electronic devices. Background Technology
[0002] Currently, electronic devices such as tablets and foldable phones display received screen-projected content via floating windows. This floating window obstructs the user interface originally displayed on the device, thus affecting the user's browsing experience. This is especially true on smaller-screen devices like foldable phones, where the obstruction of the screen by the floating window is significant, further impacting the browsing experience.
[0003] Summary of the Invention
[0004] This application provides a screen projection display method and related electronic equipment.
[0005] In a first aspect, this application provides a screen mirroring method, which is applied to a first device, the first device having a first application and a second application installed thereon. The method includes: establishing a screen mirroring communication connection between the first device and the second device; when the first device displays a first interface of the first application in full screen, the first device receives a first screen stream from the second device through the screen mirroring communication connection; the first device simultaneously displays a first split-screen window and a second split-screen window, the first split-screen window including a second interface of the first application, the second split-screen window including a first screen image, the second interface including part or all of the content in the first interface, the first screen image originating from the first screen stream; when the first device displays a third interface of the second application in full screen, the first device receives a second screen stream from the second device through the screen mirroring communication connection; the first device displays a first floating window on the third interface, the first floating window including a second screen image, the second screen image originating from the second screen stream.
[0006] By implementing the above method, the first device can choose to display the received screen projection content (i.e., the screen of the second device) in a split-screen or floating manner according to different states when establishing the screen projection communication connection, thereby reducing the obstruction of the screen projection content on the original screen of the first device and improving the user browsing experience.
[0007] Preferably, the first device is a foldable screen phone or tablet computer, and the second device is a candybar screen phone.
[0008] In some embodiments, the method further includes: when the first device displays the desktop in full screen, the first device receives a third screen stream from the second device via a screen mirroring communication connection; the first device stops displaying the desktop and displays the third screen image in full screen, the third screen image being derived from the third screen stream.
[0009] By implementing the above method, the first device can also display the projected content in full screen in scenarios where the desktop is displayed in full screen. This not only displays as much projected content as possible and improves screen utilization, but also does not interrupt the user's browsing events and does not affect the user's browsing experience.
[0010] In some embodiments, when the second device is in a portrait display orientation, the first split-screen window and the second split-screen window are arranged horizontally; in some embodiments, when the second device is in a landscape display orientation, the first split-screen window and the second split-screen window are arranged vertically.
[0011] In other words, when the second device is displayed in portrait mode, after screen mirroring, the user can continue browsing the second device's screen in portrait mode on the first device; when the second device is displayed in landscape mode, after screen mirroring, the user can continue browsing the second device's screen in landscape mode on the first device. This allows users to obtain a stable and smooth browsing experience before and after screen mirroring. On the other hand, the first device's selection of left-right or top-bottom split-screen based on portrait / landscape mode helps improve screen utilization, thereby further enhancing the user's browsing experience.
[0012] In some embodiments, the second split-screen window also includes a first identifier, which is used to indicate that the first screen image comes from the second device.
[0013] In this way, users can intuitively distinguish which content on the first device comes from the first device itself and which content comes from the second device that initiated the screen mirroring.
[0014] In some embodiments, the aspect ratio of the first screen is equal to that of the screen of the second device, the width of the second split-screen window is equal to the width of the first screen, the height of the second split-screen window is equal to the height of the screen of the first device, and the first split-screen window is located in the area of the screen of the first device excluding the second split-screen window.
[0015] For example, in some embodiments, the method further includes: establishing a screen mirroring communication connection between the first device and the third device; when the first device displays the first interface of the first application in full screen, the first device receives the fourth screen stream from the third device through the screen mirroring communication connection; the first device simultaneously displays a third split-screen window and a fourth split-screen window, the third split-screen window including the second interface of the first application, the fourth split-screen window including the fourth screen image, the fourth screen image originating from the fourth screen stream; the aspect ratio of the fourth screen image is equal to the aspect ratio of the screen of the third device, and the aspect ratio of the screen of the third device is different from the aspect ratio of the screen of the second device.
[0016] In this way, the first device can adjust the size of the second split-screen window according to the screen size of the second device to ensure that the received screen-projected content is not distorted, and the user can have the same browsing experience as the second device. On the other hand, by setting the width / height of the second split-screen window to be equal to the width / height of the first screen, the first device can avoid black borders, improve screen utilization, and thus enhance the user's browsing experience.
[0017] In some embodiments, the first split-screen window and the second split-screen window are arranged horizontally, with the first split-screen window on the left and the second split-screen window on the right. The method further includes: after the first device detects a left swipe operation on the screen, the first device closes the second split-screen window and displays the first interface in full screen; or, after the first device detects a right swipe operation on the screen, the first device closes the first split-screen window and displays the fourth interface in full screen, the fourth interface including part or all of the content of the first screen.
[0018] In this way, users can switch from split-screen to full-screen display by swiping left or right, satisfying their needs to browse a specific user interface.
[0019] In some embodiments, after the first device simultaneously displays the first split-screen window and the second split-screen window, the method further includes: after the first device detects an upward swipe operation on the screen, the first device closes the first split-screen window and the second split-screen window and displays the desktop of the first device.
[0020] In this way, users can quickly return to the desktop by swiping up.
[0021] In some embodiments, after the first device simultaneously displays the first split-screen window and the second split-screen window, the method further includes: after the first device detects an upward swipe-and-hold operation on the screen, the first device closes the first split-screen window and the second split-screen window, and displays the background interface of the first device, the background interface including a first background card; after the first device detects an operation on the first background card, the first device redisplays the first split-screen window and the second split-screen window, the first split-screen window including a second interface, and the second split-screen window including a first screen image.
[0022] In this way, users can quickly access the background interface by swiping up and holding the screen, and then quickly return to the previous split-screen display or other display state through the background interface.
[0023] In some embodiments, the second split-screen window further includes a navigation bar, which includes multiple controls for switching the screen display of the second device shown in the second split-screen window.
[0024] At this point, the user can switch the screen view of the second device displayed on the first device using the navigation bar.
[0025] In some embodiments, the background color of the navigation bar changes with the color of the first screen, enhancing the consistency between the navigation bar and the screen of the second device being projected, and improving the user experience.
[0026] In some embodiments, when the first split-screen window and the second split-screen window are arranged horizontally, the width of the navigation bar is equal to the width of the second split-screen window, and the sum of the height of the navigation bar and the height of the second split-screen window is equal to the height of the first device screen; when the first split-screen window and the second split-screen window are arranged vertically, the height of the navigation bar is equal to the height of the second split-screen window, and the sum of the width of the navigation bar and the width of the second split-screen window is equal to the width of the first device screen.
[0027] In some embodiments, after the first device displays the first floating window on the third interface, the method further includes: the first device stopping the display of the third interface and displaying the fifth interface of the third application, wherein the first floating window continues to be displayed on the fifth interface; in response to a first split-screen operation input by the user in the first floating window, the first device simultaneously displays a fifth split-screen window and a sixth split-screen window, the fifth split-screen window including the seventh interface of the third application, the sixth split-screen window including the second screen image, and the seventh interface including part or all of the content in the fifth interface.
[0028] In some embodiments, after the first device stops displaying the desktop and displays the third screen in full screen, the method further includes: in response to a second split-screen operation input by the user, the first device simultaneously displays a seventh split-screen window and an eighth split-screen window, the seventh split-screen window including a sixth interface, and the eighth split-screen window including the third screen; wherein the sixth interface includes multiple application icons and a search bar, and the multiple application icons correspond to multiple applications installed on the first device.
[0029] In some embodiments, after the first device stops displaying the desktop and displays the third screen in full screen, the method further includes: after the first device detects a right swipe operation on the screen, the first device stops displaying the third screen and displays the desktop of the second device in full screen; after the first device detects another right swipe operation on the screen, the first device stops displaying the desktop of the second device and displays the desktop of the first device in full screen.
[0030] In this way, users can switch between floating / full-screen display and split-screen display to meet their changing browsing needs.
[0031] In a second aspect, this application provides an electronic device including one or more processors and one or more memories; wherein the one or more memories are coupled to one or more processors, and the one or more memories are used to store a computer program, which, when executed by one or more processors, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0032] Thirdly, embodiments of this application provide a chip system applied to an electronic device. The chip system includes one or more processors, which are used to invoke computer instructions to cause the electronic device to perform the methods described in the first aspect and any possible implementation thereof.
[0033] Fourthly, this application provides a computer-readable storage medium including a computer program that, when run on an electronic device, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0034] Fifthly, this application provides a computer program product containing instructions that, when the computer program product is run on an electronic device, cause the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0035] Understandably, the electronic device provided in the second aspect, the chip system provided in the third aspect, the computer storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to execute the method provided in this application. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods, and will not be repeated here. Attached Figure Description
[0036] Figure 1A is a schematic diagram of a screen projection display provided in an embodiment of this application;
[0037] Figure 1B is a schematic diagram of another screen projection display provided in an embodiment of this application;
[0038] Figure 2 is a flowchart of a screen projection method provided in an embodiment of this application;
[0039] Figures 3A-3G are a set of user interface diagrams for establishing a screen mirroring communication connection provided in this application example;
[0040] Figures 3H-3K are another set of user interface diagrams for establishing a screen mirroring communication connection provided in this application example;
[0041] Figures 4A and 4B are schematic diagrams of another set of user interfaces for displaying projected screens provided in this application example;
[0042] Figures 5A-5F are schematic diagrams of another set of user interfaces for displaying projected screens provided in this application example;
[0043] Figure 6 is a flowchart of another screen projection display method provided in an embodiment of this application;
[0044] Figures 7A-7G are a set of user interface diagrams for establishing a screen mirroring communication connection provided in this application example;
[0045] Figures 8A and 8B are a set of schematic diagrams for determining the target split-screen window size provided in this application example;
[0046] Figures 9A-9I are a set of user interface diagrams provided in this application for stopping split-screen display based on user touch operation;
[0047] Figures 9J-9N are a set of user interface diagrams for switching screen images based on user touch operations provided in this application.
[0048] Figures 10A-10C show another set of target split-screen window styles provided in this application example;
[0049] Figures 11A and 11B are another set of schematic diagrams for determining the target split-screen window size provided in this application example;
[0050] Figures 12A-12F are a set of user interface diagrams provided in this application example, showing the switching from floating display to split-screen display;
[0051] Figures 13A-13D are a set of user interface diagrams provided in this application example, showing the switching from full-screen display to split-screen display;
[0052] Figures 14A-14F are schematic diagrams of a set of user interfaces for displaying projection icons provided in this application example;
[0053] Figure 15 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0054] The following are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.
[0055] Electronic devices can periodically update all or part of the displayed content on the screen according to the screen refresh rate, that is, update the screen image (also known as the interface, display interface, etc.). The collection of screen images in sequence is called a screen stream.
[0056] Screen mirroring: An electronic device can send its screen stream to another electronic device, which will then display it sequentially on the screen of the other electronic device, allowing users to browse on other electronic devices. The electronic device sending the screen stream is denoted as source device 10; the electronic device receiving the screen stream and displaying it on its own screen is denoted as target device 20.
[0057] Figure 1A is a schematic diagram of a screen mirroring scenario provided in an embodiment of this application. As shown in Figure 1A, the mobile phone (i.e., source device 10) can send its own screen stream to the tablet computer (i.e., target device 20) for display on the tablet computer's screen. In this way, the user can browse the mobile phone screen on the tablet computer and conveniently obtain the content they need from the mobile phone.
[0058] The source device 10 is not limited to mobile phones; it can also be an electronic device such as a smartwatch or smart bracelet. The target device 20 is not limited to tablets; it can also be a foldable phone, laptop, television, in-vehicle device, smart home device, and / or smart city device. This application does not impose special restrictions on the specific types of the source device 10 and the target device 20. Typically, the screen size of the source device 10 is smaller than the screen size of the target device 20.
[0059] As shown in Figure 1A, in one implementation, the target device 20 displays the source device 10's screen 100 on its own currently displayed screen 200. The size of screen 100 is typically smaller than the size of screen 200. In this case, the source device 10's screen occludes the target device 20's screen, preventing the user from accessing the obscured screen content of the target device 20.
[0060] In particular, when the target device 20 is a foldable screen phone, because the screen size of the foldable screen phone is smaller (compared to the target device 20 such as a tablet or laptop), the screen of the source device 10 projected onto the target device 20 will obstruct the original screen more significantly, thus affecting the user's browsing experience.
[0061] The above embodiments illustrate the process of screen mirroring. In other embodiments, the source device 10 and the target device 20 can also perform screen mirroring from different sources.
[0062] In heterogeneous screen mirroring, the source device 10 can send an interface it can display to the target device 20 for display, while continuing to display other interfaces itself; alternatively, the source device 10 can send its currently displayed screen to the target device 20 and then switch to displaying other interfaces. Referring to Figure 1B, the source device 10 can send its user interface 109 to the target device 20 for display, and then the source device 10 can switch to displaying other user interfaces, such as a video playback interface 108. That is, in heterogeneous screen mirroring, the screen displayed by the source device 10 and the screen displayed by the source device 10 in the target device 20 may not be the same.
[0063] Similarly, in heterogeneous screen projection, the screen of the source device 10 will also obstruct the screen of the original target device 20, especially when the target device 20 is a foldable phone, which will affect the user's browsing experience.
[0064] Therefore, this application provides a screen projection display method.
[0065] Implementing this method, after establishing a screen mirroring communication connection, the target device 20 (first device) can receive the screen stream of the source device 10 (second device, third device) based on the screen mirroring communication connection with it. On the other hand, after establishing the screen mirroring communication connection, the target device 20 can also obtain its own display status. When the display status indicates that the target device 20 is displaying an application that supports split-screen, the target device 20 can display the user interface of the application supporting split-screen and the screen of the source device 10 in a split-screen manner; when the display status indicates that the target device 20 is displaying an application that does not support split-screen, the target device 20 can display the screen of the source device 10 floating on the user interface of the application that does not support split-screen. The screen of the source device 10 is obtained based on the screen stream of the source device 10.
[0066] Figure 2 is a flowchart of a screen projection display method provided in an embodiment of this application.
[0067] S201. The source device 10 and the target device 20 establish a screen projection communication connection.
[0068] S202. The target device 20 obtains its own display status.
[0069] S203. The source device 10 sends a screen stream to the target device 20 via a screen mirroring communication connection.
[0070] S202 and S203 have no timing requirements. That is, the target device 20 can execute S202 to obtain its own display status first, and then receive the screen stream sent by the source device 10 through the screen projection communication connection; or, the target device 20 can execute S202 to obtain its own display status after receiving the screen stream sent by the source device 10. This application embodiment does not impose any restrictions on this.
[0071] S204. When the display status of the target device 20 indicates that the target device 20 is displaying an application that supports split-screen, the target device 20 displays the user interface of the application that supports split-screen and the screen of the source device 10 in split-screen mode.
[0072] S205. When the display status of the target device 20 indicates that the target device 20 is displaying an application that does not support split-screen, the target device 20 displays the screen of the source device 10 on the user interface of the application that does not support split-screen.
[0073] S206. When the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 switches from the desktop to the screen of the source device 10.
[0074] Optionally, in some embodiments, when the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 may also display the screen of the source device 10 floating on the desktop.
[0075] Optionally, in other embodiments, when the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 may also display the desktop of the target device 20 and the screen of the source device 10 in split screen, or display the split-screen recommendation interface and the screen of the source device 10 in split screen.
[0076] Figures 3A-3G are a set of user interface diagrams for establishing a screen mirroring communication connection provided in this application.
[0077] When displaying any user interface, the source device 10 (e.g., a mobile phone, device name "PHONE-0") can detect a swipe-down operation on the screen. In response to this operation, the source device 10 can display a control center interface. Figure 3A is a schematic diagram of the desktop of the source device 10 provided in an embodiment of this application. As shown in Figure 3A, when displaying the desktop, the source device 10 can detect a swipe-down operation on the screen. In response to this operation, the source device 10 can display the user interface shown in Figure 3B. The user interface shown in Figure 3B can be referred to as the control center interface.
[0078] As shown in Figure 3B, the control center interface may include a screen mirroring shortcut control 301. The source device 10 can detect user operations on the screen mirroring shortcut control 301, such as a click operation. In response to this operation, the source device 10 can search for nearby available devices that support screen mirroring. Referring to Figure 3C, after detecting a user operation on the screen mirroring shortcut control 301, the source device 10 can display a dialog box 302. The dialog box 302 includes a prompt message, such as "Searching for available devices," to inform the user that the source device 10 is searching for nearby available devices that support screen mirroring. As shown in Figure 3C, preferably, after detecting a user operation on the screen mirroring shortcut control 301, the source device 10 can redisplay the desktop and display the dialog box 302 on the desktop.
[0079] Referring to Figure 3D, after finding available devices that support screen mirroring, the source device 10 can display dialog box 303. Dialog box 302 includes a list of available devices, displaying the found devices that support screen mirroring, such as "FOLDPHONE-1" and "DESKTOP-2". The option "FOLDPHONE-1" corresponds to a foldable phone with the device name "FOLDPHONE-1", and the option "DESKTOP-2" corresponds to a laptop computer 22 with the device name "DESKTOP-2". The user can determine the target device 20 by performing a user action on any option in the list of available devices.
[0080] Referring to Figure 3E, for example, source device 10 can detect user operation on option "FOLDPHONE-1". In response to the operation, source device 10 can send a request to "FOLDPHONE-1" to establish a screen mirroring communication connection. At this time, the foldable phone with the device name "FOLDPHONE-1" is the target device 20.
[0081] Referring to Figure 3F, after receiving the above request, the foldable phone (i.e., target device 20) can display a dialog box 304. The dialog box 304 may include a query message, such as "Attempting screen mirroring, do you agree?". The user can agree to the source device 10's request to establish a screen mirroring communication connection by operating on control 305; or, the user can also reject the source device 10's request to establish a screen mirroring communication connection by operating on control 306.
[0082] After agreeing to the request from source device 10 to establish a screen mirroring communication connection, source device 10 establishes a screen mirroring communication connection with target device 20. Subsequently, after each frame of screen image is synthesized, source device 10 can send the screen image to target device 20 through the aforementioned screen mirroring communication connection. The collection of screen images sent by source device 10 to target device 20 constitutes the screen stream. This process is called source device 10 sending a screen stream to target device 20 through the screen mirroring communication connection.
[0083] In this embodiment of the application, after requesting the establishment of a screen mirroring communication connection, the target device 20 can also obtain its own display status:
[0084] 1. When the display status of the target device 20 indicates that the target device 20 is displaying an application that supports split-screen, the target device 20 displays the user interface of the application that supports split-screen and the screen of the source device 10 in split-screen mode.
[0085] Referring to Figure 3F, exemplarily, when a request to establish a screen mirroring communication connection is received, the target device 20 is displaying a note-taking application (first application) in full screen. In response to the request, the target device 20 may display a dialog box 304 on the user interface (first interface) of the note-taking application currently being displayed in full screen. After detecting a user operation on control 305, a screen mirroring communication connection can be established between the source device 10 and the target device 20.
[0086] The note-taking application may include multiple layout resources. Based on these multiple layout resources, the note-taking application can support split-screen display, that is, adjust the size and layout of the application's user interface according to the size of the allocated screen display area. At this time, the display state of the target device 20 indicates that the target device 20 is displaying an application that supports split-screen. Therefore, according to the above display state, after receiving the screen image of the source device 10 sent by the source device 10, the target device 20 can display the user interface of the note-taking application and the screen image of the source device 10 in a split-screen manner.
[0087] Referring to Figure 3G, the target device 20 can display two split-screen windows, such as split-screen window 31 (first split-screen window) and split-screen window 32 (second split-screen window). The target device 20 can continue to display the user interface of the note-taking application (second interface) in split-screen window 31, and display the screen of the source device 10 (first screen) in split-screen window 32, such as the desktop of the source device 10 that is currently displayed.
[0088] When the note-taking application is displayed in full screen, the target device 20 can display the table of contents and content in columns (first interface). Referring to Figure 3F, the target device 20 can display a table of contents including multiple note summaries (e.g., notes 1-4) on the left side of the screen; and display the specific content of a single note (e.g., note 1) on the right side of the screen. Referring to Figure 3G, the note-taking application's user interface continues to be displayed in the split-screen window 31 (second interface). This can be achieved by continuing to display the table of contents of the note-taking application in the split-screen window 31; alternatively, it can be achieved by continuing to display the user interface of the note-taking application in the split-screen window 31, or by continuing to display the content of a single note in the split-screen window 31. The user interface of the note-taking application continuing to be displayed in the split-screen window 31 includes part or all of the content of the previous note-taking application's user interface.
[0089] A horizontal bar control is provided in a split-screen window. As shown in Figure 3G, a horizontal bar control 311 is provided in split-screen window 31, and a horizontal bar control 321 is provided in split-screen window 32. The horizontal bar control can be used to switch display modes. For example, the target device 20 can display the note interface in split-screen window 31 in full screen based on user operation of the horizontal bar control 311; or, the target device 20 can display the note interface in split-screen window 31 in floating mode based on another user operation of the horizontal bar control 311. Correspondingly, the target device 20 can display the desktop of the source device 10 in split-screen window 32 in full screen / floating mode based on user operation of the horizontal bar control 321. This will be described in detail in subsequent embodiments and will not be elaborated here.
[0090] When displaying in split-screen mode, the target device 20 also displays a handle 312. The target device 20 can update the size of the split-screen window based on dragging operations performed on the handle 312. For example, the target device 20 can increase the size of the split-screen window 32 and decrease the size of the split-screen window 31 by dragging the handle 312 to the left; conversely, the target device 20 can decrease the size of the split-screen window and increase the size of the split-screen window 312 by dragging the handle 312 to the right. Understandably, as the split-screen window increases or decreases, the target device 20 can adaptively adjust the content within that split-screen window.
[0091] Other applications installed on the target device 20, such as gallery, browser, and reader, can also support split-screen display. When a screen mirroring communication connection is established, and the target device 20 is displaying other applications that support split-screen, such as gallery, browser, and reader, the target device 20 can also determine that it is currently displaying an application that supports split-screen. Therefore, the target device 20 displays the user interface of the application that supports split-screen and the screen of the source device 10 in a split-screen format. These will not be listed one by one here.
[0092] Referring to Figure 3H, in other embodiments, the source device 10 can also detect user operations on the trust ring card 309. In response to these operations, the source device 10 can display the trust ring interface shown in Figure 3I. The trust ring interface can display multiple device icons that have established trust connections with the source device 10, such as icons 314, 315, and 316. Icon 314 corresponds to a laptop that has established a trust connection with the source device 10, icon 315 corresponds to a tablet that has established a trust connection with the source device 10, and icon 316 corresponds to a foldable phone that has established a trust connection with the source device 10. Icon 313 corresponds to the source device 10. The source device 10 can provide its capabilities and resources to other devices that have established trust connections.
[0093] Referring to Figures 3I-3J, source device 10 can detect user operations applied to icon 313. Then, source device 10 can display multiple service icons, such as icons 317 and 318. Source device 10 can detect user operations that drag icon 317 to icon 316. In response to the above operations, source device 10 can send a request to establish a screen mirroring communication connection to the foldable screen phone (i.e., target device 20) corresponding to icon 316. After establishing the screen mirroring communication connection, referring to Figure 3G, source device 10 can send its screen stream to target device 20 for display on target device 20.
[0094] Not limited to the methods shown in Figures 3A-3E and 3H-3K, users can also initiate a screen mirroring request to the target device 20 through other operations, establish a screen mirroring communication connection, and then send the screen stream of the source device 10 to the target device 20 for display on the target device 20. This will not be elaborated further here.
[0095] 2. When the display status of the target device 20 indicates that the target device 20 is displaying an application that does not support split-screen, the target device 20 displays the screen of the source device 10 on the user interface of the application that does not support split-screen.
[0096] Referring to Figure 4A, exemplarily, upon receiving a request to establish a screen mirroring communication connection, the target device 20 is displaying a video playback interface 411 (third interface) of a video player (second application) in full screen. In response to the request, the target device 20 may display a dialog box 304 on the currently full-screen video playback interface 411. After detecting a user operation on control 305, a screen mirroring communication connection can be established between the source device 10 and the target device 20.
[0097] In some embodiments, the video player does not support split-screen display. In this case, the display state of the target device 20 indicates that the target device 20 is displaying an application that does not support split-screen. Therefore, based on the above display state, after receiving the screen image of the source device 10 sent by the source device 10, the target device 20 can display the screen image of the source device 10 floating on the user interface of the application that does not support split-screen.
[0098] Referring to Figure 4B, the target device 20 can continue to display the video playback interface 411 in full screen at the previous size. Simultaneously, the target device 20 can create a floating window 41 (first floating window). The target device 20 can display the screen of the source device 10 (second screen) within the floating window 41, such as the desktop currently displayed on the source device 10. The floating window 41 is layered above the video playback interface 411. Therefore, the user can simultaneously view both the video playback interface 411 and the projected screen of the source device 10.
[0099] The target device 20 also includes other applications that do not support split-screen. Similarly, when a screen mirroring communication connection is established and the target device 20 is displaying other applications that do not support split-screen, the target device 20 can display the screen of the source device 10 floating on the user interface of the application that does not support split-screen. These will not be listed one by one here.
[0100] 3. When the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 switches from the desktop to the screen of the source device 10.
[0101] Referring to Figure 5A, exemplarily, when a request to establish a screen mirroring communication connection is received, the target device 20 is displaying its desktop in full screen. In response to the request, the target device 20 can display a dialog box 304 on the currently displayed desktop. After detecting a user operation on control 305, a screen mirroring communication connection can be established between the source device 10 and the target device 20. At this time, the display state of the target device 20 indicates that it is displaying its desktop in full screen. Therefore, based on the display state, after receiving the screen image of the source device 10 sent by the source device 10, the target device 20 can switch from the desktop to the screen image of the source device 10. For example, the target device 20 can display the screen image of the source device 10 in full screen.
[0102] Referring to Figure 5B, the target device 20 can stop displaying the desktop and switch to displaying the screen image of the source device 10 (the third screen image), such as the desktop image currently displayed by the source device 10. As shown in Figure 5B, the target device 20 can obtain a split-screen window 43 with the same aspect ratio as the screen of the source device 10 based on the current display posture of the target device 20, and use it to display the screen image of the source device 10. Other areas outside the split-screen window 43 can display a black background color.
[0103] In some embodiments, the screen projection content sent by the source device 10 is an application interface other than the desktop. In this case, when switching to the screen of the source device 10, the target device 20 can display an application interface with more content that matches the screen size of the target device 20. Here, the application interface with more content that corresponds to the application interface actually displayed by the source device 10 is also referred to as the screen of the source device 10.
[0104] Specifically, during the establishment of the screen mirroring communication connection, the source device 10 can obtain the screen size of the target device 20. The source device 10 can then draw an application interface that matches the screen size of the target device 20 and includes more application content, and then send the application interface to the target device 20 for display.
[0105] Referring to Figure 5C, when the source device 10 plans to project the note-taking application interface 512 onto the target device 20, the source device 10 can, based on the obtained screen size of the target device 20, draw a note-taking application interface 502 that matches the screen size of the target device 20 and includes more application content, and then send the note-taking application interface 502 to the target device 20. Thus, the target device 20 can display the note-taking application interface 502 that matches its own screen size and includes more application content.
[0106] When the desktop is displayed in full screen, it indicates that the target device 20 does not currently have an urgent display task. Therefore, as shown in Figures 5B and 5C, after receiving the screen projection request, the target device 20 can display the screen of the source device 10 in full screen. At this time, displaying the screen of the source device 10 in full screen can show as much projection content as possible, improve screen utilization, and not affect the user's browsing experience.
[0107] Optionally, in some embodiments, when the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 may also display the screen of the source device 10 floating on the desktop.
[0108] Referring to Figure 5D, the target device 20 can continue to display its desktop in full screen. Simultaneously, the target device 20 can create a floating window 42. The target device 20 can display the screen of the source device 10 within the floating window 42, such as the desktop currently displayed by the source device 10.
[0109] Optionally, in other embodiments, when the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 may also display the desktop of the target device 20 and the screen of the source device 10 in split screen, or display the split-screen recommendation interface and the screen of the source device 10 in split screen.
[0110] Referring to Figure 5E, the target device 20 can display two split-screen windows: split-screen window 31 and split-screen window 32. At this time, the target device 20 can continue to display its desktop in split-screen window 31, and display the screen of the source device 10 in split-screen window 32, such as the desktop of the source device 10 that is currently being displayed.
[0111] Understandably, while continuing to display the desktop of the target device 20, the target device 20 can adjust the layout of its desktop to adapt to the changing display area. Similarly, the target device 20 will also display the horizontal bar control 311 for the corresponding split-screen window 31, the horizontal bar control 321 for the corresponding split-screen window 32, and the handle 312, so that the user can adjust the size and display mode of the split-screen windows, which will not be elaborated here.
[0112] Alternatively, referring to Figure 5F, the target device 20 can display a split-screen recommendation interface 511, including a search bar 501 and multiple application icons, in the split-screen window 31, and display the screen of the source device 10 in the split-screen window 32. Users can quickly open the corresponding application through the application icons displayed in the split-screen recommendation interface 511, thereby browsing the application and the screen of the source device 10 in a split-screen format. For applications already installed on the target device 20 but whose icons are not yet displayed in the split-screen recommendation interface 511, users can also quickly access them through the search bar 501, thereby quickly opening the aforementioned applications and browsing the application and the screen of the source device 10 in a split-screen format.
[0113] In some embodiments, when a request to establish a screen mirroring communication connection is received, the target device 20 may also be displaying application A and application B in a split-screen manner. In this case, in response to the above request, after the screen mirroring communication connection is established, the target device 20 may display a floating window on the interface where application A and application B were previously displayed in a split-screen manner, and the screen image received from the source device 10 may be displayed in the floating window.
[0114] In some embodiments, when a request to establish a screen mirroring communication connection is received, the target device 20 may also be displaying one or more applications through one or more floating windows. In this case, in response to the above request, after establishing the screen mirroring communication connection, the target device 20 may add a new floating window on the interface that previously displayed one or more floating windows, and display the received screen image of the source device 10 in the floating window.
[0115] The target device 20 can be configured with a maximum number of floating windows. When the number of currently displayed floating windows is less than the maximum, after establishing a screen mirroring communication connection, the target device 20 can add a new floating window to the interface where one or more floating windows were previously displayed, displaying the screen image received from the source device 10. When the number of currently displayed floating windows reaches the maximum, after establishing a screen mirroring communication connection, the target device 20 can close the earliest opened floating window (denoted as floating window M) and add a new floating window, displaying the screen image received from the source device 10. Application C is displayed in floating window M. After closing floating window M, the target device 20 can display a floating ball corresponding to application C. After detecting a user operation on the floating ball, the target device 20 can redisplay application C. Optionally, the target device 20 can redisplay floating window M, redisplaying application C within floating window M. Optionally, the target device can also display application C in full screen.
[0116] Figure 6 is a flowchart of another screen projection display method provided in an embodiment of this application.
[0117] S301. Source device 10 and target device 20 establish a screen projection communication connection.
[0118] S302. The target device 20 obtains its own display status.
[0119] S303. Target device 20 acquires the display posture of source device 10.
[0120] The display orientation of an electronic device includes landscape and portrait modes. Landscape mode refers to the orientation when the long bezel of the electronic device is parallel to the horizontal plane; portrait mode refers to the orientation when the short bezel of the electronic device is parallel to the horizontal plane. The electronic device can determine its current display orientation using an accelerometer and a gyroscope. The electronic device includes a source device 10 and a target device 20. Based on the screen projection communication connection established in S301, the target device 20 can obtain the display orientation of the source device 10 from the source device 10.
[0121] S304. Source device 10 sends a screen stream to target device 20 via screen mirroring communication connection.
[0122] This application embodiment does not restrict the order in which the target device 20 executes S302, S303, and S304.
[0123] Optionally, the target device 20 can also determine the display orientation of the source device 10 based on the size of the screen stream. The size of the screen stream is represented as X1 (width) * X2 (height). The width is parallel to the horizontal plane, and the height is perpendicular to the horizontal plane. When X1 < X2, the target device 20 can determine that the source device 10 is displayed in portrait mode; when X1 > X2, the target device 20 can determine that the source device 10 is displayed in landscape mode. In this case, the target device 20 does not need to execute S303.
[0124] S305. When the display status of the target device 20 indicates that the target device 20 is displaying an application that supports split-screen, and the display posture of the source device 10 indicates that the source device 10 is displaying in portrait mode, the target device 20 displays the user interface of the application that supports split-screen and the screen of the source device 10 in a split-screen manner on the left and right.
[0125] Referring to Figure 3F, after establishing a screen mirroring communication connection based on the user operation applied to control 305, the target device 20 can obtain the display orientation of the source device 10. Referring to Figures 3A-3E, at this time, the source device 10 is displayed in portrait mode. Therefore, referring to Figure 3G, based on its own display of a split-screen application, and with the source device 10 displaying in portrait mode, the target device 20 can display two horizontally arranged split-screen windows: split-screen window 31 and split-screen window 32. The target device 20 can continue to display the user interface of the split-screen-enabled note-taking application in split-screen window 31, and display the screen of the source device 10 in split-screen window 32, that is, displaying the user interface of the split-screen-enabled application and the screen of the source device 10 in a horizontal split-screen configuration.
[0126] S306. When the display status of the target device 20 indicates that the target device 20 is displaying an application that supports split-screen, and the display orientation of the source device 10 indicates that the source device 10 is displaying in landscape mode, the target device 20 displays the user interface of the application that supports split-screen and the screen of the source device 10 in a split-screen manner.
[0127] Referring to Figures 7A-7F, when the source device 10 is displayed in landscape mode (e.g., displaying the document XXX.pdf), the user can perform a swipe-down operation and interact with the screen mirroring shortcut control 301. Based on these operations, the source device 10 begins searching for nearby available devices that support screen mirroring (e.g., "FOLDPHONE-1" or "DESKTOP-2"). Depending on the user's selection of any available device (e.g., the user's action on "FOLDPHONE-1"), the source device 10 sends a request to that available device to establish a screen mirroring communication connection, thereby establishing a screen mirroring communication connection with that device.
[0128] At this point, the target device 20 can determine that the source device 10 is in landscape mode. Therefore, referring to Figure 7G, based on its own display of a split-screen application and the source device 10 being in landscape mode, the target device 20 can display two vertically arranged split-screen windows: split-screen window 71 and split-screen window 72. Thus, the target device 20 can continue to display the user interface of the split-screen note-taking application in split-screen window 72, and display the screen of the source device 10, such as the document XXX.pdf viewing interface, in split-screen window 71.
[0129] S307. When the display status of the target device 20 indicates that the target device 20 is displaying an application that does not support split-screen, the target device 20 displays the screen of the source device 10 on the user interface of the application that does not support split-screen.
[0130] S308. When the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 switches from the desktop to the screen of the source device 10.
[0131] Optionally, in some embodiments, when the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 may also display the screen of the source device 10 floating on the desktop.
[0132] Optionally, in other embodiments, when the display status of the target device 20 indicates that the target device 20 is displaying the desktop in full screen, the target device 20 may also display the desktop of the target device 20 and the screen of the source device 10 in split screen, or display a split-screen recommendation interface (e.g., split-screen recommendation interface 511) and the screen of the source device 10 in split screen.
[0133] The split-screen window used to display the screen of the source device 10 during split-screen operation is called the target split-screen window, such as split-screen window 32 and split-screen window 71. The split-screen window used for display on the target device 20 itself during split-screen operation is called the local split-screen window, such as split-screen window 31 and split-screen window 72.
[0134] After receiving the screen stream from the source device 10, the target device 20 can determine the size of the target split-screen window based on the size of the screen stream from the source device 10, and then determine the size of the remaining local split-screen window.
[0135] Specifically, in a scenario of split-screen display, the target device 20 can determine the ratio P1 between the height of its own screen and the height of the source device 10's screen, and then determine the width of the screen image of the source device 10 to be displayed (target screen image, such as the first screen image) based on the aforementioned P1 and the width of the source device 10's screen.
[0136] As shown in Figure 8A, for example, the screen width of target device 20 is W1 and the height is H1; the screen width of source device 10 is W2 and the height is H2. Therefore, target device 20 can determine P1 = H1 / H2. Based on P1 and the screen width W2 of source device 10, target device 20 can determine the width of the target screen image W3 = P1 * W2. When the entire target split-screen window is used to display the target screen image, the width of the target split-screen window is W3. Therefore, the width of the local split-screen window W4 = W1 - W3. As shown in Figure 8A, the split-screen window enclosed by W4 * H1 is the split-screen window used for displaying the target device 20 itself, i.e., the local split-screen window; the split-screen window enclosed by W3 * H1 is the split-screen window used to display the screen image of source device 10, i.e., the target split-screen window.
[0137] In a scenario of split-screen display, the target device 20 can determine the ratio P2 between the width of its own screen and the width of the source device 10's screen, and then determine the height of the target screen image based on the aforementioned P2 and the height of the source device 10's screen.
[0138] As shown in Figure 8B, the target device 20 can determine P2 = W1 / W2. Based on P2 and the height H2 of the source device 10's screen, the target device 20 can determine the height H3 of the target screen image = P2 * H2. When the entire target split-screen window is used to display the target screen image, the height of the target split-screen window is H3. Therefore, the height H4 of the local split-screen window = H1 - H3. As shown in Figure 8B, the split-screen window enclosed by W1 * H4 is the local split-screen window used for displaying the target device 20 itself, and the split-screen window enclosed by W1 * H3 is the target split-screen window used to display the screen image of the source device 10.
[0139] Using the above method, the target device 20 can automatically adjust the size of the target screen and the target split-screen window according to the size of the screen stream sent by the source device 10 and the size of its own screen, so that the width / height of the target split-screen window is equal to the width / height of the target screen. This ensures that the projected content in the target screen is not distorted, reduces black borders, improves screen utilization, and thus enhances the user's browsing experience.
[0140] During the split-screen display of the user interface of the application supporting split-screen and the screen of the source device 10, the target device 20 can stop the split-screen display based on a touch operation performed on the screen. Figures 9A-9I are a set of schematic diagrams of user interfaces that stop the split-screen display based on user touch operations provided in this application.
[0141] A touch operation that slides from the left edge of the screen to the right is called a right swipe. A touch operation that slides from the right edge of the screen to the left is called a left swipe. Typically, in response to the above left / right swipe operations, the electronic device can return to the previous level of the interface (e.g., return from the interface displaying the specific content of a note to the table of contents).
[0142] Therefore, in this embodiment, the target device 20 can close the split-screen window according to the user's left / right swipe operation, providing the user with a gesture interaction experience that conforms to user habits. Specifically, in response to a left swipe operation, the target device 20 can close the right split-screen window, stop displaying the user interface in the right split-screen window, and display the user interface in the left split-screen window in full screen; in response to a right swipe operation, the target device 20 can close the left split-screen window, stop displaying the user interface in the left split-screen window, and display the user interface in the right split-screen window in full screen.
[0143] Referring to Figure 9A, after the split-screen display of the note-taking application and the screen of the source device 10, the target device 20 can detect a right swipe operation. Referring to Figure 9B, in response to the above operation, the target device 20 can close the split-screen window 31, stop displaying the user interface of the note-taking application in the split-screen window 31, and display the screen of the source device 10 in the split-screen window 32 (the fourth interface) in full screen. When stopping the display of the note-taking application, the target device 20 can close the note-taking application; optionally, the target device 20 can also switch the note-taking application to run in the background.
[0144] In this embodiment, the entire screen is used to display an application, i.e., full-screen display, such as a full-screen note-taking application or a full-screen desktop of the source device 10. During the display of this application, the application's user interface may or may not fill the entire screen. Referring to Figure 9B, when the desktop of the source device 10 is displayed in full-screen mode, the desktop of the source device 10 may not fill the entire screen of the target device 20 to maintain the display style of the source device 10 itself, facilitating user use and differentiation.
[0145] Referring to Figures 9C-9D, after the split-screen display of the note-taking application and the screen of the source device 10, the target device 20 can detect a left swipe operation. In response to the above operation, the target device 20 can close the split-screen window 32, stop displaying the screen of the source device 10 in the split-screen window 32, and display the user interface of the note-taking application in the split-screen window 31 in full screen.
[0146] Preferably, when the screen display of the source device 10 is stopped, the target device 20 maintains the screen projection communication connection. This allows the target device 20 to re-display the screen of the source device 10 based on user actions (e.g., the user selecting to display the screen of the source device 10 in the background interface 901 in Figure 9H) to meet the user's browsing needs. Optionally, the target device 20 can also disconnect the screen projection communication connection to save power. As shown in Figure 9D, when switching to full-screen display, the target device 20 can display an application user interface that matches the screen size of the target device 20, maximizing the display of application content and improving screen utilization.
[0147] A touch operation that involves swiping upwards from the bottom edge of the screen is called a swipe-up operation. Typically, in response to a swipe-up operation, an electronic device can return to the home screen. Therefore, in this embodiment, the target device 20 can also display the home screen based on the user's swipe-up operation, in order to cater to user habits, provide users with a convenient interactive experience to access the home screen of the target device 20, and reduce the user's learning curve.
[0148] Referring to Figures 9E-9F, after the split-screen display of the note-taking application and the screen of the source device 10, the target device 20 can detect an upward swipe operation. In response to this operation, the target device 20 can stop the split-screen display of the note-taking application and the screen of the source device 10, and display its own desktop. The target device 20 can save the task of displaying the split-screen display of the note-taking application and the screen of the source device 10 to the background, maintaining the screen mirroring communication connection (e.g., receiving the screen stream from the source device 10 but not displaying it). After detecting a specific user operation (e.g., the user selecting to display the screen of the source device 10 in the background interface 901 in Figure 9H), the target device 20 can restart the above display task, that is, resume the split-screen display of the note-taking application and the screen of the source device 10.
[0149] A touch operation that involves swiping up, holding the touch position for a period of time, and then releasing the touch is called a swipe-up-hold operation. Typically, in response to a swipe-up-hold operation, an electronic device can display a background interface. Therefore, in this embodiment, the target device 20 can also display the background interface based on the user's swipe-up-hold operation, in order to conform to user habits, provide users with a convenient interactive experience to access the background interface of the target device 20, and reduce the user's learning cost.
[0150] Referring to Figures 9G-9H, after the split-screen display of the note-taking application and the screen of the source device 10, the target device 20 can detect an upward swipe-and-hold operation. In response to this operation, the target device 20 can display a background interface 901. The background interface 901 includes one or more background cards, such as cards 911, 912, and 913. One background card corresponds to one screen state. Furthermore, one background card can correspond to one or more background applications. For example, card 911 corresponds to the screen state of the split-screen display of the note-taking application and the screen of the source device 10 (at this time, card 911 corresponds to the note-taking application and the application projected from the source device 10), card 912 corresponds to the screen state of the full-screen display of player A (at this time, card 912 corresponds to the video application), and card 913 corresponds to the screen state of the full-screen display of the file management application (at this time, card 913 corresponds to the file management application).
[0151] The target device 20 can switch to the screen state corresponding to any background card based on the user operation performed on that background card. For example, referring to Figures 9H-9I, the target device 20 can detect a touch operation performed on card 911 (first background card), and in response to the operation, the target device 20 can re-split the screen display of the note-taking application and the screen of the source device 10.
[0152] Similarly, during the process of displaying the screen of the source device 10 in full screen, the target device 20 can switch the screen display according to the touch operation applied to the screen.
[0153] Referring to Figures 9J-9K, when the screen of the source device 10 is displayed in full screen (e.g., the note-taking application interface sent by the source device 10), the target device 20 can detect a right swipe (or left swipe, or up swipe) operation. In response to this operation, the target device 20 can display the desktop of the source device 10. For example, the desktop of the source device 10 can be displayed in full screen. In this way, when the screen of the source device 10 is projected onto the target device 20 in full screen, the user can obtain a similar immersive experience as on the source device 10. Referring to Figures 9K-9L, after switching to the desktop of the source device 10, if the target device 20 detects another right swipe (or left swipe, or up swipe) operation, in response to this operation, the target device 20 can display its own (i.e., the desktop of the target device 20).
[0154] Referring to Figures 9M-9N, when the screen of the source device 10 is displayed in full screen, the target device 20 can detect an upward swipe-and-hold operation. In response to this operation, the target device 20 can display the background interface 902. At this time, after detecting a touch operation on the card 914, in response to this operation, the target device 20 can refresh the note application interface 502 shown in Figure 9M.
[0155] Optionally, in some embodiments, when displaying the user interface of a split-screen application and the screen of the source device 10 in a split-screen format, the target device 20 may also display a navigation bar in the target split-screen window displaying the screen of the source device 10. The navigation bar includes multiple controls for switching the screen of the source device 10. Users can switch the screen of the source device 10 using the controls in the navigation bar. The area displaying the navigation bar is also called the navigation bar area.
[0156] Referring to Figures 10A and 10B, after detecting a user operation on control 305 and establishing a screen mirroring communication connection between the source device 10 and the target device 20, the target device 20 can display two split-screen windows: split-screen window 31 and split-screen window 32. The target device 20 can continue to display the user interface of the note-taking application in split-screen window 31, and display the screen of the source device 10 in split-screen window 32. At this time, split-screen window 32 also includes a navigation bar 103. Preferably, the navigation bar 103 is at the bottom of split-screen window 32, and the width of the navigation bar 103 is equal to the width of split-screen window 32.
[0157] The navigation bar 103 includes one or more controls, such as a back control 111, a homepage control 112, and a background control 113. Users can use the back control 111 to switch the screen displayed in the split-screen window 32 to the previous user interface of the source device 10, the homepage control 112 to switch the screen displayed in the split-screen window 32 to the desktop of the source device 10, and the background control 113 to switch the screen displayed in the split-screen window 32 to the background interface of the source device 10. Users can switch the screen of the source device 10 within the split-screen window 32 using these controls.
[0158] Referring to Figure 10C, in a split-screen display scenario, the navigation bar 103 can be positioned on the right or left side of the split-screen window 32, and the height of the navigation bar 103 is equal to the height of the split-screen window 71. Similarly, users can switch the screen display of the source device 10 in the split-screen window 71 using the controls in the navigation bar 103.
[0159] Specifically, in a scenario where the left and right screens are split and the navigation bar 103 is displayed, the target device 20 can determine the ratio P3 of its own screen height to the screen height of the source device 10, and then determine the width of the target screen and the width of the navigation bar 103 based on the above P3 and the width of the screen of the source device 10.
[0160] Referring to Figure 11A, assuming the height of the reserved navigation bar 103 is H0, the target device 20 can determine P3 = (H1 - H0) / H2. Based on the above P3 and the width W2 of the source device 10's screen, the target device 20 can determine the width W3' of the target screen image = P3 * W2, and determine the width of the navigation bar 103, i.e., W3'. Therefore, the width W4' of the local split-screen window = W1 - W3'. As shown in Figure 11A, the split-screen window enclosed by W4' * H1 is the local split-screen window used for displaying the target device 20 itself, and the split-screen window enclosed by W3' * H1 is the target split-screen window used to display the screen image of the source device 10. Among them, the area enclosed by W3' * H0 is the area used to display the navigation bar 103, and the area enclosed by W3' * (H1 - H0) is the area used to display the target screen image.
[0161] Similarly, in a scenario where the screen is split vertically and the navigation bar 103 is displayed, the target device 20 can determine the ratio P4 between the width of its own screen and the width of the source device 10's screen, and then determine the height of the target screen image based on the aforementioned P4 and the height of the source device 10's screen.
[0162] Referring to Figure 11B, assuming the width of the reserved navigation bar 103 is W0, the target device 20 can determine P4 = (W1 - W0) / W2. Based on the above P4 and the height H2 of the source device 10's screen, the target device 20 can determine the height H3' of the target screen image = P4 * H2, and determine the height of the navigation bar 103, i.e., H3'. Therefore, the height H4' of the local split-screen window = H1 - H3'. As shown in Figure 11B, the split-screen window enclosed by H4' * W1 is the local split-screen window used for displaying the target device 20 itself, and the split-screen window enclosed by H3' * W1 is the target split-screen window used to display the screen image of the source device 10. Among them, the area enclosed by H3' * W0 is the area used to display the navigation bar 103, and the area enclosed by H3' * (W1 - W0) is the area used to display the target screen image.
[0163] In some embodiments, the target device 20 may set the background color of the navigation bar 103 to white and the color of the controls in the navigation bar 103 (e.g., the back control 111, the homepage control 112, and the background control 113) to black, making the controls more conspicuous and easier for the user to access. Similarly, the target device 20 may also set the background color of the navigation bar 103 to black and the color of the controls in the navigation bar 103 to white. In some embodiments, the target device 20 may use other sets of colors with strong contrast to highlight the controls in the navigation bar 103; this application embodiment does not limit this.
[0164] Furthermore, the target device 20 can also adjust the background color of the navigation bar 103 and the color of the controls in the navigation bar 103 according to the color of the screen of the source device 10 in the target split-screen window, so that the background color of the navigation bar 103 is the same as or similar to the color of the screen of the source device 10, thereby enhancing the consistency between the navigation bar 103 and the screen of the source device 10 and improving the user's viewing experience.
[0165] Specifically, the target device 20 can obtain the dark and light modes of the source device 10. When the source device 10 is in dark mode, the target device 20 can set the background color of the navigation bar 103 to black, or other colors that are the same as or similar to the dark mode used by the source device 10. When the source device 10 is in light mode, the target device 20 can set the background color of the navigation bar 103 to white, or other colors that are the same as or similar to the light mode used by the source device 10.
[0166] The target device 20 can also obtain the color of a specific area of the source device 10 through a color picker, and then set the background color of the navigation bar 103 to be the same as or similar to the color of the specific area. Preferably, the specific area is the bottom area of the screen of the source device 10.
[0167] Optionally, in some embodiments, the target device 20 may also switch from the screen of the floating display source device 10 to the screen of the split-screen display source device 10.
[0168] Figures 12A-12F are a set of user interface diagrams provided in this application example, showing the switching from floating display to split-screen display.
[0169] Referring to Figures 12A-12B, after the screen of the source device 10 is displayed in a floating manner, the target device 20 can detect an upward swipe operation. In response to this operation, the target device 20 can stop displaying the video playback interface 411 and display the desktop of the target device 20. During the transition from the video playback interface 411 to the desktop, the target device 20 maintains the floating display of the screen of the source device 10.
[0170] After displaying the desktop, the target device 20 can detect a user operation to open any application that supports split-screen. In response to this operation, the target device 20 can stop displaying its desktop and display the user interface of the application that supports split-screen. For example, referring to Figures 12B-12C, the target device 20 can detect a user operation to open a note-taking application (an application that supports split-screen) by clicking the note icon. In response to this operation, the target device 20 can stop displaying its desktop and display the user interface (fifth interface) of the note-taking application (third application). During the process of switching from the desktop to the user interface of any application that supports split-screen, the target device 20 continues to display the screen of the source device 10.
[0171] As shown in Figure 12C, the floating window 41 includes a settings bar 1200. The settings bar 1200 includes controls 1201, 1202, 1203, and 1204. Among them, control 1201 can be used to switch to full-screen display, control 1202 can be used to close the floating window 41 and pause the display of the projected content without interrupting the projected communication connection, control 1203 can be used to display more controls, and control 1204 can be used to close the floating window 41, stop the display of the projected content, and disconnect the projected communication connection.
[0172] For example, referring to Figures 12C-12D, the target device 20 can detect a user operation by clicking control 1203. In response to this operation, the target device 20 can display an option bar 1211. The option bar 1211 includes controls 1201, 1202, and 1204, and also includes controls 1205 and 1206. Among them, control 1205 can be used to switch to split-screen display, and control 1206 can be used to switch to floating display.
[0173] Referring to Figure 12E, the target device 20 can detect the user operation of clicking the control 1205 (first split-screen operation). In response to the above operation, the target device 20 can display the projected content in the floating window 41 and the application currently running on the target device 20 in a split-screen manner. Referring to Figure 12F, the target device 20 can display split-screen window 31 (fifth split-screen window) and split-screen window 32 (sixth split-screen window), and display the user interface of the note-taking application (seventh interface) in split-screen window 31, and display the screen of the source device 10 (second screen) in split-screen window 32.
[0174] As shown in Figure 12F, a horizontal bar control 321 is also provided in the split-screen window 32 displaying the screen of the source device 10. The horizontal bar control 321 of the split-screen window 32 corresponds to the control 1205 in the floating window 41. Therefore, when displaying the user interface of the note-taking application and the screen of the source device 10 in split-screen mode, the user can access the option bar 1211 through the horizontal bar control 321, and then switch to floating display or full-screen display to meet the user's real-time needs and improve the user's browsing experience. Further details are omitted here.
[0175] In some embodiments, the target device 20 may also switch from the screen of the full-screen display source device 10 to the screen of the split-screen display source device 10.
[0176] Figures 13A-13D are a set of user interface diagrams provided in this application example, showing the switching from full-screen display to split-screen display.
[0177] Referring to Figures 13A-13B, when the screen of the source device 10 is displayed in full screen, the target device 20 can display control 1301 on the screen of the source device 10. The target device 20 can detect user operation by clicking control 1301, and in response to the above operation, the target device 20 can display option bar 1211. Then, referring to Figures 13B-13C, the target device 20 can detect user operation by clicking control 1205 (second split-screen operation), and in response to the above operation, the target device 20 can display split-screen window 31 (seventh split-screen window) and split-screen window 32 (eighth split-screen window), and display a split-screen recommendation interface 511 (sixth interface) including search bar 501 and multiple application icons in split-screen window 31, and display the screen of the source device 10 (third screen) in split-screen window 32.
[0178] Furthermore, the target device 20 can detect user operations that open any application that supports split-screen. In response to these operations, the target device 20 can display the user interface of the application supporting split-screen and the screen of the source device 10 in a split-screen manner. Referring to Figures 13C-13D, the target device 20 can detect user operations that open a note-taking application (an application that supports split-screen) by clicking the note icon. In response to these operations, the target device 20 can display the user interface of the note-taking application and the screen of the source device 10 in a split-screen manner. As shown in Figure 13D, a horizontal bar control 321 is also provided in the split-screen window 32 that displays the screen of the source device 10. When the user interface of the note-taking application and the screen of the source device 10 are displayed in a split-screen manner, the user can access the option bar 1211 through the horizontal bar control 321, and then switch to floating display or full-screen display, which will not be elaborated here.
[0179] Optionally, in some embodiments, when displaying the screen of the source device 10, the target device 20 may display a projection identifier (first identifier) on the screen of the source device 10 to indicate to the user the specific source of the image content in that area.
[0180] Taking split-screen display as an example, referring to Figure 14A, the target device 20 can display a screen sharing identifier 1401 on the screen of the source device 10 at the top of the split-screen window 32, such as: Screen sharing - from "PHONE-0", to prompt the user that the image content in the split-screen window 32 comes from "PHONE-0" (i.e., the source device 10), so as to remind the user to distinguish.
[0181] Similarly, when the screen of the source device 10 is displayed in full screen or floating display, the target device 20 can display the projection icon 1401 on the screen of the source device 10, which will not be shown one by one here.
[0182] Optionally, as shown in Figure 14B, when the screen of the source device 10 is displayed in a floating display, the target device 20 may display the projection icon 1401 in the settings bar 1200. Optionally, as shown in Figures 14C-14D, when the screen of the source device 10 is displayed in split-screen or full-screen mode, the target device 20 may also display the projection icon 1401 in the top area of the screen outside the screen of the source device 10. Optionally, as shown in Figures 14E-14F, when the screen of the source device 10 is displayed in split-screen or full-screen mode, the target device 20 may also display the projection icon 1401 in the lower right corner of the screen. This application embodiment does not limit the specific display position of the projection icon.
[0183] Figure 15 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.
[0184] The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0185] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0186] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0187] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.
[0188] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0189] For example, processor 110 can couple to touch sensor 180K, charger, flash, camera 193, etc., via I2C bus interface. Processor 110 can couple to audio module 170 via I2S bus interface to realize communication between processor 110 and audio module 170. Audio module 170 can transmit audio signals to wireless communication module 160 via PCM interface to realize the function of answering phone calls through Bluetooth headset. Processor 110 can communicate with Bluetooth module in wireless communication module 160 via UART interface to realize Bluetooth function. Audio module 170 can transmit audio signals to wireless communication module 160 via UART interface to realize the function of playing music through Bluetooth headset. MIPI interface can be used to connect processor 110 to peripheral devices such as display 194 and camera 193. MIPI interface includes camera serial interface (CSI), display serial interface (DSI), etc. Processor 110 and camera 193 can communicate through CSI interface to realize the shooting function of electronic device. The processor 110 and display screen 194 can communicate via the DSI interface to realize the display function of the electronic device. The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display screen 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device, or to transfer data between the electronic device and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices.
[0190] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a limitation on the structure of the electronic device. In other embodiments of this application, the electronic device may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0191] The charging management module 140 receives charging input from the charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141. The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, internal memory 121, display 194, camera 193, and wireless communication module 160, etc.
[0192] The wireless communication function of electronic devices can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0193] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. Mobile communication module 150 can provide wireless communication solutions for electronic devices, including 2G / 3G / 4G / 5G. Wireless communication module 160 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLANs) (such as Wireless Fidelity (Wi-Fi) networks), Bluetooth (BT), Global Navigation Satellite System (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies.
[0194] In some embodiments, antenna 1 of the electronic device is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling the electronic device to provide other wireless communication technologies. These other wireless communication technologies may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), etc. The GNSS may include Global Positioning System (GPS), Global Navigation Satellite System (GLONASS), BeiDou Navigation Satellite System (BDS), Quasi-Zenith Satellite System (QZSS), and / or Satellite Based Augmentation Systems (SBAS), etc.
[0195] In this embodiment, the source device 10 and the target device 20 establish a screen projection communication connection based on the wireless communication functions provided by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, and send and receive the screen image of the source device 10.
[0196] Electronic devices implement display functions through GPUs, display screens 194, and application processors. A GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor, used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0197] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be manufactured using organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microled, micro-oled, quantum dot light-emitting diodes (QLEDs), etc. In some embodiments, the electronic device may include one or N displays 194, where N is a positive integer greater than 1.
[0198] In this embodiment, the source device 10 and the target device 20 display the user interface shown in Figures 3A-3G, 3H-3K, 4A-4B, 5A-5F, 7A-7G, 9A-9I, 9J-9N, 10A-10C, 12A-12F, 13A-13D, and 14A-14F, based on the display functions provided by the GPU, display screen 194, and application processor.
[0199] Electronic devices can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0200] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).
[0201] RAM can include static random-access memory (SRAM), dynamic random-access memory (DRAM), synchronous dynamic random-access memory (SDRAM), and double data rate synchronous dynamic random-access memory (DDR SDRAM, such as fifth-generation DDR SDRAM, which is generally called DDR5 SDRAM). NVM can include disk storage devices and flash memory.
[0202] RAM can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data. NVM can also store executable programs and user and application data, and can be pre-loaded into RAM for direct reading and writing by the processor 110.
[0203] In the embodiments of this application, the executable program code for implementing the screen projection display method shown in Figures 3A-3G, 3H-3K, 4A-4B, 5A-5F, 7A-7G, 9A-9I, 9J-9N, 10A-10C, 12A-12F, 13A-13D, and 14A-14F can be stored in NVM. After the electronic device is powered on, it can load the executable program code stored in the NVM into the RAM, enabling it to provide the user with the screen projection display function shown in Figures 3A-3G, 3H-3K, 4A-4B, 5A-5F, 7A-7G, 9A-9I, 9J-9N, 10A-10C, 12A-12F, 13A-13D, and 14A-14F.
[0204] The external memory interface 120 can be used to connect to an external NVM to expand the storage capacity of electronic devices.
[0205] Electronic devices can implement audio functions such as music playback and recording through audio modules 170, speakers 170A, receivers 170B, microphones 170C, headphone jacks 170D, and application processors.
[0206] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic devices can receive button input via buttons 190, generating key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card.
[0207] The term "user interface (UI)" used in the specification, claims, and drawings of this application refers to the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form acceptable to the user. The user interface of an application is source code written in a specific computer language such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on the terminal device, ultimately presenting user-recognizable content such as images, text, and buttons. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined using tags or nodes, such as XML tags. <textview> 、 <imgview> 、 <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a webpage, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a webpage is also defined through tags or nodes in the webpage source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>Used to define the elements and attributes of a webpage.
[0208] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0209] As used in the specification and appended claims of this application, the singular expressions "a," "an," "the," "the," "the," and "this" are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any or all possible combinations of one or more of the listed items. As used in the above embodiments, depending on the context, the term "when" can be interpreted as meaning "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if (the stated condition or event) is interpreted as meaning "if determining..." or "in response to determining..." or "when (the stated condition or event) is detected" or "in response to detecting (the stated condition or event)."
[0210] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.
[0211] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.< / canvas> < / video> < / videoview> < / imgview> < / textview>
Claims
1. A screen projection display method, applied to a first device, wherein the first device has a first application and a second application installed, characterized in that, The method includes: The first device establishes a screen projection communication connection with the second device; When the first device displays the first interface of the first application in full screen, the first device receives the first screen stream of the second device through the screen projection communication connection; The first device simultaneously displays a first split-screen window and a second split-screen window. The first split-screen window includes the second interface of the first application, and the second split-screen window includes the first screen image. The second interface includes part or all of the content in the first interface, and the first screen image comes from the first screen stream. When the first device displays the third interface of the second application in full screen, the first device receives the second screen stream from the second device through the screen projection communication connection; The first device displays a first floating window on the third interface. The first floating window includes a second screen image, which is derived from the second screen stream.
2. The method according to claim 1, characterized in that, The method further includes: When the first device displays the desktop in full screen, the first device receives the third screen stream from the second device through the screen projection communication connection; The first device stops displaying the desktop and displays a third screen image in full screen, the third screen image being derived from the third screen stream.
3. The method according to claim 1 or 2, characterized in that, When the second device is in portrait mode, the first and second split-screen windows are arranged horizontally; when the second device is in landscape mode, the first and second split-screen windows are arranged vertically.
4. The method according to claim 1, characterized in that, The second split-screen window also includes a first identifier, which is used to indicate that the first screen image comes from the second device.
5. The method according to claim 1, characterized in that, The aspect ratio of the first screen is the same as that of the second device screen. The width of the second split-screen window is the same as the width of the first screen. The height of the second split-screen window is equal to the height of the first device screen. The first split-screen window is located in the area of the first device screen other than the second split-screen window.
6. The method according to claim 1, characterized in that, The method further includes: The first device establishes a screen projection communication connection with the third device; When the first device displays the first interface of the first application in full screen, the first device receives the fourth screen stream from the third device through the screen projection communication connection; The first device simultaneously displays a third split-screen window and a fourth split-screen window. The third split-screen window includes the second interface of the first application, and the fourth split-screen window includes a fourth screen image derived from the fourth screen stream. The aspect ratio of the fourth screen image is equal to that of the screen of the third device, and the aspect ratio of the screen of the third device is different from that of the screen of the second device.
7. The method according to claim 1, characterized in that, The first split-screen window and the second split-screen window are arranged horizontally, with the first split-screen window on the left and the second split-screen window on the right. The method further includes: After the first device detects a left swipe operation on the screen, the first device closes the second split-screen window and displays the first interface in full screen; or, After the first device detects a right swipe operation on the screen, the first device closes the first split-screen window and displays a fourth interface in full screen, the fourth interface including part or all of the content of the first screen.
8. The method according to claim 1, characterized in that, After the first device simultaneously displays the first split-screen window and the second split-screen window, the method further includes: After the first device detects an upward swipe operation on the screen, the first device closes the first split-screen window and the second split-screen window, and displays the desktop of the first device.
9. The method according to claim 1, characterized in that, After the first device simultaneously displays the first split-screen window and the second split-screen window, the method further includes: After the first device detects an upward swipe-and-hold operation on the screen, the first device closes the first split-screen window and the second split-screen window, and displays the background interface of the first device, which includes a first background card. After the first device detects an operation performed on the first background card, the first device redisplays the first split-screen window and the second split-screen window, wherein the first split-screen window includes the second interface and the second split-screen window includes the first screen image.
10. The method according to claim 1, characterized in that, The second split-screen window also includes a navigation bar, which contains multiple controls for switching the screen display of the second device in the second split-screen window.
11. The method according to claim 10, characterized in that, The background color of the navigation bar changes in accordance with the color of the first screen.
12. The method according to claim 10, characterized in that, When the first split-screen window and the second split-screen window are arranged side by side, the width of the navigation bar is equal to the width of the second split-screen window, and the sum of the height of the navigation bar and the height of the second split-screen window is equal to the height of the first device screen. When the first split-screen window and the second split-screen window are arranged vertically, the height of the navigation bar is equal to the height of the second split-screen window. The heights of the two screen windows are equal, and the sum of the width of the navigation bar and the width of the second split-screen window is equal to the width of the first device screen.
13. The method according to claim 1, characterized in that, After the first device displays the first floating window on the third interface, the method further includes: The first device stops displaying the third interface and displays the fifth interface of the third application, wherein the first floating window continues to be displayed on the fifth interface; In response to the user's first split-screen operation input in the first floating window, the first device simultaneously displays a fifth split-screen window and a sixth split-screen window. The fifth split-screen window includes the seventh interface of the third application, the sixth split-screen window includes the second screen image, and the seventh interface includes some or all of the content in the fifth interface.
14. The method according to claim 2, characterized in that, After the first device stops displaying the desktop and displays the third screen in full screen, the method further includes: In response to a second split-screen operation input by the user, the first device simultaneously displays a seventh split-screen window and an eighth split-screen window. The seventh split-screen window includes a sixth interface, and the eighth split-screen window includes the third screen. The sixth interface includes multiple application icons and a search bar, and the multiple application icons correspond to multiple applications installed on the first device.
15. The method according to claim 2, characterized in that, After the first device stops displaying the desktop and displays the third screen in full screen, the method further includes: After the first device detects a right swipe operation on the screen, the first device stops displaying the third screen and displays the desktop of the second device in full screen. After the first device detects a right swipe operation on the screen again, the first device stops displaying the desktop of the second device and displays the desktop of the first device in full screen.
16. An electronic device, characterized in that, It includes one or more processors and one or more memories; wherein the one or more memories are coupled to the one or more processors, and the one or more memories are used to store a computer program that, when the one or more processors execute the computer program, causes the method as described in any one of claims 1-15 to be performed.
17. A chip system applied to an electronic device, the chip system comprising one or more processors, characterized in that, The processor is used to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-15.
18. A computer program product containing instructions, characterized in that, When the computer program product is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-15.
19. A computer-readable storage medium comprising a computer program, characterized in that, When the computer program is run on an electronic device, it causes the electronic device to perform the method as described in any one of claims 1-15.