Multi-device cooperation method and system
By establishing a shared connection between multiple devices, the drag and drop window function across devices and systems is realized, which solves the problem of manual connection between users in the existing technology, improves user experience and operation efficiency, and supports multiple device types .
Patent Information
- Application Number
- CN202310854770.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-12
- Publication Date
- 2025-01-14
AI Technical Summary
In the existing multi-device collaboration technology, users need to manually connect to achieve screen mirroring, screen expansion and multi-screen collaboration, and it is impossible to realize drag and drop windows across devices and systems, resulting in poor user experience.
By establishing a shared connection between key and mouse between electronic devices, using the cursor and window drag mechanism, the drag window function across devices and systems is realized without the need for manual connection of users and adapting to the operating system window style of the target device.
Improves user experience, reduces learning costs and operation efficiency, supports more device types such as tablets and folding screens, and realizes cross-device collaborative operation without manual connection.
Smart Images

Figure CN119311342A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of terminal technology, and in particular, to a multi-device collaboration method and system. Background Art
[0002] Multi-device collaboration is a distributed technology applied to multiple electronic devices. Using multi-device collaboration technology, two or more electronic devices can collaborate across systems and devices to achieve resource sharing and collaborative operations. With the continuous development of terminal technology, multi-device collaboration has produced many different types of collaboration.
[0003] Among the different collaboration types, some collaboration types are initiated by the master device (generally the initiator of multi-device collaboration) to the slave device (generally the participant of multi-device collaboration) in response to user operations. These collaboration types can be called manual collaboration services, such as: keyboard and mouse sharing, screen mirroring, screen extension, multi-screen collaboration, etc.
[0004] Currently, for collaboration types such as screen mirroring, screen extension, and multi-screen collaboration, users need to connect manually, and cannot drag windows across devices and systems, which fails to provide users with a rich user experience. Summary of the invention
[0005] The present application provides a multi-device collaboration method and system, which allows users to drag windows across devices and systems without manual connection, thereby improving the user experience.
[0006] In a first aspect, an embodiment of the present application provides a multi-device collaboration method, including: a first electronic device displays a first window, a first cursor, and a first taskbar on a first desktop, the first electronic device is equipped with a first operating system, the first electronic device is connected to an input device, and the first window is a window matching the first operating system; in a process in which the first cursor drags the first window toward a first screen edge of the first electronic device, when the first window edge of the first window does not reach the first screen edge, the first window edge moves toward the first screen edge, and the first window edge is the window edge of the first window on the side close to the first screen edge; when the first window edge moves out of the first screen edge and the first cursor does not reach the first screen edge, the first electronic device moves the first window so that a portion of the first window moves outside the first screen edge; when the first cursor moves from the first screen edge to the first screen edge of the second electronic device When the second electronic device is at the edge of the second screen, the first electronic device hides the first cursor and the first window, and the second electronic device displays an extended window and a second cursor at the edge of the second screen, and displays a transient page in the extended window, wherein the second electronic device is equipped with a second operating system, the second electronic device is connected to an input device, and the extended window is a window that matches the second operating system; when the second cursor drags the extended window away from the edge of the second screen, the second electronic device displays a part of the extended window moved to within the edge of the second screen; in response to the user's release operation of the second cursor and the extended window, the second electronic device displays a second desktop in the extended window, and displays a second taskbar and a maximized second window on the second desktop, the second desktop is projected from the first desktop, the second window has the same content as the first window, and the second taskbar has the same content as the first taskbar.
[0007] The multi-device collaboration method provided by the present application is based on the establishment of a shared keyboard and mouse connection between electronic devices. Users can drag windows across devices and systems without manual connection, thereby improving the user experience. In addition, the window dragged to another electronic device has a window style that matches the operating system of the electronic device, reducing the user's learning cost and improving the user's operating efficiency. Furthermore, the embodiments of the present application support more device types, such as tablet computers, folding screens, etc.
[0008] In one implementation, when the first cursor moves from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor and the first window, and the second electronic device displays the extended window and the second cursor at the second screen edge, and after displaying the transient page in the extended window, it also includes: in the process of the second cursor dragging the extended window to the second screen edge, when the second window edge of the extended window moves in the direction close to the second screen edge and the second cursor does not reach the second screen edge, the second electronic device moves the extended window so that a part of the extended window moves outside the second screen edge, and the second window edge is in the same direction as the first window edge; when the second cursor moves from the second screen edge to the first screen edge of the first electronic device, the second electronic device hides the second cursor and the extended window, and the first electronic device displays the first cursor and the first window at the first screen edge; in response to the user's release operation of the first cursor and the first window, the first electronic device displays the first window on the first desktop. With this implementation, when the user drags the window for the first time, if the user does not raise his hand, he can also drag the window from the second electronic device back to the first electronic device.
[0009] In one implementation, in response to the user releasing the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the maximized second window on the second desktop, including: in response to the user releasing the second cursor and the extended window, the second electronic device displays a loading page in the extended window, and after the second desktop is loaded, the second desktop is displayed, and the second taskbar and the maximized second window are displayed on the second desktop, wherein the loading page is used to indicate that the second electronic device is loading the second desktop. With this implementation, after the user raises his hand, based on the establishment of the screen extension connection, the window is dragged between the electronic devices, and the dragged extended window is a window that matches the operating system of the second electronic device. In this way, the embodiment of the present application has the visual effect of dragging a window, reduces the user's learning cost, and improves the user's operating efficiency.
[0010] In one implementation, in response to the user releasing the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and after displaying the second taskbar and the maximized second window on the second desktop, the method further includes: in response to the user dragging the second window in the extended window, the second electronic device moves the second window on the second desktop. With this implementation, the second electronic device actually displays the same content as the first desktop of the first electronic device in the extended window, rather than only displaying the content in the first window. Therefore, the second window is not fixedly displayed in the extended window, but can be moved in the extended window.
[0011] In one implementation, the top area of the extended window includes a first floating button, and the first floating button is used to move the extended window; in response to the user's release operation on the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the second window in a maximized form on the second desktop, and further includes: in response to the user's drag operation on the first floating button, the second electronic device moves the extended window. With this implementation, the user can move the window dragged to the second electronic device, compared with the current screen expansion method of fixedly displaying the content in the first electronic device on the display screen of the second electronic device. The implementation method of the embodiment of the present application can improve the user experience.
[0012] In one implementation, the bottom area of the extended window includes a second floating button, and the second floating button is used to maximize the display of the extended window, or minimize the display of the extended window; in response to the user's release operation on the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the maximized second window on the second desktop, and further includes: in response to the user's swiping up operation on the second floating button, the second electronic device minimizes the display of the extended window; or, in response to the user's swiping down operation on the second floating button, the second electronic device maximizes the display of the extended window. With this implementation, the user can maximize or minimize the display of the extended window through gesture operation, compared with the current screen expansion method of fixedly displaying the content in the first electronic device on the display screen of the second electronic device. The implementation of the embodiment of the present application can improve the user experience.
[0013] In one implementation, the top area of the extended window includes a maximize button, a minimize button, and a close button; in response to the user's release operation on the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and after displaying the second taskbar and the maximized second window on the second desktop, it also includes: in response to the user's click operation on the maximize button, the second electronic device maximizes the display of the extended window; or, in response to the user's click operation on the minimize button, the second electronic device minimizes the display of the extended window; or, in response to the user's click operation on the close button, the second electronic device closes the extended window. With this implementation, the user can maximize, minimize, or close the extended window, compared to the current screen extension method of fixedly displaying the content in the first electronic device on the display screen of the second electronic device. The implementation of the embodiment of the present application can improve the user experience.
[0014] In one implementation, in response to the user's release operation on the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and after displaying the second taskbar and the maximized second window on the second desktop, it also includes: in response to the user's stretching operation on the window edge of the extended window, the second electronic device expands and displays the extended window; or, in response to the user's zooming operation on the window edge of the extended window, the second electronic device zooms and displays the extended window. With this implementation, the user can adjust the size of the extended window, compared with the current screen expansion method of fixedly displaying the content in the first electronic device on the display screen of the second electronic device. The implementation of the embodiment of the present application can improve the user experience.
[0015] In one implementation, in response to a user's release operation on the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and after displaying the second taskbar and the maximized second window on the second desktop, the method further includes: the first electronic device displays a third window on the first desktop, the third window being a window matching the first operating system; in the process of the first cursor dragging the third window to move toward the first screen edge of the first electronic device, when the third window edge of the third window does not reach the first screen edge, the third window edge moves toward the first screen edge, the third window edge being the window edge of the third window on the side close to the first screen edge; when the third window edge moves out of the first screen edge and the first cursor does not reach the first screen edge, the first electronic device moves the third window so that a portion of the third window moves outside the first screen edge, and the content of the third window is different from that of the first window; when the first cursor moves out of the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor, and the second electronic device displays the second cursor at the second screen edge, and displays a fourth window in the extended window, the content of the fourth window being the same as the content of the portion of the third window moved outside the first screen edge; in response to the user's release operation on the second cursor and the fourth window, the second electronic device releases the fourth window in the extended window. With this implementation, a user can drag multiple windows and display them in an extended window.
[0016] In one implementation, when the first cursor moves from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor, and the second electronic device displays the second cursor at the second screen edge, and after displaying the fourth window in the extended window, it also includes: in the process of the second cursor dragging the fourth window to the fourth window edge of the extended window, when the fifth window edge of the fourth window moves in the direction close to the third window edge and the second cursor has not reached the second screen edge, the second electronic device moves the fourth window so that a part of the fourth window moves outside the second screen edge, the fourth window edge is opposite to the direction of the first window edge, and the fifth window edge is in the same direction as the first window edge; when the second cursor moves from the second screen edge to the first screen edge of the first electronic device, the second electronic device hides the second cursor and the extended window, and the first electronic device displays the first cursor and the third window at the first screen edge; in response to the user's release operation on the first cursor and the third window, the first electronic device displays the third window on the first desktop. With this implementation, when the user drags the window for the second time, if the user does not raise his hand, he can also drag the window from the second electronic device back to the first electronic device.
[0017] In one implementation, after the second electronic device minimizes and displays the extended window, it also includes: the first electronic device displays a third window on the first desktop, the third window is a window matching the first operating system; in the process of the first cursor dragging the third window to the first screen edge of the first electronic device, when the third window edge of the third window does not reach the first screen edge, the third window edge moves to the first screen edge, and the third window edge is the window edge of the third window close to the first screen edge; when the third window edge moves out of the first screen edge and the first cursor does not reach the first screen edge, the first electronic device moves the third window so that a part of the third window moves outside the first screen edge, and the content of the third window is different from that of the first window; when the first cursor moves out of the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor, and the second electronic device displays the second cursor at the second screen edge, and, evokes the extended window from the background and displays a fourth window in the extended window, the content of the fourth window is the same as the content of the part of the third window moved outside the first screen edge; in response to the user's release operation of the second cursor and the fourth window, the second electronic device releases the fourth window in the extended window. With this implementation, when the second electronic device displays the extended window in the background, when the user drags the window for the second time, the extended window can be called up from the background and the second dragged window can be displayed in the extended window.
[0018] In one implementation, when the extended window is displayed in the form of a floating window, the window edge of the extended window includes a first toolbar button; in response to the user's release operation on the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the maximized second window on the second desktop, and further includes: in response to the user's click operation on the first toolbar button, the second electronic device displays the first toolbar on the window edge of the extended window. With this implementation, when the extended window is in the form of a floating window, a toolbar can be displayed to provide users with a variety of shortcut tools.
[0019] In one implementation, the second electronic device maximizes display of the extended window, including: the second electronic device displays a second toolbar at the edge of the extended window. In this implementation, when the extended window is in full screen mode, a toolbar can be displayed to provide a variety of shortcut tools for the user.
[0020] In one implementation, the extended window includes a toolbar, the toolbar includes a mode switching button, the mode switching button is used to switch the screen extension mode to the screen mirroring mode, or to switch the screen mirroring mode to the screen extension mode, wherein the extended window displays the second desktop, and when the second taskbar and the second window displayed in a maximized manner are displayed on the second desktop, the extended window is in the screen extension mode; in response to the user's release operation of the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the second window displayed in a maximized manner on the second desktop, and further includes: in response to the user's first click operation on the mode switching button, the second electronic device changes from displaying the second taskbar and the second window displayed in the extended window to displaying the current page of the display screen of the first electronic device, so that the extended window is in the screen mirroring mode. In this implementation, the extended window can set a mode switching button in the toolbar to switch between the screen extension mode and the screen mirroring mode.
[0021] In one implementation, after the second electronic device changes from displaying the second taskbar and the maximized second window to displaying the current page of the display screen of the first electronic device in the extended window in response to the user's first click operation on the mode switching button, the method further includes: in response to the user's second click operation on the mode switching button, the second electronic device changes from displaying the current page of the display screen of the first electronic device to displaying the second taskbar and the maximized second window in the extended window, so that the extended window is in screen extension mode. With this implementation, the user can switch between screen extension mode and screen mirroring mode by clicking the mode switching button.
[0022] In one implementation, after the second electronic device maximizes the display of the extended window, the second electronic device further includes: in response to the user moving the second cursor to the top area of the extended window, the second electronic device displays a third floating button in the top area of the extended window; in response to the user clicking the third floating button, the second electronic device displays a floating window option control in the top area of the extended window, the floating window option control including a first sub-button and a second sub-button, the first sub-button is used to display the extended window in full screen form, and the second sub-button is used to switch the extended window to a floating window form; in response to the second electronic device displaying the floating window option control, the second electronic device highlights the first sub-button; in response to the user clicking the second sub-button, the second electronic device changes the extended window from being displayed in full screen form to being displayed in a floating window form. With this implementation, when the extended window is in full screen form, the user can switch the extended window between full screen form and floating window form.
[0023] In one implementation, after the second electronic device maximizes the display of the extended window, the second electronic device further includes: in response to the user moving the second cursor to the top area of the extended window, the second electronic device displays a third floating button in the top area of the extended window; in response to the user dragging the third floating button, the second electronic device changes the extended window from full-screen display to floating window display. With this implementation, when the extended window is in full-screen mode, the user can switch between the full-screen mode and the floating window mode.
[0024] In a second aspect, an embodiment of the present application provides an electronic device, the electronic device being equipped with a first operating system; the electronic device comprising: a display screen; one or more processors; a memory; and a communication module; wherein the memory stores one or more computer programs, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to execute the multi-device collaboration method in the above-mentioned first aspect and its implementation method.
[0025] In a third aspect, an embodiment of the present application provides an electronic device, the electronic device being equipped with a second operating system; the electronic device comprising: a display screen; one or more processors; a memory; and a communication module; wherein the memory stores one or more computer programs, and the one or more computer programs include instructions, which, when executed by the electronic device, enable the electronic device to execute the multi-device collaboration method as described in the first aspect and its implementation method.
[0026] In a fourth aspect, an embodiment of the present application provides a multi-device collaboration system, including the first electronic device in the second aspect, the second electronic device in the third aspect, and an input device. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1It is a schematic diagram of a scenario of establishing screen extension between electronic devices;
[0028] Figure 2 is a schematic diagram of a multi-device collaborative system provided in an embodiment of the present application;
[0029] Figure 3A This is a schematic diagram of the first scenario of establishing keyboard and mouse sharing on a PC provided in an embodiment of the present application;
[0030] Figure 3B This is a schematic diagram of a second scenario of establishing keyboard and mouse sharing on a PC provided in an embodiment of the present application;
[0031] Figure 3C This is a schematic diagram of a third scenario of establishing keyboard and mouse sharing on a PC provided in an embodiment of the present application;
[0032] Figure 3D This is a schematic diagram of a fourth scenario of establishing keyboard and mouse sharing on a PC provided in an embodiment of the present application;
[0033] Figure 3E is a schematic diagram of a scenario in which a PC establishes keyboard and mouse sharing provided in some other embodiments of the present application;
[0034] Figure 4A This is a schematic diagram of the first scenario of establishing keyboard and mouse sharing on a tablet computer provided in an embodiment of the present application;
[0035] Figure 4B This is a schematic diagram of a second scenario in which a tablet computer provides keyboard and mouse sharing according to an embodiment of the present application;
[0036] Figure 4C This is a schematic diagram of a third scenario of establishing keyboard and mouse sharing on a tablet computer provided in an embodiment of the present application;
[0037] Figure 5A This is a schematic diagram of the first scenario of establishing keyboard and mouse sharing on a foldable screen mobile phone provided in an embodiment of the present application;
[0038] Figure 5B This is a schematic diagram of a second scenario of establishing keyboard and mouse sharing on a foldable screen mobile phone provided in an embodiment of the present application;
[0039] Figure 5C This is a schematic diagram of a third scenario of establishing keyboard and mouse sharing on a foldable screen mobile phone provided in an embodiment of the present application;
[0040] Fig. 6A is a schematic diagram of a scenario in which a mouse cursor moves from a PC to a tablet computer provided by an embodiment of the present application;
[0041] Figure 6B It is a schematic diagram of a scenario in which a mouse cursor moves from a PC to a foldable screen mobile phone provided in an embodiment of the present application;
[0042] Figure 7 is a structural schematic diagram of a tablet computer provided in an embodiment of the present application;
[0043] Figure 8 is a software structure block diagram of a tablet computer according to an embodiment of the present application;
[0044] Fig. 9 It is a first schematic diagram of the first embodiment provided by the present application;
[0045] Fig.10 is a second schematic diagram of the first embodiment provided by the present application;
[0046] Fig.11 is the third schematic diagram of the first embodiment provided by the present application;
[0047] Fig.12 is the fourth schematic diagram of the first embodiment provided by the present application;
[0048] Fig.13 is the fifth schematic diagram of the first embodiment provided by the present application;
[0049] Fig.14 is the sixth schematic diagram of the first embodiment provided by the present application;
[0050] Fig.15 It is the seventh schematic diagram of the first embodiment provided by the present application;
[0051] Fig.16 It is the eighth schematic diagram of the first embodiment provided by the present application;
[0052] Fig.17 It is the ninth schematic diagram of the first embodiment provided by the present application;
[0053] Fig.18 It is the tenth schematic diagram of the first embodiment provided by the present application;
[0054] Fig.19 is a first schematic diagram of a second embodiment provided by the present application;
[0055] Fig. 20 is a second schematic diagram of a second embodiment provided by the present application;
[0056] Fig.21 is a third schematic diagram of the second embodiment provided by the present application;
[0057] Fig. 22 is a first schematic diagram of the third embodiment provided by the present application;
[0058] Fig.23 This is a schematic diagram of the first toolbar display form provided in the embodiment of the present application;
[0059] Fig.24 is a schematic diagram of a mode switching scenario provided in an embodiment of the present application;
[0060] Fig.25 This is a schematic diagram of a second toolbar display form provided in an embodiment of the present application;
[0061] Fig.26 This is a schematic diagram of the first scenario of window switching provided in an embodiment of the present application;
[0062] Fig. 27 is a second scenario schematic diagram of window switching provided in an embodiment of the present application;
[0063] Fig.28 is a first schematic diagram of the fourth embodiment provided by the present application;
[0064] Fig.29 is a second schematic diagram of the fourth embodiment provided by the present application;
[0065] Fig.30 This is the first schematic diagram of the abnormal drag window scenario provided by this application;
[0066] Fig.31 This is the second schematic diagram of the abnormal drag window scenario provided by this application;
[0067] Fig.32 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application;
[0068] Fig.33 It is a schematic diagram of the structure of a second electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0069] The technical solutions in the embodiments of the present application will be described clearly below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments of the present application, other embodiments obtained by ordinary technicians in this field without making creative work all belong to the protection scope of the present application.
[0070] The terms "first", "second", and "third" in the specification and claims of this application are used to distinguish different objects, rather than to limit a specific order. In the description of this application, unless otherwise specified, "at least one" means one, two, and more than two.
[0071] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0072] The terms used in the implementation method part of this application are only used to explain the specific embodiments of this application, and are not intended to limit this application. The embodiments of this application will be described in detail below in conjunction with the accompanying drawings.
[0073] In order to facilitate technical personnel to understand the technical solutions of the embodiments of the present application, the technical terms involved in the embodiments of the present application are explained below.
[0074] Multi-device collaboration is a distributed technology applied to multiple electronic devices. Using multi-device collaboration technology, two or more electronic devices can collaborate across systems and devices to achieve resource sharing and collaborative operation.
[0075] Multi-device collaboration can be applied to electronic devices of the same or different types. The types of electronic devices include but are not limited to mobile phones, tablet computers, laptops, large-screen devices (such as smart TVs, smart screens), personal computers (persona1computers, PCs), handheld computers, netbooks, personal digital assistants (personal digital assistants, PDAs), wearable electronic devices, vehicle-mounted devices, virtual reality devices, and other devices.
[0076] Multi-device collaboration needs to be implemented based on the communication connection between devices. The communication connection can be a wired communication connection or a wireless communication connection. Among them, the solution for wired communication connection can include USB On-The-Go (OTG) technology, for example; the solution for wireless communication can include wireless fidelity (Wi-Fi), Wi-Fi Direct (Wi-Fi Direct), Bluetooth (BT), near field communication (NFC), infrared technology (IR), etc.
[0077] With the continuous development of terminal technology, multi-device collaboration has produced a variety of different collaboration types (also known as collaborative services), such as keyboard and mouse sharing, screen mirroring, screen extension, application continuation, call sharing and notification sharing.
[0078] The following is an introduction to some collaboration types.
[0079] Keyboard and mouse sharing: Electronic device A and electronic device B can share each other's original input devices, such as mouse, keyboard, etc. For example, the input device of electronic device A is shared with electronic device B, and the shared input device can be used for input in both electronic device A and electronic device B. In addition, in the keyboard and mouse sharing type, files can be transferred between electronic devices A and B.
[0080] Screen mirroring: All contents on the screen of electronic device A are completely mirrored on the screen of electronic device B. The contents of electronic device A displayed on electronic device B are the same as those displayed on electronic device A, and change as the contents displayed on electronic device A change.
[0081] Screen extension: Use the screen of electronic device B as the secondary screen of electronic device A. Electronic device A can transfer part of the content it needs to display to the secondary screen for display. The screen of electronic device A and the screen of electronic device B can display content together, thereby expanding the display capability of electronic device A.
[0082] Multi-screen collaboration: Projecting the user interface of electronic device A onto the screen of electronic device B for display, allowing the user to operate the user interface of electronic device A in electronic device B, and transferring files from electronic device B to electronic device A by performing specific operations in electronic device B (for example, dragging and dropping files from the user interface of electronic device B to the user interface of electronic device A), thereby realizing cross-device operations and cross-device file transfers between electronic devices A and B. The user interface of electronic device A can be displayed in any area of the screen of electronic device B, or in full screen.
[0083] Among the multiple collaboration types listed above: some collaboration types are initiated by the master device (generally the initiator of multi-device collaboration) to the slave device (generally the participant of multi-device collaboration) in response to user operations, and therefore can be called manual collaboration services or manual collaboration businesses, such as: screen expansion, screen projection, screen mirroring, multi-screen collaboration, keyboard and mouse sharing, etc.; other collaboration types are automatically triggered when the triggering rules are met when the user turns on the function, and therefore can be called automatic collaboration services or automatic collaboration businesses, such as: super call, super notification, super continuation, etc.
[0084] For two electronic devices, the cooperation type they support is generally related to factors such as device type, screen size, device capability, etc. Therefore, two electronic devices may support only one cooperation type or may support multiple cooperation types.
[0085] Take manual collaborative service as an example:
[0086] If the master device is a PC and the slave device is a non-folding screen mobile phone, the supported collaboration types may include keyboard and mouse sharing and multi-screen collaboration. Among them, when the PC and the non-folding screen mobile phone trigger the connection for the first time, the default collaboration type may be multi-screen collaboration.
[0087] If the master device is a PC and the slave device is a foldable screen mobile phone, the supported collaboration types may include keyboard and mouse sharing and multi-screen collaboration. Among them, when the PC and the foldable screen mobile phone trigger the connection for the first time, the default collaboration type may be multi-screen collaboration.
[0088] If the master device is a PC and the slave device is a tablet, the supported collaboration types may include screen mirroring, screen extension, and keyboard and mouse sharing. When the PC and the tablet are connected for the first time, the default collaboration type may be screen mirroring.
[0089] That is to say, when the master device is a PC and the slave device is a tablet or a foldable screen mobile phone, the current collaboration types such as screen mirroring and screen extension are usually manual collaboration services.
[0090] Specifically, manual collaboration services include the following scenarios.
[0091] It should be noted here that since screen mirroring, screen expansion and other collaborative types are only supported in PCs, tablets and foldable screen mobile phones, in the following embodiments, electronic device A is a PC, electronic device B is a tablet, and electronic device C is a foldable screen mobile phone for exemplary description.
[0092] Figure 1 It is a schematic diagram of a scenario in which a screen extension connection is established between electronic devices.
[0093] like Figure 1 As shown, screen extension connection can be established between electronic devices. Taking the case where electronic device A and electronic device B (not shown in the figure) are in a connected state as an example, the user can click icon Q (not shown in the figure) in electronic device A. In response to the user's click operation on icon Q, electronic device A starts software W corresponding to icon Q and displays interface 01. The first side of interface 01 is used to display one or more options, which at least include device option 02. For example, software W can be computer housekeeper software.
[0094] The user can click on the device option 02. In response to the user's click operation on the device option 02, the electronic device A displays the collaborative page 03 corresponding to the device option 02 on the second side of the interface 01. The collaborative page 03 may include a screen mirroring card 04 and a screen extension card 05. Among them, the screen mirroring card 04 can be used for the electronic device A to establish a screen mirroring connection with the electronic device B. The screen extension card 05 can be used for the electronic device A to establish a screen extension connection with the electronic device B. After the screen extension connection is established, the electronic device B does not display the desktop icons, taskbar shortcut icons, etc. in the electronic device A.
[0095] The user can click on the screen mirroring card 04. In response to the user's click operation on the screen mirroring card 04, electronic device A and electronic device B can establish a screen mirroring connection. Electronic device B mirrors all the contents displayed on the display screen of electronic device A completely on the display screen of electronic device B. The content of electronic device A displayed in electronic device B is the same as the content displayed on electronic device A, and changes as the content displayed on electronic device A changes.
[0096] The user can click on the screen expansion card 05. In response to the user's click operation on the screen expansion card 05, the electronic device A and the electronic device B can establish a screen expansion connection, and the electronic device B can display a portion of the content that the electronic device A needs to display, so as to expand the display capability of the electronic device A. The window style displayed by the electronic device B is the same as that of the electronic device A.
[0097] In the process of establishing a connection for manual collaborative services such as screen mirroring and screen expansion, the user needs to manually connect electronic device A and electronic device B in software W, which reduces the user experience. Moreover, after these manual collaborative services are connected, the window style displayed by electronic device B is the same as that of electronic device A, rather than the same as the window style of the operating system of electronic device B itself. In this way, when the user operates the window displayed on the extended screen of electronic device A in electronic device B, due to the different operating habits for PCs and tablet computers, a certain learning cost is generated, which reduces the operating efficiency. Furthermore, manual collaborative services such as screen mirroring and screen expansion are currently only supported between electronic devices such as PCs and tablet computers, and there are relatively few types of electronic devices that support such manual collaborative services.
[0098] It can be seen that the services that the above-mentioned collaborative types such as keyboard and mouse sharing, screen mirroring, and screen extension can provide to users are relatively simple and limited, and the benefits they bring in terms of improving operational efficiency are small, and they cannot provide users with a rich user experience.
[0099] In order to solve the above problems, an embodiment of the present application provides a multi-device collaboration method.
[0100] Figure 2 It is a schematic diagram of a multi-device collaborative system provided in an embodiment of the present application.
[0101] like Figure 2 As shown, the multi-device collaboration method in the embodiment provided in the present application can be applied to a multi-device collaboration system 200, which may include a first electronic device 200a, a second electronic device 200b and an input device 200c.
[0102] The first electronic device 200a may be specifically an electronic device that can be equipped with a first operating system, such as a laptop computer, a PC, a handheld computer, etc. The second electronic device 200b may be specifically an electronic device that can be equipped with a second operating system, such as a tablet computer, a folding screen mobile phone, etc. The first operating system and the second operating system are different. For example, the first operating system may be any one of Windows operating system, Mac OS, Linux operating system, Unix operating system, DOS operating system, Honor operating system (Magic OS), Android operating system, iOS or Harmony OS, and the second operating system may be any one of Windows operating system, Mac OS, Linux operating system, Unix operating system, DOS operating system, Honor operating system, Android operating system, iOS or Harmony OS that is different from the first operating system. The input device 200c may be specifically a mouse, a keyboard, a touchpad, etc.
[0103] The multi-device collaboration method of the embodiment of the present application can be applied to various types of electronic devices that support keyboard and mouse sharing, screen mirroring, and screen expansion. The embodiment of the present application does not limit the specific types of electronic devices such as the first electronic device 200a and the second electronic device 200b, and the embodiment of the present application does not limit the specific types of operating systems such as the first operating system and the second operating system.
[0104] The user can drag the content of the first window displayed by the first electronic device 200a to the display screen of the second electronic device 200b, so that the second electronic device 200b displays an extended window, and the content in the extended window is the same as the content in the first window. In this way, the user can drag windows across devices and systems without manual connection.
[0105] It should be noted here that before the user drags the window, a keyboard and mouse sharing connection needs to be established between the first electronic device 200a and the second electronic device 200b.
[0106] Current keyboard and mouse sharing connections are usually implemented based on the Bluetooth function.
[0107] The embodiment of the present application shows a method of establishing a keyboard and mouse sharing connection that is different from the Bluetooth connection method.
[0108] In this establishment method, the electronic device can actively identify the near-field electronic device located in its vicinity and establish an interconnection relationship with its near-field device. In this way, electronic devices in the same interconnection relationship can provide users with a variety of services including but not limited to call sharing, notification sharing, and keyboard and mouse sharing. Furthermore, based on the identity authentication system and networking functions, multiple electronic devices are added to the interconnection relationship to achieve self-discovery, self-networking, and self-connection of multiple devices. Electronic devices may include laptops, smart screens, tablet computers, and smart phones. In an embodiment of the present application, after the interconnection relationship is established, a keyboard and mouse sharing connection can be established between electronic devices in the same interconnection relationship.
[0109] Figure 3A This is a schematic diagram of the first scenario of a PC establishing a keyboard and mouse sharing connection provided in an embodiment of the present application.
[0110] like Figure 3A As shown, in some embodiments, the PC displays a first icon 11 on its home screen page. For example, the first icon 11 is a computer manager icon.
[0111] Figure 3B This is a second scenario diagram of a PC establishing a keyboard and mouse sharing connection provided in an embodiment of the present application.
[0112] like Figure 3B As shown, the user clicks the first icon 11 through the input device. In response to the user's click operation on the first icon 11, the PC starts the first software and displays the first software interface 10. For example, the first software is a computer housekeeper software, and the first side of the first software interface 10 is used to display one or more options, which at least include the first interconnection option 12. The second side of the first software interface 10 is used to display the user page corresponding to each option.
[0113] In the initial state, the PC may select the first interconnection option 12 by default on the first side of the first software interface 10 , and display the first interconnection page 13 corresponding to the first interconnection option 12 by default on the second side of the first software interface 10 .
[0114] Among them, the first interconnected page 13 may include multiple function cards, which are used to introduce the first collaborative service that the PC can provide to the user. The first collaborative service can be, for example, keyboard and mouse sharing or call sharing. The function card may include a keyboard and mouse sharing card 14, which can be used to enable the PC to provide a keyboard and mouse sharing service. The first interconnected page 13 may also include a first device list 15. The first device list 15 can be used to display the device names of near-field devices that have established a connection with the PC. Specifically, when the Bluetooth function is turned on, the PC can automatically discover near-field devices located around it, which also have the Bluetooth function turned on and are logged in with the same identity authentication account. In this way, the PC can automatically establish a Bluetooth connection with the near-field device, complete a self-organizing network, form an interconnection relationship, and display the device name of the near-field device that has established a connection in the first device list 15.
[0115] It should be noted here that when the PC does not select the first interconnection option 12 by default on the first side of the first software interface 10, the user can click the first interconnection option 12 through the input device, and in response to the user's click operation on the first interconnection option 12, the PC can select the first interconnection option 12 and display the first interconnection page 13 on the second side of the first software interface 10. The embodiment of the present application does not limit the display method of the first interconnection page 13.
[0116] Figure 3C This is a schematic diagram of a third scenario in which a PC establishes a keyboard and mouse sharing connection provided in an embodiment of the present application.
[0117] like Figure 3C As shown, the user clicks on the keyboard and mouse sharing card 14 through the input device. In response to the user's click operation on the keyboard and mouse sharing card 14, the PC displays the first keyboard and mouse sharing page 16 on the second side of the first software interface 10. The first keyboard and mouse sharing page 16 includes a first device display area 16a and a second device display area 16b. The PC can display the second device display area 16b below the first device display area 16a. The first device display area 16a includes a first device identifier 17a located in the middle of the area, and the first device identifier 17a can be used to show the user that the current device is a PC. The first device display area 16a also includes a display platform 18 located near the first device identifier 17a. Multiple display platforms 18 can be provided for displaying near-field devices that have established keyboard and mouse sharing with the PC. For example, the display platform 18 can include a first display platform 18a provided on the right side of the first device identifier 17a, and a second display platform 18b provided on the left side of the first device identifier 17a.
[0118] Among them, when the PC and the mobile phone have established a keyboard and mouse sharing connection, the PC can float and display the second device logo 17b on the first display platform 18a, and the second device logo 17b can be used to show the user that the mobile phone has established a keyboard and mouse sharing connection with the PC. When the PC and the tablet computer have not established a keyboard and mouse sharing connection, the PC displays the second display platform 18b as a blank display platform. At this time, the PC can display the third device logo 17c wrapped by the first bubble element in the second device display area 16b. The third device logo 17c can be used to show the user that the tablet computer is in an interconnected relationship but has not established a keyboard and mouse sharing connection with the PC. The PC can also display the device name of the tablet computer corresponding to the third device logo 17c below the first bubble element. For example, the device name is "HONOR Pad".
[0119] Figure 3D This is a schematic diagram of the fourth scenario of a PC establishing a keyboard and mouse sharing connection provided in an embodiment of the present application.
[0120] like Figure 3D As shown, if a keyboard and mouse sharing connection needs to be established between the PC and the tablet computer, the user can click on the first bubble element. In response to the user dragging the first bubble element to the second display platform 18b, the PC can suspend and display the fourth device identifier 17d on the second display platform 18b. The fourth device identifier 17d can be used to show the user that the tablet computer has established a keyboard and mouse sharing connection with the PC. In this way, the PC can establish a keyboard and mouse sharing connection with a mobile phone and a tablet computer in the same interconnected relationship.
[0121] The embodiments of the present application include but are not limited to the methods of establishing a keyboard and mouse sharing connection between a PC, a tablet computer and a mobile phone in the above embodiments.
[0122] like Figure 3C As shown, in other embodiments, the first keyboard and mouse sharing page 16 also includes at least two optional items 19, and the first optional item 19a can be used to enable a quick operation mode for establishing a keyboard and mouse sharing connection. Specifically, the user can click on the first optional item 19a, and in response to the user's click operation on the first optional item 19a, the PC can turn on or off the function of "continuously touching the mouse cursor on the side edge of the computer screen twice to quickly establish a connection." The second optional item 19b can be used to enable an auxiliary operation mode for keyboard and mouse sharing. Specifically, the user can click on the second optional item 19b, and in response to the user's click operation on the second optional item 19b, the PC can turn on or off the function of "automatically adjusting the screen arrangement as the device placement position changes." It should be noted here that when the function of "automatically adjusting the screen arrangement as the device placement position changes" is turned on, the PC can automatically identify the physical positions of the tablet computers and / or mobile phones located around it.
[0123] For example, after a keyboard and mouse sharing connection is established between electronic devices, in the initial state, the tablet is on the left side of the PC, the mobile phone is on the right side of the PC, and the mouse cursor is located on the display screen of the PC. At this time, in response to the user's operation of moving the mouse cursor to the right edge of the display screen of the PC, the mouse cursor can cross to the display screen of the mobile phone. If the placement of the devices changes, the tablet is placed between the PC and the mobile phone. At this time, the mouse cursor is located on the display screen of the mobile phone. In response to the user's operation of moving the mouse cursor to the left edge of the display screen of the mobile phone, the mouse cursor can cross to the display screen of the tablet, instead of crossing back to the display screen of the PC.
[0124] Figure 3E It is a schematic diagram of a scenario in which a PC establishes a keyboard and mouse sharing connection provided in other embodiments of the present application.
[0125] like Figure 3E As shown, in other embodiments, the PC can open a keyboard and mouse sharing connection through an input device with which it has a paired relationship. Among them, the input device can be, for example, a wired mouse, a wireless mouse, a wired keyboard and / or a wireless keyboard. After the PC turns on the function of "touch the mouse cursor twice continuously on the side edge of the computer screen to quickly establish a connection", in response to the mouse cursor touching the border of the PC's display screen twice in a row, the PC displays a keyboard and mouse shortcut sharing page 20 at the border of its display screen, and the keyboard and mouse shortcut sharing page 20 includes a second bubble element 21 and a third bubble element 22. The second bubble element 21 can be used to show the user a tablet computer that is in an interconnected relationship but has not established a keyboard and mouse sharing connection with the PC. The third bubble element 22 can be used to show the user a mobile phone that is in an interconnected relationship but has not established a keyboard and mouse sharing connection with the PC. The user can click the second bubble element 21 and / or the third bubble element 22 through the input device, and in response to the user's click operation on the second bubble element 21 and / or the third bubble element 22, the PC can establish a keyboard and mouse sharing connection with the tablet computer and / or the mobile phone. In this way, the PC can establish a keyboard and mouse sharing connection with the tablet computer and mobile phone in the same interconnection relationship.
[0126] It should be noted here that when a PC establishes a keyboard and mouse sharing connection with other electronic devices, the other electronic devices first need to enable the keyboard and mouse sharing service.
[0127] Figure 4A This is a schematic diagram of the first scenario of establishing a keyboard and mouse sharing connection for a tablet computer provided in an embodiment of the present application.
[0128] like Figure 4A As shown, the tablet computer displays a second icon 31 on its home screen page. For example, the second icon 31 is a setting icon.
[0129] Figure 4BThis is a schematic diagram of a second scenario in which a tablet computer provides an embodiment of the present application to establish a keyboard and mouse sharing connection.
[0130] like Figure 4B As shown, the user clicks the second icon 31. In response to the user's click operation on the second icon 31, the tablet computer starts the second software and displays the second software interface 30. For example, the second software may be a setting software in the system software. The first side of the second software interface 30 is used to display one or more options, which at least include the second interconnection option 32. The second side of the second software interface 30 is used to display the user page corresponding to each option.
[0131] In the initial state, the tablet computer may select the second interconnection option 32 by default on the first side of the second software interface 30 , and display the second interconnection page 33 corresponding to the second interconnection option 32 by default on the second side of the second software interface 30 .
[0132] Among them, the second interconnection page 33 may include multiple first collaborative service options, and the first collaborative service option is used to enable the tablet computer to provide a second collaborative service. The second collaborative service may be, for example, keyboard and mouse sharing or call sharing. The first collaborative service option may include a first keyboard and mouse sharing option 34, which is used to enable the tablet computer to provide a keyboard and mouse sharing service. The second interconnection page 33 may also include a second device list 35. The second device list 35 may be used to display the device names of near-field devices that have established a connection with the tablet computer. Specifically, when the Bluetooth function is turned on, the tablet computer can automatically discover near-field devices located around it, which also have the Bluetooth function turned on and are logged in with the same identity authentication account. In this way, the tablet computer can automatically establish a Bluetooth connection with the near-field device, complete a self-organizing network, form an interconnection relationship, and display the device name of the near-field device that has established a connection in the second device list 35. Among them, the tablet computer can also display the second interconnection page 33 in other ways. For details, please refer to the display method of the first interconnection page 13, which will not be repeated in the embodiment of the present application.
[0133] Figure 4C This is a schematic diagram of a third scenario in which a tablet computer provides an embodiment of the present application to establish a keyboard and mouse sharing connection.
[0134] like Figure 4CAs shown, the user clicks on the first keyboard and mouse sharing option 34. In response to the user's click on the first keyboard and mouse sharing option 34, the tablet computer displays a second keyboard and mouse sharing page 36 on the second side of the second software interface 30. The second keyboard and mouse sharing page 36 includes a first keyboard and mouse sharing switch 37. The user clicks on the first keyboard and mouse sharing switch 37. In response to the user's click on the first keyboard and mouse sharing switch 37, the tablet computer can turn on or off the keyboard and mouse sharing service. When the first keyboard and mouse sharing switch 37 is in the on state, the tablet computer turns on the keyboard and mouse sharing service, so that the tablet computer supports establishing a keyboard and mouse sharing connection with other electronic devices in an interconnected relationship.
[0135] Figure 5A This is a schematic diagram of the first scenario in which a foldable screen mobile phone provides a keyboard and mouse sharing connection according to an embodiment of the present application.
[0136] like Figure 5A As shown, the folding screen mobile phone displays a third icon 41 on its home screen page. For example, the third icon 41 is a setting icon.
[0137] Figure 5B This is a schematic diagram of the second scenario in which the foldable screen mobile phone provided in an embodiment of the present application establishes a keyboard and mouse sharing connection.
[0138] like Figure 5B As shown, the user clicks on the third icon 41. In response to the user's click on the third icon 41, the folding screen mobile phone starts the third software and displays the third software interface 40. For example, the third software may be a setting software in the system software, and the first side of the third software interface 40 is used to display one or more options, which at least include the third interconnection option 42. The second side of the third software interface 40 is used to display the user page corresponding to each option.
[0139] In the initial state, the foldable screen mobile phone can select the third interconnection option 42 by default on the first side of the third software interface 40, and display the third interconnection page 43 corresponding to the third interconnection option 42 by default on the second side of the third software interface 40.
[0140] Among them, the third interconnected page 43 may include multiple second collaborative service options, and the second collaborative service option is used to enable the folding screen mobile phone to provide a third collaborative service. The third collaborative service can be, for example, keyboard and mouse sharing or call sharing. The second collaborative service option may include a second keyboard and mouse sharing option 44, which is used to enable the folding screen mobile phone to provide a keyboard and mouse sharing service. The third interconnected page 43 may also include a third device list 45. The third device list 45 can be used to display the device name of the near-field device that has established a connection with the folding screen mobile phone. Specifically, when the Bluetooth function is turned on, the folding screen mobile phone can automatically discover the near-field devices located around it, which also turn on the Bluetooth function and log in with the same identity authentication account. In this way, the folding screen mobile phone can automatically establish a Bluetooth connection with the near-field device, complete the self-organizing network, form an interconnection relationship, and display the device name of the near-field device that has established a connection in the third device list 45. Among them, the folding screen mobile phone can also display the third interconnected page 43 in other ways. For details, please refer to the display method of the first interconnected page 13, which will not be repeated in this embodiment of the present application.
[0141] Figure 5C This is a schematic diagram of the third scenario in which the foldable screen mobile phone provides a keyboard and mouse sharing connection according to an embodiment of the present application.
[0142] like Figure 5C As shown, the user clicks on the second keyboard and mouse sharing option 44. In response to the user's click on the second keyboard and mouse sharing option 44, the electronic device C can display a third keyboard and mouse sharing page 46, and the third keyboard and mouse sharing page 46 includes a second keyboard and mouse sharing switch 47. The user clicks on the second keyboard and mouse sharing switch 47. In response to the user's click on the second keyboard and mouse sharing switch 47, the foldable screen mobile phone turns on or off the keyboard and mouse sharing service. When the second keyboard and mouse sharing switch 47 is in the on state, the foldable screen mobile phone turns on the keyboard and mouse sharing service, so that the foldable screen mobile phone supports establishing a keyboard and mouse sharing connection with other electronic devices in an interconnected relationship.
[0143] In this way, a keyboard and mouse sharing connection can be established between different electronic devices in the same interconnection relationship.
[0144] Fig. 6A It is a schematic diagram of a scenario in which a mouse cursor moves from a PC to a tablet computer according to an embodiment of the present application.
[0145] like Fig. 6AAs shown, after a keyboard and mouse sharing connection is established between different electronic devices, the mouse of the PC can be used to control the tablet computer and / or foldable screen mobile phone. For example, when the tablet computer is located on the right side of the PC and the mouse cursor is located on the display screen of the PC, the user can move the mouse cursor to the right boundary of the display screen of the PC. In response to the user's movement operation, the PC hides the mouse cursor on its right boundary, and the tablet computer displays the mouse cursor on the left boundary of its display screen. At this time, the mouse cursor can be used to control the tablet computer.
[0146] Figure 6B This is a schematic diagram of a scenario in which a mouse cursor moves from a PC to a foldable screen mobile phone, as provided in an embodiment of the present application.
[0147] like Figure 6B As shown, for example, the foldable screen mobile phone is set on the left side of the PC, and when the mouse cursor is located on the display screen of the PC, the user can move the mouse cursor to the right edge of the display screen of the PC. In response to the user's movement operation, the PC hides the mouse cursor on its right edge, and the foldable screen mobile phone displays the mouse cursor on the left edge of its display screen. At this time, the mouse cursor can be used to control the foldable screen mobile phone.
[0148] In this way, different electronic devices in the same interconnected relationship can share a keyboard and mouse connection. The keyboard and mouse sharing connection can be initiated by an input device of a PC or a tablet computer, and the embodiment of the present application does not limit the device that initiates the keyboard and mouse sharing connection.
[0149] Based on the establishment of a keyboard and mouse sharing connection, the present application provides a first embodiment.
[0150] The first embodiment of the present application is described with the first electronic device 200a as a PC, the second electronic device 200b as a tablet computer, and the input device 200c as a mouse. The first electronic device 200a is used as a sender device, and the second electronic device 200b is used as a receiver device. The input device 200c can be an external device of the first electronic device 200a, or an external device of the second electronic device 200b. After the first electronic device 200a and the second electronic device 200b establish keyboard and mouse sharing, the input device 200c can be used to control the first electronic device 200a, or the second electronic device 200b.
[0151] The first electronic device 200a and the second electronic device 200b may be located in the same interconnection relationship, and a keyboard and mouse sharing connection is established based on the interconnection relationship. The first electronic device 200a and the second electronic device 200b may also establish a keyboard and mouse sharing connection in a manner other than establishing an interconnection relationship, which is not specifically limited in the present embodiment.
[0152] In this way, based on the integration of keyboard and mouse sharing, screen extension, screen mirroring and other capabilities, users can use the mouse to drag the first window displayed on the PC to the extended window displayed on the tablet without manual connection, thereby realizing dragging windows across devices and systems, improving the user experience.
[0153] The first embodiment of the present application can realize dragging a window from a PC to a tablet computer.
[0154] Specifically, a window is a display form of an application user interface, which is equivalent to a container of the application user interface. The user can click the application user interface in the window through the input device 200c to perform human-computer interaction with the application.
[0155] In electronic devices with different operating systems, the same application may have different window display specifications. In the same electronic device, the same type of application window may have the same window display specification for different applications, and different types of application windows may have different window display specifications for the same application.
[0156] Exemplarily, for an electronic device equipped with a Windows operating system, the types of windows include at least maximized windows, minimized windows, and normal windows. Window display specifications include, for example, display positions of maximize, minimize, and close buttons. For an electronic device equipped with an Android operating system, the types of windows include at least full-screen application windows, floating windows, split-screen application windows, and split-screen windows within applications. Window display specifications include, for example, the style of virtual buttons, the display positions of virtual buttons, and user control instructions of virtual buttons.
[0157] It should be noted that the embodiments of the present application only provide exemplary descriptions of the types of windows, and windows may also have other types of classification. For example, in the Windows operating system, the types of windows may also include standard windows, dialog windows, and desktop windows. Standard windows may, for example, be folder windows, application windows, etc. Such windows may change the window size and may have menus, toolbars, title bars, status bars, borders, client areas, etc. A dialog window may have a variety of controls, such as command buttons, edit boxes, combo boxes, radio buttons, check buttons, etc. A desktop window may only have a client area. The embodiments of the present application do not specifically limit the types of windows.
[0158] In the first embodiment of the present application, the first window displayed on the PC matches the window display specification of the Windows operating system, and the extended window displayed on the tablet matches the window display specification of the Android operating system for illustration.
[0159] This application takes a tablet computer as an example to illustrate the structure of the second electronic device 200b.
[0160] Figure 7 It is a structural schematic diagram of a tablet computer provided in an embodiment of the present application.
[0161] like Figure 7 As shown, the tablet computer may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0162] It is understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the tablet computer. In other embodiments of the present application, the tablet computer may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0163] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated into one or more processors. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.
[0164] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory.
[0165] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the tablet computer, and can also be used to transfer data between the tablet computer and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0166] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of a tablet computer. While the charging management module 140 is charging the battery 142, it can also power the electronic device through the power management module 141.
[0167] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0168] The wireless communication function of the tablet computer can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.
[0169] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the tablet computer can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0170] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to tablet computers. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0171] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0172] The wireless communication module 160 can provide wireless communication solutions for the tablet computer, including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, etc. The wireless communication module 160 can be one or more devices integrating at least one communication processing module.
[0173] The tablet computer implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0174] The tablet computer can realize the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0175] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the tablet computer. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
[0176] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, an application required for at least one function (such as a file transfer function, an album function, etc.), etc. The data storage area can store data (such as files, photos, videos, etc.) created during the use of the tablet computer.
[0177] The tablet computer can implement audio functions such as music playing and recording through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0178] The key 190 includes a power button, a volume button, etc. The key 190 can be a mechanical key or a touch key. The tablet computer can receive key input and generate key signal input related to user settings and function control of the tablet computer.
[0179] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. Motor 191 can also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194.
[0180] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0181] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the tablet computer by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The tablet computer can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The tablet computer interacts with the network through the SIM card to implement functions such as calls and data communications.
[0182] It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the tablet computer. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0183] The software system of the tablet computer can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to illustrate the software structure of the tablet computer.
[0184] Figure 8 It is a software structure block diagram of the tablet computer according to an embodiment of the present application.
[0185] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0186] The application layer can include a series of application packages.
[0187] like Figure 8 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.
[0188] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0189] like Figure 8 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0190] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0191] Content providers are used to store and retrieve data and make it accessible to applications. The data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0192] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0193] The phone manager is used to provide communication functions for the tablet computer, such as the management of call status (including answering, hanging up, etc.).
[0194] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0195] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0196] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0197] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0198] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0199] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0200] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0201] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0202] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0203] A 2D graphics engine is a drawing engine for 2D drawings.
[0204] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0205] In this way, based on the hardware structure and software structure of the tablet computer, the tablet computer can display the extended window.
[0206] The first embodiment of the present application is introduced below with reference to the accompanying drawings.
[0207] Fig. 9 This is the first schematic diagram of the first embodiment provided in the embodiments of the present application.
[0208] like Fig. 9 As shown, in some embodiments, the user can place the tablet computer to the right side of the PC and place the tablet computer in a horizontal position.
[0209] It should be noted here that the embodiment of the present application is only exemplified by placing the tablet computer in a horizontal state on the right side of the PC. In a specific implementation, the tablet computer can be placed in a vertical state and the tablet computer can be placed on the left side of the PC. The embodiment of the present application does not limit the placement state and placement position of the tablet computer. The implementation methods corresponding to the various placement states and placement positions of the tablet computer can refer to each other.
[0210] The PC displays a first window 101 and a first taskbar 102 on the first desktop, and displays a first user page of a first application in the first window 101. The first window 101 is a window matching the first operating system, and specifically can be an application window of a first application, and the first application can be any application program in the PC, for example, the first application is a presentation application.
[0211] It should be noted here that the embodiment of the present application is only exemplified by the PC displaying the first window 101 on the first desktop. The first window 101 can also be displayed on other pages, such as a browser page, and the embodiment of the present application is not limited to this.
[0212] When the PC is connected to the mouse, a first cursor is displayed on the first desktop.
[0213] The user can move the first cursor to the first window 101 by using the mouse, hold down the mouse button, and drag the first window 101 along the first path 103. The first cursor is the cursor associated with the mouse in the PC, and the first path 103 is a path pointing to the direction of the side adjacent to the PC and the tablet computer. For example, if the right edge of the PC screen is adjacent to the left edge of the tablet screen, the first path 103 points to the direction of the right edge of the PC screen.
[0214] The PC has a first screen edge 104 , which may be a screen edge of the display screen of the PC close to the tablet computer.
[0215] In the process of the first cursor dragging the first window 101 toward the first screen edge 104 of the PC, when the first window edge 1011 of the first window 101 has not reached the first screen edge 104, the first window edge 1011 moves toward the first screen edge 104, and the first window edge 1011 is the window edge of the first window 101 on the side close to the first screen edge 104.
[0216] When the first window edge 1011 moves out of the first screen edge 104 and the first cursor does not reach the first screen edge 104, the PC moves the first window 101 so that a portion of the first window 101 moves outside the first screen edge 104. When the user holds down the mouse button without raising his hand and the first cursor does not reach the first screen edge 104, the content on the display screen of the tablet computer does not change. For example, in the initial state, the tablet computer displays the third desktop 201, which can be the main screen interface of the tablet computer. When the user holds down the mouse button and drags the first window 101 without raising his hand and the first cursor does not reach the first screen edge 104, the tablet computer displays the third desktop 201.
[0217] Fig.10 This is the second schematic diagram of the first embodiment provided in the embodiments of the present application.
[0218] like Fig.10 As shown, the tablet computer has a second screen edge 202 , which may be a screen edge of the display screen of the tablet computer close to the PC, and opposite to the first screen edge 104 .
[0219] The user holds down the mouse button and drags the first window 101 along the first path 103 . Without lifting the mouse button, the user can drag the first cursor from the first screen edge 104 to the second screen edge 202 along the first path 103 .
[0220] When the first cursor moves from the first screen edge 104 to the second screen edge 202 of the tablet computer, the PC hides the first cursor and the first window 101, and the tablet computer displays the extended window 203 and the second cursor at the second screen edge 202, and displays a transient page in the extended window 203, where the extended window 203 is a window matching the second operating system.
[0221] A transient page is a page without any content loaded. A transient mark 204 may be displayed in the transient page. The transient mark 204 may be an application mark of the first application. For example, the transient mark 204 is a presentation application mark, which is used to indicate the presentation application to be loaded in the extension window 204 .
[0222] The second cursor is the cursor associated with the mouse in the tablet computer. The display forms of the first cursor associated with the same mouse in the PC and the second cursor associated with the same mouse in the tablet computer may be different. For example, the first cursor in the PC is displayed in the form of an arrow, and the second cursor in the tablet computer is displayed in the form of a gray circle. The embodiment of the present application does not limit the display form of the mouse cursor.
[0223] Since the user has not raised his hand, at this time, the extended window 203 is in a dragged state.
[0224] When the second cursor reaches the second screen edge 202 , the extended window 203 usually displays only a partial area.
[0225] After the second cursor reaches the second screen edge 202, the user can continue to drag the extension window 203 to the central area of the tablet display screen, so that the extension window 203 is located at a position convenient for the user to operate. It should be noted here that the user can drag the extension window 203 to any area of the tablet display screen, and the embodiment of the present application only uses dragging to the central area for exemplary description, and the embodiment of the present application does not limit the dragging position of the extension window 203.
[0226] When the second cursor drags the extended window 203 to move in a direction away from the second screen edge 202 , the tablet computer displays a portion of the extended window 203 that moves to within the second screen edge 202 .
[0227] In this way, as the extension window 203 moves to a portion of the area within the second screen edge 202 and gradually increases, the user can drag the extension window 203 to a position that is convenient for operation.
[0228] Fig.11 This is the third schematic diagram of the first embodiment provided in this application.
[0229] like Fig.10 and Fig.11 As shown, when the user holds down the mouse button without lifting the hand, and after the second cursor reaches the second screen edge 202 , the mouse cursor can be dragged from the second screen edge 202 back to the first screen edge 104 along the second path 205 .
[0230] In the process of the second cursor dragging the extended window 203 toward the second screen edge, when the second window edge 2031 of the extended window 203 moves toward the second screen edge 202 and the second cursor has not reached the second screen edge 202, the tablet computer moves the extended window 203 so that a portion of the extended window 203 moves outside the second screen edge 202, and the second window edge 2031 is in the same direction as the first window edge 1011.
[0231] When the second cursor moves from the second screen edge 202 to the first screen edge 104 of the PC, the tablet hides the second cursor and the extended window 203, and the PC displays the first cursor and the first window 101 at the first screen edge 104. The user can raise the mouse when the PC displays the first cursor and the first window 101 at the first screen edge 104.
[0232] In response to the user's release operation on the first cursor and the first window 101 , the PC displays the first window 101 on the first desktop.
[0233] That is, when the user drags the first window 101 from the PC to the tablet computer, if the user holds down the mouse button without lifting the mouse, the first window 101 can be dragged back to the PC even if the first window 101 has been completely dragged out of the first screen edge 104 of the PC.
[0234] Fig.12 This is the fourth schematic diagram of the first embodiment provided by this application.
[0235] like Fig.12 As shown, after the second cursor reaches the second screen edge 202, the user continues to drag the extension window 203 toward the center area of the tablet computer, and after dragging the extension window 203 to a position convenient for the user to operate, the user can raise the mouse. For example, the extension window 203 can display its entire area at a position convenient for the user to operate.
[0236] In response to the user releasing the second cursor and the extension window 203, the tablet computer displays a loading page in the extension window 203. The loading page is used to indicate that the tablet computer is loading the second desktop.
[0237] When the tablet computer is loading the second desktop, the tablet computer displays the first element 206 in the loading page, and the first element 206 can be used to indicate that the tablet computer is loading the second desktop. For example, the first element 206 can be two water drop-shaped elements that are continuously separated and merged.
[0238] It should be noted that, after the second cursor reaches the second screen edge 202 and the user raises the mouse, the user cannot drag the extended window 203 back to the PC.
[0239] When the extended window 203 displays its entire area, it also displays a series of buttons for user convenience. The function of each button is described in detail in the following embodiments.
[0240] It should also be noted that after the extended window 203 is released to the tablet computer, the user can operate the tablet computer using a mouse or a touch screen. The specific operation method can be set according to user habits, and this embodiment of the application is not limited to this.
[0241] In the following drawings of the present application, manual operation of a tablet computer by a user through a touch screen is taken as an exemplary description. Fig.13 This is the fifth schematic diagram of the first embodiment provided by this application.
[0242] like Fig.12 and Fig.13 As shown, in response to the user's release operation on the second cursor and the extended window 203, the tablet computer displays a loading page in the extended window 203, and after the second desktop is loaded, the second desktop is displayed, and the second taskbar 211 and the maximized second window 212 are displayed on the second desktop. The second desktop can be the first desktop projected based on the extended screen. The second window 212 has the same content as the first window 101, and the second taskbar 211 has the same content as the first taskbar 102.
[0243] In this way, since the second window 212 has the same content as the first window 101, the user can interact with the first application in the second window 212, thereby improving the user experience. In addition, the content displayed in the extended window 203 gives the user the visual effect of dragging the first window 101 from the PC to the tablet computer.
[0244] Further, the tablet computer may display the extended window 203 in the form of a floating window in a horizontal screen state by default. The floating window form in the horizontal screen state is set based on the scenario of dragging a window from the PC to the tablet computer. In this way, this floating window form is convenient for displaying the content in the PC. The embodiment of the present application is only exemplified by the floating window form of the extended window 203 in the horizontal screen state. In fact, the extended window 203 may also have other forms, such as full screen form, split screen form, etc. For example, the display form of the extended window 203 can be determined according to the position of the second cursor after the user drags the extended window 203 and raises the mouse. For example, the user drags the extended window 203, and after raising the mouse, the second cursor is located in the middle area of the display screen of the tablet computer, and the tablet computer can display the extended window 203 in the form of a floating window. The user drags the extended window 203, and after raising the mouse, the second cursor is located at the top boundary of the display screen of the tablet computer, and the tablet computer can display the extended window 203 in full screen form. After the user drags the extended window 203 and raises the mouse, the second cursor is located at the side edge of the display screen of the tablet computer, and the tablet computer can display the extended window 203 in a split screen form. The embodiment of the present application does not limit the display form of the extended window 203.
[0245] Further, the extended window 203 may be displayed in accordance with the window display specification of the Android operating system. The extended window 203 may be provided with a title bar, and a floating button (bar) 207 may be provided in the title bar. The title bar may include a top title bar provided in the top area of the extended window 203 and a bottom title bar provided in the bottom area of the extended window 203. The floating button 207 may include a first floating button 207a provided in the middle area of the top title bar and a second floating button 207b provided in the middle area of the bottom title bar.
[0246] It should be noted here that the shapes of the first suspension button 207a and the second suspension button 207b may include at least one of a strip, a circle, and a ring, which is not limited in this embodiment of the present application.
[0247] The first floating button 207 a may be used to move the extended window 203 .
[0248] Fig.14 This is the sixth schematic diagram of the first embodiment provided by this application.
[0249] like Fig.14As shown, the user can drag the first floating button 207a, and the user can manually press and hold the first floating button 207a to drag the extended window 203. Alternatively, the user moves the second cursor to the first floating button 207a with a mouse, presses and holds the mouse button, and drags the first floating button 207a to drag the extended window 203.
[0250] In response to the user's dragging operation on the first floating button 207 a , the tablet computer moves the extension window 203 .
[0251] The second floating button 207 b can be used to maximize the display of the extended window 203 or minimize the display of the extended window 203 .
[0252] Fig.15 This is the seventh schematic diagram of the first embodiment provided in this application.
[0253] like Fig.15 As shown, the user can slide up the second floating button 207b to minimize the extended window 203.
[0254] In response to the user's upward sliding operation on the second floating button 207b, the tablet computer minimizes and displays the extended window 203. Among them, the minimized display of the extended window 203 has multiple scenarios. For example, the tablet computer can minimize the extended window 203 and display it in the background, or minimize the extended window 203 and display it in the floating ball, or minimize the extended window 203 and display it in the floating window. The minimized display mode of the extended window 203 can be set according to actual conditions, and the embodiment of the present application is not limited to this.
[0255] Fig.16 This is the eighth schematic diagram of the first embodiment provided by this application.
[0256] like Fig.16 As shown, the user can slide down the second floating button 207 b to maximize the display of the extended window 203 .
[0257] In response to the user's sliding down operation on the second floating button 207 b , the tablet computer maximizes and displays the extended window 203 .
[0258] like Fig.16 As shown in (a) of FIG. 1 , when the extended window 203 is in the form of a floating window, the tablet computer maximizes and displays the second window 212 in the extended window 203. Fig.16As shown in (b) of FIG. 1 , when the extended window 203 is in full screen form, the tablet computer displays the second desktop in the extended window 203 and displays the second window on the second desktop. The second window 212 is a window for which no window display specification is set. It can be seen that there is a certain difference in the display content when the extended window 203 is in the form of a floating window and when it is in the form of a full screen. The reasons for this difference are further explained below.
[0259] The extended window 203 is based on the establishment of screen extension to display the content in the PC. Specifically, the PC displays the first desktop on the display screen and displays the first window 101 on the first desktop. In the process of dragging the first window 101 on the display screen of the PC, the user cannot actually drag only the first user interface in the first window 101 and send only the first user interface to the tablet computer, but sends all the contents of the display screen of the PC to the tablet computer. After the second cursor reaches the second screen boundary 202, in response to the user's release operation of the second cursor and the extended window 203, the tablet computer displays the extended window 203 in the form of a floating window and establishes a screen extension connection in the extended window 203. The process of establishing the screen extension connection includes the process of the tablet computer receiving all the contents in the display screen of the PC. After the tablet computer receives all the contents in its display screen sent by the PC, it displays the second desktop in the extended window 203 and displays the second taskbar 211 and the maximized second window 212 on the second desktop. That is, the second window 212 covers the area of the second desktop except the second taskbar 211. In this way, the embodiment of the present application has the visual effect of dragging the first user page of the first window 101 in the PC to the extended window 203 of the tablet computer, so that the tablet computer displays the same content as the first window 101 in the extended window 203 .
[0260] In response to the user's sliding down operation on the second floating button 207 b , the tablet computer maximizes and displays the extended window 203 , displays the second desktop in the extended window 203 , and displays the second window 212 in the middle area of the second desktop.
[0261] It should be noted that when the extended window 203 is maximized and displayed, no title bar is set, and the second desktop is displayed in full screen on the display screen of the tablet computer.
[0262] The second window 212 is not fixedly displayed in the extended window 203 . Therefore, when the extended window 203 is in a floating window form or a full-screen form, the user can drag the second window 212 to adjust the position of the second window 212 .
[0263] Fig.17 This is the ninth schematic diagram of the first embodiment provided in this application.
[0264] like Fig.17 As shown, the extended window 203 is exemplified as a full-screen form, and the user can drag the second window 212, wherein the user can drag the second window 212 by manually long pressing the second window 212, or the user can move the second cursor to the second window 212 with the mouse, hold down the mouse button, and drag the second window 212.
[0265] In response to the user's dragging operation on the second window 212 , the tablet computer moves the second window 212 .
[0266] When the extended window 203 is displayed in full screen, the second window 212 may include a first minimize button 2121 , a first maximize button 2122 , and a first close button 2123 .
[0267] The user may click the first minimize button 2121 to minimize the second window 212 in the extended window 203 (this process is not shown in the drawing).
[0268] In response to the user's click operation on the first minimize button 2121, the tablet computer minimizes and displays the second window 212 in the extended window 203. For example, the tablet computer minimizes and displays the second window 212 in the extended window 203 to the background. Since the second window 212 can be used to operate the first application, when the tablet computer minimizes and displays the second window 212 to the background, the application icon of the first application can be displayed in the second task bar 211. In this way, the user can click the application icon of the first application in the second task bar 211, and in response to the user's click operation on the application icon of the first application in the second task bar 211, the tablet computer can restore the display of the second window 212 from the background.
[0269] The user may click the first maximization button 2122 to maximize the second window 212 in the extended window 203 (this process is not shown in the drawing).
[0270] In response to the user clicking the first maximize button 2122, the tablet computer maximizes and displays the second window 212 in the extended window 203. In this way, the tablet computer can cover the second window 212 in the extended window 203 in the area of the second desktop except the second taskbar 211.
[0271] The user may click the first close button 2123 to close the second window 212 in the extended window 203 (this process is not shown in the drawing).
[0272] In response to the user clicking the first close button 2123 , the tablet computer closes the second window 212 in the extended window 203 .
[0273] It should be noted that when the extended window 203 is displayed in the form of a floating window, since the extended window 203 has already displayed Fig.13 The second maximize button 208, the second minimize button 209 and the second close button 210 are shown, therefore, the first minimize button 2121, the first maximize button 2122 and the first close button 2123 may not be displayed in the second window 212, so that when the user drags the window from the PC to the tablet computer, displaying the extended window 203 and the second window 212 in the extended window 203 can have the visual effect of displaying only one window, which can improve the user experience.
[0274] In the embodiment of the present application, when the extended window 203 is displayed in the form of a floating window or in the form of a full screen, the user can choose whether to set the first minimize button 2121, the first maximize button 2122 and the first close button 2123 in the second window 212 according to user habits, and the embodiment of the present application is not limited to this.
[0275] Fig.18 This is the tenth schematic diagram of the first embodiment provided by this application.
[0276] like Fig.18 As shown, the user can stretch or zoom the border of the extended window 203 to adjust the window size of the extended window 203. The user can manually press and hold the border of the extended window 203 to adjust the size of the extended window 203, or the user can move the mouse cursor to the border of the extended window 203 to adjust the size of the extended window 203.
[0277] In response to the user stretching the border of the extension window 203 , the tablet computer expands and displays the extension window 203 .
[0278] In response to the user's zooming operation on the border of the extension window 203 , the tablet computer zooms and displays the extension window 203 .
[0279] When the tablet computer expands and displays the extended window 203 or scales and displays the extended window 203, the second window 212 may change with the change in the window size of the extended window 203, or may remain unchanged when the window size of the extended window 203 changes, so that only the second desktop changes with the change in the size of the extended window 203. The embodiment of the present application does not limit the specific form of the expanded display or scaled display in the extended window 203.
[0280] Further Fig.13As shown, since the extension window 203 has a second maximize button 208 , a second minimize button 209 and a second close button 210 in the title bar, the user can click the second maximize button 208 to maximize the extension window 203 .
[0281] In response to the user clicking the second maximize button 208, the tablet computer maximizes and displays the extended window 203. The manner in which the tablet computer maximizes and displays the extended window 203 can be found in Fig.16 , this embodiment of the present application will not be elaborated on this.
[0282] The user can click the second minimize button 209 to minimize the extended window 203 .
[0283] In response to the user clicking the second minimize button 209, the tablet computer minimizes and displays the extended window 203. The method of minimizing and displaying the extended window 203 on the tablet computer can be referred to in Fig.15 , this embodiment of the present application will not be elaborated on this.
[0284] The user can click the second close button 209 to close the extended window 203 .
[0285] In response to the user clicking the second close button 209, the tablet computer closes the extended window 203. It should be noted that, since the user cannot drag the extended window 203 back to the PC after the second cursor reaches the second screen edge 202 and lifts the mouse, the tablet computer can only close the extended window 203 in response to the user clicking the second close button 209, but cannot drag the extended window 203 out of the tablet computer by dragging.
[0286] It should be noted that, since the second maximize button 208, the second minimize button 209 and the second close button 210 in the extended window 203 are displayed according to the window display specification of the Android operating system, Fig. 9 The third minimize button 105, the third maximize button 106 and the third close button 107 in the first window 101 are displayed according to the window display specification of the Windows operating system. The difference in the window display specification makes the display style, display position and user operation method of each button have certain differences. The extended window 203 provided by the tablet computer is a window whose window style and window operation method are matched with the Android operating system, rather than a window matched with the Windows operating system. In this way, the user's learning cost can be reduced and the problem of low operation efficiency caused by the inconsistency between the window and the electronic device operation is solved.
[0287] In this way, based on the establishment of the keyboard and mouse sharing connection, the user can drag a window from the PC to the tablet computer without manual connection.
[0288] The second embodiment of the present application can drag more windows to the tablet computer based on the first embodiment of the present application.
[0289] The second embodiment of the present application is described by taking a scenario in which the tablet computer displays an extended window 203 after the user drags the window for the first time.
[0290] Fig.19 It is the first schematic diagram of the second embodiment provided by this application.
[0291] like Fig.19 As shown, after the user drags the window for the first time, he can drag the window for the second time.
[0292] The PC displays a third window 301 on the first desktop, and displays a third user page in the third window 301. The third window 301 is a window that matches the first operating system, and can be an application window of the first application or an application window of another application, which is not limited in the embodiment of the present application. For example, the third window 301 is an application window of a presentation application, and the third user page can be a user page in the presentation application that has different content from the first user page.
[0293] It should be noted here that the embodiment of the present application is only exemplified by the PC displaying the third window 301 on the first desktop. The third window 301 can also be displayed on other pages, such as a browser page, and the embodiment of the present application is not limited to this.
[0294] The user can move the first cursor to the third window 301 by using the mouse, hold down the mouse button, and drag the third window 301 along the third path 302. The third path 302 is a path pointing to the direction where the PC and the tablet computer are adjacent. For example, if the right edge of the PC screen is adjacent to the left edge of the tablet computer screen, the third path 302 points to the direction where the right edge of the PC screen is located.
[0295] In the process of the first cursor dragging the third window 301 toward the first screen edge 104 of the PC, when the third window edge 3011 of the third window 301 has not reached the first screen edge 104, the third window edge 3011 moves toward the first screen edge 104, and the third window edge 3011 is the window edge of the third window 301 on the side close to the first screen edge 104.
[0296] When the third window edge 3011 moves out of the first screen edge 104 and the first cursor does not reach the first screen edge 104, the PC moves the third window 301 so that a portion of the third window 301 moves out of the first screen edge 104, and the content of the third window 301 is different from that of the first window 101. Since the user does not raise his hand, at this time, the fourth window 303 is in a dragged state.
[0297] When the second cursor reaches the second screen edge 202, the fourth window 303 does not pass through the area of the third desktop in the tablet computer that is not covered by the extended window 203, but is directly displayed in the extended window 203. At this time, the fourth window 303 usually only displays a partial area in the extended window 203.
[0298] After the second cursor reaches the second screen edge 202, the user can move the second cursor to the fourth window 303 and drag the fourth window 303 to the central area of the extended window 203, so that the fourth window 303 is located at a position convenient for the user to operate. It should be noted here that the user can drag the fourth window 303 to any area in the tablet computer extended window 203. The embodiment of the present application only uses dragging to the central area of the extended window 203 as an exemplary description, and the embodiment of the present application does not limit the dragging position of the fourth window 303.
[0299] When the first cursor moves from the first screen edge 104 to the second screen edge 202 of the tablet computer, the PC hides the first cursor, and the tablet computer displays the second cursor at the second screen edge 202, and displays the fourth window 303 in the extended window 203, and the content of the fourth window 303 is the same as the content in the part of the third window 301 moved outside the first screen edge 104.
[0300] When the second cursor drags the fourth window 303 to move in a direction away from the fourth window edge 2032 of the extended window 203 , the tablet computer displays that the fourth window 303 moves to a portion of the extended window 203 .
[0301] In this way, as the fourth window 303 moves to a portion of the extended window 203 and its area gradually increases, the user can drag the fourth window 303 to a position in the extended window 203 that is convenient for operation.
[0302] Fig. 20 It is a second schematic diagram of the second embodiment provided by this application.
[0303] like Fig. 9 , Fig.19 and Fig. 20As shown, when the user holds down the mouse button without lifting the hand, and after the second cursor reaches the second screen edge 202 , the mouse cursor can be dragged from the second screen edge 202 back to the first screen edge 104 along the fourth path 304 .
[0304] When the second cursor drags the fourth window 303 toward the fourth window edge 2032 of the extended window 203, when the fifth window edge 3034 of the fourth window 303 moves toward the fourth window edge 2032 and the second cursor has not reached the second screen edge 202, the tablet computer moves the fourth window 303 so that a portion of the fourth window 303 moves outside the second screen edge 202, the fourth window edge 2032 is opposite to the direction of the first window edge 1011, and the fifth window edge 3034 is in the same direction as the first window edge 1011.
[0305] When the second cursor moves from the second screen edge 202 to the first screen edge 104 of the PC, the tablet computer hides the second cursor and the extended window 203 , and the PC displays the first cursor and the third window 301 at the first screen edge 104 .
[0306] The user may raise the mouse when the PC displays the first cursor and the third window 301 at the first screen edge 104 .
[0307] In response to the user's release operation on the first cursor and the first window 101 , the PC displays the first window 101 on the first desktop.
[0308] That is, when the user drags the third window 301 from the PC to the tablet computer, if the user holds down the mouse button without lifting the hand, the first window 101 can be dragged back to the PC even if the third window 301 has been completely dragged out of the first screen edge 104 of the PC. Fig.21 This is the third schematic diagram of the second embodiment provided in this application.
[0309] like Fig.21 As shown, after the second cursor reaches the second screen edge 202, the user continues to drag the fourth window 303 toward the center of the tablet computer, and after dragging the fourth window 303 to a position convenient for user operation, the user can raise the mouse. For example, the fourth window 303 can display its entire area at a position convenient for user operation.
[0310] In response to the user's release operation on the second cursor and the fourth window 303 , the tablet computer releases the fourth window 303 in the extended window 203 .
[0311] It should be noted here that, since the extension window 203 has completed the establishment of the screen extension connection, the content displayed in the fourth window 303 does not need to be loaded and can be directly displayed in the extension window 203 .
[0312] The fourth window 303 may be provided with a fourth minimize button 3031 , a fourth maximize button 3032 , and a fourth close button 3033 .
[0313] Since only one extended window 203 matching the Android operating system can be established in the tablet computer, when more windows are dragged from the PC to the tablet computer, it cannot be guaranteed that each window is a window matching the Android operating system. Therefore, the fourth window 303 can be displayed in the extended window 203 in a form matching the Windows operating system. In this way, when the user drags the second window, the fourth window 303 may completely cover the second window 212. In this way, in order to facilitate switching, scaling and other adjustments of the second window 212 and the fourth window 303, the tablet computer can display a fourth minimize button 3031, a fourth maximize button 3032, and a fourth close button 3033 in the fourth window 303 to perform corresponding operations.
[0314] In the second embodiment of the present application, the process of the user dragging the window more times based on the second dragging of the window can refer to the process of dragging the window for the second time, which will not be described in detail in the embodiment of the present application.
[0315] The third embodiment of the present application can drag more windows to the tablet computer based on the first embodiment of the present application.
[0316] The third embodiment of the present application is described by taking a scenario in which after the user drags the window for the first time, the tablet computer minimizes the extended window 203 and displays it in the background.
[0317] Fig. 22 It is the first schematic diagram of the third embodiment provided by this application.
[0318] like Fig. 22 As shown, after the user drags the window for the first time, he can drag the window for the second time.
[0319] The PC displays a third window 301 on the first desktop, and displays a third user page in the third window 301. The third window 301 is a window that matches the first operating system, and can be an application window of the first application or an application window of another application, which is not limited in the embodiment of the present application. For example, the third window 301 is an application window of a presentation application, and the third user page can be a user page in the presentation application that has different content from the first user page.
[0320] It should be noted here that the embodiment of the present application is only exemplified by the PC displaying the third window 301 on the first desktop. The third window 301 can also be displayed on other pages, such as a browser page, and the embodiment of the present application is not limited to this.
[0321] The user can use the mouse to move the first cursor to the third window 301, hold down the mouse button, and drag the third window 301 along the third path 302. The third path 302 is a path pointing to the direction of the side where the PC and the tablet are adjacent. For example, the right edge of the PC screen is adjacent to the left edge of the tablet screen, and the third path 302 points to the direction where the right edge of the PC screen is located. In the process of the first cursor dragging the third window 301 to the first screen edge 104 of the PC, when the third window edge 3011 of the third window 301 does not reach the first screen edge 104, the third window edge 3011 moves toward the first screen edge 104, and the third window edge 3011 is the window edge of the third window 301 on the side close to the first screen edge 104.
[0322] When the third window edge 3011 moves out of the first screen edge 104 and the first cursor does not reach the first screen edge 104, the PC moves the third window 301 so that a portion of the third window 301 moves outside the first screen edge 104, and the contents of the third window 301 are different from those of the first window 101.
[0323] Since the user has not raised his hand, at this time, the fourth window 303 is in a dragged state.
[0324] When the second cursor reaches the second screen edge 202, the fourth window 303 does not pass through the area of the third desktop in the tablet computer that is not covered by the extended window 203, but is directly displayed in the extended window 203. At this time, the fourth window 303 usually only displays a partial area in the extended window 203.
[0325] After the second cursor reaches the second screen edge 202, the user can move the second cursor to the fourth window 303, and drag the fourth window 303 to the central area of the extended window 203, so that the fourth window 303 is located at a position convenient for the user to operate. It should be noted here that the user can drag the fourth window 303 to any area in the tablet computer extended window 203. The embodiment of the present application only exemplifies the dragging to the central area of the extended window 203, and the embodiment of the present application does not limit the dragging position of the fourth window 303. When the first cursor moves from the first screen edge 104 to the second screen edge 202 of the tablet computer, the PC hides the first cursor, and the tablet computer displays the second cursor at the second screen edge 202, and wakes up the extended window 203 from the background, displays the fourth window 303 in the extended window 203, and the content of the fourth window 303 is the same as the content of the part of the third window 301 moved to the outside of the first screen edge 104.
[0326] When the second cursor drags the fourth window 303 to move in a direction away from the fourth window edge 2032 of the extended window 203 , the tablet computer displays a portion of the fourth window 303 that has moved to the extended window 203 .
[0327] In this way, as the fourth window 303 moves to a portion of the extended window 203 and its area gradually increases, the user can drag the fourth window 303 to a position in the extended window 203 that is convenient for operation.
[0328] like Fig. 20 As shown, when the user holds down the mouse button without lifting the hand, and after the second cursor reaches the second screen edge 202 , the mouse cursor can be dragged from the second screen edge 202 back to the first screen edge 104 along the fourth path 304 .
[0329] In response to the user dragging the fourth window 303 with the mouse and the second cursor reaching the second screen edge 202 , the tablet computer moves the fourth window 303 in the extended window 203 so that a portion of the fourth window 303 moves outside the second screen edge 202 .
[0330] In response to the second cursor reaching the second screen edge 202 , the tablet computer hides the second cursor.
[0331] In response to the tablet hiding the second cursor, the PC displays the first cursor and the third window 301 at the first screen edge 104. The third user interface in the third window 301 displays the content in the fourth user interface corresponding to the portion of the fourth window 303 that moves outside the second screen edge 202.
[0332] The user may raise the mouse when the PC displays the first cursor and the third window 301 at the first screen edge 104 .
[0333] In response to the user releasing the third window 301 through the input device, the PC displays the third user interface in the third window 301 .
[0334] That is to say, when the user drags the third window 301 from the PC to the tablet computer, if the user holds down the mouse button without lifting the hand, the third window 301 can be dragged back to the PC even if the third window 301 has been completely dragged out of the first screen edge 104 of the PC.
[0335] It should be noted that, since the tablet computer has already called up the extended window 203 from the background, when the user drags the third window 301 back to the PC, the tablet computer will not minimize the extended window 203 to the background, but will still display the extended window 203 on the current page.
[0336] like Fig.21 As shown, after the second cursor reaches the second screen edge 202, the user continues to drag the fourth window 303 toward the center of the tablet computer, and after dragging the fourth window 303 to a position convenient for user operation, the user can raise the mouse. For example, the fourth window 303 can display its entire area at a position convenient for user operation.
[0337] In response to the user releasing the fourth window 303 through the input device, the tablet computer may release the fourth window 303 in the extended window 203 .
[0338] It should be noted here that, since the extension window 203 has completed the creation of screen extension, the content in the fourth window 303 does not need to be loaded and can be directly displayed in the extension window 203 .
[0339] It should also be noted that if the extended window 203 is displayed in full screen on the display screen of the tablet computer before being minimized and displayed in the background, the tablet computer will display the extended window 203 in full screen after waving it from the background. If the extended window 203 is displayed in a floating window on the display screen of the tablet computer before being minimized and displayed in the background, the tablet computer will display the extended window 203 in a floating window after waving it from the background.
[0340] In the third embodiment of the present application, the process of the user dragging the window more times based on the second dragging of the window can refer to the process of the second dragging of the window in the second embodiment of the present application, which will not be described in detail in this embodiment of the present application.
[0341] In the above embodiments of the present application, the extended window 203 can be displayed in a floating window form or a full-screen form. Based on these two display forms of the extended window 203, the embodiments of the present application can also set a toolbar in the extended window 203 so that the extended window 203 can achieve more functions.
[0342] Fig.23 This is a schematic diagram of the first toolbar display form provided in the embodiment of the present application;
[0343] like Fig.23 As shown, when the extended window 203 is displayed in the form of a floating window, a first toolbar button 401 may be set at the window edge of the extended window 203 .
[0344] The first toolbar button 401 can be set at the left window edge of the extended window 203, or at the right window edge of the extended window 203, and can be set according to the user's usage habits, which is not limited in the embodiment of the present application. The embodiment of the present application does not limit the display form of the first toolbar button 401.
[0345] The user can click the first toolbar button 401 to call up the first toolbar 402 .
[0346] In response to the user clicking the first toolbar button 401 , the tablet computer may display the first toolbar 402 at the edge of the window.
[0347] The first toolbar 402 may be provided with a first save button 4021, a first cancel button 4022, a first audio switch button 4023, a first window move back button 4024, a first mode switch button 4025, a first disconnect button 4026, and a first help button 4027. It should be noted that the first toolbar 402 may also be provided with other buttons to implement corresponding functions, which is not limited in the embodiment of the present application.
[0348] The user can click the first save button 4021 to save the current operation.
[0349] In response to the user clicking the first save button 4021 , the tablet computer may save the user's most recent operation.
[0350] The user can click the first cancel button 4022 to cancel the current operation.
[0351] In response to the user clicking the first undo button 4022 , the tablet computer may undo the user's most recent operation.
[0352] The user can click the first audio switching button 4023 to switch the current audio output device from the PC to the tablet computer, or from the tablet computer to the PC.
[0353] In response to the user clicking the first audio switch button 4023, the tablet computer may switch the current audio output device from the PC to the tablet computer, or vice versa.
[0354] The user can click the first window move back button 4024, and the tablet computer can move the extended window 203 from the tablet computer back to the PC.
[0355] Taking the first window dragging by the user as an example, the user drags the first window 101 in the PC to the tablet computer, so that the tablet computer displays the extended window 203. Then, in response to the user clicking the first window move back button 4024, the tablet computer hides the extended window 203. In response to the tablet computer hiding the extended window 203, the PC displays the first window 101.
[0356] The user may click the first mode switching button 4025 to enable the tablet computer to switch the extension window 203 from the screen extension mode to the screen mirroring mode, or from the screen mirroring mode to the screen extension mode.
[0357] It should be noted that when the user drags the window for the first time, the extended window 203 is usually established in the screen extension mode by default.
[0358] Fig.24 It is a schematic diagram of a mode switching scenario provided in an embodiment of the present application.
[0359] like Fig.24 As shown, after the user drags the window for the first time, the tablet computer displays the second window 212 and the second task bar 211 in the extended window 203. At this time, the PC terminal may display the following Fig.13 The first desktop is shown. In this way, the user can operate on the PC side and the tablet side respectively.
[0360] The user can open the third window 301 on the PC. In response to the user's operation of opening the third window 301, the PC displays the third window 301 on the first desktop. At this time, since the user does not operate the tablet computer, the tablet computer displays the second window 212 and the second taskbar 211 in the extended window 203. The tablet computer is in the screen extension mode.
[0361] The user may click the first toolbar button 401 . In response to the user's clicking operation on the first toolbar button 401 , the tablet computer displays the first toolbar 402 , and displays the first mode switching button 4025 in the first toolbar 402 .
[0362] The user can click the first mode switching button 4025. In response to the user's click operation on the first mode switching button 4025, the tablet computer can change from displaying the second window 211 to displaying the fourth window 303 in the extended window 203. In this way, the content displayed in the extended window 203 of the tablet computer is the same as the current page of the PC, and the tablet computer is in screen mirroring mode.
[0363] The user can click the first disconnect button 4026 to disconnect the tablet computer from the PC.
[0364] In response to the user clicking the first disconnect button 4026 , the tablet computer may disconnect the connection between the tablet computer and the PC.
[0365] The user can click the first help button 4027 to enable the tablet computer to provide help information to the user.
[0366] In response to the user clicking the first help button 4027 , the tablet computer may display help information.
[0367] The user may also use other functions provided by the first toolbar 402 based on other buttons in the first toolbar 402, which is not limited in this embodiment of the present application.
[0368] Fig.25 This is a schematic diagram of a second toolbar display form provided in an embodiment of the present application;
[0369] like Fig.25 As shown, when the extended window 203 is displayed in full screen mode, a second toolbar 501 may be set on the side border of the extended window 203 .
[0370] It should be noted that when the extended window 203 is displayed in full screen form, the second toolbar 501 does not need to be hidden, and is normally displayed at the window edge of the extended window 203. Among them, the second toolbar 501 can be set at the left window edge of the extended window 203, and can also be set at the right window edge of the extended window 203. It can be set according to the user's usage habits, and this embodiment of the present application does not display this. The embodiment of the present application does not limit the display form of the second toolbar 501.
[0371] The second toolbar 501 may be provided with a second save button 5011, a second undo button 5012, a second audio switch button 5013, a second window move back button 5014, a second mode switch button 5015, a second disconnect button 5016 and a second help button 5017. It should be noted that the second toolbar 501 may also be provided with other buttons to implement corresponding functions, which is not limited in the embodiment of the present application.
[0372] The functions corresponding to the buttons in the second toolbar 501 in the embodiment of the present application can refer to the functions of the buttons in the first toolbar 402, which will not be described in detail in the embodiment of the present application.
[0373] When the extended window 203 is displayed in full screen format, the embodiment of the present application can also switch the window display format.
[0374] Fig.26 This is a first scenario diagram of window switching provided in an embodiment of the present application.
[0375] like Fig.26 As shown, the user can move the mouse cursor to the top area of the extended window 203 to evoke the third floating button 601 .
[0376] In response to the user moving the second cursor to the top area of the extended window 203 , the tablet computer displays a third floating button 601 .
[0377] The user can click the third floating button 601 to call up the floating window option control 602.
[0378] In response to the user clicking the third floating button 601, the tablet computer can display a floating window option control 602 in the top area of the extended window 203, and the floating window option control 602 includes a first sub-button 6021 and a second sub-button 6022. The first sub-button 6021 is used to indicate that the extended window 203 is displayed in full screen form, and the second sub-button 6022 is used to switch the extended window 203 to be displayed in a floating window form.
[0379] In response to the tablet computer displaying the floating window option control 602, the tablet computer may highlight the first sub-button 6021. In this way, the first sub-button 6021 may indicate that the tablet computer currently displays the extended window 203 in full screen form.
[0380] The user may click the second sub-button 6022 to switch the extended window 203 to be displayed in the form of a floating window.
[0381] In response to the user clicking the second sub-button 6022 , the tablet computer changes the display of the extension window 203 from a full-screen display to a floating window display.
[0382] When the extended window 203 is displayed in full screen mode, the embodiment of the present application can also switch the window display mode in other operation modes.
[0383] Fig. 27 This is a second scenario diagram of window switching provided in an embodiment of the present application.
[0384] like Fig. 27 As shown, the user can move the mouse cursor to the top area of the extended window 203 to evoke the third floating button 601 .
[0385] In response to the user moving the second cursor to the top area of the extended window 203 , the tablet computer displays a third floating button 601 .
[0386] The user can drag the third floating button 601 to change the extended window 203 from being displayed in a full-screen form to being displayed in a floating window form.
[0387] In response to the user's dragging operation on the third floating button 601 , the tablet computer changes the display of the extended window 203 from the full-screen form to the floating window form.
[0388] In the above embodiment, the first electronic device 200a is a PC, the second electronic device 200b is a tablet computer, and the input device 200c is a mouse. In the embodiment of the present application, the number of second electronic devices 200b can be more than one, and the second electronic device 200b can also be set to other device types.
[0389] Fig.28 This is the first schematic diagram of the fourth embodiment provided by the present application.
[0390] like Fig.28 As shown, the fourth embodiment of the present application is described with the first electronic device 200a being a PC, the second electronic device 200b being a foldable screen mobile phone, and the input device 200c being a mouse.
[0391] A foldable screen mobile phone is an electronic device whose display screen can be bent 360 degrees. The foldable screen mobile phone generally includes: a first body 701, a second body 702 rotatably connected to the first body 701 through a rotating shaft, and a first display screen 703 arranged on one side of the first body 701 and the second body 702. Based on the above structure, the foldable screen mobile phone can be configured as follows: Fig.28 The inward folding screen mobile phone shown in (a) Fig.28 The outward folding screen mobile phone shown in (b) and Fig.28The up-and-down folding screen mobile phone shown in (c) is shown in FIG. Among them, the outward-folding folding screen mobile phone can make the first display screen 703 face the user side after folding by relative rotation of the first body 701 and the second body 702; the inward-folding folding screen mobile phone and the up-and-down folding folding screen mobile phone can make the first display screen 703 face away from the user side after folding by relative rotation of the first body 701 and the second body 702.
[0392] like Fig.28 As shown in (d), the inward folding screen mobile phone also includes a second display screen 704, which is located on the back of the first display screen 703, and the second display screen 704 is fixed on the first body 701. After the first body 701 and the second body 702 are rotated and folded relative to each other, the second display screen 704 faces the user side.
[0393] It should be noted here that Fig.28 The first display screen 703 in the inward folding screen mobile phone shown in (a) is as follows Fig.28 The first display screen 703 in the outward-folding folding screen mobile phone shown in (b) has a larger screen size and can therefore be used to implement dragging windows.
[0394] And as Fig.28 The first display screen 703 in the up-and-down folding screen mobile phone shown in (c), and Fig.28 The second display screen 704 in the inward-folding folding screen shown in (d) cannot be used to drag the window due to its small screen size.
[0395] In addition, foldable screen mobile phones that support dragging windows need to be in the unfolded state to drag windows.
[0396] Fig.29 This is the second schematic diagram of the fourth embodiment provided by this application.
[0397] like Fig.29 As shown, when the second electronic device 200b is a folding screen mobile phone and is in an unfolded state, the window can be dragged. Among them, the process of the user dragging the window can refer to the dragging process when the second electronic device 200b is a tablet computer. This embodiment of the application will not be repeated.
[0398] The present application can also provide more embodiments based on the number of different second electronic devices 200b, for example, in the interconnected relationship formed by the first electronic device 200a being a PC, the first second electronic device 200b being a tablet computer, and the second second electronic device 200b being a folding screen mobile phone, dragging windows between the devices is implemented. The embodiments of the present application are not limited to this.
[0399] Fig.30This is the first schematic diagram of the abnormal window dragging scenario provided by the embodiment of the present application.
[0400] like Fig.30 As shown, the second electronic device 200b is a foldable screen mobile phone, and when the foldable screen mobile phone is in a non-expanded state, window dragging cannot be achieved between the PC and the foldable screen mobile phone.
[0401] The PC displays a first window 101 and a first task bar 102 on the first desktop, and displays a first user page in the first window 101 .
[0402] The user can move the first cursor to the first window 101 by using the mouse, hold down the mouse button, and drag the first window 101 along the fifth path 108. The fifth path 108 is a path pointing to the direction of the side adjacent to the PC and the folding screen mobile phone.
[0403] In the process of the first cursor dragging the first window 101 toward the first screen edge 104 of the PC, when the first window edge 1011 of the first window 101 has not reached the first screen edge 104, the first window edge 1011 moves toward the first screen edge 104, and the first window edge 1011 is the window edge of the first window 101 on the side close to the first screen edge 104.
[0404] When the first window edge 1011 moves out of the first screen edge 104 and the first cursor does not reach the first screen edge 104 , the PC moves the first window 101 so that a portion of the first window 101 moves out of the first screen edge 104 .
[0405] When the first cursor reaches the first screen edge 104, the PC displays a first prompt message 801. The first prompt message 801 is used to prompt the user to keep the folding screen mobile phone in the unfolded state. For example, the content of the first prompt message may be "Please keep the folding screen in the unfolded state."
[0406] It should be noted here that the PC obtains the folding status of the foldable screen mobile phone based on the establishment of a keyboard and mouse sharing connection.
[0407] Fig.31 This is the second schematic diagram of the abnormal window dragging scenario provided by the embodiment of the present application.
[0408] like Fig.31 As shown, when the second electronic device 200b is a non-folding screen mobile phone, window dragging cannot be achieved between the PC and the non-folding screen mobile phone.
[0409] The PC displays a first window 101 and a first task bar 102 on the first desktop, and displays a first user page in the first window 101 .
[0410] The user can move the first cursor to the first window 101 by using the mouse, hold down the mouse button, and drag the first window 101 along the sixth path 109. The sixth path 109 is a path pointing in the direction of the side adjacent to the PC and the non-folding screen mobile phone.
[0411] In the process of the first cursor dragging the first window 101 toward the first screen edge 104 of the PC, when the first window edge 1011 of the first window 101 has not reached the first screen edge 104, the first window edge 1011 moves toward the first screen edge 104, and the first window edge 1011 is the window edge of the first window 101 on the side close to the first screen edge 104.
[0412] When the first window edge 1011 moves out of the first screen edge 104 and the first cursor does not reach the first screen edge 104 , the PC moves the first window 101 so that a portion of the first window 101 moves out of the first screen edge 104 .
[0413] When the first cursor reaches the first screen edge 104, the PC displays a second prompt message 901. The second prompt message 901 is used to prompt the user that dragging a window from the PC to the mobile phone is not supported. For example, the content of the second prompt message may be "Dragging a computer window to the mobile phone is not supported yet."
[0414] It should be noted here that the PC determines that the current connected device is a non-folding screen mobile phone based on the establishment of a keyboard and mouse sharing connection.
[0415] In this way, the multi-device collaboration method provided by the present application is based on the establishment of keyboard and mouse sharing between electronic devices. Users can drag windows across devices and systems without manual connection, thereby improving the user experience. In addition, the window dragged to another electronic device has a window style that matches the operating system of the electronic device, reducing the user's learning cost and improving the user's operating efficiency. Furthermore, the embodiments of the present application support more device types, such as tablet computers, folding screens, etc.
[0416] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of an electronic device. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the steps of a multi-device collaborative method of each example described in the embodiment disclosed in this application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or electronic device software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0417] The embodiment of the present application can divide the above-mentioned electronic device into functional modules or functional units according to the above-mentioned method example. For example, each functional module or functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules or functional units. Among them, the division of modules or units in the embodiment of the present application is schematic, which is only a logical function division, and there may be other division methods in actual implementation.
[0418] Fig.32 A schematic diagram of the structure of a first electronic device provided in an embodiment of the present application.
[0419] like Fig.32 As shown, the embodiment of the present application discloses an electronic device, which is equipped with a first operating system, such as the above-mentioned tablet computer, smart phone, large screen device (such as: smart screen, smart TV, etc.), wearable device (such as: smart bracelet, smart watch), etc. The electronic device may specifically include: a touch screen 2201, the touch screen 2201 includes a touch sensor 2206 and a display screen 2207; one or more processors 2202; a memory 2203; a communication module 2208; one or more applications (not shown); and one or more computer programs 2204, and the above-mentioned devices may be connected through one or more communication buses 2205. The one or more computer programs 2204 are stored in the above-mentioned memory 2203 and are configured to be executed by the one or more processors 2202, and the one or more computer programs 2204 include instructions, which can be used to execute the relevant steps performed by the first electronic device 200a in the above-mentioned embodiment.
[0420] Fig.33 A schematic diagram of the structure of a second electronic device provided in an embodiment of the present application.
[0421] like Fig.33As shown, an embodiment of the present application discloses an electronic device, which is equipped with a second operating system, such as the above-mentioned personal computer PC. The electronic device may specifically include: a display screen 2301; one or more processors 2302; a memory 2303; a communication module 2306; one or more application programs (not shown); and one or more computer programs 2304. The above-mentioned components may be connected via one or more communication buses 2305. The one or more computer programs 2304 are stored in the above-mentioned memory 2303 and are configured to be executed by the one or more processors 2302, and the one or more computer programs 2304 include instructions, which can be used to execute the relevant steps performed by the second electronic device 200b in the above-mentioned embodiment.
[0422] An embodiment of the present application also provides a multi-device collaborative system, which includes the first electronic device, the second electronic device and the input device in the above embodiment.
[0423] The embodiment of the present application also provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected by lines. For example, the interface circuit can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit can be used to send signals to other devices. Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instruction is executed by the processor, the electronic device can perform the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiment of the present application.
[0424] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes each function or step executed by the mobile phone in the above-mentioned method embodiment.
[0425] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer executes each function or step executed by the mobile phone in the above method embodiment.
[0426] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0427] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0428] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0429] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0430] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.
[0431] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims
1. A multi-device collaboration method, characterized in that: include: The first electronic device displays a first window, a first cursor and a first task bar on a first desktop, the first electronic device is equipped with a first operating system, the first electronic device is connected to an input device, and the first window is a window matching the first operating system; In the process of the first cursor dragging the first window to move toward the first screen edge of the first electronic device, When a first window edge of the first window does not reach the first screen edge, the first window edge moves toward the first screen edge, and the first window edge is a window edge of the first window close to the first screen edge; When the edge of the first window moves out of the edge of the first screen and the first cursor does not reach the edge of the first screen, the first electronic device moves the first window so that a part of the first window moves out of the edge of the first screen; When the first cursor moves from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor and the first window, and the second electronic device displays an extended window and a second cursor at the second screen edge, and displays a transient page in the extended window, wherein the second electronic device is equipped with a second operating system, the second electronic device is connected to the input device, and the extended window is a window matching the second operating system; In the process of the second cursor dragging the extended window to move in a direction away from the edge of the second screen, the second electronic device displays a portion of the extended window moved to within the edge of the second screen; In response to the user's release operation on the second cursor and the extended window, the second electronic device displays a second desktop in the extended window, and displays a second taskbar and a maximized second window on the second desktop, the second desktop is projected from the first desktop, the second window has the same content as the first window, and the second taskbar has the same content as the first taskbar.
2. The multi-device collaboration method according to claim 1, characterized in that: When the first cursor moves from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor and the first window, and the second electronic device displays an extended window and a second cursor at the second screen edge, and after displaying a transient page in the extended window, further comprising: When the second cursor drags the extended window toward the edge of the second screen, When the second window edge of the extended window moves toward the direction close to the second screen edge and the second cursor has not reached the second screen edge, the second electronic device moves the extended window so that a part of the extended window moves outside the second screen edge, and the second window edge is in the same direction as the first window edge; When the second cursor moves from the second screen edge to the first screen edge of the first electronic device, the second electronic device hides the second cursor and the extended window, and the first electronic device displays the first cursor and the first window at the first screen edge; In response to the user releasing the first cursor and the first window, the first electronic device displays the first window on the first desktop.
3. The multi-device collaboration method according to claim 1, characterized in that: In response to the user releasing the second cursor and the extended window, the second electronic device displays a second desktop in the extended window, and displays a second taskbar and a maximized second window on the second desktop, including: In response to the user's release operation on the second cursor and the extended window, the second electronic device displays a loading page in the extended window, and after the second desktop is loaded, displays the second desktop, and displays the second taskbar and the maximized second window on the second desktop, wherein the loading page is used to indicate that the second electronic device is loading the second desktop.
4. The multi-device collaboration method according to claim 3, characterized in that: In response to the user releasing the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the maximized second window on the second desktop, further comprising: In response to a user dragging operation on the second window in the extended window, the second electronic device moves the second window on the second desktop.
5. The multi-device collaboration method according to claim 1, characterized in that: The top area of the extended window includes a first floating button, and the first floating button is used to move the extended window; After the second electronic device displays a second desktop in the extended window in response to the user's release operation on the second cursor and the extended window, and displays a second taskbar and a maximized second window on the second desktop, the method further includes: In response to a user dragging operation on the first floating button, the second electronic device moves the extended window.
6. The multi-device collaboration method according to claim 1, characterized in that: The bottom area of the extended window includes a second floating button, and the second floating button is used to maximize the display of the extended window, or minimize the display of the extended window; In response to the user's release operation on the second cursor and the extended window, the second electronic device displays a second desktop in the extended window, and displays a second taskbar and a maximized second window on the second desktop, and further includes: In response to a user sliding up the second floating button, the second electronic device minimizes and displays the extended window; Alternatively, in response to a user sliding down the second floating button, the second electronic device maximizes and displays the extended window.
7. The multi-device collaboration method according to claim 1, characterized in that: The top area of the extended window includes a maximize button, a minimize button and a close button; In response to the user releasing the second cursor and the extended window, the second electronic device displays the second desktop in the extended window, and displays the second taskbar and the maximized second window on the second desktop, further comprising: In response to a user clicking operation on the maximize button, the second electronic device maximizes and displays the extended window; Alternatively, in response to a user clicking operation on the minimize button, the second electronic device minimizes and displays the extended window; Alternatively, in response to a user clicking operation on the close button, the second electronic device closes the extended window.
8. The multi-device collaboration method according to claim 1, characterized in that: After the second electronic device displays a second desktop in the extended window in response to the user's release operation on the second cursor and the extended window, and displays a second taskbar and a maximized second window on the second desktop, the method further includes: In response to a user stretching operation on a window edge of the extended window, the second electronic device expands and displays the extended window; Alternatively, in response to a user's zooming operation on a window edge of the extended window, the second electronic device zooms and displays the extended window.
9. The multi-device collaboration method according to claim 1, characterized in that: After the second electronic device displays a second desktop in the extended window in response to the user's release operation on the second cursor and the extended window, and displays a second taskbar and a maximized second window on the second desktop, the method further includes: The first electronic device displays a third window on the first desktop, where the third window is a window matching the first operating system; In the process of the first cursor dragging the third window to move toward the edge of the first screen of the first electronic device, When the third window edge of the third window does not reach the first screen edge, the third window edge moves toward the first screen edge, and the third window edge is the window edge of the third window close to the first screen edge; When the edge of the third window moves out of the edge of the first screen and the first cursor does not reach the edge of the first screen, the first electronic device moves the third window so that a part of the third window moves out of the edge of the first screen, and the content of the third window is different from that of the first window; When the first cursor moves out from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor, and the second electronic device displays a second cursor at the second screen edge, and displays a fourth window in the extended window, wherein the content of the fourth window is the same as the content of the portion of the third window moved out of the first screen edge; In response to a user's release operation on the second cursor and the fourth window, the second electronic device releases the fourth window in the extended window.
10. The multi-device collaboration method according to claim 9, characterized in that: When the first cursor moves from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor, and the second electronic device displays a second cursor at the second screen edge, and after displaying a fourth window in the extended window, the method further includes: In the process of the second cursor dragging the fourth window to move toward the fourth window edge of the extended window, When the fifth window edge of the fourth window moves toward the direction close to the fourth window edge and the second cursor has not reached the second screen edge, the second electronic device moves the fourth window so that a part of the fourth window moves outside the second screen edge, the fourth window edge is opposite to the first window edge, and the fifth window edge is in the same direction as the first window edge; When the second cursor moves from the second screen edge to the first screen edge of the first electronic device, the second electronic device hides the second cursor and the extended window, and the first electronic device displays the first cursor and the third window at the first screen edge; In response to the user releasing the first cursor and the third window, the first electronic device displays the third window on the first desktop.
11. The multi-device collaboration method according to claim 6 or 7, characterized in that: After the second electronic device minimizes and displays the extended window, the method further includes: The first electronic device displays a third window on the first desktop, wherein the third window is a window matching the first operating system; In the process of the first cursor dragging the third window to move toward the edge of the first screen of the first electronic device, When the third window edge of the third window does not reach the first screen edge, the third window edge moves toward the first screen edge, and the third window edge is the window edge of the third window close to the first screen edge; When the edge of the third window moves out of the edge of the first screen and the first cursor does not reach the edge of the first screen, the first electronic device moves the third window so that a part of the third window moves out of the edge of the first screen, and the content of the third window is different from that of the first window; When the first cursor moves out from the first screen edge to the second screen edge of the second electronic device, the first electronic device hides the first cursor, and the second electronic device displays a second cursor at the second screen edge, and wakes up the extended window from the background, and displays a fourth window in the extended window, wherein the content of the fourth window is the same as the content of the portion of the third window moved out of the first screen edge; In response to a user's release operation on the second cursor and the fourth window, the second electronic device releases the fourth window in the extended window.
12. The multi-device collaboration method according to claim 1, characterized in that: When the extended window is displayed in the form of a floating window, the window edge of the extended window includes a first toolbar button; In response to the user's release operation on the second cursor and the extended window, the second electronic device displays a second desktop in the extended window, and displays a second taskbar and a maximized second window on the second desktop, and further includes: In response to a user clicking operation on the first toolbar button, the second electronic device displays a first toolbar at a window edge of the extended window.
13. The multi-device collaboration method according to claim 6 or 7, characterized in that: The second electronic device maximizing and displaying the extended window includes: The second electronic device displays a second toolbar at the window edge of the extended window.
14. The multi-device collaboration method according to claim 1, characterized in that: The extension window includes a toolbar, the toolbar includes a mode switching button, the mode switching button is used to switch the screen extension mode to the screen mirroring mode, or to switch the screen mirroring mode to the screen extension mode, wherein the extension window displays the second desktop and displays the second taskbar and the maximized second window on the second desktop, and the extension window is in the screen extension mode; After the second electronic device displays a second desktop in the extended window in response to the user's release operation on the second cursor and the extended window, and displays a second taskbar and a maximized second window on the second desktop, the method further includes: In response to the user's first click operation on the mode switching button, the second electronic device changes in the extended window from displaying the second taskbar and the maximized second window to displaying the current page of the display screen of the first electronic device, so that the extended window is in the screen mirroring mode.
15. The multi-device collaboration method according to claim 14, characterized in that: After the second electronic device changes in the extended window from displaying the second taskbar and the maximized second window to displaying the current page of the display screen of the first electronic device in response to the user's first click operation on the mode switching button, the method further includes: In response to the user's second click operation on the mode switching button, the second electronic device changes in the extended window from displaying the current page of the display screen of the first electronic device to displaying the second taskbar and the maximized second window, so that the extended window is in the screen extension mode.
16. The multi-device collaboration method according to claim 6 or 7, characterized in that: After the second electronic device maximizes and displays the extended window, the method further includes: In response to the user moving the second cursor to the top area of the extended window, the second electronic device displays a third floating button in the top area of the extended window; In response to a user clicking operation on the third floating button, the second electronic device displays a floating window option control in a top area of the extended window, the floating window option control comprising a first sub-button and a second sub-button, the first sub-button being used to display the extended window in full screen form, and the second sub-button being used to switch the extended window to be displayed in a floating window form; In response to the second electronic device displaying the floating window option control, the second electronic device highlights the first sub-button; In response to a user clicking operation on the second sub-button, the second electronic device changes the display of the extended window from a full-screen form to a floating window form.
17. The multi-device collaboration method according to claim 6 or 7, characterized in that: After the second electronic device maximizes and displays the extended window, the method further includes: In response to the user moving the second cursor to the top area of the extended window, the second electronic device displays a third floating button in the top area of the extended window; In response to the user's dragging operation on the third floating button, the second electronic device changes the display of the extended window from a full-screen form to a floating window form.
18. An electronic device, characterized in that: The electronic device is equipped with a first operating system; The electronic device comprises: a display screen; one or more processors; Memory; Communication module; Wherein, one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device executes the multi-device collaboration method as described in any one of claims 1-17.
19. An electronic device, characterized in that: The electronic device is equipped with a second operating system; The electronic device comprises: a display screen; one or more processors; Memory; Communication module; Wherein, one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device executes the multi-device collaboration method as described in any one of claims 1-17.
20. A multi-device collaborative system, characterized in that: The device comprises a first electronic device, a second electronic device and an input device, wherein the first electronic device comprises the electronic device as claimed in claim 18, and the second electronic device comprises the electronic device as claimed in claim 19.