Split-screen window dragging method and related equipment

Abstract

The embodiment of the invention provides a split-screen window dragging method and related equipment. According to the method, the process of carrying out different-source screen projection in the second electronic equipment after the split-screen window of the first electronic equipment is dragged to the second electronic equipment can be supported, and the richness of equipment interaction is increased. Moreover, the wallpaper is displayed in the first electronic equipment for a period of time from the time when the user loosens the hand and releases the mouse in the second electronic equipment to the time when the real screen projection content is displayed in the screen projection window of the second electronic equipment, so that the user does not perceive the process that the window of the first application is switched from the split screen to the full screen in the first electronic equipment, and the user experience is improved. And user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a split-screen window dragging method and related equipment. Background Art

[0002] With the development of communication technology, some electronic devices can share input devices after being interconnected, and the input devices may include a mouse, a touchpad, etc. For example, after a tablet computer PAD and a personal computer (PC) are interconnected, the content displayed on the PAD interface can be triggered by the mouse connected to the PC.

[0003] In some implementations, after the PAD is connected to the PC, it can also support dragging files and pictures in the PC to the PAD through the mouse connected to the PC. However, the functions achieved by the mouse between the PAD and the PC are relatively simple, which is not conducive to the user experience in device interconnection. Summary of the invention

[0004] The embodiments of the present application provide a split-screen window dragging method and related devices, which are applied to the field of terminal technology. In the embodiments of the present application, it is possible to drag the split-screen window in a PAD or a mobile phone to a PC, and then drag it back to the PAD or the mobile phone in the PC for heterogeneous screen projection, thereby increasing the richness of device interaction.

[0005] In a first aspect, an embodiment of the present application proposes a split-screen window dragging method. The method is applied to a communication system, the communication system includes a first electronic device installed with a first operating system and a second electronic device installed with a second operating system, the first electronic device or the second electronic device is connected to an input device, the first operating system is different from the second operating system, and the method includes:

[0006] The first electronic device displays a first cursor, a first split-screen window, and a second split-screen window, the first cursor is located on the first split-screen window, the first split-screen window is a split-screen window of a first application, and the second split-screen window is a split-screen window of a second application; when the user controls the first cursor to select and drag the first split-screen window to a first position through an input device, the first electronic device displays a full-screen image, and displays a first motion effect window at the first position, stops displaying the first split-screen window and the second split-screen window, the first motion effect window includes a first identifier of the first application, the first motion effect window is located on an upper layer of the full-screen image, and the size of the first motion effect window is smaller than the size of the full-screen image; during the process of the first cursor dragging the first motion effect window, when the first cursor When a cursor moves from the first screen edge of the first electronic device to the second screen edge of the second electronic device, the first electronic device displays a full-screen image and stops displaying the first animation window, and the second electronic device displays the second animation window dragged by the first cursor, and the second animation window includes the second identifier of the first application; during the process of the first cursor dragging the second animation window, when it is detected that the user releases the first cursor at the second position through the input device, the second electronic device displays a projection window at the second position and stops displaying the second animation window, the projection window is used to display content that is partially or completely the same as the content of the first split-screen window, and the first electronic device displays the full-screen window of the second application.

[0007] In this way, after dragging the split-screen window of the first electronic device to the second electronic device, the process of heterogeneous screen projection can be supported in the second electronic device, increasing the richness of device interaction. In addition, when the user releases the mouse in the second electronic device and the real screen projection content is displayed in the projection window of the second electronic device, the wallpaper is displayed in the first electronic device, so that the user does not perceive the process of the first application window switching from split screen to full screen in the first electronic device, thereby improving the user experience.

[0008] In a possible implementation, in response to the cursor release event, the first electronic device also mounts the first split-screen window to the virtual display, moves the stack in the virtual display, and sets both the first application and the second application to full-screen mode. In this way, the first application can be projected on the second electronic device in the form of a full-screen window, and the first electronic device displays the full-screen second application, and the first electronic device can support the user to implement other functions.

[0009] In a possible implementation, before both the first application and the second application are set to full-screen mode, it includes: the first electronic device receives a stack shift instruction from the second electronic device; the first electronic device removes the first split-screen window from the display of the first electronic device; the first electronic device exits the split-screen mode of the second application; after both the first application and the second application are set to full-screen mode, it includes: the first electronic device sets the first application to be visible, and hides the full-screen image. In this way, after the first application is shifted to the virtual display, the second electronic device can display the full-screen window of the first application, and the first electronic device can display the full-screen window of the second application. After implementing heterogeneous screen projection in the second electronic device, the first electronic device can support users to implement other functions.

[0010] In a possible implementation, it also includes: when the user uses the input device to control the first cursor to select and drag the first split-screen window, the first electronic device also sends the identification information of the first application to the second electronic device; the identification information includes the identification information including: application package name, application name and / or application icon. In this way, when the cursor subsequently drags the split-screen window from the first electronic device to the second electronic device, the second electronic device can promptly draw the dynamic effect window based on the application package name, application name and / or application icon and other information, so that the user can have the experience of dragging the split-screen window to the second electronic device.

[0011] In a possible implementation, when the first cursor is dragging the second motion effect window, when the first cursor moves from the second screen edge of the second electronic device to the first screen edge of the first electronic device, the first electronic device displays the first motion effect window dragged by the first cursor, the first motion effect window is located on the upper layer of the full-screen image, and the second electronic device stops displaying the second motion effect window. In this way, it can support the user to drag the split-screen window of the first electronic device to the second electronic device, and it can also support the split-screen window to be dragged from the second electronic device back to the first electronic device, enriching the device interaction scene.

[0012] In a first aspect, an embodiment of the present application proposes a split-screen window dragging method. The method is applied to a communication system, the communication system includes a first electronic device installed with a first operating system and a second electronic device installed with a second operating system, the first electronic device or the second electronic device is connected to an input device, the first operating system is different from the second operating system, and the method includes:

[0013] The first electronic device displays a first cursor, a first split-screen window, and a second split-screen window, the first cursor is located on the first split-screen window, the first split-screen window is a split-screen window of a first application, and the second split-screen window is a split-screen window of a second application; when the user controls the first cursor to select and drag the first split-screen window through an input device, the first electronic device sends identification information of the first application to the second electronic device; when the first cursor drags the first split-screen window to a first position, the first electronic device displays a first motion effect window at the first position, the display area of ​​the second split-screen window remains unchanged, the first motion effect window includes part or all of the identification information of the first application, the lower layer of the first motion effect window displays a mask, and the size of the first motion effect window is smaller than the size of the first split-screen window; in the process of the first cursor dragging the first motion effect window, when the first cursor moves from the first electronic device to the second electronic device, When the first screen edge of the electronic device moves out to the second screen edge of the second electronic device, the first electronic device displays the mask and the second split-screen window in a split-screen manner, stops displaying the first animation window, and the second electronic device displays the second animation window dragged by the first cursor, where the second animation window includes part or all of the identification information of the first application; during the process of the first cursor dragging the second animation window, when it is detected that the user releases the first cursor at the second position through the input device, the second electronic device displays the full-screen window of the first application at the second position, stops displaying the second animation window, and the full-screen window of the first application is used to display content that is partially or completely the same as that of the first split-screen window, and the second electronic device sends a cursor release event to the first electronic device; in response to the cursor release event, the first electronic device displays the full-screen window of the second application.

[0014] In this way, after dragging the split-screen window of the first electronic device to the second electronic device, the process of heterogeneous screen projection can be supported in the second electronic device, increasing the richness of device interaction. In addition, when the user releases the mouse in the second electronic device and the real screen projection content is displayed in the projection window of the second electronic device, the wallpaper is displayed in the first electronic device, so that the user does not perceive the process of the first application window switching from split screen to full screen in the first electronic device, thereby improving the user experience.

[0015] In a possible implementation, in response to the cursor release event, the first electronic device also mounts the first split-screen window to the virtual display, moves the stack in the virtual display, and sets both the first application and the second application to full-screen mode. In this way, the first application can be projected on the second electronic device in the form of a full-screen window, and the first electronic device displays the full-screen second application, and the first electronic device can support the user to implement other functions.

[0016] In one possible implementation, before both the first application and the second application are set to full-screen mode, it includes: the first electronic device receives a stack shift instruction from the second electronic device; the first electronic device removes the first split-screen window from the display of the first electronic device; the first electronic device exits the split-screen mode of the second application; after both the first application and the second application are set to full-screen mode, it includes: the first electronic device sets the first application to be visible, and hides the mask. In this way, after the first application is stacked to the virtual display, the second electronic device can display the full-screen window of the first application, and the first electronic device can display the full-screen window of the second application. After heterogeneous screen projection is implemented in the second electronic device, the first electronic device can support users to implement other functions.

[0017] In a possible implementation, it also includes: when the user uses the input device to control the first cursor to select and drag the first split-screen window, the first electronic device also sends the identification information of the first application to the second electronic device; the identification information includes the identification information including: application package name, application name and / or application icon. In this way, when the cursor subsequently drags the split-screen window from the first electronic device to the second electronic device, the second electronic device can promptly draw the dynamic effect window based on the application package name, application name and / or application icon and other information, so that the user can have the experience of dragging the split-screen window to the second electronic device.

[0018] In a possible implementation, when the first cursor is dragging the second motion effect window, when the first cursor moves from the second screen edge of the second electronic device to the first screen edge of the first electronic device, the first electronic device displays the first motion effect window dragged by the first cursor, the first motion effect window is located on the upper layer of the mask, and the second electronic device stops displaying the second motion effect window. In this way, it can support the user to drag the split-screen window of the first electronic device to the second electronic device, and it can also support the split-screen window to be dragged from the second electronic device back to the first electronic device, enriching the device interaction scene.

[0019] In a third aspect, an embodiment of the present application provides a communication system, which may include a first electronic device and a second electronic device of the first aspect or the second aspect, wherein the first electronic device may implement a method performed by the first electronic device as described in any possible implementation of the first aspect, the second aspect, or any one of the first and second aspects, and the second electronic device may implement a method performed by the second electronic device as described in any possible implementation of the first aspect, the second aspect, or any one of the first and second aspects.

[0020] In a fourth aspect, an embodiment of the present application provides a split-screen window dragging device, which may be an electronic device, or a chip or chip system in an electronic device. The split-screen window dragging device may include a display unit and a processing unit. When the split-screen window dragging device is an electronic device, the display unit may be a display screen. The display unit is used to execute the display step so that the electronic device implements the method performed by the first electronic device or the second electronic device described in the first aspect or any possible implementation of the first aspect. When the split-screen window dragging device is an electronic device, the processing unit may be a processor. The split-screen window dragging device may also include a storage unit, which may be a memory. The storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit so that the electronic device implements the method performed by the first electronic device or the second electronic device described in the first aspect or any possible implementation of the first aspect. When the split-screen window dragging device is a chip or chip system in an electronic device, the processing unit may be a processor. The processing unit executes the instructions stored in the storage unit so that the electronic device implements the method performed by the first electronic device or the second electronic device described in the first aspect, the second aspect, or any possible implementation of any of the first and second aspects. The storage unit may be a storage unit within the chip (eg, a register, a cache, etc.), or a storage unit within the electronic device that is located outside the chip (eg, a read-only memory, a random access memory, etc.).

[0021] In a fifth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, the memory being used to store code instructions, and the processor being used to run the code instructions to execute a method executed by a first electronic device described in any possible implementation of the first aspect or the second aspect, or to execute a method executed by a second electronic device described in any possible implementation of the first aspect or the second aspect.

[0022] In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the method performed by the first electronic device as described in any possible implementation of the first aspect or the second aspect is implemented, or the method performed by the second electronic device as described in any possible implementation of the first aspect or the second aspect is implemented.

[0023] In the seventh aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is run, it enables the computer to execute a method executed by a first electronic device described in any possible implementation of the first aspect or the second aspect, or execute a method executed by a second electronic device described in any possible implementation of the first aspect or the second aspect.

[0024] In an eighth aspect, the present application provides a chip or a chip system, the chip or chip system comprising at least one processor and a communication interface, the communication interface and the at least one processor are interconnected by a line, and the at least one processor is used to run a computer program or instruction to execute a method performed by a first electronic device described in any possible implementation of the first aspect or the second aspect, or to execute a method performed by a second electronic device described in any possible implementation of the first aspect or the second aspect. The communication interface in the chip may be an input / output interface, a pin, or a circuit, etc.

[0025] In a possible implementation, the chip or chip system described above in the present application further includes at least one memory, in which instructions are stored. The memory may be a storage unit inside the chip, such as a register, a cache, etc., or a storage unit of the chip (e.g., a read-only memory, a random access memory, etc.).

[0026] It should be understood that the third to eighth aspects of the present application correspond to the technical solutions of the first or second aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 A schematic diagram of a keyboard and mouse interconnection scenario in an embodiment of the present application;

[0028] Figure 2 This is a schematic diagram of another keyboard and mouse interconnection scenario according to an embodiment of the present application;

[0029] Figure 3 A schematic diagram of the hardware structure of a first electronic device 100 provided in an embodiment of the present application;

[0030] Figure 4 A schematic diagram of the hardware structure of the second electronic device 200 provided in an embodiment of the present application;

[0031] Figure 5 A schematic diagram of the software structure of a first electronic device 100 and a second electronic device 200 provided in an embodiment of the present application;

[0032] Figure 6 A schematic diagram of software module interaction provided in an embodiment of the present application;

[0033] Figure 7 A schematic diagram of displaying a split-screen window in a PAD provided in an embodiment of the present application;

[0034] Figure 8 A schematic diagram of a split-screen window shrinking animation displayed in a PAD provided in an embodiment of the present application;

[0035] Fig. 9 A schematic diagram of displaying a dynamic effect window and a split-screen wallpaper mask in a PAD provided in an embodiment of the present application;

[0036] Fig.10 A schematic diagram of displaying a partial dynamic effect window and a split-screen wallpaper mask in a PAD provided in an embodiment of the present application;

[0037] Fig.11 A schematic diagram of a PC displaying a dynamic effect window provided in an embodiment of the present application;

[0038] Fig.12 A schematic diagram of a partial dynamic effect window displayed in a PC provided in an embodiment of the present application;

[0039] Fig.13 A schematic diagram of displaying a dynamic effect window and a split-screen wallpaper mask in a PAD provided in an embodiment of the present application;

[0040] Fig.14 A schematic diagram of displaying a split-screen window in a PAD provided in an embodiment of the present application;

[0041] Fig.15 A schematic diagram of displaying a heterogeneous screen projection window in a PC provided in an embodiment of the present application;

[0042] Fig.16 A schematic diagram of a process of heterogeneous screen projection provided in an embodiment of the present application;

[0043] Fig.17 Another software module interaction diagram provided in an embodiment of the present application;

[0044] Fig.18 A schematic diagram of displaying a dynamic effect window and a full-screen wallpaper mask in another PAD provided in an embodiment of the present application;

[0045] Fig.19 A schematic diagram of another PC displaying a dynamic effect window provided in an embodiment of the present application;

[0046] Fig. 20 A schematic diagram of displaying a partial dynamic effect window and a full-screen wallpaper mask in another PAD provided in an embodiment of the present application;

[0047] Fig.21A schematic diagram of displaying a dynamic effect window and a full-screen wallpaper mask in another PAD provided in an embodiment of the present application;

[0048] Fig. 22 A schematic diagram of displaying a split-screen window in another PAD provided in an embodiment of the present application;

[0049] Fig.23 A schematic diagram of another process of heterogeneous screen projection provided in an embodiment of the present application;

[0050] Fig.24 A schematic diagram of displaying a same-source screen projection window in a PC provided in an embodiment of the present application;

[0051] Fig.25 A flowchart of a split-screen window dragging method provided in an embodiment of the present application;

[0052] Fig.26 A flowchart of another split-screen window dragging method provided in an embodiment of the present application;

[0053] Fig. 27 A schematic diagram of the structure of a split-screen window dragging device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] 1. Same-source screen projection: It can be understood that the content displayed in the screen projection interface of the projected device is the same or basically the same as the content displayed on the screen projection device interface. For example, when a mobile phone or PAD is used as a screen projection device to project the same-source screen to the projected device PC, the interface displayed by the mobile phone or PAD is the same as the content displayed in the screen projection display window on the PC. Of course, the screen projection display window on the PC can also display a title bar (such as maximize and minimize buttons), or the screen projection display window on the PC may not display the content in the status bar of the mobile phone or PAD. When the interface in the mobile phone or PAD changes from the first interface to the second interface, the content displayed in the screen projection display window on the PC may also change from the first interface to the second interface.

[0055] 2. Heterogeneous screen projection: It can be understood that the content displayed in the projection interface of the projected device may be different from the content displayed on the projection device interface. For example, when a mobile phone or PAD is used as a projection device to project the screen to the projected device PC, the mobile phone or PAD can display the interface of the first application, and the projection display window on the PC can display the interface of the second application. When the interface in the mobile phone or PAD changes from the first interface to the second interface, the interface displayed in the projection display window on the PC may remain unchanged.

[0056] 3. Keyboard and mouse sharing technology: It can be understood as a technology that uses an electronic device to control the electronic device and other electronic devices interconnected with the electronic device.

[0057] 4. Drag state: It can be used to identify whether the drag operation continues and whether the cursor is in the electronic device that starts the drag during the drag. For example, the drag state may include a first value, a second value, and a third value. The first value is used to indicate that there is no drag event in progress; the second value is used to indicate that there is a drag event in progress and the cursor is displayed in the electronic device that starts the drag; the third value is used to indicate that there is a drag event in progress and the cursor is not displayed in the electronic device that starts the drag. Among them, the occurrence of a drag event can be understood as the drag operation has not ended (for example, the user has not released the mouse), and the absence of a drag event can be understood as the absence of a drag operation (for example, the user has not pressed the mouse and dragged). The first value, the second value, and the third value can be different without special limitation. For example, the first value can be set to 0, the second value to 1, the third value to 2, etc.

[0058] In an embodiment of the present application, by setting the drag state, when a mouse crossing occurs, the electronic device can determine whether the mouse crossing is a cursor crossing when there is no drag event (for example, the user does not press the mouse, but only moves the mouse to cross between electronic devices), or a cursor dragging window crossing when there is a drag event (for example, the user presses the mouse in a full-screen window, and moves the mouse to drag the full-screen window to cross between electronic devices).

[0059] For example, when the mouse passes through the electronic device from which the mouse is being dragged, if the electronic device determines that the dragging state is the second value, the electronic device updates the dragging state to the third value; if the electronic device determines that the dragging state is not the second value, the electronic device does not update the dragging state, and the electronic device can execute the cursor crossing related processes when there is no dragging event.

[0060] Similarly, when the mouse passes back from another electronic device to the electronic device that initiated the drag, if the electronic device determines that the drag state is the third value, the electronic device updates the drag state to the second value; if the electronic device determines that the drag state is not the third value, the electronic device does not update the drag state, and the electronic device can execute the cursor crossing related processes when there is no drag event.

[0061] 5. Other terms

[0062] In the embodiments of the present application, words such as "first" and "second" are used to distinguish the same or similar items with substantially the same functions and effects. For example, the first chip and the second chip are only used to distinguish different chips, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0063] It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0064] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, a--c, bc, or abc, where a, b, c can be single or multiple.

[0065] It should be noted that the "at..." in the embodiment of the present application can be the instant when a certain situation occurs, or can be a period of time before or after a certain situation occurs, and the embodiment of the present application does not specifically limit this. In addition, the display interface provided in the embodiment of the present application is only an example, and the display interface can also include more or less content.

[0066] In some implementations, only the dragging and dropping of files, pictures, and application icons are supported between devices that establish communication based on keyboard and mouse sharing technology. After dragging files, pictures, and application icons from one device to another, it is not supported to drag the files, pictures, and application icons back to the original device. The interaction scenarios are relatively limited, affecting the user experience.

[0067] In view of this, the full-screen drag method provided in the embodiment of the present application can support the dragging of full-screen windows between electronic devices. Among them, the operating systems installed on the two electronic devices can be different, for example, device 1 is an Android operating system, and device 2 is a Windows operating system. For example, after the split-screen window of device 1 is dragged to device 2, it can also support the split-screen window port to be dragged from device 2 back to device 1, or, after the split-screen window of device 1 is dragged to device 2, heterogeneous screen projection is realized on device 2, enriching the scene of interaction between devices and improving user experience.

[0068] The split-screen window application dragging method provided in the embodiment of the present application can be applied in a communication system, and the communication system may include a first electronic device 100 and a second electronic device 200.

[0069] For example, Figure 1 As shown, an input device 300 may be connected to the first electronic device 100, and the first electronic device 100 and the second electronic device 200 may establish a communication connection. After the first electronic device 100 and the second electronic device 200 turn on the keyboard and mouse sharing function, the user can not only use the input device 300 of the first electronic device 100 to control the first electronic device 100, but also pass the input device 300 to the screen of the second electronic device 200 to control the second electronic device 200. In an embodiment of the present application, the user can drag the split screen window in the first electronic device 100 to the second electronic device 200, and then display the content of the split screen window of the first electronic device 100 on the screen of the second electronic device 200 through the same source screen projection or the different source screen projection. In this way, the scene of interaction after the first electronic device 100 and the second electronic device 200 are interconnected can be enriched, and the user experience can be improved.

[0070] Or, if Figure 2 As shown, the second electronic device 200 may be connected to an input device 300, and the first electronic device 100 and the second electronic device 200 may establish a communication connection. After the first electronic device 100 and the second electronic device 200 turn on the keyboard and mouse sharing function, the user can not only use the input device 300 of the second electronic device 200 to control the second electronic device 200100, but also pass the input device 300 to the screen of the first electronic device 100 to control the first electronic device 100. In an embodiment of the present application, the user can drag the split screen window in the first electronic device 100 to the second electronic device 200, and then display the content of the split screen window of the first electronic device 100 on the screen of the second electronic device 200 through the same source screen projection or the different source screen projection. In this way, the scene of interaction after the first electronic device 100 and the second electronic device 200 are interconnected can be enriched, and the user experience can be improved.

[0071] Among them, the first electronic device 100 and the second electronic device 200 may enable the keyboard and mouse functions in the following ways, including but not limited to: using the input device 300 to touch the edge of the first electronic device 100 or the edge of the second electronic device 200 a preset number of times, and / or, the second electronic device 200 provides an interface for establishing keyboard and mouse sharing with the first electronic device 100, and the user chooses to share the keyboard and mouse with the first electronic device 100 in the interface.

[0072] Understandably, Figure 1 and Figure 2 The first electronic device 100 is a PAD, the second electronic device 200 is a PC, and the input device 300 is a mouse. This example does not limit the first electronic device 100, the second electronic device 200, and the input device 300.

[0073] The first electronic device 100 and the second electronic device 200 can be devices of the same type or devices of different types. Exemplarily, the first electronic device 100 and the second electronic device 200 can be any of the following electronic devices: a mobile phone, a tablet computer, a PDA, a laptop computer, a mobile internet device (MID), a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, a wireless terminal in industrial control, a wireless terminal in self driving, a wireless terminal in remote medical surgery, a wireless terminal in a smart grid, a wireless terminal in transportation safety, a wireless terminal in a smart city, a wireless terminal in a smart home, a cellular phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a wireless communication device, ... assistant, PDA), handheld devices with wireless communication functions, computing devices or other processing devices connected to wireless modems, vehicle-mounted devices, wearable devices, electronic devices in 5G networks or electronic devices in future public land mobile networks (PLMN), electronic devices in Internet of Things (IoT) systems, etc., which are not limited in the embodiments of the present application. Among them, the mobile phone can be a straight-screen mobile phone or a folding screen mobile phone.

[0074] The input device 300 may include a mouse, a touch pad, a touch screen, or the like.

[0075] It should be noted that when the input device 300 is connected to the first electronic device 100 or the second electronic device 200, it can be a wired connection or a wireless connection. When the input device 300 is wiredly connected to a device such as a mobile phone or a PAD, an adapter can be used to convert the interface of the input device 300 into a type that can be inserted into the interface of the mobile phone or PAD to achieve a wired plug-in connection.

[0076] In order to better understand the embodiment of the present application, the structure of the first electronic device 100 and the structure of the second electronic device 200 in the embodiment of the present application are exemplarily introduced below:

[0077] Figure 3 The schematic diagram of the structure of the first electronic device 100 is shown. The first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0078] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0079] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0080] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0081] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0082] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuits sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0083] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0084] The first electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for split-screen window application dragging, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0085] Figure 4 FIG. 2 shows a schematic diagram of the structure of the second electronic device 200. Figure 4, the second electronic device 200 may include multiple subsystems that cooperate to perform, coordinate or monitor one or more operations or functions of the electronic device 202. The second electronic device 200 includes a processor 210, an input surface 220, a coordination engine 230, a power subsystem 240, a power connector 250, a wireless interface 260 and a display 270.

[0086] Exemplarily, the coordination engine 230 can be used to communicate and / or process data with other subsystems of the second electronic device 200; for example, communicate and / or trade data with the stylus 100; measure and / or obtain the output of one or more analog or digital sensors (such as a touch sensor), etc.

[0087] The processor 210 may be used to execute, coordinate and / or manage functions of the second electronic device 200. Such functions may include, but are not limited to, communicating with other subsystems of the second electronic device 200 and / or transaction data, etc.

[0088] The processor 210 may be used to process, receive or send data or instructions. For example, the processor may be a microprocessor, a central processing unit, an application specific integrated circuit, a field programmable gate array, a digital signal processor, an analog circuit, a digital circuit or a combination of these devices. The processor may be a single-threaded or multi-threaded processor. The processor may be a single-core or multi-core processor.

[0089] During use, the processor 210 may be configured to access a memory storing instructions that may be configured to cause the processor to execute, coordinate or monitor one or more operations or functions of the second electronic device 200 .

[0090] The wireless interface 260 may be used to communicate with the first electronic device 100 .

[0091] It is understandable that some of the specific details presented above regarding the first electronic device 100 and the second electronic device 200 may not be necessary, and the embodiments of the present application do not limit the specific structures of the first electronic device 100 and the second electronic device 200.

[0092] In the embodiment of the present application, the first electronic device 100 and the second electronic device 200 may use different operating systems, and the operating system may include, for example, any of the following operating systems: Linux operating system, Unix operating system, Android operating system, iOS operating system or Windows operating system, etc.

[0093] For example, Figure 5Taking the case where the operating system of the first electronic device 100 is the Android system and the operating system of the second electronic device 200 is the Windows system as an example, partial software architectures of the first electronic device 100 and the second electronic device 200 are exemplified.

[0094] like Figure 5 As shown, the operating system of the first electronic device 100 may include an application layer and an application framework layer (framework, FWK).

[0095] The application layer may include a keyboard and mouse module, which may also be called a virtual input installation package (virtualinput android package, VIAPK), a keyboard and mouse APK, and the like.

[0096] The keyboard and mouse module can be used for device connection management, drag status update and synchronization, keyboard and mouse event interception and injection, mouse crossing identification, etc. Among them, device connection management is used to realize discovery and communication connection between devices, drag status update and synchronization is used to update and synchronize whether there is a drag event in the device, whether there is a cursor in the device, etc., keyboard and mouse event interception and injection is used to intercept and inject keyboard and mouse parameters when it is determined that a keyboard and mouse event occurs, etc., and mouse crossing identification is used to identify whether the mouse cursor crosses the edge of the display screen of the electronic device.

[0097] FWK can include a variety of system services (system servers), including, for example, drag framework, drag process management, and heterogeneous screen projection.

[0098] The drag framework can be used for drag shadow creation, gesture recognition, input event listening, drag shadow display and hiding, etc. Among them, drag shadow creation can be understood as creating a split-screen window or dynamic effect window that can move with the mouse; gesture recognition is used to recognize drag operations, etc., input event listening is used to listen to the position of the mouse, etc., and drag shadow display and hiding is used to manage whether the PAD displays a drag shadow or does not display a drag shadow.

[0099] The drag process management can be used for drag status update and synchronization, wallpaper mask hiding and display, application layer visibility management, abnormal timeout protection, etc. Among them, the drag status update and synchronization are used to update and synchronize whether there is a drag event in the device, whether there is a cursor in the device, and other states. Optionally, the drag state in FWK can be synchronized with the drag state in the keyboard and mouse module. Wallpaper mask hiding and displaying are used to manage the hiding or display of wallpaper masks during the dragging process of split-screen windows. Application layer visibility management is used to manage the display or hiding of the layer where the split-screen window application is located. Abnormal timeout protection is used to protect the normal operation of the application in the split-screen window application when the drag process is abnormal.

[0100] Heterogeneous screen projection can be used for application stack migration, window mode switching, and exiting split screen stack, etc. Among them, application stack migration is used, for example, to realize heterogeneous screen projection of the content in the split screen window application of an electronic device to other devices, window mode switching is used, for example, to switch the window mode from split screen mode to full screen mode or from full screen mode to split screen mode, etc., and exiting split screen stack is used, for example, to manage the target application and paired application in the split screen pair and exit split screen mode.

[0101] It is understandable that the application framework layer may also include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., which is not specifically limited in the embodiments of the present application.

[0102] Of course, the operating system of the first electronic device 100 may also include a hardware abstract layer (HAL), a driver layer, and a hardware layer, etc. Each layer has its own role and division of labor, which is not limited in the embodiment of the present application.

[0103] like Figure 5 As shown, the operating system of the second electronic device 200 may include an application layer, and the application layer may include applications such as PC Manager.

[0104] PC Butler can be installed in the operating system of the PC in the form of a system application or a third-party application. For example, PC Butler is used for device connection management, drag status update and synchronization, keyboard and mouse event management, heterogeneous screen projection, etc. Among them, device connection management is used to realize discovery and communication connection between devices, drag status update and synchronization is used to update and synchronize whether there is a drag event in the device, whether there is a cursor in the device, etc., keyboard and mouse event management is used to realize the management of mouse pressing, moving, and lifting events, etc., heterogeneous screen projection is used to manage the stacking and projection between the first electronic device 100 and the second electronic device 200, etc. Optionally, PC Butler can also be used for animation start and stop, animation resource management. Animation start and stop are used to manage the timing of displaying or not displaying animations, etc., and animation resource management is used to manage the resources required for the display of animations, etc.

[0105] Of course, the operating system of the second electronic device 200 may also include other layers such as a kernel and a driver, which are used to implement various functions of the second electronic device 200 together with the application layer, and this embodiment of the present application does not limit this.

[0106] When the first electronic device 100 and the second electronic device 200 implement the split-screen window application dragging method of the embodiment of the present application, the modules in the operating systems of each device may interact with each other. The following will combine the possible software module interactions and possible interface displays in the process of implementing the split-screen window application dragging by the first electronic device 100 and the second electronic device 200 to exemplify the split-screen window application dragging method provided by the embodiment of the present application.

[0107] For ease of description, in the embodiments of the present application and the related drawings, the first electronic device 100 is a PAD, the second electronic device 200 is a PC, and the input device 300 is a mouse. This example does not constitute a specific limitation on the first electronic device 100, the second electronic device 200, and the input device 300. For example, the first electronic device 100 can also be replaced by a PAD, etc.

[0108] It is understandable that before the PAD and PC perform split-screen window dragging, the PAD and PC can first perform keyboard and mouse connection. During the keyboard and mouse connection stage between the PAD and PC, the PAD can bind the communication service between the application framework layer and the keyboard and mouse module for mutual communication between subsequent modules. In addition, the application framework layer can apply to the keyboard and mouse module for a drag switch, and the keyboard and mouse module can decide whether to support window dragging based on the PAD configuration items and the situation of the PC, and return it to the application framework layer. If the PAD supports window dragging, the split-screen window dragging method of the embodiment of the present application can be executed.

[0109] For example, Figure 6 The diagram shows a schematic diagram of the interaction process of each module in the PAD and PC software system in which a drag operation on a split-screen window is received from the PAD and the drag operation continues, causing the mouse to pass from the PAD to the PC.

[0110] The modules involved on the PAD side may include the keyboard and mouse module in the application layer and the following modules in the application framework layer:

[0111] Split screen caption view, multi window switch manager, multi win drag animation adapter, view module, and window manager service.

[0112] Among them, the keyboard and mouse module can be used for keyboard and mouse crossing monitoring.

[0113] The split-screen title view can be used to determine whether there is an operation to drag the bar of the split-screen window; the multi-window switching manager can be used to initialize the hot zone; the multi-window drag animation adapter can be used to create a drag shadow; the view module can be used to start drag and drop; the window management service can be used for related work of dragging the split-screen window with the mouse.

[0114] The modules involved on the PC side may include a keyboard and mouse module and a screen projection module. The screen projection module is used to realize the screen projection of the application in the PAD split-screen window on the PC.

[0115] like Figure 6 As shown in the figure, the interaction process of some modules in the PAD and PC software system may include the following steps:

[0116] S601. The split-screen title view detects that the bar is long pressed and updates the drag state to the second value.

[0117] PAD can display multiple split-screen windows, for example, Figure 7 It is a display interface of a PAD, wherein the PAD includes two split-screen windows, one split-screen window displays a calculator application, and the other split-screen window displays a calendar application.

[0118] Any split-screen window may include a draggable area. Taking the split-screen window of a calculator application as an example, the draggable area may include bar 703, the area where the title bar is located, and / or the area near the title bar. For example, Figure 7 The area from the middle dotted line to the top part of the split-screen window can be set as the draggable area 701. The draggable area of ​​the split-screen window can be managed by the application displayed in the split-screen window.

[0119] When the keyboard and mouse function is enabled in the PAD, the cursor 702 can be moved in the draggable area 701 through an input device 300 such as a mouse. The cursor 702 can be Figure 7 The arrow shape shown may also be a circle or any other shape, which is not specifically limited in the embodiments of the present application.

[0120] Among them, the split-screen title view may correspond to the draggable area 701 .

[0121] The split-screen title view monitoring a long press on the bar can be understood as: the user can press the mouse in the draggable area 701 to trigger the split-screen title view of the PAD to monitor a bar press operation; the user does not lift the mouse within a preset time after pressing the mouse, triggering the split-screen title view of the PAD to monitor a bar press operation; for example, the split-screen title view recognizes a long press (on long click). The preset time can be 100ms.

[0122] S602: The split-screen title view instructs the multi-window switching manager to add a hot zone.

[0123] The hotspots in the multi-window switching manager can be understood as Figure 7 The draggable area 701 in the interface shown. When the split-screen title view recognizes a long press operation on the bar 703, the multi-window switching manager can perform an add hot area operation to facilitate subsequent management of the hot area.

[0124] S603: The multi-window switching manager initializes the hot zone.

[0125] The multi-window switching manager can rely on the view View drag frame to initialize the hot zone management. To facilitate understanding of the initialization process, the present application embodiment first combines Figure 8 The schematic diagram of the interface after initialization is described.

[0126] Exemplarily, the PAD detects a long press operation on the bar, and in response to the long press operation, the PAD displays Figure 8 The interface shown in the figure, wherein the PAD can be split into left and right screens; for example, a split screen window 801 is displayed in the left window of the PAD, wherein the split screen window 801 is proportionally reduced; and a split screen window 802 is displayed in the right window of the PAD, and the size of the split screen window 802 does not change. It can be seen that the split screen window 801 is smaller than the split screen window 802, and the split screen window 801 does not cover the display area of ​​the left window, and a split screen wallpaper mask 803 can be displayed in the left window. The split screen wallpaper mask can be understood as the wallpaper mask displayed in the window on the side where the application is dragged, and the wallpaper mask is not displayed in the window on the other side where the application is not dragged.

[0127] Specifically, the initialization process may include the following steps:

[0128] 1) The multi-window switching manager obtains a screenshot of the task and converts the screenshot into a bitmap image.

[0129] The task can be the target application process displayed in the split-screen window. For example, the task can correspond to Figure 7 In the example, the application processes in the two split-screen windows of the PAD, such as the calculator application and the calendar application. The multi-window switching manager can call the function get top stack snapshot to obtain the task screenshot.

[0130] It should be noted that the PAD may include multiple split-screen windows, each of which may display an application process. The screenshot of the task described in step 1) corresponds to the split-screen title view that detects a long press bar operation, for example, Figure 7In the present invention, the multi-window switching manager of the PAD obtains the screenshot of the calculator application and converts it into a bitmap image composed of pixels.

[0131] 2) The multi-window switching manager calculates the surface of the drag shadow.

[0132] Drag shadow can be Figure 8 In the split screen window 801, the surface may be a screen buffer area for storing the drag shadow, and the surface of the drag shadow may correspond to Figure 8 The multi-window switching manager can call the function pre-start drag and drop to calculate the size of the drag shadow

[0133] It is understandable that the multi-window switching manager obtains Figure 7 After the bitmap image of the split-screen window of the calculator application shown in FIG. 1 is obtained, the split-screen window needs to be reduced to obtain the following Figure 8 The split screen window 801 shown. Therefore, it is necessary to determine the length and width of the reduced split screen window 801. Among them, the length and width of the split screen window 801 can be customized.

[0134] 3) Initialize the drag view.

[0135] The dragged view can be the root view (m root view).

[0136] It should be noted that in Figure 8 In the example, the split screen wallpaper mask 803 can be understood as the surface of the calculator application being hidden, so that the left side of the PAD does not display the running interface of the calculator application; on the upper layer of the split screen wallpaper mask 803, the system adds a new view - split screen window 801, which can be a screenshot that can be dragged. In the process of dragging the split screen window 801, the mouse actually drags the screenshot of the calculator application, not the calculator application itself.

[0137] Therefore, in step 3), the multi-window switching manager applies for a view and loads the corresponding layout file to facilitate the subsequent layout management of the view. For example, the multi-window switching manager can call the function initialize hot area (init hotarea) to initialize the drag view; during the initialization process, the multi-window switching manager can add the screenshot of the task, the surface of the drag shadow, etc. to the layout file of the drag view, so that the subsequent drag framework can draw a view as shown in the split-screen window 801 based on the parameters of the layout file.

[0138] 4) Drag the view to register the listener.

[0139] The multi-window switching manager can call a function to add a global layout listener (add on global layoutlistener) to register and listen to the dragging view.

[0140] The drag view listener can call the callback function on global layout when drawing the view.

[0141] 5) Start drag and drop

[0142] Among them, when the drag view is drawn, the multi-window switching manager can call back on global layout and execute the start drag and drop method.

[0143] S604: The multi-window switching manager instructs the multi-window drag animation adapter to start dragging and dropping.

[0144] After the hot zone is initialized, you can call the start drag and drop function to instruct the multi-window drag animation adapter to start dragging and dropping.

[0145] S605: The multi-window drag animation adapter creates a drag shadow.

[0146] The background of the drag shadow can be a task screenshot, and the drag shadow is in a displayable state. For example, after the multi-window drag animation adapter creates a drag shadow, the PAD can display the following Figure 8 Split screen window 801 is shown.

[0147] After the drag shadow is created, the drag shadow can move along with the cursor. The process of the cursor dragging the split screen window 801 can be shown in steps S606-S616:

[0148] S606: The multi-window drag animation adapter instructs the view to start dragging and dropping, and the surface of the application is set to a hidden state.

[0149] After the user performs a long press operation, the user does not lift his finger and performs a move action. After the Framework side of the PAD detects the drag operation, it executes the start drag process and sets the surface of the application to a hidden state. Specifically, the multi-window drag animation adapter instructs the view module to start drag and drop. The multi-window drag animation adapter can call the function start drag and drop to instruct the view module to start drag and drop.

[0150] It is understandable that, when the cursor is dragging the drag shadow, the drag shadow can move along with the cursor, and the surface of the drag shadow is displayed, while the surface of the application is hidden. Figure 8 As shown, the surface of the calculator application is in a hidden state, and the split-screen wallpaper mask 803 of the PAD can be the surface of the computer application in the hidden state, or can be the wallpaper on the surface of the computer application. The style of the split-screen wallpaper mask 803 can be as follows Figure 8 As shown, the split screen wallpaper mask can also be other patterns and colors. The split screen window 801 in the display state can be displayed on the upper layer of the split screen wallpaper mask 803.

[0151] S607: The keyboard and mouse module obtains information such as the application package name, application name, and application icon, and updates the drag state to a second value.

[0152] In a possible implementation, the view module may transmit information such as the application package name, application name, and application icon to the keyboard and mouse module. The application package name may be a globally unique identifier of the application. The view module may determine the task of the target application to be dragged, and report the information such as the application package name, application name, and application icon to the keyboard and mouse module.

[0153] In another possible implementation, after receiving the start drag and drop signal, the view module may also call the function drag start for basic mode to instruct the window management service to start dragging; after receiving the monitoring signal, the window management service instructs the keyboard and mouse module to call back the drag start signal (on drag start) so that the keyboard and mouse module can obtain information such as the application package name, application name, and application icon.

[0154] It is understandable that the keyboard and mouse module can register multiple listeners in the view drag framework. When it listens to a process calling the start drag and drop function, the keyboard and mouse module will receive a callback of on drag start. When the keyboard and mouse module receives on drag start, the input parameters of on drag start contain drag information. For example, the name of the file, picture, and task that the cursor is dragging, and the path of the file, picture, and task. The keyboard and mouse module can also use the method of calling back ondrag start after receiving the listener to obtain information such as the application package name, application name, and application icon.

[0155] In a possible implementation, when the split-screen title view detects that the bar is long pressed, the drag state is the second value; for example: mDragState=1.

[0156] In the embodiment of the present application, the keyboard and mouse modules of the PAD can update the drag state to a second value, and the second value can be used to indicate that a drag operation is in progress and the cursor is displayed in the PAD.

[0157] It is understandable that when there is no drag event, the drag status in the virtual input management and the keyboard and mouse module of the PAD can both be a first value, and the first value can be used to indicate that no drag operation is performed.

[0158] S608. The keyboard and mouse module of the PAD sends information such as the application package name, application name, and application icon to the keyboard and mouse module of the PC.

[0159] Based on S607-S608, the view module can send information such as package name and application icon to the keyboard and mouse module of the PC in advance through the keyboard and mouse module of the PAD. In this way, when the mouse is subsequently transferred from the PAD to the PC, the PC can draw the dynamic window in time with the application package name, application name, application icon and other information, so that the user can have the experience of dragging the split-screen window to the PC. The dynamic window will be described in detail in the subsequent steps and will not be repeated here.

[0160] It should be noted that when executing S606-S608, the split-screen window in the PAD can be continuously displayed, and the view drag framework can execute steps related to the split-screen window display. For example, the view drag framework can synchronize the coordinates of the split-screen window with the coordinates of the cursor so that the split-screen window moves with the cursor. Among them, the split-screen window dragging calls the ability of the View drag framework, which is similar to the principle of file dragging. Here, the drag shadow of the cursor dragging is a screenshot of the application in the split-screen window, and the drag shadow will automatically move with the mouse move event.

[0161] S609, drag the split-screen window with the mouse.

[0162] Exemplarily, the process of dragging the split-screen window with the mouse can be divided into the following stages:

[0163] (1) An animation of the split-screen window shrinking is displayed, and the split-screen wallpaper mask is displayed at the bottom of the shrunken split-screen window. The shrunken split-screen window includes a task screenshot of the application running window when dragging.

[0164] (2) Displaying an animation window, wherein the split-screen wallpaper mask is displayed in the lower layer of the animation window. The animation window can be understood as an animation window drawn by the view dragging frame according to information such as the target application package name, application name, and application icon in the PAD split-screen window. The animation window does not include a specific application running window. The size of the animation window can be a default value or can be related to the resolution of the PAD, etc., which is not specifically limited in the embodiments of the present application.

[0165] Among them, stage (1) can be a very short time, after which the shrunk split-screen window disappears and the task screenshot surface is hidden. In stage (2), the surface of the animation window is displayed, and the cursor can be displayed on the top of the animation window, and the animation window moves with the cursor. In this way, the user can experience the smooth process of the split-screen window from shrinking to following the dragging in a continuous drag operation, thereby improving the user experience.

[0166] For example, Figure 8 As shown, when the user can drag the split-screen window, the PAD displays an animation of the split-screen window 801 shrinking, and the split-screen wallpaper mask 803 is displayed under the shrunken split-screen window 801.

[0167] If the user continues to drag, Fig. 9 As shown, when the shrunken split-screen window continues to shrink, the dynamic effect window 901 drawn by the PAD is displayed, and the split-screen wallpaper mask 902 is displayed under the dynamic effect window.

[0168] The user can continue dragging to drag the animation window to the edge of the PAD screen. Fig.10 As shown, the portion of the motion effect window 1001 that exceeds the edge of the PAD screen is not displayed, and the portion of the motion effect window 1001 that does not exceed the edge of the PAD screen is displayed.

[0169] The keyboard and mouse modules of S610 and PAD detect that the mouse passes through to the PC.

[0170] During the dragging operation, the mouse may cross the edge of the PAD display screen, and the keyboard and mouse module of the PAD can monitor the occurrence of the mouse crossing.

[0171] The keyboard and mouse module of PAD can update the drag state to a third value. When PAD determines that the drag state is the third value, it can stop drawing the animation window and continue drawing the split-screen wallpaper mask, so that the split-screen wallpaper mask is displayed in PAD instead of the animation window, allowing users to experience the effect of the target application being dragged away.

[0172] After the mouse passes from the PAD to the PC, the PC draws a motion effect window. The motion effect window in the PC can be understood as a motion effect window drawn by the PC based on information such as the application package name, application name, and application icon of the target application in the PAD split-screen window. The motion effect window does not include a specific application running interface. The size of the motion effect window can be a default value or can be related to the resolution of the PAD, etc., and the embodiments of the present application do not make specific limitations.

[0173] During the drag operation, the part of the PC's animation window that exceeds the edge of the PC screen is not displayed, and the part of the PC's animation window that does not exceed the edge of the PC screen is displayed. As the drag operation continues, the animation window can be fully displayed on the PC, such as Fig.11 A schematic diagram of an interface showing a split-screen wallpaper mask 1102 in a PAD and a complete motion effect window 1101 of a PC in a PC is shown.

[0174] In a possible implementation, the process of the mouse crossing from the PAD side to the PC side can be as follows:

[0175] 1) The view drag framework of the PAD receives a mouse cancel event and updates the drag state to the third value.

[0176] The view drag framework can receive mouse events, such as down events, up events, and move events. The view drag framework can call the start drag and drop function to listen to mouse events. For example, during the mouse dragging process, the view drag framework receives down events, move events, etc. When the mouse moves out of the edge of the PAD display screen, the view drag framework can no longer listen to the mouse event, and the view drag framework will receive a cancel event, indicating that the mouse disappears on the PAD side display screen.

[0177] The drag state is updated from the second value to the third value. It can be understood that when the mouse is located at the PAD side, the drag state mDragState = 1; when the mouse crosses to the PC side, the drag state mDragState = 2. The keyboard and mouse module can determine the display screen where the cursor is located according to the value of the drag state.

[0178] It is understandable that when the keyboard and mouse module of the PAD detects that the mouse crosses, the keyboard and mouse module of the PAD may first determine whether the drag state is the second value. If the drag state is the second value, the keyboard and mouse module of the PAD may update the drag state to the third value, and the keyboard and mouse module of the PAD may also synchronously indicate the display window to the PC. If the drag state is not the second value, the keyboard and mouse module of the PAD may not update the drag state, and the keyboard and mouse module of the PAD may not indicate the display window to the PC.

[0179] It should be noted that PAD can continuously query the value of the drag status at a certain period. If the drag status is updated to a third value, PAD can stop drawing the animation window and continue drawing the wallpaper mask, so that the wallpaper is displayed in PAD instead of the animation window, allowing users to experience the effect of the target application being dragged away.

[0180] 2)PAD sets the drag shadow of the split-screen window to a hidden state.

[0181] The drag shadow of the split-screen window can correspond to Fig.10 The animation window 1001 in .

[0182] The drag shadow of the split-screen window is hidden, which can be understood as: Figure 10 to Figure 11 During the process, the mouse passes from the left edge of the PAD to the display screen of the PC, and the motion effect window 1001 on the PAD is hidden, and the motion effect window 1001 is no longer displayed on the display screen of the PAD.

[0183] 3) The keyboard and mouse module of the PAD monitors the mouse crossing event and sends a first signaling to the keyboard and mouse module of the PC.

[0184] The mouse crossing event may be a mouse event corresponding to the mouse crossing from the display screen of the PAD to the display screen of the PC.

[0185] When the keyboard and mouse module of the PAD detects a mouse crossing event, the keyboard and mouse module of the PAD sends a first signaling to the keyboard and mouse of the PC. The first signaling is used to notify the keyboard and mouse module of the PC of the mouse crossing event, so that the keyboard and mouse module of the PC draws an animation window according to the application package name, application name, application icon and other information obtained in step S608.

[0186] 4) The PC displays the animation window.

[0187] The PC can display e.g. Fig.11 The animation window 1101 in the image.

[0188] After the mouse passes from the PAD to the PC, the animation window in the PAD is hidden and displayed, and the animation window is drawn in the PC. The animation window can be understood as a animation window drawn by the PC based on information such as the application package name, application name, and application icon in the split-screen application. The animation window does not include a specific application running interface. The size of the animation window can be a default value or can be related to the resolution of the PAD, etc., and the embodiments of the present application do not make specific limitations.

[0189] During the dragging operation, the part of the animation window that exceeds the edge of the PC screen is not displayed, and the part of the window that does not exceed the edge of the PC screen is displayed. Fig.12 FIG. 1 shows an interface diagram of hiding the dynamic effect window in the PAD and displaying a portion of the dynamic effect window 1201 in the PC. As the dragging operation proceeds, the dynamic effect window can be fully displayed in the PC, such as Fig.11 A schematic diagram of the interface is shown in which the motion effect window is hidden in the PAD and the complete motion effect window 1101 is displayed in the PC.

[0190] When the mouse moves from the PAD side to the PC side, the split-screen wallpaper mask is displayed in the split-screen window corresponding to the dragged application in the PAD, and the split-screen window corresponding to the application not dragged in the PAD does not change. Figure 9-12As shown, the left split-screen window displays the split-screen wallpaper mask, and the right split-screen window displays the calendar application. In the embodiment of the present application, the wallpaper mask can be a wallpaper with a pattern, or it can be a wallpaper mask after the split-screen application is set to be hidden as shown in the accompanying figure. The embodiment of the present application does not limit this.

[0191] In the embodiment of the present application, after the mouse drags the animated window from the PAD to the PC, two scenarios may be involved. Scenario 1: The user does not release the mouse on the PC, the dragging operation continues, and the mouse moves back from the PC to the PAD. The animated window in the PC is not displayed, and the split-screen window in the PAD is displayed again, that is, the mouse can drag the split-screen window to move between the PC and the PAD. Scenario 2: The user releases the mouse on the PC, the dragging operation ends, and the content of the PAD split-screen window is projected on the PC.

[0192] The above two scenarios and corresponding processes are described below in conjunction with the accompanying drawings.

[0193] The dragging process of scene 1 can be shown as follows:

[0194] exist Fig.11 In the figure, the mouse moves to the PC, and the PC displays an animated window 1101; the PAD displays a split-screen wallpaper mask 1102.

[0195] exist Fig.12 As the mouse continues to drag the animation window, the animation window 1201 exceeds the edge of the PC screen, the portion of the animation window 1201 that exceeds the edge of the PC screen is not displayed, and the portion of the animation window 1201 that does not exceed the edge of the PC screen is displayed.

[0196] exist Fig.13 In the example, while the dragging operation is in progress, the mouse passes from the right edge of the PC to the PAD, and the animation window 1301 is also displayed on the display screen of the PAD.

[0197] exist Fig.14 In the example, the keyboard and mouse module of the PAD recognizes the lift event, and the PAD displays two split-screen windows, where the split-screen window 1401 may correspond to the split-screen window of the application dragged by the mouse.

[0198] It can be seen that Fig.14 and Figure 7 After dragging the dynamic effect window corresponding to the split-screen window to the PC, you can still drag the dynamic effect window back to the PAD to restore the split-screen window on the PAD. In this way, when the user drags the split-screen window by mistake, the PAD side can restore the display of the original split-screen window, improving the user experience.

[0199] The interaction process of some modules in the software system corresponding to scenario 1 can be shown as follows:

[0200] After step S610, the method further includes:

[0201] S611. The keyboard and mouse module of the PAD detects a mouse back-through event.

[0202] The mouse crossing back event may be a mouse event corresponding to the mouse crossing from the display screen of the PC to the display screen of the PAD.

[0203] Among them, in one possible implementation method, the keyboard and mouse module of the PAD can change from listening to the cancel event to listening to the mouse event, and thus listen to the mouse return event; in another possible implementation method, after the keyboard and mouse module of the PC fails to listen to the mouse event, it sends the cannel event to the keyboard and mouse module of the PAD, so that the keyboard and mouse module of the PAD listens to the mouse return event.

[0204] S612. The keyboard and mouse module of the PAD updates the drag state to the second value, and synchronizes the drag state to the framework.

[0205] The keyboard and mouse module of the PAD updates the drag state from the third value to the second value, for example, updating mDragState=1. After the framework obtains the drag state of the second value, it can continue to execute step S609, the view drags the framework to continue the drag process, and the mouse can drag the dynamic window to move in the PAD. The framework can also execute step S613 to end the drag process, as shown in step S613:

[0206] S613: When the keyboard and mouse module of the PAD detects a lift event, the dragging process ends.

[0207] When the PAD recognizes the up event, the keyboard and mouse module updates the drag state to the first value, for example: mDragState = 0. When the drag state is the first value, the dynamic effect window on the PAD side disappears, and the PAD resumes displaying the split-screen window, such as Fig.14 As shown, the PAD displays a split-screen window 1401 of a calculator application and a split-screen window of a calendar application.

[0208] The dragging process of scene 2 can be shown as follows:

[0209] exist Fig.11 In the example, the mouse moves to the PC, and an animated window 1101 is displayed on the display screen of the PC.

[0210] exist Fig.15In the example, the keyboard and mouse module of the PC detects a lift event, and the PC displays a projection window 1501 of the calculator application; the PAD displays a full-screen window 1503 of the calendar application; wherein the size of the full-screen window of the calculator application in the PC can be customized. The projection window 1501 can be a full-screen window, and the projection window 1501 can be understood as the corresponding window when the calculator application is displayed in full screen in the PAD.

[0211] In this scenario, the user can drag the split-screen window on the PAD side to the PC side, and have the PC screen projected for display, enriching the interaction scenarios between devices and improving the user experience.

[0212] The interaction process of some modules in the software system corresponding to scenario 2 can be shown as follows:

[0213] After step S610, the method further includes:

[0214] S614. The keyboard and mouse module of the PAD injects a lift event into the framework and updates the drag state to the first value.

[0215] The keyboard and mouse module of the PC sends the monitored lift event to the keyboard and mouse module of the PAD. After receiving the lift event, the keyboard and mouse module notifies the framework of the lift event.

[0216] Update the drag state to the first value, which may be: mDragState=0.

[0217] S615: After the framework detects the lift event, the dragging process ends.

[0218] Ending the drag process can prevent the animation window from following the mouse movement.

[0219] S616, PC starts screen projection from different sources.

[0220] The PC can start the screen projection from different sources by: Fig.15 In the example, the PC projects the full-screen window of the calculator application, the PAD displays the full-screen window of the calendar application, and the PC and PAD display different window contents.

[0221] Combine the following Fig.16 The process of step S616, in which the PC starts heterogeneous screen projection, in the embodiment of the present application is further explained.

[0222] The modules involved on the PAD side may include modules in the application framework layer.

[0223] Among them, the modules in the application framework layer may also include: configuration container, split screen combination, multi window manager, task display area, task module and multi display manager. Among them, the configuration container can be used to refresh the windows of the target application and the paired application to full screen mode; the split screen combination can be used to exit the split screen mode of the target application and the paired application when the PAD has a split screen pair; the multi window manager, the task display area and the task module can be used to perform related work of mounting the split screen window of the target application on the virtual display; the task module can also be used to set the window mode to full screen mode; the multi display manager can be used to perform related work of stack shifting.

[0224] The PAD side also includes a PC assistant.

[0225] like Fig.16 As shown in the figure, the interaction process of some modules in the PAD and PC software system may include the following steps:

[0226] S1601. The screen projection module of the PC instructs the computer assistant to move the stack.

[0227] Stack shifting can be understood as mounting the split-screen window corresponding to the target application on the PAD to the virtual display (virtual display), and the virtual display can project the split-screen window to the PC side.

[0228] S1602. The computer assistant of the PC instructs the multi-display manager of the PAD to move the stack.

[0229] The PC's computer assistant calls the function move stacks to display, instructing the PAD's multi-display manager to move stacks. The multi-display manager executes handle Aysn Cast MoveStack, and the multi-task manager obtains the target application to be projected.

[0230] S1603: The multi-display manager instructs the task display area to remove the split-screen window of the target application in the PAD.

[0231] It is understandable that in Fig.11In the example, although the split-screen wallpaper mask is displayed on the left split-screen window of the PAD, the target application (calculator application) is still running on the PAD; before projecting the target application to the PC display, the PAD needs to mount the split-screen window of the target application to the virtual display so that the target application is displayed on the PC and not on the PAD. Therefore, the split-screen window of the target application needs to be removed here.

[0232] The process of mounting the split-screen window of the target application to the virtual display may include:

[0233] 1) The multi-display manager instructs the task module to reparent.

[0234] 2) The task module instructs the task display area to remove the child item (remove child).

[0235] 3) Remove child task from task display area.

[0236] 4) The task display area determines whether to remove the root task reference (remove root task reference if needed).

[0237] 5) The task display area instructs the multi-window manager to determine whether to remove the stack reference (remove stack reference if needed).

[0238] 6) The multi-window manager instructs the split-screen combination to determine whether to remove the stack reference.

[0239] S1604: When the target application has a paired application, set the paired application to full screen mode.

[0240] It should be noted that when the PAD displays two applications in split screen, the two applications are often bound in the form of a split screen pair. For example, the target application may correspond to a computer application, and the paired application may correspond to a calendar application. Therefore, before projecting the target application to the PC display, it is necessary to check whether the target application appears in the form of a split screen pair on the PAD side; if so, it is necessary to unbind the split screen pair first, so that the target application and the paired application exit the split screen mode, and then project the target application.

[0241] The paired application may correspond to Fig.15 The calendar app in full screen mode can correspond to Fig.15 The full screen window 1503 on the PAD side. After the PAD exits the split screen mode, the paired application enters the full screen mode.

[0242] Specifically, step S1604 may include the following steps:

[0243] 1) Split screen combination handles removing split screen stack (handle remove split stack).

[0244] 2) The split screen combination instructs the multi-window manager to exit the split screen mode.

[0245] The split-screen combination calls the function exit multi stack to instruct the multi-window manager to exit the split-screen mode of the paired application.

[0246] 3) The multi-window manager instructs the task module to set the window mode to full screen mode.

[0247] The multi-window manager calls the function to set the window mode (set window mode) and sets the paired application to full screen mode (set window mode: fullscreen).

[0248] 4) The task module instructs the configuration container to set the window mode and sets the paired application to full screen mode.

[0249] The task module sends a set windowing mode command to refresh the configuration of the paired application's task to full screen, and traverses the child windows to refresh the configuration of the activity to full screen.

[0250] It should be noted that in S1605, the PAD can set the window mode of the paired application to full-screen mode. For a group of split-screen pairs, for example, the split-screen pair includes a calculator application and a calendar application, the split-screen window of the calculator application is located on the left, and the split-screen window of the calendar application is located on the right. Here, the split-screen window on the right is exited from the split-screen mode, and the task call function set window mode of the split-screen window on the right is set to fullscreen. For another example, the split-screen pair includes a calculator application and a calendar application, the split-screen window of the calculator application is located on the right, and the split-screen window of the calendar application is located on the left. Here, the split-screen window on the left is exited from the split-screen mode, and the task call function set window mode of the split-screen window on the left is set to fullscreen. Thereby achieving the effect of displaying the paired application in full screen in the PAD.

[0251] S1605. The PAD projects the target application from the virtual display to the PC and sets the display to full screen mode.

[0252] After the split-screen pair is unbound, the PAD can move the task stack of the target application to the PC, and the PC side displays the full-screen window of the target application.

[0253] Specifically, step S1605 includes:

[0254] 1) PAD moves the task of the target application from PAD to PC.

[0255] Here, the display screen of the PAD can be regarded as the main screen, and the display screen on the PC side can be regarded as a virtual display, which can be used for screen projection. After the task is moved, the PC can include the target application, and at this time, the surface of the target application is invisible.

[0256] During this process, a timer can be started, and the timer time can be 500ms. It can be understood that when the PAD projects the full-screen window of the target application to the PC, it takes some time for the animation window on the PC side to disappear and the projection window to be displayed on the PC side. This time can be controlled by the timer.

[0257] 2)PAD sets the target application's surface to be visible.

[0258] After the surface of the target application is set to be visible, the display of the PC can display the target application.

[0259] 3)PAD sets the target application to full screen mode.

[0260] The multi-display manager can issue set windowing mode to refresh the configuration of the target application's task to full screen, and traverse the child windows to refresh the configuration of the activity to full screen.

[0261] It should be noted that in step S1605, the window of the paired application in the split-screen pair has been refreshed to full-screen mode, and in step S1605, the window of the target application is refreshed to full-screen mode; in step S1605, the multi-display manager calls the function set window mode and sets the parameter to undefined; when refreshing the configuration of the task of the target application subsequently, the fullscreen config in the parent level can be used for refresh.

[0262] 4)PAD hides the split-screen wallpaper mask.

[0263] After starting the cross-screen projection, the split-screen wallpaper mask will no longer be displayed on the PAD side. At this time, the PAD can hide the split-screen wallpaper mask. For example, Fig.15 In the figure, the full screen window 1503 of the calendar application is displayed on the PAD side, and the split-screen wallpaper mask is not drawn in the left area of ​​the upper layer of the full screen window 1503.

[0264] In order to improve the smoothness and aesthetics of the process of dragging the dynamic effect window with the mouse, the embodiment of the present application also provides a method for setting a full-screen wallpaper mask, such as Fig.17 As shown:

[0265] S1701. The split-screen title view detects that the bar is long pressed and updates the drag state to the second value.

[0266] S1702: The split-screen title view instructs the multi-window switching manager to add a hot zone.

[0267] S1703: The multi-window switching manager initializes the hot zone.

[0268] S1704: The multi-window switching manager instructs the multi-window drag animation adapter to start dragging and dropping.

[0269] S1705. The multi-window drag animation adapter creates a drag shadow.

[0270] S1706. The multi-window drag animation adapter instructs the view to start dragging and dropping, and the surface of the application is set to a hidden state.

[0271] S1707. The keyboard and mouse module obtains information such as the application package name, application name, and application icon.

[0272] S1708. The keyboard and mouse module of the PAD sends information such as the application package name, application name, and application icon to the keyboard and mouse module of the PC.

[0273] For steps S1701-S1708, reference may be made to the relevant descriptions of steps S601-S608, which will not be repeated here.

[0274] S1709. Drag the split-screen window with the mouse.

[0275] Exemplarily, the process of dragging the split-screen window with the mouse can be divided into the following stages:

[0276] (1) An animation of the split-screen window shrinking is displayed, and the split-screen wallpaper mask is displayed at the bottom of the shrunken split-screen window. The shrunken split-screen window includes a task screenshot of the application running window when dragging.

[0277] (2) Displaying an animation window, a full-screen wallpaper mask is displayed under the animation window. The animation window can be understood as an animation window drawn by the view drag frame according to the target application package name, application name, application icon and other information in the PAD split-screen window. The animation window does not include a specific application running window. The size of the animation window can be a default value or related to the resolution of the PAD, etc., which is not specifically limited in the embodiments of the present application. The full-screen wallpaper mask can be understood as a wallpaper mask with the same size as the PAD screen size; the full-screen wallpaper mask may include the application icon of the paired application, etc.

[0278] Among them, stage (1) can be a very short time, after which the reduced split-screen window disappears and the surface of the task screenshot is hidden. In stage (2), the surface of the animation window is displayed, and the cursor can be displayed on the top of the animation window. The animation window moves with the cursor. In the process of reducing the split-screen window in the PAD to displaying the animation window, the full-screen wallpaper mask can smoothly cover the PAD display screen and continue to display during the dragging process. In this way, the user can experience the smooth process of the split-screen window from shrinking to following the dragging movement in a continuous dragging operation, thereby improving the user experience.

[0279] For example, Figure 8 As shown, when the user can drag the split-screen window, the PAD displays an animation of the split-screen window 801 shrinking, and the split-screen wallpaper mask 803 is displayed under the shrunken split-screen window 801.

[0280] If the user continues to drag, Fig.18 As shown, when the reduced split-screen window continues to shrink, the dynamic effect window 1801 drawn by the PAD is displayed, and the full-screen wallpaper mask 1802 is displayed under the dynamic effect window. The full-screen wallpaper mask 1802 includes application icons for pairing, for example, the application icon 1803 of the calendar application.

[0281] The user can continue to drag the animation window to the edge of the PAD screen. During this process, the portion of the animation window that exceeds the edge of the PAD screen is not displayed, and the portion of the animation window that does not exceed the edge of the PAD screen is displayed.

[0282] The keyboard and mouse modules of S1710 and PAD detect that the mouse is crossing to the PC.

[0283] The keyboard and mouse module of PAD can update the drag state to a third value. When PAD determines that the drag state is the third value, it can stop drawing the animation window and continue drawing the full-screen wallpaper mask, so that the full-screen wallpaper mask is displayed in PAD instead of the animation window, so that the user experiences the effect of the target application being dragged away.

[0284] After the mouse passes from the PAD to the PC, the PC draws a motion effect window. The motion effect window in the PC can be understood as a motion effect window drawn by the PC based on information such as the application package name, application name, and application icon of the target application in the PAD split-screen window. The motion effect window does not include a specific application running interface. The size of the motion effect window can be a default value or can be related to the resolution of the PAD, etc., and the embodiments of the present application do not make specific limitations.

[0285] During the drag operation, the part of the PC's animation window that exceeds the edge of the PC screen is not displayed, and the part of the PC's animation window that does not exceed the edge of the PC screen is displayed. As the drag operation continues, the animation window can be fully displayed on the PC, such as Fig.19 It shows an interface schematic diagram showing a full-screen wallpaper mask 1902 in the PAD and a complete motion effect window 1901 of the PC in the PC.

[0286] In a possible implementation, the process of the mouse crossing from the PAD side to the PC side can be as follows:

[0287] 1) The view drag framework of the PAD receives a mouse cancel event and updates the drag state to the third value.

[0288] 2)PAD sets the drag shadow of the split-screen window to a hidden state.

[0289] 3) PAD draws the full-screen wallpaper mask.

[0290] The full-screen wallpaper mask can be a thumbnail mask of the paired application in the split-screen pair, for example Fig.19 Full screen wallpaper mask 1902 in.

[0291] It is understandable that the PAD display is as follows Fig.19 When the interface is shown, the PAD continues to run the calculator application and the calendar application, but the surfaces of the calculator application and the calendar application are not visible. The PAD adds a full-screen wallpaper mask and a dynamic effect window on the upper layer of the application surface to achieve a smooth and beautiful effect.

[0292] Among them, in one possible implementation method, when the cursor drags the animation window to the edge of the PAD, the full-screen wallpaper mask may appear to advance from left to right or from right to left, so as to reflect the effect that when the animation window passes through the PAD, the full-screen wallpaper mask fills the PAD screen as the animation window passes through the PAD.

[0293] In another possible implementation, when the cursor drags the animation window from the edge of the PC to the edge of the PAD, the full-screen wallpaper mask may exit from left to right or from right to left, so as to reflect the effect that when the animation window passes back to the PAD, the full-screen wallpaper mask disappears as the animation window passes into the PAD.

[0294] 4) The keyboard and mouse module of the PAD monitors the mouse crossing event and sends a first signaling to the keyboard and mouse module of the PC.

[0295] 5) The PC displays the animation window.

[0296] For steps 1, 2, 4 and 5, reference may be made to the relevant description in step S610, which will not be elaborated in the embodiment of the present application.

[0297] Fig.17 The embodiment shown is also applicable to scenario 1 and scenario 2. Fig.17Based on the illustrated embodiment, the dragging process of scene 1 can be as follows:

[0298] exist Fig.19 In the figure, the mouse moves to the PC, and the PC displays an animated window 1901; the PAD displays a full-screen wallpaper mask 1902.

[0299] exist Fig. 20 As the mouse continues to drag the animation window, the mouse moves from the PC back to the PAD. The portion of the animation window 2001 that does not exceed the edge of the PAD screen is displayed, and the portion of the animation window 2001 that exceeds the edge of the PC screen is not displayed.

[0300] exist Fig.21 In the process of dragging, the mouse passes from the right edge of the PC to the PAD, and the animation window 2101 is also displayed on the display screen of the PAD.

[0301] exist Fig. 22 In the example, the keyboard and mouse module of the PAD recognizes the lift event, and the PAD displays two split-screen windows, where split-screen window 2201 may correspond to the split-screen window of the target application being dragged by the mouse. It is understandable that during the process of dragging the split-screen application with the mouse, the PAD may display the target application based on the hot zone where the mouse coordinates are located when the mouse recognizes the lift operation. For example, in Fig. 22 In the example, when the mouse is located in the right area of ​​the PAD and a lift operation is recognized, the split screen window 2201 on the right side displays the calculator application, and the split screen window 2202 on the left side displays the calendar application. Fig.14 In the example, when the mouse is located in the left area of ​​the PAD and a lift operation is recognized, the left split-screen window displays the calculator application, and the right split-screen window displays the calendar application.

[0302] The interaction process of some modules in the software system corresponding to scenario 1 can be shown as follows:

[0303] After step S1710, the method further includes:

[0304] S1711. The keyboard and mouse module of the PAD detects a mouse return event.

[0305] S1712. The keyboard and mouse module of the PAD updates the drag state to the second value, and synchronizes the drag state to the framework.

[0306] S1713: When the keyboard and mouse module of the PAD detects a lift event, the dragging process ends.

[0307] For steps S1711-S1713, reference may be made to the relevant descriptions of steps S611-S613, which will not be repeated here.

[0308] The dragging process of scene 2 can be shown as follows:

[0309] exist Fig.19 In the figure, the mouse moves to the PC, and the PC displays an animated window 1901; the PAD displays a full-screen wallpaper mask 1902.

[0310] exist Fig.15 In the example, the keyboard and mouse module of the PC detects a lift event, and the PC displays a projection window 1501 of the calculator application; the PAD displays a full-screen window 1503 of the calendar application; wherein the size of the full-screen window of the calculator application in the PC can be customized. The projection window 1501 can be a full-screen window, and the projection window 1501 can be understood as the corresponding window when the calculator application is displayed in full screen in the PAD.

[0311] The interaction process of some modules in the software system corresponding to scenario 2 can be shown as follows:

[0312] S1714. The keyboard and mouse module of the PAD injects a lift event into the framework and updates the drag state to the first value.

[0313] S1715. After the framework detects the lift event, it ends the dragging process.

[0314] S1716, PC starts screen projection from different sources.

[0315] For steps S1714-S1716, reference may be made to the relevant descriptions of steps S614-S616, which will not be repeated here.

[0316] Combine the following Fig.23 The process of step S1716, in which the PC starts heterogeneous screen projection, in the embodiment of the present application is further explained.

[0317] like Fig.23 As shown in the figure, the interaction process of some modules in the PAD and PC software system may include the following steps:

[0318] S2301. The screen projection module of the PC instructs the computer assistant to move the stack.

[0319] S2302. The computer assistant of the PAD instructs the multi-display manager of the PAD to move the stack.

[0320] S2303: The multi-display manager instructs the task display area to remove the split-screen window of the target application in the PAD.

[0321] S2304: When the target application has a paired application, set the paired application to full screen mode.

[0322] S2305. The PAD moves the target application from the PAD to the PC and sets the application to a full-screen mode.

[0323] Specifically, step S2305 includes:

[0324] 1) PAD moves the task of the target application from PAD to PC.

[0325] 2)PAD sets the target application's surface to be visible.

[0326] 3)PAD sets the target application to full screen mode.

[0327] 4)PAD hides the full-screen wallpaper mask.

[0328] After launching the cross-source screen projection, the full-screen wallpaper mask is no longer displayed on the PAD side. At this time, the PAD can hide the full-screen wallpaper mask. For example, Fig.15 In the figure, the PAD side displays a full-screen window 1503 of the calendar application, and no full-screen wallpaper mask is drawn on the upper layer of the full-screen window 1503.

[0329] For steps S2301-S2305, refer to the relevant description of steps S1601-S1605 and will not be repeated here.

[0330] Optional, in Fig.15 As shown, a control 1502 may also be displayed in the screen projection window 1501 of the PC. The control 1502 may be called a home button. When the home button is triggered, the same source screen projection of the PC and the PAD may be realized. For example, Fig.24 As shown, the content displayed in the PC's screen projection window 2401 is the same as the content displayed on the PAD, thereby conveniently realizing the switching from heterogeneous screen projection to homogeneous screen projection.

[0331] Based on the above embodiments, the present application provides a split-screen window dragging method. For example, Fig.25 A flowchart of a split-screen window dragging method provided in an embodiment of the present application.

[0332] The split-screen window dragging method provided in the embodiment of the present application can be applied to the following Figure 1 or Figure 2 In the communication system shown, the communication system includes a first electronic device installed with a first operating system and a second electronic device installed with a second operating system, the first electronic device or the second electronic device is connected to an input device, and the first operating system is different from the second operating system.

[0333] The communication system can refer to Figure 1 and Figure 2 For the description of the first electronic device and the second electronic device, reference can be made to the description of the above embodiments and no further details are given.

[0334] like Fig.25 As shown, the method includes:

[0335] S2501. The first electronic device displays a first cursor, a first split-screen window, and a second split-screen window. The first cursor is located on the first split-screen window. The first split-screen window is a split-screen window of a first application, and the second split-screen window is a split-screen window of a second application.

[0336] Exemplarily, step S2501 may correspond to Figure 7 The first cursor may correspond to the cursor 702 in the interface, and no further description is given. It can be understood that in the embodiment of the present application, the first application may correspond to the target application in the above embodiment, and the second application may correspond to the paired application in the above embodiment. The first application and the second application may both be any application, for example, the first application is a calculator application, and the second application is a calendar application, and the embodiment of the present application does not limit this.

[0337] S2502. When the user controls the first cursor through the input device to select and drag the first split-screen window to the first position, the first electronic device displays the full-screen image, displays the first motion effect window at the first position, stops displaying the first split-screen window and the second split-screen window, the first motion effect window includes the first identifier of the first application, the first motion effect window is located on the upper layer of the full-screen image, and the size of the first motion effect window is smaller than the size of the full-screen image.

[0338] Exemplarily, step S2502 may correspond to Fig.18 In the embodiment of the present application, after the first electronic device briefly displays the reduced full-screen window, it can display the first dynamic effect window. The full-screen image corresponds to the full-screen wallpaper mask 1802, the first dynamic effect window corresponds to the dynamic effect window 1801, and the first identifier can be information such as the application icon and / or application name of the first application.

[0339] S2503. During the process of the first cursor dragging the first animation window, when the first cursor moves from the first screen edge of the first electronic device to the second screen edge of the second electronic device, the first electronic device displays a full-screen image and stops displaying the first animation window, and the second electronic device displays the second animation window dragged by the first cursor, and the second animation window includes the second identifier of the first application.

[0340] Exemplarily, step S2503 may correspond to Fig.19 , when the cursor moves from the left side of the PAD to the right side of the PC, the PAD displays a full-screen image; the full-screen image may correspond to the full-screen wallpaper mask 1902, and the second small window may correspond to the dynamic effect window 1901 on the PC side. The second identifier may include information such as the application icon and / or application name of the first application, and the first identifier and the second identifier may be the same or different.

[0341] S2504. During the process of the first cursor dragging the second animation window, upon detecting that the user releases the first cursor at the second position through the input device, the second electronic device displays the projection window at the second position and stops displaying the second animation window, the projection window being used to display content that is partially or completely the same as the content of the first split-screen window, and the first electronic device displays the full-screen window of the second application.

[0342] In the embodiment of the present application, the second position may be any position in the display screen of the second electronic device. The projection window may be a window in the second electronic device for displaying the projection content of the first application.

[0343] It is understandable that it takes some time for the second electronic device to pull up the projection window and display the content of the first application in the projection window. During this period of time, the projection window of the second electronic device may display a projection animation or a black screen mask, and the first electronic device displays a full-screen wallpaper mask, so that the user does not perceive the process of the window of the first application switching to full screen in the first electronic device, which is in line with the user's usual heterogeneous projection experience. The specific implementation can refer to Fig.16 The relevant descriptions in the illustrated embodiments are omitted here.

[0344] In the embodiment of the present application, after dragging the split-screen window of the first electronic device to the second electronic device, the process of heterogeneous screen projection can be supported in the second electronic device, thereby increasing the richness of device interaction. Moreover, during the period between when the user releases the mouse in the second electronic device and when the real screen projection content is displayed in the projection window of the second electronic device, the wallpaper is displayed in the first electronic device, so that the user does not perceive the process of switching the windows of the first application and the second application from the split-screen window to the full-screen window, thereby improving the user experience.

[0345] Exemplarily, step S2504 may correspond to Fig.15 Related description of the display interface, the projection window corresponds to projection window 1501.

[0346] It is understandable that in Fig.25 Based on the embodiments of the present application, there are some possible implementations of the embodiments, and each possible implementation may also correspond to some expressions in the above embodiments, and similar contents will not be repeated here.

[0347] Optionally, in response to the cursor release event, the first electronic device also mounts the first split-screen window to the virtual display, moves the stack in the virtual display, and sets both the first application and the second application to full-screen mode.

[0348] The first electronic device performs stack shifting; after the first electronic device completes stack shifting, part or all of the content of the full-screen window is displayed in the projection window, and the first electronic device stops displaying the wallpaper. The process can refer to the description of stack shifting in step S2303, which will not be repeated here.

[0349] Optionally, before setting both the first application and the second application to full screen mode, the method includes:

[0350] The first electronic device receives the stack shift instruction from the second electronic device; the first electronic device removes the first split-screen window from the display of the first electronic device; the first electronic device exits the split-screen mode of the second application.

[0351] After both the first application and the second application are set to full screen mode, the method includes: the first electronic device sets the first application to be visible, and hides the full screen image.

[0352] The process can correspond to Fig.23 The relevant description in the illustrated embodiment will not be repeated here.

[0353] Optionally, it also includes: when the user controls the first cursor to select and drag the first split-screen window through the input device, the first electronic device also sends identification information of the first application to the second electronic device; the identification information includes: application package name, application name and / or application icon.

[0354] In this way, when the cursor subsequently drags the split-screen window from the first electronic device to the second electronic device, the second electronic device can promptly draw an animated window using information such as the application package name, application name and / or application icon, allowing the user to have the experience of dragging the split-screen window to the second electronic device.

[0355] Optionally, during the process of the first cursor dragging the second motion effect window, when the first cursor moves from the second screen edge of the second electronic device to the first screen edge of the first electronic device, the first electronic device displays the first motion effect window dragged by the first cursor, the first motion effect window is located on the upper layer of the full-screen image, and the second electronic device stops displaying the second motion effect window. In this way, it can support the user to drag the split-screen window of the first electronic device to the second electronic device, and it can also support the split-screen window to be dragged from the second electronic device back to the first electronic device, enriching the device interaction scenario.

[0356] Based on the above embodiment, the present application embodiment provides another split-screen window dragging method. For example, Fig.26 A flowchart of another split-screen window dragging method provided in an embodiment of the present application.

[0357] The split-screen window dragging method provided in the embodiment of the present application can be applied to the following Figure 1 or Figure 2 In the communication system shown, the communication system includes a first electronic device installed with a first operating system and a second electronic device installed with a second operating system, the first electronic device or the second electronic device is connected to an input device, and the first operating system is different from the second operating system.

[0358] The communication system can refer to Figure 1 and Figure 2 For the description of the first electronic device and the second electronic device, reference can be made to the description of the above embodiments and no further details are given.

[0359] like Fig.26 As shown, the method includes:

[0360] S2601. The first electronic device displays a first cursor, a first split-screen window, and a second split-screen window. The first cursor is located on the first split-screen window. The first split-screen window is a split-screen window of a first application, and the second split-screen window is a split-screen window of a second application.

[0361] Exemplarily, step S2601 may correspond to Figure 7 The first cursor may correspond to the cursor 702 in the interface, and no further description is given. It can be understood that in the embodiment of the present application, the first application may correspond to the target application in the above embodiment, and the second application may correspond to the paired application in the above embodiment. The first application and the second application may both be any application, for example, the first application is a calculator application, and the second application is a calendar application, and the embodiment of the present application does not limit this.

[0362] S2602: When the user uses an input device to control a first cursor to select and drag the first split-screen window, the first electronic device sends identification information of the first application to the second electronic device.

[0363] The identification information of the first application includes information such as the application package name, application name, and application icon of the first application.

[0364] S2603. When the first cursor drags the first split-screen window to the first position, the first electronic device displays the first animation window at the first position, the display area of ​​the second split-screen window remains unchanged, the first animation window includes part or all of the identification information of the first application, the lower layer of the first animation window displays a mask, and the size of the first animation window is smaller than the size of the first split-screen window.

[0365] In the embodiment of the present application, after the first electronic device briefly displays the reduced split-screen window, it can display the first dynamic effect window. The first dynamic effect window can be understood as a dynamic effect window displayed in the first electronic device. The first dynamic effect window includes a first identifier of the first application. The first identifier includes, for example, an icon and / or name of the first application. The first position can be any position in the display screen of the first electronic device. Exemplarily, S2603 can correspond to Fig. 9 According to the relevant description, the first motion effect window can be the motion effect window 901, and the mask can correspond to the split-screen wallpaper mask 902.

[0366] S2604. During the process of the first cursor dragging the first animation window, when the first cursor moves from the first screen edge of the first electronic device to the second screen edge of the second electronic device, the first electronic device displays the mask and the second split-screen window in a split-screen manner, stops displaying the first animation window, and the second electronic device displays the second animation window dragged by the first cursor, and the second animation window includes part or all of the identification information of the first application.

[0367] In the embodiment of the present application, the second animation window can be understood as an animation window displayed in the second electronic device, and the second animation window includes identification information of the first application. Fig.11 According to the relevant description, the mask may correspond to the split-screen wallpaper mask 1102, and the second motion effect window may be the motion effect window 1101.

[0368] S2605. During the process of the first cursor dragging the second animation window, when it is detected that the user releases the first cursor at the second position through the input device, the second electronic device displays the full-screen window of the first application at the second position and stops displaying the second animation window. The full-screen window of the first application is used to display content that is partially or completely the same as the content of the first split-screen window, and the second electronic device sends a cursor release event to the first electronic device.

[0369] In the embodiment of the present application, the second position may be any position in the display screen of the second electronic device. The full screen window of the first application displayed by the second electronic device at the second position may be a projection window, and the projection window may be a window in the second electronic device for displaying the projection content of the first application.

[0370] It is understandable that it takes some time for the second electronic device to pull up the projection window and display the content of the first application in the projection window. During this period of time, the projection window of the second electronic device may display projection animation or a black screen mask, etc. The first electronic device displays wallpaper, which can make the user unaware of the process of the first application window switching from a split-screen window to a full-screen window, which is in line with the user's usual heterogeneous projection experience. For specific implementation, please refer to Fig.16 The relevant description in will not be repeated here.

[0371] S2606. In response to the cursor release event, the first electronic device displays a full-screen window of the second application.

[0372] After the first application in the first electronic device completes stack shifting, the second electronic device displays the full-screen window of the first application, and the first electronic device displays the full-screen window of the second application. Fig.15 shown.

[0373] Optionally, in response to the cursor release event, the first electronic device also mounts the first split-screen window to the virtual display, moves the stack in the virtual display, and sets both the first application and the second application to full-screen mode.

[0374] The first electronic device performs stack shifting; after the first electronic device completes stack shifting, the projection window displays part or all of the content of the full-screen window, and the first electronic device stops displaying the wallpaper. The process can refer to the description of stack shifting in step S1603, which will not be repeated here.

[0375] Optionally, before setting both the first application and the second application to full screen mode, the method includes:

[0376] The first electronic device receives the stack shift instruction from the second electronic device; the first electronic device removes the first split-screen window from the display of the first electronic device; the first electronic device exits the split-screen mode of the second application.

[0377] After both the first application and the second application are set to full screen mode, the method includes: the first electronic device sets the first application to be visible, and hides the mask.

[0378] The process can correspond to Fig.16 The relevant description in the illustrated embodiment will not be repeated here.

[0379] Optionally, it also includes: when the user controls the first cursor to select and drag the first split-screen window through the input device, the first electronic device also sends identification information of the first application to the second electronic device; the identification information includes: application package name, application name and / or application icon.

[0380] In this way, when the cursor subsequently drags the split-screen window from the first electronic device to the second electronic device, the second electronic device can promptly draw an animated window using information such as the application package name, application name and / or application icon, allowing the user to have the experience of dragging the split-screen window to the second electronic device.

[0381] Optionally, during the process of the first cursor dragging the second motion effect window, when the first cursor moves from the second screen edge of the second electronic device to the first screen edge of the first electronic device, the first electronic device displays the first motion effect window dragged by the first cursor, the first motion effect window is located on the upper layer of the mask, and the second electronic device stops displaying the second motion effect window. In this way, it can support the user to drag the split-screen window of the first electronic device to the second electronic device, and it can also support the split-screen window to be dragged from the second electronic device back to the first electronic device, enriching the device interaction scenario.

[0382] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0383] The split-screen window dragging method of the embodiment of the present application has been described above, and the device for executing the split-screen window dragging method provided by the embodiment of the present application is described below. Those skilled in the art can understand that the method and the device can be combined and referenced with each other, and the relevant device provided by the embodiment of the present application can execute the steps in the split-screen window dragging method.

[0384] like Fig. 27 As shown, the split-screen window dragging device 2700 can be used in a communication device, a circuit, a hardware component or a chip, and the split-screen window dragging device includes: a display unit 2701 and a processing unit 2702. The display unit 2701 is used to support the display step performed by the split-screen window dragging device 2700; the processing unit 2702 is used to support the split-screen window dragging device 2700 to perform the information processing step.

[0385] In a possible implementation, the split-screen window dragging device 2700 may also include a communication unit 2703. Specifically, the communication unit is used to support the split-screen window dragging device 2700 to perform the steps of sending data and receiving data. The communication unit 2703 may be an input or output interface, a pin or a circuit, etc.

[0386] In some embodiments, the split-screen window dragging device 2700 may further include: a storage unit 2704. The processing unit 2702 and the storage unit 2704 are connected via a line. The storage unit 2704 may include one or more memories, and the memory may be a device used to store programs or data in one or more devices or circuits. The storage unit 2704 may exist independently and be connected to the processing unit 2702 of the split-screen window dragging device via a communication line. The storage unit 2704 may also be integrated with the processing unit 2702.

[0387] The storage unit 2704 can store computer-executable instructions of the method in the terminal device so that the processing unit 2702 executes the method in the above embodiment. The storage unit 2704 can be a register, a cache, or a RAM, etc. The storage unit 2704 can be integrated with the processing unit 2702. The storage unit 2704 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and the storage unit 2704 can be independent of the processing unit 2702.

[0388] The split-screen window dragging method provided in the embodiment of the present application can be applied to electronic devices with communication functions. The electronic device includes a terminal device, and the specific device form of the terminal device can refer to the above-mentioned related description, which will not be repeated here.

[0389] An embodiment of the present application provides a terminal device, which includes: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the above method.

[0390] The embodiment of the present application provides a chip. The chip includes a processor, and the processor is used to call a computer program in a memory to execute the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above related embodiments, and will not be repeated here.

[0391] The embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. The above method is implemented when the computer program is executed by the processor. The method described in the above embodiment can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the function can be stored as one or more instructions or codes on a computer-readable medium or transmitted on a computer-readable medium. Computer-readable media can include computer storage media and communication media, and can also include any medium that can transfer a computer program from one place to another. The storage medium can be any target medium that can be accessed by a computer.

[0392] In one possible implementation, a computer-readable medium may include RAM, ROM, compact disc read-only memory (CD-ROM) or other optical disk storage, disk storage or other magnetic storage devices, or any other medium that is intended to carry or store the required program code in the form of instructions or data structures and can be accessed by a computer. Moreover, any connection is appropriately referred to as a computer-readable medium. For example, if a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL) or wireless technology (such as infrared, radio and microwave) is used to transmit software from a website, server or other remote source, the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disks and optical disks as used herein include optical disks, laser disks, optical disks, digital versatile disks (DVD), floppy disks and Blu-ray disks, where disks usually reproduce data magnetically, while optical disks reproduce data optically using lasers. Combinations of the above should also be included in the scope of computer-readable media.

[0393] An embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed, the computer executes the above method.

[0394] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to generate a machine, so that the instructions executed by the processing unit of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0395] The above specific implementation methods further illustrate the purpose, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above are only specific implementation methods of the present invention and are not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made on the basis of the technical solutions of the present invention should be included in the scope of protection of the present invention.

Claims

1. A split-screen window dragging method, characterized in that: Applied to a communication system, the communication system includes a first electronic device installed with a first operating system and a second electronic device installed with a second operating system, the first electronic device or the second electronic device is connected to an input device, the first operating system is different from the second operating system, and the method includes: The first electronic device displays a first cursor, a first split-screen window, and a second split-screen window, the first cursor is located on the first split-screen window, the first split-screen window is a split-screen window of a first application, and the second split-screen window is a split-screen window of a second application; When the user controls the first cursor to select and drag the first split-screen window to a first position through the input device, the first electronic device displays a full-screen image, displays a first motion effect window at the first position, and stops displaying the first split-screen window and the second split-screen window, wherein the first motion effect window includes a first identifier of the first application, the first motion effect window is located on an upper layer of the full-screen image, and a size of the first motion effect window is smaller than a size of the full-screen image; In the process of dragging the first motion effect window by the first cursor, when the first cursor moves from the first screen edge of the first electronic device to the second screen edge of the second electronic device, the first electronic device displays the full-screen image, stops displaying the first motion effect window, and the second electronic device displays the second motion effect window dragged by the first cursor, and the second motion effect window includes the second identifier of the first application; During the process of dragging the second motion effect window with the first cursor, when it is detected that the user releases the first cursor at the second position through the input device, the second electronic device displays the projection window at the second position and stops displaying the second motion effect window, the projection window is used to display content that is partially or completely the same as the content of the first split-screen window, and the first electronic device displays the full-screen window of the second application.

2. The method according to claim 1, characterized in that In response to the cursor release event, the first electronic device also mounts the first split-screen window to a virtual display, moves the stack in the virtual display, and sets both the first application and the second application to full-screen mode.

3. The method according to claim 2, characterized in that Before setting both the first application and the second application to full screen mode, the method includes: The first electronic device receives a stack shift instruction from the second electronic device; The first electronic device removes the first split-screen window from the display of the first electronic device; The first electronic device exits the second application from the split-screen mode; After both the first application and the second application are set to full screen mode, the method includes: The first electronic device sets the first application to be visible and hides the full-screen image.

4. The method according to any one of claims 1 to 3, characterized in that: Also includes: When the user controls the first cursor to select and drag the first split-screen window through the input device, the first electronic device also sends identification information of the first application to the second electronic device; The identification information includes: application package name, application name and / or application icon.

5. The method according to any one of claims 1 to 4, characterized in that: During the process of the first cursor dragging the second motion effect window, when the first cursor moves from the second screen edge of the second electronic device to the first screen edge of the first electronic device, the first electronic device displays the first motion effect window dragged by the first cursor, the first motion effect window is located on the upper layer of the full-screen image, and the second electronic device stops displaying the second motion effect window.

6. A split-screen window dragging method, characterized in that: Applied to a communication system, the communication system includes a first electronic device installed with a first operating system and a second electronic device installed with a second operating system, the first electronic device or the second electronic device is connected to an input device, the first operating system is different from the second operating system, and the method includes: The first electronic device displays a first cursor, a first split-screen window, and a second split-screen window, the first cursor is located on the first split-screen window, the first split-screen window is a split-screen window of a first application, and the second split-screen window is a split-screen window of a second application; When the user controls the first cursor to select and drag the first split-screen window through the input device, the first electronic device sends identification information of the first application to the second electronic device; When the first cursor drags the first split-screen window to a first position, the first electronic device displays a first motion effect window at the first position, the display area of ​​the second split-screen window remains unchanged, the first motion effect window includes part or all of the identification information of the first application, a mask is displayed at the lower layer of the first motion effect window, and the size of the first motion effect window is smaller than the size of the first split-screen window; In the process of dragging the first motion effect window by the first cursor, when the first cursor moves from the first screen edge of the first electronic device to the second screen edge of the second electronic device, the first electronic device displays the mask and the second split-screen window in split screen, stops displaying the first motion effect window, and the second electronic device displays the second motion effect window dragged by the first cursor, wherein the second motion effect window includes part or all of the identification information of the first application; During the process of dragging the second motion effect window with the first cursor, when detecting that the user releases the first cursor at the second position through the input device, the second electronic device displays the full-screen window of the first application at the second position, stops displaying the second motion effect window, and the full-screen window of the first application is used to display content that is partially or completely the same as that of the first split-screen window, and the second electronic device sends a cursor release event to the first electronic device; In response to the cursor release event, the first electronic device displays a full screen window of the second application.

7. The method according to claim 6, characterized in that In response to the cursor release event, the first electronic device also mounts the first split-screen window to a virtual display, moves the stack in the virtual display, and sets both the first application and the second application to full-screen mode.

8. The method according to claim 7, characterized in that Before setting both the first application and the second application to full screen mode, the method includes: The first electronic device receives a stack shift instruction from the second electronic device; The first electronic device removes the first split-screen window from the display of the first electronic device; The first electronic device exits the second application from the split-screen mode; After both the first application and the second application are set to full screen mode, the method includes: The first electronic device sets the first application to be visible and hides the mask.

9. The method according to any one of claims 6 to 8, characterized in that: Also includes: When the user controls the first cursor to select and drag the first split-screen window through the input device, the first electronic device also sends identification information of the first application to the second electronic device; The identification information includes: application package name, application name and / or application icon.

10. The method according to any one of claims 6 to 9, characterized in that: During the process of the first cursor dragging the second motion effect window, when the first cursor moves from the second screen edge of the second electronic device to the first screen edge of the first electronic device, the first electronic device displays the first motion effect window dragged by the first cursor, the first motion effect window is located on the upper layer of the mask, and the second electronic device stops displaying the second motion effect window.

11. A communication system, characterized in that: The communication system includes a first electronic device with a first operating system installed and a second electronic device with a second operating system installed, the first electronic device or the second electronic device is connected to an input device, the first operating system is different from the second operating system, the first electronic device executes the method executed by the first electronic device as described in any one of claims 1-10, or the second electronic device executes the method executed by the second electronic device as described in any one of claims 1-10.

12. An electronic device, characterized in that: include: Processor and memory; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the electronic device executes the method executed by the first electronic device as described in any one of claims 1-10, or executes the method executed by the second electronic device as described in any one of claims 1-10.

13. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the computer program implements the method performed by the first electronic device as described in any one of claims 1 to 10, or implements the method performed by the second electronic device as described in any one of claims 1 to 10.

14. A computer program product, characterized in that It comprises a computer program, which, when being executed, enables a computer to execute the method executed by the first electronic device as claimed in any one of claims 1 to 10, or to execute the method executed by the second electronic device as claimed in any one of claims 1 to 10.

Images