Collaborative Window Processing Method, System and Electronic Device

Abstract

An embodiment of the present application provides a collaborative window processing method, system, and electronic device. The method includes: a first electronic device projects its screen to a second electronic device, and a collaborative window of the first electronic device is displayed on the second electronic device, where the first collaborative window is always the same as the interface displayed on the first electronic device, and the application interface displayed on the second collaborative window is different from that of the first collaborative window; after the user clicks the camera function option on the interface of the second collaborative window, the first collaborative window and the first electronic device display the interface of the information collected by the camera of the first electronic device; when the user operates the first electronic device to complete the information collection, the first collaborative window and the first electronic device resume displaying the previous interface, and the second collaborative window displays the interface after obtaining the collected information. Thus, by invoking the camera function in any collaborative window of the second electronic device, the interface of the information collected by its camera can be displayed on the first electronic device, which is convenient for the user to operate and improves the user experience.

Description

[0001] This application is a divisional application. The name of the original application is "Collaborative Window Processing Method, System and Electronic Device", the application number of the original application is 202111095503.8, the filing date of the original application is September 17, 2021, and the entire content of the original application is incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal devices, and in particular to a collaborative window processing method, system and electronic device. Background Art

[0003] Multiple terminals owned by a user can cooperate with each other to achieve multi-screen collaboration across devices. For example, when a mobile phone projects its screen to a tablet, one or more collaborative windows of the mobile phone can be displayed on the tablet. Among them, only the display interface of one collaborative window is the same as the display interface of the mobile phone. If the user clicks on the camera function option in the application interface displayed in a collaborative window (the display interface of this collaborative window is different from the display interface of the mobile phone), the interface for the mobile phone camera to collect information will only be displayed in this collaborative window. At this time, the user needs to hold the mobile phone to collect information, but can only view the information collection situation in the collaborative window, and the operation is extremely inconvenient. Summary of the Invention

[0004] To solve the above technical problems, embodiments of this application provide a collaborative window processing method, system and electronic device. In this method, when the user invokes the camera function in the application displayed in any collaborative window, the interface for the mobile phone camera to collect information can be displayed on the mobile phone, which is convenient for the user to operate and thus improves the user experience.

[0005] In a first aspect, an embodiment of the present application provides a collaborative window processing system. The system includes a first electronic device and a second electronic device, and the second electronic device is wirelessly connected to the first electronic device. The first electronic device projects its screen to the second electronic device. The second electronic device displays a first collaborative window and at least one second collaborative window on the display screen, where a target display interface is displayed on both the first collaborative window and the display screen of the first electronic device; the display interface of a target application in the first electronic device is displayed in the second collaborative window, and the target display interface is different from the display interface of the target application. The second electronic device sends a first indication message to the first electronic device in response to a click operation on a camera function option on the display interface of the second collaborative window, where the first indication message is used to instruct the first electronic device to activate the camera. In response to receiving the first indication message, the first electronic device displays an interface for the camera to collect information on the display screen of the first electronic device and projects the screen so that the interface for the camera to collect information is displayed in the first collaborative window. In response to a target operation on the first electronic device, the first electronic device obtains an information collection result corresponding to the camera function option, restores the display interface on the display screen of the first electronic device to the target display interface, and projects the screen so that the display interface of the first collaborative window is restored to the target display interface, and the display interface of the target application after obtaining the information collection result is displayed in the second collaborative window. In this way, even when invoking a camera function task in an application displayed in a collaborative window different from that of the first electronic device, the display interface of the camera function task can be moved to the display screen of the first electronic device for display. At this time, the user does not need to hold the first electronic device, but can view the information collection situation in the collaborative window of the second electronic device, which greatly improves the convenience of user operation. Moreover, when the information collection is completed, the display interface of the first electronic device will be restored, and the information collection result will still be displayed in the original collaborative window, without affecting the user experience.

[0006] Exemplarily, the target application refers to any application that can call the camera, which can be the shooting function of the camera or the scanning function of the camera. Exemplarily, the target application can be a memo, WeChat, Taobao, etc.

[0007] Exemplarily, the camera function option can be a shooting option (which can also be called a camera option). Correspondingly, the interface for the camera to collect information can be an interface for the camera to collect images; the information collection result can be the collected images, videos, etc.; the target operation on the first electronic device can be a click operation on the shooting option on the interface for the camera to collect images.

[0008] Exemplarily, the camera function option can be a scanning option, such as "Scan". Correspondingly, the interface for the camera to collect information can be the interface for the camera to scan an image; the information collection result can be a scanning result, a code scanning result, etc.; the target operation on the first electronic device can be a moving operation on the first electronic device.

[0009] According to the first aspect, when the camera function option is the shooting option, the first electronic device, in response to a click operation on the shooting option on the interface for the camera to collect an image, acquires the captured image and performs screen mirroring so that the display interface of the target application is displayed in the second collaborative window, and the display interface of the target application includes the captured image. In this way, even when the camera task (shooting task) is invoked in an application displayed in a collaborative window different from the display of the first electronic device, the camera shooting interface can be moved to and displayed on the display screen of the first electronic device. At this time, the user does not need to hold the first electronic device, but can view the image collection situation in the collaborative window of the second electronic device, greatly improving the convenience of user operation. Moreover, when the shooting is completed, the display interface of the first electronic device will be restored, and the captured image will be displayed in the original collaborative window, without affecting the user experience.

[0010] Exemplarily, the display interface of the target application including the captured image can be that only the captured image is displayed in the display interface of the target application, or that both the captured image and other information of the target application are displayed in the display interface of the target application.

[0011] According to the first aspect, or any implementation manner of the above first aspect, the first electronic device, in response to a click operation on the shooting option on the interface for the camera to collect an image, displays a photo preview interface on the display screen of the first electronic device and displays the photo preview interface in the first collaborative window; the first electronic device, in response to a click operation on the photo completion confirmation option on the photo preview interface, acquires the captured image. In this way, even when the camera task (shooting task) is invoked in an application displayed in a collaborative window different from the display of the first electronic device, the camera shooting interface can be moved to and displayed on the display screen of the first electronic device. At this time, the user does not need to hold the first electronic device, but can view the image collection situation in the collaborative window of the second electronic device, greatly improving the convenience of user operation. Moreover, when the user has completed shooting, the user can view the shooting effect on the display screen of the first electronic device. After the user confirms, the display interface of the first electronic device will be restored, and the captured image will be displayed in the original collaborative window, enhancing the user experience.

[0012] According to the first aspect, or any implementation of the above first aspect, when the camera function option is the scanning option, the first electronic device responds to a movement operation on the first electronic device, performs a scanning operation, obtains a scanning result, and projects the screen to display the display interface of the target application in the second collaboration window. Among them, the display interface of the target application includes the display interface corresponding to the scanning result. In this way, even if the scanning task is invoked in an application displayed in a collaboration window different from the display of the first electronic device, the scanning interface can be moved to the display screen of the first electronic device. At this time, the user does not need to hold the first electronic device, but can view the information collection and scanning situation in the collaboration window of the second electronic device, greatly improving the convenience of user operation. Moreover, when the scanning is completed, the display interface of the first electronic device will be restored, and the scanning result (such as the link interface corresponding to the QR code) will be displayed in the original collaboration window, without affecting the user experience.

[0013] According to the first aspect, or any implementation of the above first aspect, before the second electronic device sends the first indication information to the first electronic device in response to a click operation on the camera function option on the display interface of the second collaboration window, the second electronic device responds to at least one operation on the display interface of the second collaboration window and displays a display interface including the camera function option in the second collaboration window. In this way, regardless of which level of menu the camera function option exists in the target application, the interface for collecting information by the camera of the first electronic device that should originally be displayed in the second collaboration window can be displayed on the display screen of the first electronic device, thereby providing the user experience.

[0014] According to the first aspect, or any implementation of the above first aspect, in response to the received first indication information, the first electronic device creates a camera function task in the target application stack through the target application, and creates a first temporary stack of the target application in the first extended screen in the screen buffer of the first electronic device. The target application stack is set in the first extended screen, and the display interface of the first extended screen is displayed in the second collaborative window. The first electronic device pops the camera function task from the target application stack and pushes it into the first temporary stack of the target application. The first electronic device changes the first temporary stack of the target application from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display the interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device. The display screen of the first electronic device and the first collaborative window display the display interface of the main screen. The first electronic device destroys the first temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface. In this way, for the target application that adapts to single-application multi-tasking (that is, adapts to the ability of the system to move the collaborative window and supports multi-window startup), the camera function task of the target application is moved from the first extended screen to the main screen, thereby realizing that the interface for collecting information of the camera of the first electronic device that should originally be displayed in the second collaborative window is displayed on the display screen of the first electronic device. Moreover, when the camera function task of the target application is moved to the main screen, the target application can also provide functions corresponding to other tasks for the user to use.

[0015] According to the first aspect, or any implementation of the above first aspect, in response to the received first indication information, the first electronic device creates a camera function task in the target application stack through the target application. The target application stack is set in the first extended screen in the screen buffer of the first electronic device, and the display interface of the first extended screen is displayed in the second collaborative window. The first electronic device changes the target application stack from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display the interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device. The display screen of the first electronic device and the first collaborative window display the display interface of the main screen. The first electronic device destroys the camera function task in the target application stack and restores the target application stack from being set in the main screen to being set in the first extended screen, so as to restore the display interface on the display screen of the first electronic device to the target display interface. In this way, for the target application that does not adapt to single-application multi-tasking (that is, does not adapt to the ability of the system to move the collaborative window), the entire target application stack is moved from the first extended screen to the main screen, thereby realizing that the interface for collecting information of the camera of the first electronic device that should originally be displayed in the second collaborative window is displayed on the display screen of the first electronic device. Moreover, no changes need to be made to the target application.

[0016] According to the first aspect, or any implementation manner of the above first aspect, in response to the received first indication information, the first electronic device creates a camera function task in the target application stack through the target application. Among them, the target application stack is set in the first extended screen in the screen buffer of the first electronic device, and the display interface of the first extended screen is displayed in the second collaboration window. The first electronic device creates a second temporary stack of the target application in the main screen in the screen buffer of the first electronic device. Among them, the display interface of the main screen is displayed on the display screen of the first electronic device and in the first collaboration window. The first electronic device pops the camera function task from the target application stack and pushes it into the second temporary stack of the target application, so as to display the interface of the camera acquisition information of the first electronic device on the display screen of the first electronic device. The first electronic device destroys the second temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface. In this way, for a target application that does not adapt to single-application multi-tasking (that is, does not adapt to the ability of the system to move the collaboration window), the camera function task of the target application is moved from the first extended screen to the main screen, so as to realize that the interface of the camera acquisition information of the first electronic device that should originally be displayed in the second collaboration window is displayed on the display screen of the first electronic device.

[0017] According to the first aspect, or any implementation manner of the above first aspect, after the first electronic device creates a camera function task in the target application stack, it sends second indication information to the second electronic device, and the second indication information is used to instruct the second electronic device to freeze the display interface of the second collaboration window. In response to the received second indication information, the second electronic device freezes the display interface of the second collaboration window. In this way, for a target application that does not adapt to single-application multi-tasking, when its camera function task is moved from the second collaboration window to the mobile phone display screen, the functions corresponding to other tasks of the target application cannot be provided to the user, but by freezing the screen, the original collaboration window displaying the target application is locked, which will not affect the user's visual experience.

[0018] According to the first aspect, or any implementation manner of the above first aspect, in response to the received second indication information, the second electronic device takes a screenshot of the second collaboration window to obtain a screenshot image. The second electronic device locks and displays the screenshot image in the second collaboration window to freeze the display interface of the second collaboration window. In this way, according to the instruction of the first electronic device, the second electronic device takes a screenshot of the original collaboration window displaying the target application, and freezes the collaboration window by locking the screenshot image in the collaboration window, which will not affect the user's visual experience.

[0019] According to the first aspect, or any implementation of the first aspect above, the second electronic device obtains the display image sent by the first electronic device in response to the received second indication information; wherein the display image is obtained by the first electronic device taking a screenshot of the first extended screen; and the display image is locked and displayed in the second collaborative window to freeze the display interface of the second collaborative window. In this way, the first electronic device takes a screenshot of the first extended screen and sends the screenshot image to the second electronic device, so that the second electronic device can freeze the original collaborative window displaying the target application, without affecting the user's visual experience.

[0020] According to the first aspect, or any implementation of the first aspect above, after obtaining the information collection result corresponding to the camera function option, the first electronic device sends a third indication message to the second electronic device, and the third indication message is used to instruct the second electronic device to unfreeze the display interface of the second collaborative window. In response to the received third indication message, the second electronic device unfreezes the display interface of the second collaborative window and displays the display interface of the first extended screen in the second collaborative window. In this way, when the camera information collection of the first device is completed, the display of the second collaborative window displaying the target application will be restored, which will not affect the user experience.

[0021] According to the first aspect, or any implementation of the first aspect above, the first electronic device includes a mobile phone, and the second electronic device includes a computer, a tablet, or a television.

[0022] In a second aspect, an embodiment of the present application provides a collaborative window processing method. The method includes: a first electronic device projects a screen to a second electronic device. The second electronic device displays a first collaborative window and at least one second collaborative window on a display screen, wherein the first collaborative window and the display screen of the first electronic device both display a target display interface; the second collaborative window displays a display interface of a target application in the first electronic device, and the target display interface and the display interface of the target application are different. In response to a click operation on a camera function option on the display interface of the second collaborative window, the second electronic device sends a first indication message to the first electronic device, and the first indication message is used to instruct the first electronic device to start the camera. In response to the received first indication message, the first electronic device displays an interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device, and projects the screen to display the interface for collecting information of the camera in the first collaborative window. In response to the target operation on the first electronic device, the first electronic device obtains the information collection result corresponding to the camera function option, restores the display interface on the display screen of the first electronic device to the target display interface, and projects the screen to restore the display interface of the first collaborative window to the target display interface, so that the display interface after the target application obtains the information collection result is displayed in the second collaborative window.

[0023] According to a second aspect, when the camera function option is the shooting option, the interface for the camera to collect information includes the interface for the camera to capture images; in response to a target operation on the first electronic device, the first electronic device obtains an information collection result corresponding to the camera function option, and performs screen mirroring to display, in the second collaborative window, the display interface of the target application after obtaining the information collection result, including: in response to a click operation on the shooting option on the interface for the camera to capture images, the first electronic device captures an image and performs screen mirroring to display, in the second collaborative window, the display interface of the target application, where the display interface of the target application includes the captured image.

[0024] According to the second aspect, or any one of the implementation manners of the second aspect above, in response to a click operation on the camera option on the interface for the camera to collect information, the first electronic device captures an image, including: in response to a click operation on the shooting option on the interface for the camera to capture images, the first electronic device displays a photo preview interface on the display screen of the first electronic device and displays the photo preview interface in the first collaborative window; in response to a click operation on the photo completion confirmation option on the photo preview interface, the first electronic device captures an image.

[0025] According to the second aspect, or any one of the implementation manners of the second aspect above, when the camera function option is the scanning option, in response to a target operation on the first electronic device, the first electronic device obtains an information collection result corresponding to the camera function option, and performs screen mirroring to display, in the second collaborative window, the display interface of the target application after obtaining the information collection result, including: in response to a movement operation on the first electronic device, the first electronic device performs a scanning operation, obtains a scanning result, and performs screen mirroring to display, in the second collaborative window, the display interface of the target application, where the display interface of the target application includes a display interface corresponding to the scanning result.

[0026] According to the second aspect, or any one of the implementation manners of the second aspect above, before the second electronic device sends a first indication message to the first electronic device in response to a click operation on the camera function option on the display interface of the second collaborative window, the method further includes: in response to at least one operation on the display interface of the second collaborative window, the second electronic device displays a display interface including the camera function option in the second collaborative window.

[0027] According to a second aspect, or any implementation of the above second aspect, in response to the received first indication information, the first electronic device displays an interface of the camera capture information of the first electronic device on the display screen of the first electronic device, and projects the screen so that the interface of the camera capture information is displayed in the first collaboration window, including: in response to the received first indication information, the first electronic device creates a camera function task in the target application stack through the target application, and creates a first temporary stack of the target application in the first extended screen in the screen buffer of the first electronic device; wherein, the target application stack is set in the first extended screen, and the display interface of the first extended screen is displayed in the second collaboration window; the first electronic device pops the camera function task from the target application stack and pushes it into the first temporary stack of the target application; the first electronic device changes the first temporary stack of the target application from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display the interface of the camera capture information of the first electronic device on the display screen of the first electronic device; wherein, the display screen of the first electronic device and the main screen display interface are displayed in the first collaboration window. The first electronic device restores the display interface on the display screen of the first electronic device to the target display interface, including: the first electronic device destroys the first temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

[0028] According to a second aspect, or any implementation of the above second aspect, in response to the received first indication information, the first electronic device displays an interface of the camera capture information of the first electronic device on the display screen of the first electronic device, and projects the screen so that the interface of the camera capture information is displayed in the first collaboration window, including: the first electronic device, in response to the received first indication information, creates a camera function task in the target application stack through the target application; wherein, the target application stack is set in the first extended screen in the screen buffer of the first electronic device, and the display interface of the first extended screen is displayed in the second collaboration window; the first electronic device changes the target application stack from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display the interface of the camera capture information of the first electronic device on the display screen of the first electronic device; wherein, the display screen of the first electronic device and the main screen display interface are displayed in the first collaboration window. The first electronic device restores the display interface on the display screen of the first electronic device to the target display interface, including: the first electronic device destroys the camera function task in the target application stack, and restores the target application stack from being set in the main screen to being set in the first extended screen, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

[0029] According to a second aspect, or any implementation manner of the above second aspect, in response to receiving the first indication information, the first electronic device displays an interface of the camera capture information of the first electronic device on the display screen of the first electronic device, and performs screen mirroring so that the interface of the camera capture information is displayed in the first collaboration window, including: in response to receiving the first indication information, the first electronic device creates a camera function task in the target application stack through the target application; wherein, the target application stack is set in the first extended screen in the screen buffer of the first electronic device, and the display interface of the first extended screen is displayed in the second collaboration window; the first electronic device creates a second temporary stack of the target application in the main screen in the screen buffer of the first electronic device; wherein, the display interface of the main screen is displayed on the display screen of the first electronic device and in the first collaboration window; the first electronic device pops the camera function task out of the target application stack and pushes it into the second temporary stack of the target application, so as to display the interface of the camera capture information of the first electronic device on the display screen of the first electronic device. The first electronic device restores the display interface on the display screen of the first electronic device to the target display interface, including: the first electronic device destroys the second temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

[0030] According to a second aspect, or any implementation manner of the above second aspect, the method further includes: after creating the camera function task in the target application stack, the first electronic device sends second indication information to the second electronic device, and the second indication information is used to instruct the second electronic device to freeze the display interface of the second collaboration window; in response to receiving the second indication information, the second electronic device freezes the display interface of the second collaboration window.

[0031] According to a second aspect, or any implementation manner of the above second aspect, in response to receiving the second indication information, the second electronic device freezes the display interface of the second collaboration window, including: in response to receiving the second indication information, the second electronic device takes a screenshot of the second collaboration window to obtain a screenshot image; the second electronic device locks and displays the screenshot image in the second collaboration window, so as to freeze the display interface of the second collaboration window.

[0032] According to a second aspect, or any implementation manner of the above second aspect, in response to receiving the second indication information, the second electronic device freezes the display interface of the second collaboration window, including: in response to receiving the second indication information, the second electronic device obtains a display image sent by the first electronic device; wherein, the display image is obtained by the first electronic device taking a screenshot of the first extended screen; the second electronic device locks and displays the display image in the second collaboration window, so as to freeze the display interface of the second collaboration window.

[0033] According to a second aspect, or any implementation of the above second aspect, the method further includes: after the first electronic device obtains the information acquisition result corresponding to the camera function option, the first electronic device sends third indication information to the second electronic device, where the third indication information is used to instruct the second electronic device to release the freezing of the display interface of the second collaboration window; in response to the received third indication information, the second electronic device releases the freezing of the display interface of the second collaboration window and displays the display interface of the first extended screen in the second collaboration window.

[0034] According to a second aspect, or any implementation of the above second aspect, the first electronic device includes a mobile phone, and the second electronic device includes a computer, a tablet, or a television.

[0035] The second aspect and any implementation of the second aspect respectively correspond to the first aspect and any implementation of the first aspect. For the technical effects corresponding to the second aspect and any implementation of the second aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation of the first aspect above, which will not be elaborated here.

[0036] In a third aspect, an embodiment of the present application provides a method for processing a collaboration window. The method includes: the first electronic device casts a screen to the second electronic device, so that the second electronic device displays a first collaboration window and at least one second collaboration window on a display screen, where a target display interface is displayed on both the first collaboration window and the display screen of the first electronic device; the display interface of a target application in the first electronic device is displayed in the second collaboration window, and the target display interface is different from the display interface of the target application. In response to the received first indication information, the first electronic device displays an interface for collecting information by the camera of the first electronic device on the display screen of the first electronic device and casts the screen so that the interface for collecting information by the camera is displayed in the first collaboration window, where the first indication information is used to instruct the first electronic device to activate the camera. In response to a target operation on the first electronic device, the first electronic device obtains an information acquisition result corresponding to a camera function option, restores the display interface on the display screen of the first electronic device to the target display interface, casts the screen so that the display interface of the first collaboration window is restored to the target display interface, and enables the display interface of the target application after obtaining the information acquisition result to be displayed in the second collaboration window.

[0037] The third aspect and any implementation of the third aspect respectively correspond to the first aspect and any implementation of the first aspect. For the technical effects corresponding to the third aspect and any implementation of the third aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation of the first aspect above, which will not be elaborated here.

[0038] Fourth aspect, an embodiment of the present application provides a collaborative window processing method. The method includes: The second electronic device receives the screen projection of the first electronic device, and displays a first collaborative window and at least one second collaborative window on the display screen, where a target display interface is displayed on both the first collaborative window and the display screen of the first electronic device; a display interface of a target application in the first electronic device is displayed in the second collaborative window, and the target display interface is different from the display interface of the target application. The second electronic device responds to a click operation on a camera function option on the display interface of the second collaborative window, and sends a first indication message to the first electronic device, where the first indication message is used to instruct the first electronic device to start the camera. The second electronic device receives the screen projection of the first electronic device, and displays an interface for collecting information by the camera in the first collaborative window. The second electronic device receives the screen projection of the first electronic device, restores the display interface of the first collaborative window to the target display interface, and displays a display interface of the target application after obtaining the information collection result in the second collaborative window.

[0039] The fourth aspect and any implementation manner of the fourth aspect respectively correspond to the first aspect and any implementation manner of the first aspect. For the technical effects corresponding to the fourth aspect and any implementation manner of the fourth aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, which will not be elaborated here.

[0040] Fifth aspect, an embodiment of the present application provides an electronic device. The electronic device includes a memory and a processor. The processor is coupled to the memory; the memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the collaborative window processing method of the third aspect and any one of the third aspect, or the electronic device executes the collaborative window processing method of the fourth aspect and any one of the fourth aspect.

[0041] The fifth aspect and any implementation manner of the fifth aspect respectively correspond to the first aspect and any implementation manner of the first aspect. For the technical effects corresponding to the fifth aspect and any implementation manner of the fifth aspect, reference may be made to the technical effects corresponding to the first aspect and any implementation manner of the first aspect above, which will not be elaborated here.

[0042] Sixth aspect, an embodiment of the present application provides a computer-readable storage medium. The computer-readable storage medium includes a computer program, and when the computer program runs on an electronic device, the electronic device executes the collaborative window processing method executed by the first electronic device or the second electronic device in the second aspect, or the electronic device executes the collaborative window processing method of the third aspect and any one of the third aspect, or the electronic device executes the collaborative window processing method of the fourth aspect and any one of the fourth aspect. Description of the Drawings

[0043] Figures 1a to 1c Schematic diagram of an exemplary application scenario shown;

[0044] Figure 2 Schematic diagram of the structure of an exemplary electronic device;

[0045] Figure 3 Schematic diagram of the software structure of an exemplary electronic device;

[0046] Figure 4 Schematic diagram of module interaction provided by an embodiment of the present application;

[0047] Figures 5a to 5b Schematic diagram of an exemplary application scenario shown;

[0048] Figure 6 Schematic diagram of module interaction provided by an embodiment of the present application;

[0049] Figures 7a to 7c Schematic diagram of an exemplary application scenario shown;

[0050] Figure 8 Schematic diagram of the relationship between the screen and the stack of an electronic device provided by an embodiment of the present application;

[0051] Figure 9 Schematic diagram of module interaction provided by an embodiment of the present application;

[0052] Figures 10a to 10b Schematic diagram of an exemplary application scenario shown;

[0053] Figures 11a to 11d Schematic diagram of an exemplary application scenario shown;

[0054] Figure 12 Schematic diagram of module interaction provided by an embodiment of the present application;

[0055] Figures 13a to 13b Schematic diagram of an exemplary application scenario shown;

[0056] Figure 14 Schematic diagram of the relationship between the screen and the stack of an electronic device provided by an embodiment of the present application;

[0057] Figure 15 Schematic diagram of an exemplary application scenario shown;

[0058] Figure 16 Schematic diagram of module interaction provided by an embodiment of the present application;

[0059] Figure 17 Schematic diagram of the relationship between the screen and the stack of an electronic device provided by an embodiment of the present application;

[0060] Figure 18Schematic diagram of module interaction provided by the embodiments of the present application;

[0061] Figure 19 Schematic diagram of an exemplary application scenario. Detailed implementation manners

[0062] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0063] The term "and / or" in this article is only used to describe the associated relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone.

[0064] The terms "first" and "second" in the description and claims of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order of the objects. For example, the first target object and the second target object are used to distinguish different target objects, rather than to describe the specific order of the target objects.

[0065] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design solution described as "exemplary" or "for example" in the embodiments of the present application should not be construed as being more preferred or having more advantages than other embodiments or design solutions. Rather, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific manner.

[0066] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "a plurality of" refers to two or more. For example, a plurality of processing units refers to two or more processing units; a plurality of systems refers to two or more systems.

[0067] In an application scenario, a collaborative window generated by mirroring a first electronic device onto a second electronic device can be displayed on the screen of the second electronic device. The number of collaborative windows can be one or more. In the collaborative window, the desktop of the first electronic device can be displayed, or the display interface of any application in the first electronic device can be displayed. In the embodiments of this application, this scenario is exemplarily referred to as multi-screen collaboration, and it can also be named otherwise, such as collaborative negotiation, etc., which is not limited herein. In the multi-screen collaboration scenario, multiple terminals owned by a user can cooperate with each other to achieve multi-screen collaboration across devices. For example, multi-screen collaboration can be achieved between a mobile phone and a smart TV, a personal computer (PC), a tablet computer, etc. Another example is that multi-screen collaboration can be achieved between a tablet and a smart TV, a PC, etc., to provide a continuous service experience for the user. Among them, a communication connection needs to be established between the terminals that achieve multi-screen collaboration, which can be a wired communication connection or a wireless communication connection. Wireless communication solutions can include, for example, wireless fidelity (Wi-Fi), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc.

[0068] Such as Figures 1a to 1c The figure shows a schematic diagram of an exemplary application scenario. Referring to Figure 1a , taking the multi-screen collaboration achieved by connecting a mobile phone and a tablet through Wi-Fi as an example, after establishing a multi-screen collaboration connection between the mobile phone and the tablet, a collaborative window 101 is displayed on the display interface of the tablet (it can be any area on the tablet). The display interface of the mobile phone is always displayed on the collaborative window 101. That is to say, all the controls and images included in the display interface 102 of the mobile phone will be displayed in real time on the collaborative window 101. When the user opens an application in the collaborative window 101 of the tablet, taking the memo as an example, and opens the memo in a new window, the tablet receives the user operation and sends the user operation (including the pressure value and position coordinates corresponding to the user operation, etc.) to the mobile phone. The mobile phone can obtain the operation behavior of the user on the collaborative window 101 of the tablet. In response to the user's operation behavior, the mobile phone sends the display interface of the memo to the tablet. Correspondingly, based on the interface sent by the mobile phone, the tablet displays a collaborative window 103 on the display interface of the tablet (it can be any area on the tablet) and displays the display interface of the memo on the collaborative window 103.

[0069] Referring to Figure 1bWhen the user needs to use the camera function of the memo, the user clicks on the camera option (also known as the shooting option) 104 of the memo displayed in the collaboration window 103 of the tablet. The tablet receives the user's operation and sends the user's operation (including the pressure value and position coordinates corresponding to the user's operation, etc.) to the mobile phone. The mobile phone obtains the user's operation behavior on the collaboration window 103 of the tablet, and in response to the user's operation behavior, the mobile phone sends the camera shooting interface of the memo to the tablet. Correspondingly, based on the interface sent by the mobile phone, the tablet displays the camera shooting interface of the memo in the collaboration window 103 of the tablet, as Figure 1c shown. It should be noted that the display interface in the collaboration window 101 of the tablet is always the same as the display interface 102 of the mobile phone.

[0070] Refer to Figure 1c , the image in the camera shooting interface of the memo in the collaboration window 103 of the tablet is captured by the camera of the mobile phone (the rear camera or the front camera), but the image captured by the camera of the mobile phone will not be displayed in the display interface of the mobile phone. At this time, the user needs to hold the mobile phone with one hand (such as the right hand) for image capture, view the image capture situation in the camera shooting interface of the memo in the collaboration window 103 of the tablet, and when it is determined that the image in the camera shooting interface of the memo in the collaboration window 103 of the tablet meets the user's requirements, the user uses the other hand (such as the left hand) to click on the shooting option 105 in the camera shooting interface of the memo in the collaboration window 103 of the tablet to complete the image shooting operation. In this way, in the application scenario of multi-screen collaboration, the user needs to hold the mobile phone with one hand to capture images. Since the image capture situation will not be displayed in the display interface of the mobile phone, the user can only observe the image capture situation displayed in the camera shooting interface of the memo in the collaboration window 103 of the tablet, and when it is determined that the image capture situation meets the user's requirements, use the other hand to click on the shooting option 105 in the camera shooting interface of the memo in the collaboration window 103 of the tablet to complete the image shooting, which undoubtedly increases the inconvenience of user operation.

[0071] As Figure 2 shown is a schematic structural diagram of the electronic device 100. Optionally, the electronic device 100 can be a terminal, also known as a terminal device. The terminal can be a device with a camera such as a cellular phone or a tablet (pad), and the present application does not make a limitation. It should be noted that the schematic structural diagram of the electronic device 100 can be applicable to Figures 1a to 1c the mobile phone in Figures 1a to 1c , and can also be applicable to Figure 2 the tablet in Figure 2The various components shown in [figure] can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0072] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0073] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0074] Among them, the controller may be the nerve center and command center of the electronic device 100. The controller may generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0075] A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory.

[0076] The USB interface 130 is an interface that complies with the USB standard specifications. Specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc.

[0077] The charging management module 140 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.

[0078] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives the input of the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc.

[0079] The wireless communication function of the electronic device 100 can be implemented through antenna 1, antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0080] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: Antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0081] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc.

[0082] The wireless communication module 160 may provide solutions for wireless communications including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth, GNSS, FM, NFC, IR, etc. applied to the electronic device 100.

[0083] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technologies.

[0084] The electronic device 100 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change the display information.

[0085] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel may adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0086] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0087] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera sensor. The optical signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image through algorithms. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

[0088] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard formats such as RGB and YUV. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0089] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0090] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0091] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.

[0092] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121, so that the electronic device 100 implements the collaborative window processing method in the embodiments of the present application. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, application programs required for at least one function (such as a sound playback function, an image playback function, etc.). The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.). In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0093] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor, etc. Such as music playback, recording, etc.

[0094] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0095] The pressure sensor is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor can be disposed on the display screen 194. There are many types of pressure sensors, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor. In some embodiments, touch operations with the same touch position but different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

[0096] A touch sensor, also known as a "touch panel". The touch sensor can be disposed on the display screen 194, and together with the display screen 194, they form a touch screen, also known as a "touch control screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual outputs related to the touch operations can be provided through the display screen 194. In some other embodiments, the touch sensor can also be disposed on the surface of the electronic device 100, at a different position from where the display screen 194 is located.

[0097] The button 190 includes a power-on button, volume buttons, etc. The button 190 can be a mechanical button or a touch button. The electronic device 100 can receive button inputs and generate key signal inputs related to the user settings and function controls of the electronic device 100.

[0098] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects.

[0099] The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0100] The software system of the electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservices architecture, or cloud architecture. In the embodiments of this application, taking the Android system with a layered architecture as an example, the software structure of the electronic device 100 is illustratively described.

[0101] Figure 3 It is a software structure block diagram of the electronic device 100 in the embodiments of this application.

[0102] The layered architecture of the electronic device 100 divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into three layers, from top to bottom, namely the application layer, the application framework layer, and the kernel layer.

[0103] The application layer can include a series of application packages.

[0104] As Figure 3 shown, the application packages can include applications such as a camera, video codec, Bluetooth, collaborative negotiation application, WLAN, memo, WeChat, etc. Among them, the collaborative negotiation application is used to implement multi-screen collaboration.

[0105] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0106] like Figure 3 As shown, the application framework layer may include a window manager, a stack manager, a task manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0107] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0108] The stack manager is used to manage stack programs. The stack manager can release and establish the correspondence between the stack and the task.

[0109] The task manager is used to manage task programs. The task manager can load the content layout of the task according to the window parameters of the stack.

[0110] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including SMS notification options can include a view for displaying text and a view for displaying images.

[0111] The notification manager enables applications to display notification information in the status bar, which can be used to convey informational messages and disappear automatically after a short stay without user interaction.

[0112] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, Wi-Fi driver, sensor driver, etc.

[0113] Understandably, Figure 3 The layers in the software structure shown and the components included in each layer do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer layers than shown, and each layer may include more or fewer components, which is not limited in the present application.

[0114] It can be understood that in order for an electronic device to implement the collaborative window processing method in the embodiments of the present application, it includes the corresponding hardware and / or software modules for executing various functions. Combining the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the form of hardware or computer software driving the hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.

[0115] Before introducing a collaborative window processing method provided by an embodiment of the present application, an explanation is given to the implementation manner of multi-screen collaboration between the mobile phone and the tablet adopted in the embodiments of the present application.

[0116] In one example, in combination with Figure 4 the interaction process schematic diagram of each module as shown, and Figures 5a to 5b the application scenario schematic diagram as shown, the implementation process of multi-screen collaboration between the mobile phone and the tablet is described in detail. Referring to Figure 4 , specifically including:

[0117] S401, the view system creates a virtual screen buffer in response to the received user operation.

[0118] When the user needs to perform multi-screen collaboration between the mobile phone and the tablet, for example, the user clicks the option to agree to start the multi-screen collaboration function on the tablet. The tablet responds to the user's operation behavior, scans the electronic devices (such as mobile phones) that can establish a multi-screen collaboration connection nearby, and initiates a multi-screen collaboration connection request to the scanned electronic devices. If the discovered mobile phone is not the electronic device that the user wants to perform multi-screen collaboration with, the user can click the "Scan Code to Connect" option in the tablet prompt box, so that the tablet initiates a multi-screen collaboration connection request to the specified electronic device by scanning the code. After the mobile phone receives the multi-screen collaboration request sent by the tablet, a prompt box is displayed on the display interface of the mobile phone side. For example, the prompt box may include, but is not limited to: options for the device to establish a multi-screen collaboration connection, a "Cancel" option, and a "Connect" option. The user clicks the "Connect" option, and the view system of the mobile phone responds to the user's operation behavior, establishes a multi-screen collaboration connection with the tablet, and creates a virtual screen buffer.

[0119] In this example, the virtual screen buffer is relative to the main screen buffer. Among them, the main screen window in the main screen buffer will be directly sent to the main screen of the mobile phone. That is to say, the display interface of the main screen of the mobile phone is always consistent with the interface of the main screen window in the main screen buffer area. And each screen window in the virtual screen buffer will be projected onto the tablet for display, for example, the Cast+ projection method can be adopted.

[0120] In S402, the window manager mirrors the main screen window of the main screen buffer to the virtual screen buffer.

[0121] Each screen window in the virtual screen buffer can be obtained by mirroring each screen window in the main screen buffer. Exemplarily, since the screen resolution of the mobile phone is higher than that of the tablet, the window manager can reduce the pixel size of each screen window in the main screen buffer proportionally and then mirror it to the virtual screen buffer.

[0122] In S403, the window manager sends the video image in the virtual screen buffer to the video codec.

[0123] In this step, only the main screen window is included in the virtual screen buffer. Correspondingly, the video image sent by the window manager in the virtual screen buffer is optionally the video image displayed in the main screen window.

[0124] In S404, the video codec encodes the video image.

[0125] Exemplarily, after receiving the video image sent by the window manager, the video codec encodes the video image to generate video image frames.

[0126] In S405, the Wi-Fi driver encapsulates the video image frames into data packets and transmits them to the multi-screen collaboration terminal.

[0127] After receiving the video image frames sent by the video codec, the Wi-Fi driver encapsulates the video image frames to generate data packets and transmits the data packets to the multi-screen collaboration terminal. In this example, that is, the mobile phone transmits the data packets generated by encapsulating the video image frames through the Wi-Fi driver to the tablet. After receiving the data packets, the Wi-Fi driver of the tablet unpacks the data packets to obtain the video image frames and sends the video data frames to the video codec of the tablet. The video codec of the tablet decodes the received video image frames and sends the decoded video images to the window manager of the tablet. The window manager of the tablet displays the received video images in the collaboration window displayed on the display interface of the tablet.

[0128] Refer to Figure 5a, after the mobile phone view system creates a virtual screen buffer, the window manager mirrors the main screen window in the main screen buffer to the virtual screen buffer. At this time, the collaborative window 501 is displayed on the display interface of the tablet (which can be any area on the tablet). Among them, the main screen window in the main screen buffer will be directly sent to the mobile phone display interface, and the main screen window in the virtual screen buffer will be projected onto the collaborative window 501 on the tablet's display interface. Since the main screen window in the virtual screen buffer and the main screen window in the main screen buffer are in a mirror image relationship, the display interface in the collaborative window 501 on the tablet's display interface is always consistent with the mobile phone display interface.

[0129] S406, the view system expands the main screen buffer in response to the received user operation.

[0130] Exemplarily, the user clicks (such as double-clicking to open) a new application in the collaborative window 501 on the tablet's display interface. Taking the new application as the camera as an example, the collaborative window on the tablet's display interface sends the click coordinates of the user operation to the collaborative negotiation application of the tablet in response to the user's operation behavior. The collaborative negotiation application of the tablet determines the click pointer corresponding to the click coordinates and sends the click pointer to the collaborative negotiation application of the mobile phone. The collaborative negotiation application of the mobile phone receives the click pointer and sends an opening request to the camera application in response to the user operation corresponding to the click pointer. The camera application is opened and sends an indication message to the window manager, and the window manager sends a display instruction to the view system according to the indication message. The view system displays the camera interface in the main screen window in the main screen buffer according to the display instruction. At the same time, the window manager mirrors the camera interface to the main screen window in the virtual screen buffer. At this time, the camera interface is displayed on both the mobile phone display interface and the collaborative window 501 on the tablet's display interface.

[0131] When the user needs to display the camera interface in a new window, for example, the user clicks the "Open in New Window" option (an exemplary name, which can also be called the "Open Application in New Window" option, etc.) in the collaboration window 501. In response to the user's operation behavior, the collaboration window on the display interface of the tablet sends the click coordinates of the user operation to the collaboration negotiation application of the tablet. The collaboration negotiation application of the tablet determines the click pointer corresponding to the click coordinates and sends the click pointer to the collaboration negotiation application of the mobile phone. The collaboration negotiation application of the mobile phone receives the click pointer and, in response to the user operation corresponding to the click pointer, sends an indication message to the view system. Among them, the indication message can be used to instruct the view system to perform an operation to expand the main screen buffer. After receiving the indication message, the view system expands the main screen buffer according to the indication message. After the view system expands the main screen buffer, the window manager can create an extended screen window in the extended area of the main screen buffer. At this time, in addition to the main screen window, the main screen buffer can also include one or more extended screen windows. The following takes the main screen buffer including the extended screen 1 window as an example for explanation.

[0132] S407, the window manager displays the newly opened application interface in the extended screen 1 of the main screen buffer and mirrors the extended screen 1 window to the virtual screen buffer.

[0133] The window manager displays the newly opened application interface, such as the camera interface, in the extended screen 1 window of the main screen buffer. At this time, the interface before the newly opened application is displayed in the main screen window of the main screen buffer, such as the main view of the mobile phone (desktop application) is displayed. Correspondingly, after the screen window mirroring between the main screen buffer and the virtual screen buffer, the interface before the newly opened application is displayed in the main screen window of the virtual screen buffer, such as the main view of the mobile phone (desktop application) is displayed, and the newly opened application interface, that is, the camera interface, is displayed in the extended screen 1 window of the virtual screen buffer.

[0134] S408, the window manager sends the video image of the virtual screen buffer to the video codec.

[0135] In this step, the virtual screen buffer not only includes the main screen window but also the extended screen 1 window. Correspondingly, the window manager sends the video image of the virtual screen buffer, which not only includes the video image displayed in the main screen window but also the video image displayed in the extended screen 1 window. For example, the video images belonging to different screen windows in the virtual screen buffer will carry corresponding screen window identifiers, such as the screen window ID, so that the window manager of the tablet can divide the video images and display them in different collaboration windows.

[0136] S409, the video codec encodes the video image.

[0137] For the explanation of S409, please refer to S404 and will not be elaborated here.

[0138] S410, the Wi-Fi driver encapsulates the video image frames into data packets and then streams them to the multi-screen collaboration terminal.

[0139] For the explanation of S410, please refer to S405 and will not be elaborated here.

[0140] The window manager of the tablet displays the received video image in multiple collaboration windows on the display interface of the tablet. Exemplarily, the window manager of the tablet divides the received video image according to the screen window identifier carried by the video image and displays the video image in different collaboration windows.

[0141] Refer to Figure 5b , after the mobile phone view system expands the main screen buffer, the window manager creates an extended screen 1 window in the main screen buffer and mirrors the main screen window and the extended screen 1 window in the main screen buffer to the main screen window and the extended screen 1 window in the virtual screen buffer respectively. At this time, collaboration window 501 and collaboration window 502 are displayed on the display interface of the tablet (it can be any area on the tablet), where collaboration window 501 corresponds to the main screen window in the virtual screen buffer, and collaboration window 502 corresponds to the extended screen 1 window in the virtual screen buffer. The main screen window in the main screen buffer will be directly sent to the mobile phone display interface, the main screen window in the virtual screen buffer will be projected onto collaboration window 501 on the display interface of the tablet, and the extended screen 1 window in the virtual screen buffer will be projected onto collaboration window 502 on the display interface of the tablet. Since the main screen window in the virtual screen buffer and the main screen window in the main screen buffer are in a mirror relationship, the display interface in collaboration window 501 on the display interface of the tablet is always consistent with the mobile phone display interface; since the extended screen 1 window in the virtual screen buffer and the extended screen 1 window in the main screen buffer are in a mirror relationship, the display interface in collaboration window 502 on the display interface of the tablet is always consistent with the interface of the extended screen 1 window in the main screen buffer.

[0142] In another example, multi-screen collaboration is implemented between a mobile phone and a tablet, specifically including: after the mobile phone receives a multi-screen collaboration request sent by the tablet, a prompt box is displayed on the display interface of the mobile phone. Exemplarily, the prompt box may include but is not limited to: options for devices to establish a multi-screen collaborative connection, a "cancel" option, and a "connect" option. The user clicks the "connect" option, and the mobile phone establishes a multi-screen collaborative connection with the tablet in response to the user's operation. The main screen window in the main screen buffer is directly sent to the main screen of the mobile phone, and is also projected onto a collaborative window displayed on the display interface of the tablet (which can be any area on the tablet) (this collaborative window corresponds to the main screen window in the main screen buffer) for display.

[0143] Exemplarily, the user clicks (such as double-clicking to open) a new application in the collaborative window 501 on the display interface of the tablet. Taking the new application as a camera as an example, the collaborative window on the display interface of the tablet responds to the user's operation behavior and sends the click coordinates of the user's operation to the collaborative negotiation application of the tablet. The collaborative negotiation application of the tablet determines the click pointer corresponding to the click coordinates and sends the click pointer to the collaborative negotiation application of the mobile phone. The collaborative negotiation application of the mobile phone receives the click pointer, and in response to the user operation corresponding to the click pointer, initiates an opening request to the camera application. The camera application is opened and sends an indication message to the window manager, and the window manager sends a display instruction to the view system according to the indication message. The view system displays the camera interface in the main screen window in the main screen buffer according to the display instruction. While the interface displayed in the main screen window is sent to the main screen of the mobile phone, it is also projected to a collaborative window displayed on the display interface of the tablet. At this time, the camera interface is displayed in the collaborative window 501 on both the mobile phone display interface and the tablet display interface.

[0144] When the user needs to display the camera interface in a new window, for example, the user clicks the "Open in New Window" option in the collaboration window 501. In response to the user's operation behavior, the collaboration window on the display interface of the tablet sends the click coordinates of the user operation to the collaboration negotiation application of the tablet. The collaboration negotiation application of the tablet determines the click pointer corresponding to the click coordinates and sends the click pointer to the collaboration negotiation application of the mobile phone. After receiving the click pointer, the collaboration negotiation application of the mobile phone sends an indication message to the view system in response to the user operation corresponding to the click pointer. Among them, the indication message can be used to instruct the view system to perform an operation to expand the main screen buffer. After receiving the indication message, the view system expands the main screen buffer according to the indication message. After the view system expands the main screen buffer, the window manager can create an extended screen 1 in the extended area of the main screen buffer. The window of the extended screen 1 will be projected onto another collaboration window (this collaboration window corresponds to the window of the extended screen 1 in the main screen buffer) displayed on the display interface of the tablet (it can be any area on the tablet). At this time, in addition to the main screen window in the main screen buffer, it can also include one or more extended screen windows. For each extended screen window, the display interface of the extended screen window can be directly projected onto the collaboration window on the display interface of the tablet. At this time, the display interface in one collaboration window on the display interface of the tablet is always consistent with the display interface of the mobile phone, and the display interface of the newly opened application is displayed in the other collaboration window.

[0145] The difference between this example and the previous example is that instead of mirroring each screen window in the main screen buffer to the virtual screen buffer and then projecting it onto the tablet, the main screen window and each created extended screen window in the main screen buffer are directly projected onto the tablet. The embodiments of the present application do not limit the method of realizing multi-screen collaboration between the mobile phone and the tablet. The following will describe the embodiments of the present application in detail in combination with the multi-screen collaboration method adopted in the previous example.

[0146] The embodiments of the present application provide a method for processing a collaboration window. Specifically, in response to a click operation on the camera function option of the target application in the second collaboration window of the tablet, the display interface of the camera function task of the target application is displayed in the first collaboration window of the tablet, where at least two collaboration windows are displayed on the display interface of the tablet. The first multi-screen collaboration window corresponds to the main screen window in the main screen buffer, and the second collaboration window corresponds to the extended screen window in the main screen buffer. For example, the camera function option can be a camera option for taking pictures (or called a shooting option), or a scanning option for scanning (such as "Scan"). Correspondingly, the camera function task can be a camera task (or called a shooting task), or a scanning task.

[0147] In the embodiment of the present application, taking the target application as a memo and the second collaborative window corresponding to the extended screen 1 window in the main screen buffer as an example for illustration. In other embodiments, the specific implementation of the present application can be applied to other target applications that need to call a camera (or webcam), such as short video applications, payment applications, chat applications, etc. that need to call a webcam. The specific implementation of the present application can be applied to the third collaborative window corresponding to other extended screen windows in the main screen buffer displayed on the display interface of the tablet. The present application will not repeat the description.

[0148] One possible application scenario is that the target application is an application adapted to single-application multitasking, that is, the target application can open a new window on the basis of an existing window to carry a task of the target application; another possible application scenario is that the target application is an application not adapted to single-application multitasking, that is, the target application cannot open a new window on the basis of an existing window to carry a task of the target application.

[0149] Scenario 1

[0150] In this scenario, taking the target application as a memo as an example, the specific implementation of the embodiment of the present application will be described in detail, where the memo is an application adapted to single-application multitasking.

[0151] Such as Figure 6 shown is the interaction schematic diagram of each module. Referring to Figure 6 , the process of the collaborative window processing method provided by the embodiment of the present application specifically includes:

[0152] S601, the memo collaborative window of the tablet receives the operation of the user clicking the camera option.

[0153] The memo collaborative window on the tablet, that is, the collaborative window where the memo is located on the display interface of the tablet. Among them, the display interface of this collaborative window corresponds to the extended screen window in the main screen buffer (hereinafter, taking the collaborative window where the memo is located corresponding to the extended screen 1 window as an example). That is to say, the display interface of this collaborative window is different from the mobile phone display interface.

[0154] Referring to the application scenario schematic diagram shown in Figure 7a (1), both the mobile phone display interface and the collaborative window 702 on the display interface of the tablet display the mobile phone desktop interface, and the collaborative window 701 on the display interface of the tablet displays the display interface of the memo note task. The user clicks the camera option 7011 on the display interface of the memo note task in the collaborative window 701, and the collaborative window 701 receives the operation of the user clicking the camera option 7011.

[0155] S602, the memo collaborative window of the tablet sends the click coordinates to the tablet collaborative negotiation application.

[0156] Among them, the click coordinate is optionally the coordinate of the position point where the finger (or stylus, etc.) touches the tablet when the user clicks the camera option with reference to the coordinate system corresponding to the collaboration window 1.

[0157] S603. The collaboration negotiation application of the tablet sends a coordinate pointer to the collaboration negotiation application of the mobile phone.

[0158] The collaboration negotiation application of the tablet determines the corresponding coordinate pointer according to the received click coordinate and sends the coordinate pointer to the collaboration negotiation application of the mobile phone.

[0159] S604. The collaboration negotiation application of the mobile phone requests to start the memo camera function.

[0160] The collaboration negotiation application of the mobile phone determines that the user needs to start the memo camera function (or called memo scanning function, memo taking function) according to the coordinate pointer reported by the collaboration negotiation application of the tablet, and then sends a request to start the memo camera function to the memo.

[0161] S605. The memo of the mobile phone creates a memo camera task.

[0162] Among them, the camera task is a kind of camera function task and is used for shooting. Exemplarily, the camera function task can also be a scanning task for scanning. In this embodiment, the camera function task corresponding to the memo application is taken as an example of the camera task for explanation.

[0163] After the memo of the mobile phone receives the request to start the memo camera function, it creates a memo camera task (or called scanning task, taking task) on the memo note task (or called editing task). Refer to Figure 8 (1). The memo stack is located in the extended screen 1. Before the memo creates the memo camera task, the top of the memo stack is the memo note task. Refer to Figure 8 (2). After the memo creates the memo camera task, the memo camera task is pushed onto the memo stack. At this time, the top of the memo stack is the memo camera task.

[0164] S606. The window manager of the mobile phone creates a memo temporary stack, moves the memo camera task from the memo stack to the memo temporary stack, and moves the memo temporary stack from the extended screen 1 to the main screen.

[0165] In this scenario, since the memo is an application adapted to single-application multi-tasking, after the memo creates the memo camera task, it can declare to display the interface of the memo camera task in a new window. It should be noted that, like the original window of the memo, the new window is displayed in the extended screen 1.

[0166] Refer toFigure 8 (2), according to the memo statement, the window manager of the mobile phone creates a memo temporary stack 801 in the extended screen 1, and moves the memo camera task from the memo stack to the memo temporary stack 801. Similar to the memo stack, the memo temporary stack is also added to the extended screen 1. It should be noted that in the extended screen or the main screen, a newly created or newly opened stack will cover the currently opened stack, and correspondingly, the display window of the extended screen or the main screen will also change accordingly. In this example, in the extended screen 1, the newly created memo temporary stack will cover the memo stack. Before the memo stack is covered, the display window corresponding to the memo stack is shown on the extended screen 1; after the memo stack is covered, the display window corresponding to the memo temporary stack is shown on the extended screen 1. Before moving the memo camera task from the memo stack to the memo temporary stack 801, the top of the memo stack is the memo camera task and the memo temporary stack is empty; after moving the memo camera task from the memo stack to the memo temporary stack 801, the top of the memo stack is the memo note task, and the memo temporary stack 801 only includes the memo camera task. Subsequently, the window manager moves the memo temporary stack 801 from the extended screen 1 to the main screen.

[0167] As Figure 9 shown is the interaction diagram of each module. Referring to Figure 9 , the migration process of the collaborative window camera task provided by the embodiment of the present application includes:

[0168] S901, the window manager creates a memo temporary stack in the extended screen 1.

[0169] Referring to Figure 8 (1), only the memo stack exists in the extended screen 1. After the memo creates the memo camera task, the window manager newly creates a memo temporary stack 801 in the extended screen 1, which can be referred to Figure 8 (2). Among them, the memo temporary stack 801 is used to implement the migration of the memo camera task from the extended screen 1 to the main screen.

[0170] After the window manager creates the memo temporary stack 801, both the memo temporary stack 801 and the memo stack exist in the extended screen 1. Since the memo temporary stack 801 is newly created, the memo temporary stack 801 will cover the memo stack, which can be seen in Figure 8 (2). Regarding the stack coverage in the screen, the foregoing explanation can be referred to and will not be elaborated here.

[0171] S902, the window manager sends an indication message to the stack manager.

[0172] The indication information sent by the window manager to the stack manager is used to indicate that the memo camera task is moved from the memo stack to the memo temporary stack.

[0173] S903. The stack manager releases the corresponding relationship between the memo camera task and the memo stack.

[0174] According to the indication information, the stack manager releases the corresponding relationship between the memo camera task and the memo stack, that is, sets the superior of the memo camera task to be empty. In other words, the memo camera task is taken out from the memo stack.

[0175] S904. The stack manager sets the superior of the memo camera task to be the memo temporary stack.

[0176] According to the indication information, the stack manager sets the superior of the memo camera task to be the memo temporary stack, that is, establishes the corresponding relationship between the memo camera task and the memo temporary stack.

[0177] S905. The task manager queries the window parameters of the memo temporary stack from the window manager.

[0178] The window parameters may include but are not limited to: window size and window position.

[0179] S906. The window manager sends the window parameters of the memo temporary stack to the task manager.

[0180] The window manager sends indication information to the task manager, and the indication information may include window parameters such as window size and window position.

[0181] S907. The task manager reloads the content layout of the memo camera task according to the window parameters of the memo temporary stack.

[0182] The task manager reloads the content of the memo camera task according to the window parameters of the memo temporary stack to implement the content layout of the memo camera task. That is, the memo camera task is placed in the memo temporary stack, and the display interface of the memo camera task is displayed in the window corresponding to the memo temporary stack.

[0183] S908. The task manager sends indication information to the window manager.

[0184] The indication information sent by the task manager to the window manager is used to indicate that the window manager moves the memo temporary stack from the extended screen 1 to the main screen.

[0185] S909. The window manager releases the corresponding relationship between the memo temporary stack and the extended screen 1 and establishes the corresponding relationship between the memo temporary stack and the main screen.

[0186] The window manager releases the correspondence between the memo temporary stack and the extended screen 1 according to the indication information, that is, sets the superior of the memo temporary stack to be empty. Releasing the correspondence between the memo temporary stack and the extended screen 1 is equivalent to taking out the memo temporary stack from the extended screen 1. At the same time, the window manager establishes the correspondence between the memo temporary stack and the main screen, that is, sets the superior of the memo temporary stack to be the main screen. Establishing the correspondence between the memo temporary stack and the main screen is equivalent to putting the memo temporary stack into the main screen. Refer to Figure 8 (1), taking the case where only the desktop application stack exists on the main screen as an example. After establishing the correspondence between the memo temporary stack and the main screen, the memo temporary stack is put into the main screen and covers the desktop application stack, and reference can be made to Figure 8 (2). Exemplarily, if there are multiple stacks covering each other on the main screen, after the memo temporary stack is put into the main screen, it will cover these multiple stacks.

[0187] S607, the window manager of the mobile phone sends indication information to the view system of the mobile phone.

[0188] The indication information sent by the window manager of the mobile phone to the view system of the mobile phone can be used to indicate the view system to refresh the window display interfaces of each screen.

[0189] S608, the view system of the mobile phone displays the display interface of the memo camera task in the main screen window.

[0190] The view system of the mobile phone refreshes the window display interfaces of the main screen and the extended screen 1 according to the indication information. Among them, the display interface of the memo camera task is displayed in the main screen window, and the display interface of the memo note task is displayed in the extended screen 1 window.

[0191] Refer to Figure 8 (2), in the main screen, since the memo temporary stack covers the desktop application stack, the window displayed in the main screen window is the window corresponding to the memo temporary stack, that is, the display interface of the memo camera task in the memo temporary stack is displayed. At the same time, only the memo stack exists in the extended screen 1, and the window displayed in the extended screen 1 window is the window corresponding to the memo stack, that is, the display interface of the memo note task at the top of the stack in the memo stack is displayed.

[0192] Exemplarily, the window manager of the mobile phone mirrors the window display interfaces of the main screen and the extended screen 1 in the main screen buffer to the virtual screen buffer.

[0193] S609, the view system of the mobile phone sends an encoding request to the video codec of the mobile phone.

[0194] S610, the video codec of the mobile phone performs an encoding operation on the video image.

[0195] The window manager of the mobile phone sends the video images displayed on the main screen and the extended screen 1 in the virtual screen buffer to the video codec for encoding operations to generate video image frames.

[0196] S611. The collaborative negotiation application of the mobile phone transmits the video image frames to the collaborative negotiation application of the tablet.

[0197] In the scenario where the mobile phone and the tablet establish a Wi-Fi connection, the collaborative negotiation application of the mobile phone can transmit the video image frames to the collaborative negotiation application of the tablet in the form of data packets based on the Wi-Fi driver of the mobile phone and the Wi-Fi driver of the tablet.

[0198] S612. The collaborative negotiation application of the tablet sends a decoding request to the video codec of the tablet.

[0199] S613. The video codec of the tablet decodes the video image frames.

[0200] S614. The window manager of the tablet displays the video images in multiple windows.

[0201] The window manager of the tablet displays the received video images in multiple collaborative windows respectively on the display interface of the tablet according to the screen windows to which the video images belong. That is, the window manager of the tablet displays the video image corresponding to the display interface of the memo camera task in the collaborative window corresponding to the main screen window on the display interface of the tablet; the window manager of the tablet displays the video image corresponding to the display interface of the memo note task in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet.

[0202] Such as Figures 10a to 10b shown is a schematic diagram of an exemplary application scenario. Before the window manager executes the collaborative window camera task migration process, such as Figure 10aAs shown in the figure, in the main screen buffer, the display interface of the desktop application is shown in the main screen window 1001, and the display interface of the memo note task is shown in the extended screen 1 window 1002. Among them, the display interface of the desktop application shown in the main screen window 1001 is directly sent to the display interface of the mobile phone for display. At the same time, each screen window in the main screen buffer is mirrored to the virtual screen buffer. In the virtual screen buffer, the display interface of the desktop application is shown in the main screen window 1003, and the display interface of the memo note task is shown in the extended screen 1 window 1004. The display interfaces of each screen window in the virtual screen buffer are correspondingly projected onto the collaborative windows on the display interface of the tablet. Among them, the collaborative window 1005 corresponds to the main screen window 1003 and shows the display interface of the desktop application; the collaborative window 1006 corresponds to the extended screen 1 window 1004 and shows the display interface of the memo note task. After the window manager executes the collaborative window camera task migration process, as Figure 10b As shown in the figure, in the main screen buffer, the display interface of the memo camera task is shown in the main screen window 1001, and the display interface of the memo note task continues to be shown in the extended screen 1 window 1002. Among them, the display interface of the memo camera task shown in the main screen window 1001 is directly sent to the display interface of the mobile phone for display. At the same time, each screen window in the main screen buffer is mirrored to the virtual screen buffer. In the virtual screen buffer, the display interface of the memo camera task is shown in the main screen window 1003, and the display interface of the memo note task continues to be shown in the extended screen 1 window 1004. The display interfaces of each screen window in the virtual screen buffer are correspondingly projected onto the collaborative windows on the display interface of the tablet. Among them, the collaborative window 1005 corresponds to the main screen window 1003 and shows the display interface of the memo camera task; the collaborative window 1006 corresponds to the extended screen 1 window 1004 and continues to show the display interface of the memo note task.

[0203] Continue to refer to the application scenario schematic diagram as Figures 7a to 7b shown. As Figure 7a (1) shown, the user clicks on the camera option 7011 on the display interface of the memo note task in the collaborative window 701 on the display interface of the tablet. In response to the user's operation behavior, the interface changes of the tablet and the mobile phone can be referred to Figure 7a (2). As Figure 7a (2) shown, the collaborative window 701 on the display interface of the tablet continues to show the display interface of the memo note task, and the display interface of the mobile phone 703 and the collaborative window 702 on the display interface of the tablet simultaneously show the display interface of the memo camera task. At this time, the user can click on the shooting option 7031 in the display interface of the mobile phone 703 to perform a shooting operation. Exemplarily, in response to the user's operation behavior, the interface changes of the tablet and the mobile phone can be referred to Figure 7bFor example, as Figure 7b shown, the collaborative window 702 and the mobile phone display interface 704 on the display interface of the tablet display the camera preview image. When the user clicks the return option 7042 on the mobile phone display interface 704, the interfaces of the tablet and the mobile phone return to as Figure 7a (2) shown. When the user determines that the camera preview image meets the user's requirements, the user can click the confirmation option 7041 to indicate the completion of taking a photo.

[0204] It should be noted that, as Figure 7a (2) shown, the display interface of the memo note task displayed in the collaborative window 701 of the tablet is operable by the user. Exemplarily, that is to say, the options 7011 to 7015 in the collaborative window 701 are all clickable and operable by the user, still providing the memo note function for the user.

[0205] S615, the memo on the mobile phone receives the operation of the user clicking to complete taking a photo.

[0206] In the display interface of the memo camera task on the mobile phone display interface, the user clicks the operation to complete taking a photo. Referring to Figure 7b , the operation of the user clicking the confirmation option 7041 in the mobile phone display interface 704, the operation of clicking the confirmation option 7041 instructs the memo camera task to complete taking a photo.

[0207] S616, the memo on the mobile phone destroys the memo camera task.

[0208] In response to the operation of the user clicking to complete taking a photo, the memo destroys the memo camera task.

[0209] S617, the window manager of the mobile phone destroys the memo temporary stack.

[0210] After the memo camera task is destroyed, the memo temporary stack that originally had a corresponding relationship with the memo camera task becomes an empty stack, and the mobile phone window manager can immediately destroy the memo temporary stack. Referring to Figure 8 (2) and Figure 8 (3), after the memo temporary stack 801 is destroyed, only the desktop application stack exists in the main screen.

[0211] S618, the window manager of the mobile phone sends an indication message to the view system of the mobile phone.

[0212] The indication message sent by the window manager of the mobile phone to the view system of the mobile phone is used to instruct the view system to refresh the display interfaces of each screen window.

[0213] S619, the view system of the mobile phone displays the desktop interface in the main screen window.

[0214] The view system of the mobile phone refreshes the window display interfaces of the main screen and the extended screen 1 according to the indication information. Among them, the display interface of the main screen window switches back to the mobile phone desktop interface, and the display interface of the extended screen 1 window continues to display the memo note task.

[0215] Refer to Figure 8 (3), only the desktop application stack exists in the main screen. The window displayed on the main screen window is the window corresponding to the desktop application stack, that is, the mobile phone desktop is displayed. At the same time, only the memo stack exists in the extended screen 1. The window displayed on the extended screen 1 window is the window corresponding to the memo stack, that is, the display interface of the memo note task at the top of the stack in the memo stack is displayed.

[0216] Exemplarily, the window manager of the mobile phone still mirrors the window display interfaces of the main screen and the extended screen 1 in the main screen screen buffer to the virtual screen buffer.

[0217] S620, the view system of the mobile phone sends an encoding request to the video codec of the mobile phone.

[0218] S621, the video codec of the mobile phone performs an encoding operation on the video image.

[0219] S622, the collaborative negotiation application of the mobile phone transmits the video image frame to the collaborative negotiation application of the tablet.

[0220] S623, the collaborative negotiation application of the tablet sends a decoding request to the video codec of the tablet.

[0221] S624, the video codec of the tablet performs a decoding operation on the video image frame.

[0222] For the explanations of S620~S624, reference can be made to the foregoing, and details will not be repeated here.

[0223] S625, the window manager of the tablet displays the video image in multiple windows.

[0224] The window manager of the tablet displays the received video image in multiple collaborative windows respectively displayed on the display interface of the tablet according to the screen window to which the video image belongs. That is, the window manager of the tablet displays the video image corresponding to the desktop interface in the collaborative window corresponding to the main screen window displayed on the display interface of the tablet; the window manager of the tablet displays the video image corresponding to the display interface of the memo note task in the collaborative window corresponding to the extended screen 1 window displayed on the display interface of the tablet. At this time, reference can be made to Figure 10a , and details will not be repeated here.

[0225] In the foregoing Figures 7a to 7bBased on this, in response to the user clicking the confirmation option 7041 (i.e., completing the photo taking) in the mobile phone display interface 704, the interface changes of the tablet and the mobile phone can be referred to Figure 7c . As Figure 7c shown, the mobile phone desktop interface is restored and displayed in both the mobile phone display interface 704 and the collaborative window 702 on the tablet's display interface. The display interface of the memo note task continues to be displayed in the collaborative window 701 on the tablet's display interface, and the image 7016 captured by shooting is displayed at the editable area of the memo in this display interface.

[0226] As Figure 7a and Figure 7c shown is another application scenario. As Figure 7a (1) shown, in the collaborative window 701 on the tablet's display interface, the user clicks the camera option 7011 on the display interface of the memo note task. In response to the user's operation behavior, the interface changes of the tablet and the mobile phone can be referred to Figure 7a (2). As Figure 7a (2) shown, the display interface of the memo note task continues to be displayed in the collaborative window 701 on the tablet's display interface, and the display interface of the memo camera task is simultaneously displayed in both the mobile phone display interface 703 and the collaborative window 702 on the tablet's display interface. At this time, the user can click the photo taking option 7031 in the mobile phone display interface 703 to complete the photo taking (at this time, there is no need for the user to confirm the captured image again). Exemplarily, in response to the user's operation behavior, the interface changes of the tablet and the mobile phone can be referred to Figure 7c . As Figure 7c shown, the mobile phone desktop interface is restored and displayed in both the mobile phone display interface 704 and the collaborative window 702 on the tablet's display interface. The display interface of the memo note task continues to be displayed in the collaborative window 701 on the tablet's display interface, and the image 7016 captured by shooting is displayed at the editable area of the memo in this display interface.

[0227] The above application scenarios are explained by taking the example of the camera task performing the operation of capturing an image. If the camera task performs the operation of shooting a video, the processing flow can refer to the processing flow of the camera task performing the operation of capturing an image, which will not be elaborated here.

[0228] As Figures 11a to 11d shown is yet another application scenario. In this application scenario, taking the target application as WeChat and the camera function option as the scan option, such as the "Scan" option. Referring to the application scenario schematic diagram as Figure 11a shown, both the mobile phone display interface and the collaborative window 1102 on the tablet's display interface display the mobile phone desktop interface, and the collaborative window 1101 on the tablet's display interface displays the display interface of the WeChat chat task. As Figure 11aAs shown, the user clicks on the discovery option 11011 on the WeChat chat task display interface in the collaboration window 1101. In response to the user's operation, the interface changes of the tablet and the mobile phone can be referred to Figure 11b . As Figure 11b shown, on the display interface of the tablet, the display interface of the WeChat discovery task in the collaboration window 1101, and the display interface of the collaboration window 1102 on the mobile phone display interface and the tablet remains unchanged, and the mobile phone desktop interface continues to be displayed. As Figure 11b shown, the user clicks on the scan option on the discovery task display interface in the collaboration window 1101. In response to the user's operation, the interface changes of the tablet and the mobile phone can be referred to Figure 11c . As Figure 11c shown, on the display interface of the tablet, the collaboration window 1101 continues to display the WeChat discovery task display interface, and on the mobile phone display interface and the display interface of the collaboration window 1102 on the tablet, the WeChat scan task display interface is simultaneously displayed. As Figure 11c shown, the user holds the mobile phone and moves it so that the mobile phone camera can capture the QR code to be scanned. When the mobile phone camera captures a complete QR code image, the WeChat scan task immediately performs a scan operation to obtain the scan result. Immediately afterwards, the interface changes of the mobile phone and the tablet can be referred to Figure 11d . As Figure 11d shown, on both the mobile phone display interface and the display interface of the collaboration window 1102 on the tablet, the mobile phone desktop interface is restored, and on the display interface of the collaboration window 1101 on the tablet, the display interface corresponding to the scan result is displayed, such as the display interface of the public account linked to the scanned QR code.

[0229] In this application scenario, in response to the user's operation of clicking on the discovery option on the WeChat chat task display interface in the collaboration window 1101, the tablet displays a display interface including a camera function option (such as "scan") in the collaboration window 1101. There are many applications with camera function options, and the menu setting levels of the camera function options in different applications are different. When the display interface of the target application is displayed in the collaboration window 1101, as long as the target application has a camera function option, the tablet can display a display interface including the camera function option in the collaboration window 1101 in response to one or more operations of the user on the display interface.

[0230] It should be noted that the WeChat scan task in this application scenario corresponds to the aforementioned memo camera task and both belong to one of the camera function tasks. For the collaborative processing method flow of the WeChat scan task, reference can be made to the flow of the collaborative window processing method for the memo camera task, which will not be elaborated here. Additionally, as Figure 7a (2) and Figure 11c shown, the mobile phone display interfaces are all a type of interface for the camera to collect information. Among them, as Figure 7a(2) The mobile phone display interface shown is the interface for the camera to capture images; as Figure 11c The mobile phone display interface shown is the interface for the camera to scan images. As shown in the collaborative window 101 in 7c, and as Figure 11d The collaborative window 1101 shown is one of the display interfaces after the target application obtains the information collection result. Among them, the collaborative window 101 shown in 7c shows the display interface after the memo obtains the captured image; as Figure 11d The collaborative window 1101 shown shows the display interface after WeChat obtains the image scanning result, that is, the display interface after jumping to the QR code link. The display interface after the target application obtains the information collection result varies depending on the application, and this embodiment does not make a limitation.

[0231] In this way, in the multi-screen collaboration application scenario, even if the camera function task is invoked in the application displayed in the collaborative window (different from the mobile phone screen display), the display interface of the camera function task can be displayed on the mobile phone. At this time, the user does not need to hold the mobile phone for information collection, but can view the information collection situation in the collaborative window, greatly improving the convenience of user operation. Moreover, when the information collection is completed, the display interface of the first electronic device will be restored, and the information collection result will still be displayed in the original collaborative window, without affecting the user experience.

[0232] The technical solution provided in the embodiments of the present application is applicable to applications that are adapted to single-application multi-tasks. When the camera function task of this application is moved from the collaborative window to the mobile phone display window, the display interfaces of other tasks of the application can still be displayed in the collaborative window for the user to use the functions corresponding to other tasks. For example, when the camera function task of the memo is moved from the collaborative window to the mobile phone display window, the display interface of the note task of the memo can still be displayed in the collaborative window for the user to use.

[0233] Scenario Two

[0234] In this scenario, taking the target application as the memo as an example, the specific implementation manner of the embodiments of the present application will be described in detail. Among them, this memo is an application that is not adapted to single-application multi-tasks. In an alternative implementation manner, the display window of the camera task can be moved to the display interface of the mobile phone by moving the entire memo stack; in another alternative implementation manner, the display window of the camera task can be moved to the display interface of the mobile phone by moving the memo camera task. The following will respectively explain these two alternative implementation manners.

[0235] An alternative implementation manner can be seen in, for example, Figure 12 Shown is the interaction schematic diagram of each module. Referring to Figure 12 , the process of the collaborative window processing method provided in the embodiments of the present application specifically includes:

[0236] S1201. The memo collaboration window of the tablet receives the operation of the user clicking the camera option.

[0237] S1202. The memo collaboration window of the tablet sends the click coordinates to the tablet collaboration negotiation application.

[0238] S1203. The tablet collaboration negotiation application sends a coordinate pointer to the mobile phone's collaboration negotiation application.

[0239] S1204. The mobile phone's collaboration negotiation application requests to start the memo camera function.

[0240] For the explanations of S1201 to S1204, please refer to the foregoing and will not be elaborated here.

[0241] S1205. The mobile phone's collaboration negotiation application sends a screen freezing request to the tablet's collaboration negotiation application.

[0242] The screen freezing request is, optionally, a request indicating to freeze the extended screen window image. Among them, the screen freezing request may carry the information of the extended screen, such as the number information. In this embodiment, the screen freezing request is used to indicate the request to freeze the extended screen 1 window image, that is, the screen freezing request carries the information of the extended screen 1.

[0243] S1206. The tablet's collaboration negotiation application requests the tablet's window manager to freeze the display image of the extended screen 1.

[0244] After receiving the screen freezing request, the tablet's collaboration negotiation application parses the screen freezing request to determine the extended screen for which the display image needs to be frozen. The tablet's collaboration negotiation application sends a request to freeze the display image of the extended screen 1 to the tablet's window manager, so that the tablet's window manager performs the freezing operation on the display image of the extended screen 1.

[0245] S1207. The tablet's window manager freezes the display image of the extended screen 1.

[0246] The tablet's window manager acquires the memo note interface image, displays the memo note interface image in the window of the extended screen 1, and locks the display position of the memo note interface image to achieve the freezing of the display image of the extended screen 1. Among them, the memo note interface image is optionally the display interface of the memo note task at the moment before the start of the memo camera task.

[0247] As an alternative implementation, the image of the memo note interface obtained by the window manager of the tablet is actively obtained by the manager of the tablet. Specifically, when the window manager of the tablet receives a request from the collaborative negotiation application of the tablet to freeze the display screen of the extended screen 1, in response to this request, it obtains a frame of the memo note interface image currently displayed in the extended screen 1.

[0248] As another alternative implementation, the image of the memo note interface obtained by the window manager of the tablet is actively obtained by the window manager of the mobile phone and sent to the window manager of the tablet. Specifically, after the collaborative negotiation application of the mobile phone sends a screen freezing request to the collaborative negotiation application of the tablet, it sends indication information to the window manager of the mobile phone. The window manager of the mobile phone obtains a frame of the memo note interface image currently displayed in the extended screen 1 according to the indication information. This frame of the memo note interface image is sent to the window manager of the tablet after operations such as encoding, encapsulation, de-encapsulation, and decoding.

[0249] S1208. The memo of the mobile phone creates a memo camera task.

[0250] After the memo of the mobile phone receives a request to start the memo camera function, it creates a memo camera task on the memo note task. Refer to Figure 14 (1). The memo stack is located in the extended screen 1. Before the memo creates a memo camera task, the top of the stack of the memo stack is the memo note task. Refer to Figure 14 (2). After the memo creates a memo camera task, the memo camera task is pushed onto the memo stack. At this time, the top of the stack of the memo stack is the memo camera task.

[0251] S1209. The memo of the mobile phone sends indication information to the window manager of the mobile phone.

[0252] The indication information sent by the memo of the mobile phone to the window manager of the mobile phone can be used to instruct the window manager of the mobile phone to move the memo stack between the main screen and the extended screen. In this embodiment, this indication information is used to instruct the window manager of the mobile phone to move the memo stack from the extended screen 1 to the main screen.

[0253] S1210. The window manager of the mobile phone moves the memo stack from the extended screen 1 to the main screen.

[0254] The window manager of the mobile phone cancels the correspondence between the memo stack and the extended screen 1, that is, sets the parent of the memo stack to empty. The correspondence between the memo stack and the extended screen 1 is canceled, which is equivalent to taking the memo stack out of the extended screen 1. At the same time, the window manager of the mobile phone establishes the correspondence between the memo stack and the main screen, that is, sets the parent of the memo stack to the main screen. The correspondence between the memo stack and the main screen is established, which is equivalent to putting the memo stack into the main screen. Figure 14 (1) Take the example of only the desktop application stack in the main screen. After the correspondence between the memo stack and the main screen is established, the memo stack is placed in the main screen and covered on the desktop application stack. Figure 14 (2) For example, if there are multiple stacks that are sequentially overlapped in the main screen, the memo stack will be overlapped on the multiple stacks after being placed in the main screen.

[0255] Continue to refer to Figure 14 (2) Since there is only a memo stack in the extended screen 1 before the memo stack is moved, there is no stack in the extended screen 1 after the memo stack is moved, and the extended screen 1 is empty. Exemplarily, when the extended screen is empty, there is no image in the window display interface of the extended screen, and it can be filled with black pixels.

[0256] S1211, the window manager of the mobile phone sends instruction information to the mobile phone view system.

[0257] The instruction information sent by the window manager of the mobile phone to the view system of the mobile phone can be used to instruct the view system to refresh the window display interface of each screen.

[0258] S1212, the viewing system of the mobile phone displays the display interface of the memo camera task in the main screen window.

[0259] The mobile phone's view system refreshes the window display interfaces of the main screen and the extended screen 1 according to the instruction information. The display interface of the memo camera task is displayed in the main screen window, and no image is displayed in the extended screen 1 window, such as a black screen display.

[0260] Reference Figure 14 (2) In the main screen, since the memo stack is overlaid on the desktop application stack, the main screen window displays the window corresponding to the memo stack, that is, the display interface of the memo camera task in the memo stack is displayed. At the same time, there is no stack in the extended screen 1, and the extended screen 1 window displays no image, which can be illustrated by a black screen as an example.

[0261] Exemplarily, the window manager of the mobile phone mirrors the window display interfaces of the main screen and the extended screen 1 in the main screen buffer to the virtual screen buffer.

[0262] S1213, The view system of the mobile phone sends an encoding request to the video codec of the mobile phone.

[0263] S1214, The video codec of the mobile phone performs an encoding operation on the video image.

[0264] The window manager of the mobile phone sends the video image displayed on the main screen in the virtual screen buffer to the video codec for encoding operation to generate video image frames.

[0265] S1215, The collaborative negotiation application of the mobile phone transmits the video image frames to the collaborative negotiation application of the tablet.

[0266] In the scenario where the mobile phone and the tablet establish a Wi-Fi connection, the collaborative negotiation application of the mobile phone can transmit the video image frames to the collaborative negotiation application of the tablet in the form of data packets based on the Wi-Fi drivers of the mobile phone and the tablet.

[0267] S1216, The collaborative negotiation application of the tablet sends a decoding request to the video codec of the tablet.

[0268] S1217, The video codec of the tablet performs a decoding operation on the video image frames.

[0269] For the explanations of S1213 to S1217, please refer to the foregoing and will not be elaborated here.

[0270] S1218, The window manager of the tablet displays the video image in multiple windows.

[0271] The window manager of the tablet displays the received video image in multiple collaborative windows respectively on the display interface of the tablet according to the screen windows to which the video image belongs.

[0272] In this embodiment, the window manager of the tablet displays the video image corresponding to the display interface of the memo camera task in the collaborative window corresponding to the main screen window on the display interface of the tablet.

[0273] Since there is no image in the extended screen 1, there is no video image displayed in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet. In addition, since the collaborative negotiation application of the mobile phone also sends a screen freezing request to the collaborative negotiation application of the tablet when requesting the start of the memo camera function (see S1205 - S1207), the memo note interface image is displayed in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet.

[0274] It should be noted that if the memo note interface image is not locked and displayed in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet, there is no video image displayed in this collaborative window, for example, it may be a black screen.

[0275] As Figure 15 shown is a schematic diagram of an exemplary application scenario. Before the window manager executes the collaborative window camera task migration process, it can be as Figure 10a shown and will not be elaborated further. After the window manager executes the collaborative window camera task migration process, as Figure 15 shown, in the main screen buffer, the display interface of the memo camera task is displayed in the main screen window 1001, and there is no video image display in the extended screen 1 window 1002. Among them, the display interface of the memo camera task displayed in the main screen window 1001 is directly sent to the display interface of the mobile phone for display. At the same time, each screen window of the main screen buffer is mirrored to the virtual screen buffer. In the virtual screen buffer, the display interface of the memo camera task is displayed in the main screen window 1003, and there is no video image display in the extended screen 1 window 1004. The display interfaces of each screen window in the virtual screen buffer are correspondingly projected onto the collaborative window on the display interface of the tablet. Among them, the collaborative window 1005 corresponds to the main screen window 1003 and displays the display interface of the memo camera task; the collaborative window 1006 corresponds to the extended screen 1 window 1004 and there is no video image display. Since the window manager of the tablet performs a freeze screen process in the collaborative window 1006, the memo note interface image (the freeze screen image of the memo note task) 10061 will be locked and displayed in the collaborative window 1006, and there will be no phenomenon of the collaborative window 1006 going black.

[0276] Continue to refer to the schematic diagram of the application scenario as Figure 7a (1). Figures 13a to 13b shown. As Figure 7a (1) shown, the user clicks on the camera option 7012 on the display interface of the memo note task in the collaborative window 701 on the display interface of the tablet. In response to the user's operation behavior, the interface changes of the tablet and the mobile phone can be referred to Figure 13a . As Figure 13a shown, the memo note interface image 705 is displayed on the collaborative window 701 on the display interface of the tablet, and the display interface of the memo camera function task is simultaneously displayed on the mobile phone display interface 703 and the collaborative window 702 on the display interface of the tablet. Among them, the memo note interface image 705 is the image displayed in the collaborative window 701 on the display interface of the tablet when the user clicks on the camera option 7011 on the display interface of the memo note task.

[0277] At this time, as Figure 13a shown, the user can click on the camera option 7031 in the mobile phone display interface 703 to perform a photo-taking operation. Exemplarily, in response to the user's operation behavior, the interface changes of the mobile phone and the tablet can be referred to Figure 13b . As Figure 13bAs shown, the memo note interface image 705 continues to be displayed on the collaborative window 701 on the display interface of the tablet, and the camera preview images are displayed on the collaborative window 702 on the display interface of the tablet and the mobile phone display interface 704. When the user clicks the return option 7042 on the mobile phone display interface 704, the interfaces of the tablet and the mobile phone return to as shown in Figure 13a As shown. When the user determines that the camera preview image meets the user's requirements, the user can click the confirmation option 7041 to indicate the completion of taking a photo.

[0278] It should be noted that, as shown in Figure 13a As shown, the memo note interface image 705 is displayed on the collaborative window 701 of the tablet. Although the memo note interface image 705 is the display interface of the memo note task, it cannot be operated by the user. Exemplarily, that is to say, the options 7051 to 7055 in the memo note interface image 705 cannot be clicked for operation. For example, the options 7051 to 7055 can be set to gray to remind the user that they cannot be operated.

[0279] S1219, the memo on the mobile phone receives the operation of the user clicking to complete taking a photo.

[0280] In the display interface of the memo camera function task on the mobile phone display interface, the user clicks the operation to complete taking a photo. Referring to Figure 13b , when the user clicks the confirmation option 7041 in the mobile phone display interface 704, the operation of clicking the confirmation option 7041 indicates to the memo camera function task to complete taking a photo.

[0281] S1220, the memo on the mobile phone destroys the memo camera task.

[0282] In response to the user clicking the operation to complete taking a photo, the memo destroys the memo camera task.

[0283] S1221, the window manager of the mobile phone moves the memo stack from the main screen to the extended screen 1.

[0284] After the memo camera task is destroyed, the top of the memo stack is the memo note task, and it is moved back to the extended screen 1 from the main screen. It can be seen in Figure 14 (2).

[0285] The window manager of the mobile phone releases the corresponding relationship between the memo stack and the main screen, that is, sets the upper level of the memo stack to be empty. Releasing the corresponding relationship between the memo stack and the main screen is equivalent to taking out the memo stack from the main screen. At the same time, the window manager of the mobile phone establishes the corresponding relationship between the memo stack and the extended screen 1, that is, sets the upper level of the memo stack to be the extended screen 1. Establishing the corresponding relationship between the memo stack and the extended screen 1 is equivalent to putting the memo stack into the extended screen 1. Referring to Figure 14(2) After the correspondence between the memo stack and the main screen is removed, only the desktop application stack exists on the main screen. After the correspondence between the memo stack and the extended screen 1 is established, the memo stack is placed in the extended screen 1. At this time, there is no stack on the extended screen 1 and now there is a memo stack.

[0286] S1222, the window manager of the mobile phone sends indication information to the view system of the mobile phone.

[0287] The indication information sent by the window manager of the mobile phone to the view system of the mobile phone can be used to indicate the view system to refresh the display interfaces of the windows of each screen.

[0288] S1223, the view system of the mobile phone displays the display interface of the memo note task in the extended screen 1 window.

[0289] The view system of the mobile phone refreshes the display interfaces of the windows of the main screen and the extended screen 1 according to the indication information. Among them, the display interface of the main screen window switches back to the mobile phone desktop interface, and the display interface of the memo note task continues to be displayed in the extended screen 1 window.

[0290] Refer to Figure 14 (2) Only the desktop application stack exists on the main screen. The window displayed on the main screen is the window corresponding to the desktop application stack, that is, the mobile phone desktop is displayed. At the same time, only the memo stack exists on the extended screen 1. The window displayed on the extended screen 1 is the window corresponding to the memo stack, that is, the display interface of the memo note task at the top of the stack in the memo stack is displayed.

[0291] Exemplarily, the window manager of the mobile phone will still mirror the display interfaces of the windows of the main screen and the extended screen 1 in the main screen buffer to the virtual screen buffer.

[0292] S1224, the memo of the mobile phone sends indication information to the collaborative negotiation application of the mobile phone.

[0293] After the memo of the mobile phone destroys the memo camera task, it sends indication information to the collaborative negotiation application of the mobile phone. Among them, the indication information can be used to indicate that the memo camera task has been destroyed.

[0294] S1225, the collaborative negotiation application of the mobile phone sends a request to unfreeze the screen to the collaborative negotiation application of the tablet.

[0295] The request to unfreeze the screen is optionally a request to indicate unfreezing the extended screen window picture. Among them, the information of the extended screen, such as the number information, can be carried in the request to unfreeze the screen. In this embodiment, the request to unfreeze the screen is used to indicate a request to unfreeze the extended screen 1 window picture, that is, the information of the extended screen 1 is carried in the request to unfreeze the screen.

[0296] S1226, The collaborative negotiation application of the tablet requests the window manager of the tablet to unfreeze the display screen of the extended screen 1.

[0297] After receiving the unfreeze screen request, the collaborative negotiation application of the tablet parses the unfreeze screen request to determine the extended screen for which the display screen needs to be unfrozen. The collaborative negotiation application of the tablet sends a request to the window manager of the tablet to unfreeze the display screen of the extended screen 1, so that the window manager of the tablet can perform the operation of unfreezing the display screen of the extended screen 1.

[0298] S1227, The window manager of the tablet unfreezes the display screen of the extended screen 1.

[0299] The window manager of the tablet closes the memo note interface image displayed in the window of the extended screen 1 and redisplay the window of the extended screen 1 to unfreeze the display screen of the extended screen 1. That is, after the window manager of the tablet unfreezes the display screen of the extended screen 1, the window interface of the extended screen 1 is displayed in the collaborative window corresponding to the extended screen 1 on the display interface of the tablet.

[0300] S1228, The view system of the mobile phone sends an encoding request to the video codec of the mobile phone.

[0301] S1229, The video codec of the mobile phone performs an encoding operation on the video image.

[0302] S1230, The collaborative negotiation application of the mobile phone transmits video image frames to the collaborative negotiation application of the tablet.

[0303] S1231, The collaborative negotiation application of the tablet sends a decoding request to the video codec of the tablet.

[0304] S1232, The video codec of the tablet performs a decoding operation on the video image frames.

[0305] For the explanations of S1228~S1232, please refer to the foregoing and will not be elaborated here.

[0306] S1233, The window manager of the tablet displays the video image in multiple windows.

[0307] The window manager of the tablet displays the received video image in multiple collaborative windows displayed on the display interface of the tablet according to the screen windows to which the video image belongs. That is, the window manager of the tablet displays the video image corresponding to the desktop interface in the collaborative window corresponding to the main screen window on the display interface of the tablet; the window manager of the tablet displays the video image corresponding to the display interface of the memo note task in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet. At this time, you can continue to refer toFigure 10a , which will not be elaborated here.

[0308] In the foregoing Figure 7a (1), Figures 13a to 13b , in response to the user's operation of clicking the confirmation option 7041 (i.e., completing the photo taking) in the mobile phone display interface 704, the interface changes of the tablet and the mobile phone can be referred to Figure 7c , which will not be elaborated.

[0309] It should be noted that S1205 - S1207 can be executed before S1208 - S1217, or can be executed simultaneously with S1208 - S1217, without limitation, as long as the freezing of the collaborative window corresponding to the extended screen 1 is completed before the collaborative window of the tablet is refreshed and displayed. S1225 - S1227 can be executed before S1228 - S1232, or can be executed simultaneously with S1228 - S1232, without limitation, as long as the unlocking of the freezing of the collaborative window corresponding to the extended screen 1 is completed before the collaborative window of the tablet is refreshed and displayed.

[0310] In this way, in the application scenario of multi - screen collaboration, even if the camera function task is invoked in the application displayed in the collaborative window, the display window of the camera function task can be moved to the display interface of the mobile phone. At this time, the user can complete the operations of collecting images and taking pictures with only one hand, greatly improving the convenience of user operations. Moreover, when the user finishes taking pictures, the display of the collaborative window will be restored, without affecting the user experience.

[0311] The technical solution provided by this embodiment is applicable to applications that are not adapted to single - application multi - tasking. When the camera task of this application is moved from the collaborative window to the mobile phone display window, other tasks of the application cannot be provided for the user to use, but by freezing the original collaborative window of the displayed application, the visual experience of the user will not be affected.

[0312] An optional implementation manner can be referred to as Figure 16 shown in the interaction schematic diagram of each module. Referring to Figure 16 , the process of the collaborative window processing method provided by the embodiments of the present application specifically includes:

[0313] S1601, the memo collaborative window of the tablet receives the operation of the user clicking the camera option.

[0314] S1602, the memo collaborative window of the tablet sends the click coordinates to the collaborative negotiation application of the tablet.

[0315] S1603, the collaborative negotiation application of the tablet sends the coordinate pointer to the collaborative negotiation application of the mobile phone.

[0316] S1604, the collaborative negotiation application of the mobile phone requests the startup of the memo camera function.

[0317] S1605. The collaborative negotiation application of the mobile phone sends a screen freezing request to the collaborative negotiation application of the tablet.

[0318] S1606. The collaborative negotiation application of the tablet requests the window manager of the tablet to freeze the display screen of the extended screen 1.

[0319] S1607. The window manager of the tablet freezes the display screen of the extended screen 1.

[0320] For the explanations of S1601 - S1607, please refer to the above, and will not be elaborated here.

[0321] S1608. The memo of the mobile phone creates a memo camera task.

[0322] After the memo of the mobile phone receives a request to start the memo camera function, a memo camera task is created on the memo note task. Refer to Figure 17 (1). The memo stack is located in the extended screen 1. Before the memo creates a memo camera task, the top of the memo stack is the memo note task. Refer to Figure 17 (2). After the memo creates a memo camera task, the memo camera task is pushed onto the memo stack. At this time, the top of the memo stack is the memo camera task.

[0323] S1609. The memo of the mobile phone sends indication information to the window manager of the mobile phone.

[0324] The indication information sent by the memo of the mobile phone to the window manager of the mobile phone can be used to instruct the window manager of the mobile phone to move the memo camera task from the extended screen 1 to the main screen.

[0325] S1610. The window manager of the mobile phone creates a memo temporary stack on the main screen and moves the memo camera task from the memo stack to the memo temporary stack.

[0326] In this scenario, since the memo is an application that does not support single - application multi - tasking adaptation, the memo cannot declare to display the interface of the memo camera task in a new window. Therefore, the window manager of the mobile phone creates a memo temporary stack on the main screen according to the indication information to display the display interface of the memo camera task.

[0327] Refer to Figure 17(2) The window manager of the mobile phone creates a memo temporary stack 1701 in the main screen 1 according to the indication information, and moves the memo camera task from the memo stack to the memo temporary stack 1701. It should be noted that in the main screen, a newly created or newly opened stack will cover the currently opened stack. Correspondingly, the display window of the main screen will also change accordingly. In this example, in the main screen, the newly created memo temporary stack will cover the desktop application stack. Before the desktop application stack is covered, the display window corresponding to the desktop application stack is displayed on the main screen; after the desktop application stack is covered, the display window corresponding to the memo temporary stack is displayed on the main screen. Before moving the memo camera task from the memo stack to the memo temporary stack 1701, the top of the memo stack is the memo camera task and the memo temporary stack is empty; after moving the memo camera task from the memo stack to the memo temporary stack 1701, the top of the memo stack is the memo note task, and only the memo camera task is included in the memo temporary stack 1701.

[0328] As Figure 18 shown is the interaction schematic diagram of each module. Referring to Figure 18 , the moving process of the collaborative window camera task provided by the embodiment of the present application includes:

[0329] S1801, The window manager creates a memo temporary stack in the main screen.

[0330] Referring to Figure 17 (1), only the desktop application stack exists in the main screen. After the memo creates the memo camera task, the window manager newly creates a memo temporary stack 1701 in the main screen, which can be referred to Figure 17 (2). Among them, the memo temporary stack 1701 is used to move the memo camera task from the extended screen 1 to the main screen.

[0331] After the window manager creates the memo temporary stack 1701, both the memo temporary stack 1701 and the desktop application stack exist in the main screen. Since the memo temporary stack 1701 is newly created, the memo temporary stack 1701 will cover the memo stack, which can be seen in Figure 17 (2). Regarding the coverage of the stack on the screen, the foregoing explanation can be referred to and will not be elaborated here.

[0332] S1802, The window manager sends indication information to the stack manager.

[0333] The indication information sent by the window manager to the stack manager is used to indicate moving the memo camera task from the memo stack to the memo temporary stack.

[0334] S1803, The stack manager releases the correspondence between the memo camera task and the memo stack.

[0335] The stack manager releases the correspondence between the memo camera task and the memo stack according to the indication information, that is, sets the superior of the memo camera task to be empty, which means taking out the memo camera task from the memo stack.

[0336] S1804, The stack manager sets the superior of the memo camera task to be the memo temporary stack.

[0337] The stack manager sets the superior of the memo camera task to be the memo temporary stack according to the indication information, that is, establishes the correspondence between the memo camera task and the memo temporary stack.

[0338] S1805, The task manager queries the window parameters of the memo temporary stack from the window manager.

[0339] The window parameters may include but are not limited to: window size and window position.

[0340] S1806, The window manager sends the window parameters of the memo temporary stack to the task manager.

[0341] The window manager sends indication information to the task manager, and the indication information may include window parameters such as window size and window position.

[0342] S1807, The task manager reloads the content layout of the memo camera task according to the window parameters of the memo temporary stack.

[0343] The task manager reloads the content of the memo camera task according to the window parameters of the memo temporary stack to implement the content layout of the memo camera task. That is, put the memo camera task into the memo temporary stack and display the display interface of the memo camera task in the window corresponding to the memo temporary stack.

[0344] S1611, The window manager of the mobile phone sends indication information to the view system of the mobile phone.

[0345] The indication information sent by the window manager of the mobile phone to the view system of the mobile phone can be used to instruct the view system to refresh the window display interfaces of each screen.

[0346] S1612, The view system of the mobile phone displays the display interface of the memo camera task in the main screen window.

[0347] The view system of the mobile phone refreshes the window display interfaces of the main screen and the extended screen 1 according to the indication information. Among them, the display interface of the memo camera task is displayed in the main screen window, and the display interface of the memo note task is displayed in the extended screen 1 window.

[0348] Refer to Figure 17 (2), in the main screen, since the memo temporary stack covers the desktop application stack, the window displayed on the main screen window is the window corresponding to the memo temporary stack, that is, the display interface of the memo camera task in the memo temporary stack is displayed. At the same time, only the memo stack exists in the extended screen 1, and the window displayed on the extended screen 1 window is the window corresponding to the memo stack, that is, the display interface of the memo note task in the memo stack is displayed.

[0349] Exemplarily, the window manager of the mobile phone mirrors the window display interfaces of the main screen and the extended screen 1 in the main screen buffer to the virtual screen buffer.

[0350] S1613, the view system of the mobile phone sends an encoding request to the video codec of the mobile phone.

[0351] S1614, the video codec of the mobile phone performs an encoding operation on the video image.

[0352] S1615, the collaborative negotiation application of the mobile phone transmits the video image frames to the collaborative negotiation application of the tablet.

[0353] S1616, the collaborative negotiation application of the tablet sends a decoding request to the video codec of the tablet.

[0354] S1617, the video codec of the tablet performs a decoding operation on the video image frames.

[0355] For the explanations of S1613~S1617, reference can be made to the foregoing, and details are not repeated here.

[0356] S1618, the window manager of the tablet displays the video image in multiple windows.

[0357] The window manager of the tablet displays the received video image in multiple collaborative windows respectively displayed on the display interface of the tablet according to the screen window to which the video image belongs. That is, the window manager of the tablet displays the video image corresponding to the display interface of the memo camera task in the collaborative window corresponding to the main screen window on the display interface of the tablet; the window manager of the tablet displays the video image corresponding to the display interface of the memo note task in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet.

[0358] As Figure 19 shown is a schematic diagram of an exemplary application scenario. Before the window manager executes the collaborative window camera task migration process, it can be as Figure 10a shown, and details are not repeated here. After the window manager executes the collaborative window camera task migration process, as Figure 19As shown, in the main screen buffer, the display interface of the memo camera task is shown in the main screen window 1001, and the display interface of the memo note task is shown in the extended screen 1 window 1002. Among them, the display interface of the memo camera task shown in the main screen window 1001 is directly sent to the display interface of the mobile phone for display. At the same time, each screen window in the main screen buffer is mirrored to the virtual screen buffer. In the virtual screen buffer, the display interface of the memo camera task is shown in the main screen window 1003, and the display interface of the memo note task is shown in the extended screen 1 window 1004. The display interfaces of each screen window in the virtual screen buffer are correspondingly projected onto the collaborative windows on the display interface of the tablet. Among them, the collaborative window 1005 corresponds to the main screen window 1003 and shows the display interface of the memo camera task; the collaborative window 1006 corresponds to the extended screen 1 window 1004 and shows the display interface of the memo note task. Since the window manager of the tablet performs a freeze screen process on the collaborative window 1006, the memo note interface image (frozen screen picture of the memo note task) 10061 will be shown in the collaborative window 1006, and the display interface of the memo note task will not be shown.

[0359] In this embodiment, reference can continue to be made to the application scenario schematic diagram as shown in Figure 7a (1), Figures 13a to 13b which will not be elaborated here.

[0360] S1619, the memo of the mobile phone receives the operation of the user clicking to complete taking a photo.

[0361] The user clicks the operation of completing taking a photo in the display interface of the memo camera task on the display interface of the mobile phone. Referring to Figure 13b , when the user clicks the confirmation option 7041 in the mobile phone display interface 704, the operation of clicking the confirmation option 7041 indicates to the memo camera task to complete taking a photo.

[0362] S1620, the memo of the mobile phone destroys the memo camera task.

[0363] In response to the user's operation of clicking to complete taking a photo, the memo destroys the memo camera task.

[0364] S1621, the window manager of the mobile phone destroys the memo temporary stack.

[0365] After the memo camera task is destroyed, the memo temporary stack is empty, and the window manager of the mobile phone immediately destroys it. Refer to Figure 17 (2).

[0366] S1622, the window manager of the mobile phone sends indication information to the view system of the mobile phone.

[0367] The indication information sent by the window manager of the mobile phone to the view system of the mobile phone can be used to instruct the view system to refresh the display interfaces of each screen window.

[0368] S1623. The view system of the mobile phone displays the desktop interface in the main screen window.

[0369] The view system of the mobile phone refreshes the window display interfaces of the main screen and the extended screen 1 according to the indication information. Among them, the display interface of the main screen window switches back to the mobile phone desktop interface, and the extended screen 1 window continues to display the display interface of the memo note task.

[0370] Refer to Figure 17 (3). In the main screen, there is only a desktop application stack, and the window displayed in the main screen window is the window corresponding to the desktop application stack, that is, the mobile phone desktop is displayed. At the same time, in the extended screen 1, there is only a memo stack, and the window displayed in the extended screen 1 window is the window corresponding to the memo stack, that is, the display interface of the memo note task at the top of the memo stack is displayed.

[0371] Exemplarily, the window manager of the mobile phone still mirrors the window display interfaces of the main screen and the extended screen 1 in the main screen buffer to the virtual screen buffer.

[0372] S1624. The memo of the mobile phone sends indication information to the collaborative negotiation application of the mobile phone.

[0373] After the memo camera task of the mobile phone is destroyed, the memo of the mobile phone sends indication information to the collaborative negotiation application of the mobile phone. Among them, the indication information can be used to indicate that the memo camera task has been destroyed.

[0374] S1625. The collaborative negotiation application of the mobile phone sends a request to unfreeze the screen to the collaborative negotiation application of the tablet.

[0375] S1626. The collaborative negotiation application of the tablet requests the window manager of the tablet to unfreeze the display screen of the extended screen 1.

[0376] S1627. The window manager of the tablet unfreezes the display screen of the extended screen 1.

[0377] S1628. The view system of the mobile phone sends an encoding request to the video codec of the mobile phone.

[0378] S1629. The video codec of the mobile phone performs an encoding operation on the video image.

[0379] S1630. The collaborative negotiation application of the mobile phone transmits video image frames to the collaborative negotiation application of the tablet.

[0380] S1631. The collaborative negotiation application of the tablet sends a decoding request to the video codec of the tablet.

[0381] S1632. The video codec of the tablet decodes the video image frames.

[0382] For the explanations of S1625 - S1632, please refer to the foregoing, and will not be elaborated here.

[0383] S1633. The window manager of the tablet displays the video image in multiple windows.

[0384] The window manager of the tablet displays the received video image in the multiple collaborative windows respectively on the display interface of the tablet according to the screen windows to which the video image belongs. That is, the window manager of the tablet displays the video image corresponding to the desktop interface in the collaborative window corresponding to the main screen window on the display interface of the tablet; the window manager of the tablet displays the video image corresponding to the display interface of the memo note task in the collaborative window corresponding to the extended screen 1 window on the display interface of the tablet. At this time, please continue to refer to Figure 10a , which will not be elaborated here.

[0385] In the foregoing Figure 7a (1). Figures 13a to 13b On this basis, in response to the user's operation of clicking the confirmation option 7041 (i.e., completing the photo taking) in the mobile phone display interface 704, the interface changes of the tablet and the mobile phone can be referred to Figure 7c , which will not be elaborated here.

[0386] It should be noted that S1605 - S1607 can be executed before S1608 - S1617, or can be executed simultaneously with S1608 - S1617, without limitation, as long as the freezing of the collaborative window corresponding to the extended screen 1 is completed before the collaborative window of the tablet is refreshed and displayed. S1625 - S1627 can be executed before S1628 - S1632, or can be executed simultaneously with S1628 - S1632, without limitation, as long as the release of the freezing of the collaborative window corresponding to the extended screen 1 is completed before the collaborative window of the tablet is refreshed and displayed.

[0387] In this way, in the application scenario of multi-screen collaboration, even if the camera task is invoked in the application displayed in the collaborative window, the display window of the camera task can be moved to the display interface of the mobile phone. At this time, the user can complete the operations of collecting images and taking pictures with only one hand, greatly improving the convenience of user operation. Moreover, when the user finishes taking pictures, the display of the collaborative window will be restored, without affecting the user experience.

[0388] The technical solution provided by this embodiment is applicable to applications that are not adapted to single-application multitasking. When the camera task of this application is moved from the collaborative window to the mobile phone display window, other tasks of the application cannot be provided for the user to use. However, by freezing the screen, the original collaborative window displayed by the application is locked, which will not affect the user's visual experience.

[0389] In this embodiment, S1605 to S1607 and S1625 to S1627 can be optional operations. In the case where S1605 to S1607 and S1625 to S1627 are not executed: when the camera task of this application is moved from the collaborative window to the mobile phone display window, the display interfaces of other tasks of the application can still be displayed in the collaborative window (see Figure 10b , which will not be elaborated here), for the user to use the functions corresponding to other tasks. For example, when the camera task of the memo is moved from the collaborative window to the mobile phone display window, the display interface of the note task of the memo can still be displayed in the collaborative window for the user to use.

[0390] In the two embodiments of Scenario 2, the WeChat scanning task can also be used as an example for explanation. In these two embodiments, for the process of collaborative processing method of the WeChat scanning task, reference can be made to the process of the collaborative window processing method for the memo camera task, which will not be elaborated here. For the application scenario example diagram corresponding to the collaborative processing method of the WeChat scanning task, reference can continue to be made to Figures 11a to 11d , the difference is that: in Scenario 1, Figure 11c the discovery task display interface displayed in the collaborative window 1101 on the display interface of the tablet in is available for the user to operate, that is, each option in the discovery task display interface displayed in the collaborative window 1101 is available for the user to click and operate; in Scenario 2, Figure 11c after the collaborative window 1101 on the display interface of the tablet is frozen, although the discovery task display interface is displayed in the collaborative window 1101 on the display interface of the tablet, it is not available for the user to operate, and what is actually displayed is the screenshot image corresponding to the discovery task display interface. Exemplarily, each option in the discovery task display interface displayed in the screenshot image can be set to gray to prompt the user that it cannot be operated.

[0391] The steps executed by the electronic device 100 in the collaborative window processing method provided by the above embodiments of the present application can also be executed by a chip system included in the terminal electronic device. Among them, the chip system can include a processor and a Bluetooth chip. The chip system can be coupled to the memory, so that when the chip system runs, it calls the computer program stored in the memory to implement the steps executed by the above electronic device 100. Among them, the processor in the chip system can be an application processor or a processor other than an application processor.

[0392] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions run on an electronic device, the electronic device is caused to execute the above-related method steps to implement the collaborative window processing method in the above embodiment.

[0393] This embodiment also provides a computer program product. When the computer program product runs on a computer, the computer is caused to execute the above-related steps to implement the collaborative window processing method in the above embodiment.

[0394] In addition, an embodiment of the present application also provides a device, which may specifically be a chip, a component or a module. The device may include a processor and a memory connected to each other. The memory is used to store computer execution instructions. When the device runs, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the collaborative window processing method in the above method embodiments.

[0395] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be elaborated here.

[0396] Through the description of the above embodiments, those skilled in the art can understand that for the convenience and simplicity of description, only the above division of each functional module is used as an example. In actual applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0397] In several embodiments provided in the present application, it should be understood that the disclosed device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules or units is only a logical functional division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical, mechanical or other form.

[0398] The units described as separate components may or may not be physically separated. The components displayed as units may be one physical unit or multiple physical units, that is, they may be located in one place, or they may be distributed to multiple different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0399] In addition, in each embodiment of the present application, each functional unit can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0400] Any content of each embodiment of the present application, as well as any content of the same embodiment, can be freely combined. Any combination of the above is within the scope of the present application.

[0401] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions for causing a device (which can be a single-chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods in each embodiment of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.

[0402] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them belong to the protection scope of the present application.

[0403] The steps of the methods or algorithms described in connection with the disclosed content of the embodiments of the present application may be implemented in a hardware manner or by a processor executing software instructions. The software instructions may be composed of corresponding software modules, and the software modules may be stored in a random access memory (RAM), flash memory, read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), registers, hard disk, removable hard disk, CD-ROM, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium may also be a component of the processor. The processor and the storage medium may be located in an ASIC. Additionally, the ASIC may be located in a network device. Of course, the processor and the storage medium may also exist as discrete components in a network device.

[0404] Those skilled in the art should be able to realize that in one or more of the above examples, the functions described in the embodiments of the present application can be implemented by hardware, software, firmware, or any combination thereof. When implemented using software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. The computer-readable medium includes computer storage media and communication media, where the communication media includes any medium that facilitates the transfer of a computer program from one place to another. The storage medium can be any available medium accessible by a general-purpose or special-purpose computer.

[0405] The embodiments of the present application have been described above in conjunction with the accompanying drawings. However, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not restrictive. Under the inspiration of the present application, those of ordinary skill in the art can also make many forms without departing from the purpose of the present application and the scope protected by the claims, and all of them fall within the protection scope of the present application.

[0406] As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments or equivalently replace some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A collaborative window processing system, characterized in that, Comprising a first electronic device and a second electronic device, the second electronic device being wirelessly connected to the first electronic device; The first electronic device is configured to: Cast a screen to the second electronic device; The second electronic device is configured to: Display a first collaboration window and at least one second collaboration window on a display screen, wherein a target display interface is displayed on both the first collaboration window and the display screen of the first electronic device; a display interface of a target application in the first electronic device is displayed in the second collaboration window, and the target display interface is different from the display interface of the target application; In response to a click operation on a camera function option on the display interface of the second collaboration window, send a first indication message to the first electronic device, the first indication message being used to indicate to the first electronic device to start the camera; The first electronic device is configured to: In response to the received first indication message, display an interface of the camera capture information of the first electronic device on the display screen of the first electronic device, and cast a screen to make the interface of the camera capture information be displayed in the first collaboration window; In response to a target operation on the first electronic device, obtain an information capture result corresponding to the camera function option, restore the display interface on the display screen of the first electronic device to the target display interface, and cast a screen to make the display interface of the first collaboration window be restored to the target display interface, and make the display interface of the target application after obtaining the information capture result be displayed in the second collaboration window.

2. The system according to claim 1, characterized in that, When the camera function option is a shooting option, the interface of the camera capture information includes an interface of the camera capturing an image; the obtaining an information capture result corresponding to the camera function option in response to a target operation on the first electronic device, and casting a screen to make the display interface of the target application after obtaining the information capture result be displayed in the second collaboration window includes: In response to a click operation on the shooting option on the interface of the camera capturing an image, obtain a captured image, and cast a screen to make the display interface of the target application be displayed in the second collaboration window, and the display interface of the target application includes the captured image.

3. The system according to claim 2, wherein The obtaining a captured image in response to a click operation on the camera option on the interface of the camera capturing an image includes: In response to a click operation on the shooting option on the interface of the camera capturing an image, display a photo preview interface on the display screen of the first electronic device, and display the photo preview interface in the first collaboration window; In response to a click operation on the photo completion confirmation option on the photo preview interface, obtain a captured image.

4. The system according to claim 1, wherein When the camera function option is a scanning option, the obtaining an information capture result corresponding to the camera function option in response to a target operation on the first electronic device, and casting a screen to make the display interface of the target application after obtaining the information capture result be displayed in the second collaboration window includes: In response to a movement operation on the first electronic device, perform a scanning operation, obtain a scanning result, and perform screen mirroring to display the display interface of the target application in the second collaboration window, where the display interface of the target application includes a display interface corresponding to the scanning result.

5. The system according to claim 1, wherein Before sending the first indication information to the first electronic device in response to a click operation on the camera function option in the display interface of the second collaboration window, the second electronic device is further configured to: In response to at least one operation on the display interface of the second collaboration window, display a display interface including the camera function option in the second collaboration window.

6. The system according to claim 1, characterized in that The first electronic device is configured to: In response to the received first indication information, create a camera function task in the target application stack through the target application, and create a first temporary stack of the target application in a first extended screen in the screen buffer of the first electronic device; Wherein, the target application stack is set in the first extended screen, and the display interface of the first extended screen is displayed in the second collaboration window; Pop the camera function task out of the target application stack and push it into the first temporary stack of the target application; Change the first temporary stack of the target application from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display an interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device; Wherein, the display screen of the first electronic device and the first collaboration window display the display interface of the main screen; The first electronic device is configured to: Destroy the first temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

7. The system according to claim 1, characterized in that The first electronic device is configured to: In response to the received first indication information, create a camera function task in the target application stack through the target application; Wherein, the target application stack is set in a first extended screen in the screen buffer of the first electronic device, and the display interface of the first extended screen is displayed in the second collaboration window; Change the target application stack from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display an interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device; Wherein, the display screen of the first electronic device and the first collaboration window display the display interface of the main screen; The first electronic device is configured to: Destroy the camera function task in the target application stack, and restore the target application stack from being set in the main screen to being set in the first extended screen, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

8. The system according to claim 1, wherein The first electronic device is configured to: In response to the received first indication information, create a camera function task in the target application stack through the target application; The target application stack is set in a first extended screen in a screen buffer of the first electronic device, and a display interface of the first extended screen is displayed in the second collaborative window; Creating a second temporary stack of the target application in the main screen in the screen buffer of the first electronic device; Wherein, the display screen of the first electronic device and the first collaborative window display the display interface of the main screen; Popping the camera function task from the target application stack and pushing it into the second temporary stack of the target application, so as to realize an interface of displaying the camera acquisition information of the first electronic device on the display screen of the first electronic device; The first electronic device is used for: The second temporary stack of the target application is destroyed to restore the display interface on the display screen of the first electronic device to the target display interface.

9. The system according to claim 7 or 8, characterized in that, The first electronic device is further used for: After creating the camera function task in the target application stack, sending second indication information to the second electronic device, where the second indication information is used to instruct the second electronic device to freeze the display interface of the second collaborative window; The second electronic device is used for: In response to the received second indication information, a display interface of the second collaborative window is frozen.

10. The system according to claim 9, wherein The second electronic device is used for: In response to the received second indication information, taking a screenshot of the second collaborative window to obtain a screenshot image; The screenshot image is locked and displayed in the second collaborative window to freeze the display interface of the second collaborative window.

11. The system according to claim 9, characterized in that The second electronic device is used for: In response to the received second indication information, acquiring a display image sent by the first electronic device; wherein the display image is acquired by the first electronic device taking a screenshot of the first extended screen; The display image is locked and displayed in the second collaborative window to freeze the display interface of the second collaborative window.

12. The system according to claim 9, wherein The first electronic device is further used for: After acquiring the information collection result corresponding to the camera function option, sending third indication information to the second electronic device, wherein the third indication information is used to instruct the second electronic device to unfreeze the display interface of the second collaborative window; The second electronic device is used for: In response to the received third indication information, the display interface of the second collaborative window is unfrozen, and the display interface of the first extended screen is displayed in the second collaborative window.

13. The system according to claim 1, wherein The first electronic device includes a mobile phone, and the second electronic device includes a computer, a tablet, and a television.

14. A collaborative window processing method, characterized in that, include: The first electronic device projects the screen onto the second electronic device; The second electronic device displays a first collaborative window and at least one second collaborative window on a display screen, wherein a target display interface is displayed in the first collaborative window and on the display screen of the first electronic device; and a display interface of a target application in the first electronic device is displayed in the second collaborative window, and the target display interface is different from a display interface of the target application; The second electronic device sends first indication information to the first electronic device in response to a click operation on a camera function option on the display interface of the second collaboration window, where the first indication information is used to indicate to the first electronic device to activate the camera; In response to the received first indication information, the first electronic device displays an interface for the camera acquisition information of the first electronic device on the display screen of the first electronic device, and performs screen mirroring to display the interface for the camera acquisition information in the first collaboration window; In response to a target operation on the first electronic device, the first electronic device obtains an information acquisition result corresponding to the camera function option, restores the display interface on the display screen of the first electronic device to the target display interface, and performs screen mirroring to restore the display interface of the first collaboration window to the target display interface, so that the display interface obtained by the target application after obtaining the information acquisition result is displayed in the second collaboration window.

15. The method according to claim 14, wherein When the camera function option is a shooting option, the interface for the camera acquisition information includes an interface for the camera to acquire an image; in response to a target operation on the first electronic device, the first electronic device obtains an information acquisition result corresponding to the camera function option, and performs screen mirroring to display the display interface obtained by the target application after obtaining the information acquisition result in the second collaboration window, including: In response to a click operation on the shooting option on the interface for the camera to acquire an image, the first electronic device acquires a captured image, and performs screen mirroring to display the display interface of the target application in the second collaboration window, where the display interface of the target application includes the captured image.

16. The method according to claim 15, wherein In response to a click operation on the camera option on the interface for the camera acquisition information, the first electronic device acquires a captured image, including: In response to a click operation on the shooting option on the interface for the camera to acquire an image, the first electronic device displays a photo preview interface on the display screen of the first electronic device, and displays the photo preview interface in the first collaboration window; In response to a click operation on the photo completion confirmation option on the photo preview interface, the first electronic device acquires a captured image.

17. The method according to claim 14, wherein When the camera function option is a scanning option, in response to a target operation on the first electronic device, the first electronic device obtains an information acquisition result corresponding to the camera function option, and performs screen mirroring to display the display interface obtained by the target application after obtaining the information acquisition result in the second collaboration window, including: In response to a moving operation on the first electronic device, the first electronic device performs a scanning operation, obtains a scanning result, and performs screen mirroring to display the display interface of the target application in the second collaboration window, where the display interface of the target application includes a display interface corresponding to the scanning result.

18. The method according to claim 14, characterized in that, Before the second electronic device sends the first indication information to the first electronic device in response to a click operation on the camera function option on the display interface of the second collaboration window, it further includes: In response to at least one operation on the display interface of the second collaboration window, the second electronic device displays a display interface including the camera function option in the second collaboration window.

19. The method according to claim 14, wherein In response to the received first indication information, the first electronic device displays an interface for the camera acquisition information of the first electronic device on the display screen of the first electronic device, and performs screen mirroring to display the interface for the camera acquisition information in the first collaboration window, including: In response to the received first indication information, the first electronic device creates a camera function task in the target application stack through the target application, and creates a first temporary stack of the target application in the first extended screen in the screen buffer of the first electronic device; Wherein, the target application stack is set in the first extended screen, and the display interface of the first extended screen is displayed in the second collaboration window; The first electronic device pops the camera function task out of the target application stack and pushes it into the first temporary stack of the target application; The first electronic device changes the first temporary stack of the target application from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display an interface for the camera acquisition information of the first electronic device on the display screen of the first electronic device; Wherein, the display screen of the first electronic device and the first collaboration window display the display interface of the main screen; The first electronic device restores the display interface on the display screen of the first electronic device to the target display interface, including: The first electronic device destroys the first temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

20. The method according to claim 14, wherein In response to the received first indication information, the first electronic device displays an interface for the camera acquisition information of the first electronic device on the display screen of the first electronic device, and performs screen mirroring to display the interface for the camera acquisition information in the first collaboration window, including: The first electronic device, in response to the received first indication information, creates a camera function task in the target application stack through the target application; Wherein, the target application stack is set in the first extended screen in the screen buffer of the first electronic device, and the display interface of the first extended screen is displayed in the second collaboration window; The first electronic device changes the target application stack from being set in the first extended screen to being set in the main screen in the screen buffer of the first electronic device, so as to display an interface for the camera acquisition information of the first electronic device on the display screen of the first electronic device; Wherein, the display screen of the first electronic device and the first collaboration window display the display interface of the main screen; The first electronic device restores the display interface on the display screen of the first electronic device to the target display interface, including: The first electronic device destroys the camera function task in the target application stack and restores the target application stack from being set on the main screen to being set on the first extended screen, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

21. The method according to claim 14, characterized in that In response to the received first indication information, the first electronic device displays an interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device, and projects the screen so that the interface for collecting information of the camera is displayed in the first collaboration window, including: In response to the received first indication information, the first electronic device creates a camera function task in the target application stack through the target application; Wherein, the target application stack is set in the first extended screen in the screen buffer area of the first electronic device, and the display interface of the first extended screen is displayed in the second collaboration window; The first electronic device creates a second temporary stack of the target application in the main screen in the screen buffer area of the first electronic device; Wherein, the display interface of the main screen is displayed on the display screen of the first electronic device and in the first collaboration window; The first electronic device pops the camera function task out of the target application stack and pushes it into the second temporary stack of the target application, so as to display an interface for collecting information of the camera of the first electronic device on the display screen of the first electronic device; The first electronic device restores the display interface on the display screen of the first electronic device to the target display interface, including: The first electronic device destroys the second temporary stack of the target application, so as to restore the display interface on the display screen of the first electronic device to the target display interface.

22. The method according to claim 20 or 21, characterized in that, It further includes: After creating a camera function task in the target application stack, the first electronic device sends second indication information to the second electronic device, and the second indication information is used to instruct the second electronic device to freeze the display interface of the second collaboration window; In response to the received second indication information, the second electronic device freezes the display interface of the second collaboration window.

23. The method according to claim 22, characterized in that, In response to the received second indication information, the second electronic device freezes the display interface of the second collaboration window, including: In response to the received second indication information, the second electronic device takes a screenshot of the second collaboration window to obtain a screenshot image; The second electronic device locks and displays the screenshot image in the second collaboration window to freeze the display interface of the second collaboration window.

24. The method according to claim 22, characterized in that, In response to the received second indication information, the second electronic device freezes the display interface of the second collaboration window, including: In response to the received second indication information, the second electronic device obtains a display image sent by the first electronic device; wherein, the display image is obtained by the first electronic device taking a screenshot of the first extended screen; The second electronic device locks and displays the display image in the second collaboration window to freeze the display interface of the second collaboration window.

25. The method according to claim 22, characterized in that, It further includes: After acquiring the information collection result corresponding to the camera function option, the first electronic device sends third indication information to the second electronic device, where the third indication information is used to instruct the second electronic device to unfreeze the display interface of the second collaborative window; In response to the received third indication information, the second electronic device unfreezes the display interface of the second collaborative window and displays the display interface of the first extended screen in the second collaborative window.

26. The method according to claim 14, wherein The first electronic device includes a mobile phone, and the second electronic device includes a computer, a tablet, and a television.

27. An electronic device, characterized in that, include: a memory and a processor, the memory being coupled to the processor; The memory stores program instructions, and when the program instructions are executed by the processor, the electronic device executes the collaborative window processing method consisting of the method steps executed by the first electronic device in one of claims 14 to 26.

Images