Cloud desktop display

Abstract

Embodiments of the present disclosure provide a cloud desktop display method, device and system, a computer program product, and a storage medium. On a terminal device used by a user, dynamic creation of additional display windows outside a second display window that corresponds to a cloud desktop is supported; on this basis, when a target application is removed out of the cloud desktop, the target application can be separately streamed to an independent first display window, wherein the first display window is located outside the second display window; and the cloud desktop displayed in the second display window no longer comprises the application picture of the target application. In this way, the user can be supported to perform an application removing operation on some applications in the cloud desktop, a removed application can be displayed in an independent display window outside the cloud desktop, and the removed application is no longer affected by the obstruction of other applications in the cloud desktop.

Description

[0001] Cloud desktop display technology

[0002]

[0001] This disclosure relates to the field of cloud computing technology, and more particularly to cloud desktop display. Background Art

[0003]

[0002] Cloud desktop technology, also known as desktop virtualization or cloud computing, is a new mode that replaces traditional computers. Cloud desktop technology can provide virtualized cloud desktops, which users can display and interact with through terminal devices.

[0004]

[0003] Currently, in cloud desktops, application windows are typically displayed in a tiled or stacked manner, causing them to obscure each other. Due to the interaction principles of cloud desktops, users can only interact with the topmost application window, while there are interaction barriers with obscured application windows. This causes inconvenience for users. Summary of the Invention

[0005]

[0004] This disclosure provides a cloud desktop display method, device, system, computer program product, and storage medium to improve the interactivity of cloud desktops.

[0006]

[0005] This disclosure provides a cloud desktop display method applicable to terminal devices. The method includes: responding to a user's application removal operation on the cloud desktop, sending operation information to a cloud desktop server so that the cloud desktop server detects the application removal operation and issues a trigger command; creating a first display window for the removed target application according to the trigger command, the first display window being located outside a second display window for displaying the cloud desktop; receiving a first display stream constructed for the target application and a second display stream constructed for the cloud desktop by the cloud desktop server after detecting the application removal operation, wherein the application screen of the target application has been stopped in the cloud desktop; displaying the first display stream using the first display window; and displaying the second display stream using the second display window.

[0007]

[0006] This disclosure also provides a cloud desktop display method, applicable to a cloud desktop server. The method includes: in response to detecting that a user performs an application removal operation on a terminal device, stopping the provision of the application screen of the removed target application on the cloud desktop; issuing a trigger command to the terminal device to instruct the terminal device to create a first display window for the removed target application, the first display window being located outside a second display window for displaying the cloud desktop; and sending a first display stream constructed for the target application and a second display stream constructed for the cloud desktop to the terminal device, so that the terminal device can display the first display stream using the first display window and display the second display stream using the second display window.

[0008]

[0007] This disclosure also provides a cloud desktop display system, including a cloud desktop server and a terminal device; the terminal device and the cloud desktop server are used to execute the aforementioned cloud desktop display method.

[0009]

[0008] This disclosure also provides a cloud desktop server, including a memory, a processor, and a communication component; the memory is used to store one or more computer instructions; the processor is coupled to the memory and the communication component, and is used to execute the one or more computer instructions to execute the aforementioned cloud desktop display method.

[0009] This disclosure also provides a terminal device, including a memory, a processor, a communication component, and a display component; the memory is used to store one or more computer instructions; the processor is coupled to the memory, the communication component, and the display component, and is used to execute the one or more computer instructions to execute the aforementioned cloud desktop display method.

[0010]

[0010] This disclosure also provides a computer-readable storage medium for storing a computer program, which, when executed by one or more processors, causes the one or more processors to perform the aforementioned cloud desktop display method.

[0011]

[0011] This disclosure also provides a computer program product, including a computer program that, when executed by one or more processors, causes the one or more processors to perform the aforementioned cloud desktop display method.

[0012]

[0012] In this embodiment of the present disclosure, it is proposed that, on the terminal device used by the user, more display windows can be dynamically created outside the second display window corresponding to the cloud desktop. Based on this, after the target application is removed from the cloud desktop, the target application can be streamed to an independent first display window, which is located outside the second display window. Moreover, after the target application is removed, the application screen of the target application will stop being provided in the cloud desktop. Therefore, after the cloud desktop is streamed, the cloud desktop displayed in the second display window will no longer contain the application screen of the target application. In this way, it is possible to support users to perform application removal operations on some applications in the cloud desktop. The removed applications can be displayed in an independent display window outside the cloud desktop. The removed applications are no longer affected by the obstruction of other applications in the cloud desktop, but can be used as independent objects to support barrier-free interaction. This can provide users with a brand-new interaction mode, thereby effectively improving the interaction convenience of the cloud desktop. (See attached figures)

[0013]

[0013] The accompanying drawings, which are included to provide a further understanding of this disclosure and constitute a part of this disclosure, illustrate exemplary embodiments of the present disclosure and are used to explain the disclosure, but do not constitute an undue limitation of the disclosure. In the drawings:

[0014]

[0014] Figure 1 is a logical diagram of a traditional display solution for cloud desktops;

[0015]

[0015] Figure 2 is a schematic diagram of the structure of a cloud desktop display system provided in an exemplary embodiment of the present disclosure;

[0016]

[0016] Figure 3 is a flowchart illustrating a cloud desktop display method applicable to a cloud desktop server provided in an exemplary embodiment of this disclosure;

[0017]

[0017] Figure 4 is a schematic diagram of a cloud desktop screen in a cloud desktop server provided by an exemplary embodiment of the present disclosure;

[0018]

[0018] Figure 5 is a flowchart illustrating a cloud desktop display method applicable to a terminal device provided in an exemplary embodiment of this disclosure;

[0019]

[0019] Figure 6 is a schematic diagram of the cloud desktop display effect in a terminal device provided by an exemplary embodiment of the present disclosure;

[0020]

[0020] Figure 7 is a logical schematic diagram of an optional implementation provided by an exemplary embodiment of the present disclosure;

[0021]

[0021] Figure 8 is a schematic diagram of the display effect in a terminal device provided by an exemplary embodiment of the present disclosure;

[0022]

[0022] FIG9a is a schematic diagram of the structure of a cloud desktop server provided in another exemplary embodiment of the present disclosure;

[0023] Figure 9b is a schematic diagram of the structure of a terminal device provided in another exemplary embodiment of this disclosure. Detailed Description

[0023]

[0024] To make the objectives, technical solutions, and advantages of this disclosure clearer, the technical solutions of this disclosure will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0024]

[0025] Before proceeding with a detailed description of the technical solutions provided in the various embodiments of this disclosure, the following is a brief explanation of several technical concepts involved in this disclosure.

[0025]

[0026] Cloud desktop technology, also known as desktop virtualization or cloud computing, is a new alternative to traditional computers. It provides virtualized cloud desktops that users can display and interact with through their terminal devices.

[0026]

[0027] A cloud desktop is a computer desktop that runs on a cloud desktop server in cloud desktop technology. It should be understood that although the cloud desktop server does not display the cloud desktop image on a monitor, it has already constructed the cloud desktop image.

[0027]

[0028] Streaming technology is a data transmission technology used to support the display of the cloud desktop running on a cloud desktop server onto the user's terminal device. In streaming technology, the cloud desktop server can perform operations such as capturing, encoding, and compressing the cloud desktop's image to generate a display stream. After being transmitted over the network to the terminal device, the terminal device can render the cloud desktop's image through decompression and decoding operations.

[0028]

[0029] Cloud applications are applications that run in a cloud environment.

[0029]

[0030] Figure 1 is a logical diagram of a traditional display scheme for cloud desktops. As introduced in the background section, application windows in cloud desktops are typically tiled or stacked. Therefore, after streaming the cloud desktop, there may be occlusion issues between application windows displayed on the terminal device. Referring to Figure 1, applications A, B, and C are stacked. After streaming to the terminal device, in the cloud desktop displayed on the terminal device: application A occludes application B, and application B occludes application C. There are interaction barriers for the occluded application windows; users need to switch the occluded application window to the top layer before they can interact with it without obstruction. Referring to Figure 1, users can only interact with application A without obstruction. Interaction barriers exist for applications B and C. If a user wants to interact with application B, they need to switch application B's application window to the top layer to interact with it without obstruction. It is evident that traditional display solutions result in poor interactivity for cloud desktops.

[0030]

[0031] Therefore, this disclosure proposes a cloud desktop display solution to improve the interactivity of cloud desktops.

[0031]

[0032] The technical solutions provided by the embodiments of this disclosure are described in detail below with reference to the accompanying drawings.

[0032]

[0033] Figure 2 is a schematic diagram of a cloud desktop display system provided in an exemplary embodiment of this disclosure. Referring to Figure 2, in this embodiment, the cloud desktop system includes a cloud desktop server and a terminal device. The cloud desktop server provides the runtime environment for the cloud desktop to run. The terminal device is used by the user. Through the aforementioned streaming technology, the cloud desktop running on the cloud desktop server can be streamed to the terminal device for display. The user can interact with the cloud desktop in the corresponding display window to use it. Here, the interactive operations performed on the cloud desktop include interactive operations performed on the applications running on the cloud desktop.

[0033]

[0034] It is worth noting that, in this embodiment, the application running on the cloud desktop may include local applications on the cloud desktop server, or cloud applications accessed nested within the cloud desktop, without any limitation.

[0034]

[0035] In this embodiment, the processing logic on both the cloud desktop server and the terminal device has been modified to achieve a new cloud desktop display solution through the cooperation between the cloud desktop server and the terminal device. The technical solutions for the cloud desktop server and the terminal device will be described below. Cloud Desktop Server

[0035]

[0036] Figure 3 is a schematic flowchart illustrating a cloud desktop display method applicable to a cloud desktop server, provided by an exemplary embodiment of this disclosure. Referring to Figure 3, the method may include the following steps.

[0036]

[0037] Step 300: In response to detecting that the user has performed an application removal operation on the terminal device targeting the cloud desktop, stop providing the application screen of the removed target application on the cloud desktop.

[0037]

[0038] Step 301: Send a trigger command to the terminal device to instruct the terminal device to create a first display window for the target application that has been moved out. The first display window is located outside the second display window used to display the cloud desktop.

[0038]

[0039] Step 302: Send the first display stream built for the target application and the second display stream built for the cloud desktop to the terminal device, so that the terminal device can display the first display stream using the first display window and the second display stream using the second display window.

[0039]

[0040] In this embodiment, based on the communication protocol between the cloud desktop server and the terminal device, user operations on the terminal device can be mapped to the cloud desktop running on the cloud desktop server. For example, mouse operations initiated by the user can be mapped to the cloud desktop running on the cloud desktop server through techniques such as redirection. In this way, the cloud desktop server can monitor whether the user operations mapped from the terminal device are application removal operations. In one exemplary implementation: the cloud desktop server can monitor the operation information corresponding to the user operations mapped from the terminal device. If the operation information matches the characteristics of an application removal operation, then it is determined that an application removal operation has occurred on the cloud desktop. Here, the operation information may include, but is not limited to, operation types such as click or drag, the movement direction of the interactive touchpoint, the endpoint position of the interactive touchpoint, and the movement speed of the interactive touchpoint. For example, if the user operation on the terminal device corresponds to a drag-and-drop operation, and the interactive touchpoint has been moved out of the cloud desktop's screen area based on its endpoint position, direction, and speed, then the operation information of the user operation conforms to the characteristics of an application removal operation. Therefore, the cloud desktop server can determine that an application removal operation has occurred on the cloud desktop. In this embodiment, the interactive touchpoint can be a touch point corresponding to a touch operation or a cursor click point corresponding to a mouse operation, etc., and is not limited thereto.

[0040]

[0041] In this embodiment, the cloud desktop server can autonomously monitor application removal operations occurring in the cloud desktop through the aforementioned exemplary implementation method. However, it should be understood that the above implementation method is exemplary, and this embodiment does not limit the implementation method of the cloud desktop server monitoring whether application removal operations have occurred in the cloud desktop.

[0041]

[0042] Referring to Figures 2 and 3, in step 300, the cloud desktop server may, in response to detecting an application removal operation in the cloud desktop, stop displaying the target application that has been removed from the cloud desktop. It can be understood here that the target application is the application that the user wants to remove from the cloud desktop.

[0042]

[0043] In step 300, the display of the removed target application in the cloud desktop is stopped. This can be understood as the application screen corresponding to the target application no longer being included in the cloud desktop screen. Figure 4 is a schematic diagram of the cloud desktop screen in a cloud desktop server provided by an exemplary embodiment of this disclosure. Referring to Figure 4, after the cloud desktop server detects that application C has been removed from the cloud desktop, the cloud desktop server will no longer build the application screen of application C into the cloud desktop screen. Of course, applications A and B that have not been removed remain as they are in the cloud desktop screen.

[0043]

[0044] Referring again to Figure 3, step 301 proposes that a trigger command can be issued to the terminal device. This trigger command instructs the terminal device to create a first display window for the target application, wherein the first display window is located outside the second display window used to display the cloud desktop. The terminal device can respond to this trigger command by preparing the first display window for the target application.

[0044]

[0045] This embodiment proposes that, upon detecting an application removal operation, the cloud desktop server can construct a first display stream for the removed target application. It is worth noting that the streaming technology mentioned above can be used not only for streaming cloud desktops but also for streaming applications running on cloud desktops. An exemplary scheme for streaming a target application can be: capturing application frames at a preset frequency; and encoding the captured application frames to generate a first display stream. That is, the cloud desktop server can independently capture, encode, and perform compression and other operations mentioned above on the target application's screen to construct a first display stream for the target application.

[0045]

[0046] In this embodiment, the cloud desktop server continues the streaming process for the cloud desktop; that is, the cloud desktop server continues to build a second display stream for the cloud desktop. Thus, in this embodiment, after detecting an application removal operation from the cloud desktop, the cloud desktop server, in addition to continuing to build a second display stream for the cloud desktop, also additionally builds a first display stream for the removed target application.

[0046]

[0047] Based on this, referring to Figure 3, step 302 proposes that the cloud desktop server can send the first display stream built for the target application and the second display stream built for the cloud desktop to the terminal device, so that the terminal device can display the first display stream using the first display window and the second display stream using the second display window.

[0047]

[0048] Following the first and second display streams described above, in this embodiment, the cloud desktop server continues to send the second display stream constructed for the cloud desktop to the terminal device. Furthermore, it also sends the first display stream, separately constructed for the target application, to the terminal device. This embodiment further proposes that, in addition to providing a second display window for displaying the cloud desktop, the terminal device can also provide a dedicated first display window for the target application. Based on this, the second display stream remains displayed in the second display window, while the first display stream constructed for the target application in this embodiment is displayed separately in the first display window.

[0048]

[0049] It is worth emphasizing that the terminal device in this embodiment can support processing multiple display streams. Furthermore, in this embodiment, the streaming process of the target application does not affect the streaming process of the cloud desktop server on the cloud desktop. The two streaming processes can run in parallel without interference. However, it should be understood that after an application is removed from the cloud desktop, as mentioned earlier, the cloud desktop screen no longer contains the application screen of the removed target application. Therefore, after streaming the cloud desktop, the cloud desktop displayed on the terminal device will no longer contain the application screen of the target application. For example, referring to Figure 4, the cloud desktop server will construct a first display stream separately for the removed application C. The second display stream constructed by the cloud desktop server for the cloud desktop will no longer contain data related to the application screen of application C. Thus, the cloud desktop displayed on the terminal device will no longer contain the application screen of application C.

[0049]

[0050] Figure 5 is a flowchart illustrating a cloud desktop display method suitable for a terminal device according to an exemplary embodiment of this disclosure. Referring to Figure 5, the method may include the following steps.

[0050]

[0051] Step 500: In response to the user's application removal operation on the cloud desktop, send operation information to the cloud desktop server so that the cloud desktop server can detect the application removal operation and issue a trigger command.

[0051]

[0052] Step 501: Based on the trigger command, create a first display window for the target application that has been moved out. The first display window is located outside the second display window used to display the cloud desktop.

[0052]

[0053] Step 502: After the cloud desktop server detects the application removal operation, it receives the first display stream built for the target application and the second display stream built for the cloud desktop. The cloud desktop has stopped providing the application screen of the target application.

[0053]

[0054] Step 503: Display the first display stream using the first display window.

[0054]

[0055] Step 504: Display the second display stream using the second display window.

[0055]

[0056] In this embodiment, the terminal device can map the user operations that occur to the cloud desktop running on the cloud desktop server. Therefore, the user's application removal operation on the cloud desktop is also considered a user operation. In step 500, the terminal device will also send the operation information corresponding to this operation to the cloud desktop server so that the cloud desktop server can monitor whether an application removal operation has occurred on the cloud desktop based on the operation information.

[0056]

[0057] As mentioned earlier, after detecting an application removal operation, the cloud desktop can send a trigger command to the terminal device. This trigger command is used to instruct the terminal device to create a first display window for the target application that has been removed.

[0057]

[0058] Based on this, in step 501, after receiving such a trigger instruction, the terminal device can create a first display window for the target application that has been moved out.

[0058]

[0059] It is worth noting that in this embodiment, the terminal device already has a second display window for displaying the cloud desktop. In the cloud desktop display method provided in this embodiment, this second display window remains unchanged. However, this embodiment proposes that the terminal device can dynamically create a dedicated display window O for applications moved out of the cloud desktop, outside of the second display window.

[0059]

[0060] In this embodiment, the terminal device supports opening multiple display windows simultaneously within its operating system. This capability is a native feature of mainstream operating systems, and will not be discussed in detail here. In this embodiment, by utilizing this native capability of the terminal device's operating system, after the terminal device receives a trigger command from the cloud desktop server, it can promptly create a first display window for the target application being moved out.

[0060]

[0061] As described earlier regarding the technical logic of the cloud desktop server, the cloud desktop service continuously builds a second display stream for the cloud desktop. Furthermore, after detecting an application removal operation within the cloud desktop, the cloud desktop server also builds a first display stream for the removed target application. Based on this, referring to Figure 5, step 502 proposes that the terminal device can receive both the second display stream built by the cloud desktop server for the cloud desktop and the first display stream built by the cloud desktop server for the target application after detecting the application removal operation. Thus, the first display stream built by the cloud desktop server for the cloud desktop and the second display stream built for the target application can reach the terminal device independently. Since the cloud desktop server stops providing the target application's screen on the cloud desktop after detecting the application removal operation, the second display stream received by the terminal device in step 502 will no longer contain the display data corresponding to the target application's screen.

[0061]

[0062] Based on the aforementioned trigger command issued by the cloud desktop server to the terminal device, a first display window has been prepared on the terminal device for the target application that has been removed. A second display window is also maintained on the terminal device for the cloud desktop.

[0062]

[0063] Based on this, referring to Figure 5, steps 503 and 504 propose that the terminal device can display a first display stream using a first display window and a second display stream using a second display window. It can be understood that the first display window will display the application screen of the target application, while the second display window will display the cloud desktop screen, and the cloud desktop screen displayed in the second display window will no longer contain the application screen of the target application.

[0063]

[0064] Figure 6 is a schematic diagram of the cloud desktop display effect in a terminal device according to an exemplary embodiment of this disclosure. Referring to Figure 6, after application C is removed from the cloud desktop, the terminal device can respond to the trigger command issued by the cloud desktop server to create a new dedicated display window for application C (described as the first display window in Figure 6). The terminal device also provides a second display window for the cloud desktop. In this way, the terminal device can receive the second display stream constructed by the cloud desktop server for the cloud desktop and the first display stream constructed separately for application C. Based on the aforementioned streaming technology, the terminal device can display the application screen of application C in the first display window and the screen of the cloud desktop in the second display window. Referring to Figure 6, after application C is removed, the screen of the cloud desktop displayed by the terminal device in the second display window no longer contains the application screen of application C.

[0064]

[0065] Thus, in this embodiment, in the terminal device, the target application that has been removed from the cloud desktop can be displayed separately outside the second display window corresponding to the cloud desktop. The target application can become an interactive object parallel to the cloud desktop. The target application is no longer obscured by the applications that have not been removed from the cloud desktop, but can support barrier-free interaction with the user as an independent object.

[0065]

[0066] In addition, this embodiment also supports restoring the target application that has been removed to the cloud desktop. For example, a user can close the first display window of the target application on the terminal device. After detecting this closing operation, the cloud desktop server can re-provide the application screen of the target application on the cloud desktop; the cloud desktop server can also stop building the first display stream for the target application. The cloud desktop server can also send a restore command to the terminal device to trigger the terminal device to stop displaying the application screen of the target application in the first display window. In practical applications, after receiving the restore command, the terminal device can release (or destroy) the first display window created for the target application. The window resources released in the terminal device can be used for the display of other removed applications or for the display of local applications on the terminal device, so as to ensure the utilization rate of window resources in the terminal device.

[0066]

[0067] During their research, the inventors discovered that some terminal devices may not support displaying multiple windows simultaneously. To address this, in this embodiment, if a terminal device does not support displaying multiple windows simultaneously, it can return a failure response command to the cloud desktop server after receiving the aforementioned trigger command. Upon receiving this failure response command, the cloud desktop server can refuse to remove the target application from the cloud desktop. In this way, the cloud desktop server will no longer execute the aforementioned steps to stop providing the application screen of the removed target application in the cloud desktop and subsequent operations. The target application will remain in its original position in the cloud desktop before the application removal operation, and the cloud desktop screen displayed in the second display window on the terminal device will also include the application screen of the target application.

[0067]

[0068] Furthermore, in this embodiment, when the terminal device supports displaying multiple display windows simultaneously, a mode selection function can be added to the cloud desktop. Based on this, the terminal device can respond to a user's mode selection operation on the cloud desktop by sending operation information to the cloud desktop server. Similarly, the cloud desktop server can detect the mode selection operation based on the operation information. If the cloud desktop server determines, based on the operation information, that the mode selection operation indicates permission to respond to the application removal operation, it can cooperate with the terminal device according to the cloud desktop display method provided in this embodiment to display the removed target application in an independent display window outside the cloud desktop. Conversely, if the cloud desktop server determines, based on the operation information, that the mode selection operation indicates permission not to respond to the application removal operation, it can, as described above, refuse to remove the target application from the cloud desktop even if an application removal operation is detected.

[0068]

[0069] In summary, this embodiment supports dynamically creating more display windows outside the second display window corresponding to the cloud desktop on the user's terminal device side. Based on this, after the target application is removed from the cloud desktop, it can be streamed to an independent first display window, which is located outside the second display window. Furthermore, after the target application is removed, its application screen will cease to be displayed on the cloud desktop. Therefore, after streaming the cloud desktop, the target application's application screen will no longer be included in the cloud desktop displayed in the second display window. This allows for the use of `f` to perform application removal operations on some applications in the cloud desktop. The removed applications can be displayed in an independent display window outside the cloud desktop, and are no longer affected by obstruction from other applications in the cloud desktop. Instead, they can function as independent objects supporting barrier-free interaction, providing users with a completely new interaction mode and effectively improving the convenience of cloud desktop interaction.

[0069]

[0070] In the above or below embodiments, the cloud desktop server can adopt various implementation methods to promptly stop providing the application screen of the target application that has been removed from the cloud desktop.

[0070]

[0071] Figure 7 is a logical schematic diagram of an optional implementation of an exemplary embodiment of this disclosure. Referring to Figure 7, in this optional implementation: after detecting the aforementioned application removal operation, the cloud desktop server can create a dedicated desktop for the target application outside the cloud desktop; the target application is moved from the cloud desktop to the dedicated desktop to stop providing the application screen of the target application in the cloud desktop.

[0071]

[0072] It should be understood that in this optional implementation, the cloud desktop server's operating system supports running multiple desktops simultaneously. This is a native capability of mainstream operating systems, and we will not elaborate on this native capability here. This optional implementation utilizes this native capability of the cloud desktop server's operating system. Based on this, after detecting an application removal operation in the cloud desktop, the cloud desktop server can create a dedicated desktop for the removed target application. The dedicated desktop mentioned here, like the cloud desktop itself, is also a virtualized cloud desktop. In this optional implementation, the dedicated desktop is mainly used to provide the application screen of the target application. Therefore, in practical applications, the cloud desktop server can allocate a small amount of hardware resources to the dedicated desktop, just enough to ensure that the dedicated desktop can provide the application screen of the target application.

[0072]

[0073] In this optional implementation, moving the target application from the cloud desktop to a dedicated desktop can be understood as the dedicated desktop generating the application screen for the target application, while the cloud desktop no longer performs this task. It should be understood that in this optional implementation, there is no need to switch the target application's running location; that is, the target application can remain running in its original location. For example, if the target application is a local application on the cloud desktop server, it still runs on the cloud desktop server; if the target application is a cloud application nested within a cloud desktop, it still runs on its original cloud server.

[0073]

[0074] Furthermore, in this optional implementation, the cloud desktop server can utilize the desktop management interface provided by its operating system to create dedicated desktops for the target application. As mentioned earlier, the cloud desktop server's operating system has the native ability to run multiple desktops simultaneously. This native ability is achieved through the desktop management interface. The specific name of the desktop management interface may differ depending on the operating system; no example is provided here. The desktop management interface can be understood as an interface used to create and release desktops. Additionally, in this optional implementation, the cloud desktop server can utilize a cloud desktop server running on its operating system to move the target application from the cloud desktop to the dedicated desktop. Here, the cloud desktop server is a program component deployed on the cloud desktop server for cloud desktop management. A cloud desktop client, also a program component, is deployed on the terminal device. The cloud desktop server and cloud desktop client can communicate using the cloud desktop communication protocol to achieve cloud desktop functionality. In this optional implementation, the cloud desktop server in the cloud desktop server, in addition to managing the original cloud desktops, also has the authority to manage dedicated desktops created within the cloud desktop server. In this way, the cloud desktop server can easily control which desktop created by the cloud desktop server provides the application screen of the target application, thereby supporting the migration of the target application from the cloud desktop to a dedicated desktop.

[0074]

[0075] In another optional implementation: The cloud desktop server can minimize the target application within the cloud desktop to stop providing the target application's screen on the cloud desktop. In this optional implementation, after detecting an application removal operation on the cloud desktop, the cloud desktop server can trigger a minimize operation on the application window containing the target application within the cloud desktop to minimize the target application. It should be understood that after minimizing the target application, the cloud desktop will no longer provide the target application's screen. It is worth noting that in this optional implementation, the cloud desktop server will still generate the application screen corresponding to the target application, but it will not build the target application's screen into the cloud desktop's screen. This ensures that the cloud desktop server can subsequently build a second-display TF stream based on the target application's screen.

[0075]

[0076] It is worth noting that the two implementation methods described above are optional. In this embodiment, the cloud desktop server can also use other implementation methods to stop providing the application screen of the removed target application in the cloud desktop. For example, after detecting an application removal operation in the cloud desktop, the cloud desktop server can create other types of screen carriers for the removed target application, instead of being limited to the aforementioned dedicated desktop screen carrier. For example, a container instance can be created for the target application, which can have the function of generating application screens for the target application. Other implementation methods will not be described in more detail here.

[0076]

[0077] Accordingly, in this embodiment, after detecting an application removal operation in the cloud desktop, the cloud desktop server can employ various implementation methods to stop providing the application screen of the removed target application in the cloud desktop. This ensures that after the target application is removed, the cloud desktop running on the cloud desktop server will no longer contain the application screen of the removed application. Consequently, the terminal device will not experience the problem of repeated display of the removed application. Thus, while ensuring display accuracy, the display flexibility of applications running in the cloud desktop can be improved, providing users with a new interaction mode.

[0077]

[0078] In the above or below embodiments, various implementation methods can be used to create a first display window for the removed target application.

[0078]

[0079] In one optional implementation: The cloud desktop server can generate window requirement information for the target application based on the detected application removal operation. This window requirement information describes the positional requirement for the first display window. Based on this, the cloud desktop server can send this window requirement information to the terminal device. For example, the window requirement information can be included in the aforementioned trigger command; alternatively, it can be sent separately, without limitation. For the terminal device, it can determine the second display position corresponding to the first display window based on the window requirement information and the first display position corresponding to the second display window.

[0079]

[0080] The window requirement information may include, but is not limited to, the direction in which the target application moves out relative to the cloud desktop, window specifications, and the required window spacing or layout within the interactive view. For example, the moving direction can be calculated based on the operation information of the application moving out operation mentioned above. It should be understood that the moving direction can represent the movement trend of the target application. As mentioned earlier, the terminal device maintains a second display window; therefore, the first display position corresponding to the second display window is known to the terminal device. Based on this, the terminal device can determine the second display position for the first display window according to the aforementioned moving direction provided by the cloud desktop server. An exemplary position determination strategy could be: the cloud desktop server can use quadrant numbers to represent the moving direction. To this end, the cloud desktop server can determine the quadrant number of the moving direction in the coordinate system set for the cloud desktop, and the terminal device can determine the display orientation of the first display window relative to the second display window based on the pre-agreed correspondence between the quadrant numbers and display orientations with the cloud desktop server, thereby determining the corresponding second display position for the first display window. The correspondence between quadrant numbers and display orientations can be such that the display orientations corresponding to quadrants 1 and 2 are left quadrants. That is, if the cloud desktop server indicates that the target application moves out in quadrant 1, the terminal device can determine the display orientation of the first display window as: the left quadrant of the second display window. No further examples are given here, and the position determination strategy in this embodiment is not limited to this.

[0080]

[0081] Preferably, in this embodiment, the terminal device can support virtual reality interaction, and the terminal device can be based on virtual reality (VR), augmented reality (AR), or mixed reality technologies.

[0081] Mixed Reality (MR) or Extended Reality (XR) technologies provide an interactive field of view to the user. For example, the terminal device can be a head-mounted device. As mentioned above, the operating system of the terminal device in this embodiment has the native ability to provide multiple display windows simultaneously. Based on this, when a terminal device is used, multiple display windows can be provided simultaneously in the interactive field of view provided by the terminal device, and the multiple display windows can present a stereoscopic surround or tiled display layout.

[0082]

[0082] Based on this, following the above optional implementation, if the terminal device supports virtual reality interaction, the first display position of the second display window in the interactive field of view provided by the terminal device can be obtained; according to the first display position and the moving direction included in the window requirement information, the second display position of the first display window in the interactive field of view can be determined. The inventors discovered during their research that the display windows provided in the interactive field of view provided by the terminal device usually have regular window spacing. Therefore, in addition to using the moving direction and the first display position of the second display window in the interactive field of view as a basis, the window spacing required in the interactive field of view included in the window requirement information can also be introduced as a basis to determine the second display position of the first display window in the interactive field of view.

[0083]

[0083] Further, in this optional implementation, the terminal device can employ spatial computing technology to create a first display window for the target application, so as to better support the interaction between the user and the target application. Spatial computing involves the interaction of the user in three-dimensional space, the simulation of the physical environment, and the integration of virtual objects with the real world environment. Spatial computing is a technology that enables computers to understand the physical world and, based on this, to seamlessly integrate the real world and the digital world. The "space" in spatial computing can be understood as the physical space of the real world in which we live. Spatial computing is essentially based on calculations in real space. All the virtual images seen by the user through the terminal device can be understood as a higher-quality "layer" "overlaid" on the real world. For the technical logic of spatial computing to be self-consistent, the premise is that the image effect of the virtual space must reach the precision of the human eye. This precision depends on the fineness of the real images captured by the camera and sensors. Here, the first display window and the second display window in this embodiment are part of the image content in the virtual space.

[0084]

[0084] During the research process, the inventors discovered that the interactive field of view provided by the terminal device supports various window specifications and has a set layout method. Based on this, in this optional implementation, it is further proposed that: the cloud desktop server can also indicate the window specifications corresponding to the target application to the terminal device in the window requirement information, and the terminal device can determine the second display position for the first display window in the interactive field of view according to the window specifications, the direction of movement, the first display position, and the window spacing and layout method required in the interactive field of view. That is, the window specifications of the target application and the layout method adopted by the interactive field of view are further introduced as the basis to determine the second display position of the first display window in the interactive field of view. Among them, the layout method adopted by the interactive field of view may include, but is not limited to, a three-dimensional wraparound layout or a tiled layout.

[0085]

[0085] FIG8 is a schematic diagram of the display effect in a terminal device provided by an exemplary embodiment of the present disclosure. Referring to FIG8, the terminal device supports virtual reality interaction, and the interactive field of view provided by the terminal device adopts a stereoscopic surround layout. Referring to FIG8, the second display window in FIG8 is used to display the cloud desktop. After application A is moved out of the cloud desktop, the cloud desktop server can provide the terminal device with the moving direction of application A relative to the cloud desktop. The terminal device can determine the position of the display window for application A that needs to be created on the left side of the second display window according to the moving direction. The cloud desktop server can also provide the terminal device with the window specifications required by application A. In this way, the terminal device can determine the position of the display window for application A according to the moving direction, the required window spacing in the interactive field of view, the display position of the first display window in the interactive field of view, and the window specifications required by application A. Referring to Figure 8, the display window created by the terminal device for application A is located to the left of the second display window. The window size is adapted to application A (meaning it can be understood as being able to display the application screen of application A in full screen). The display window created for application A and the second display window present a three-dimensional wraparound layout. Similarly, referring to Figure 8, after application C is moved off the cloud desktop, the terminal device also creates a dedicated display window for application C. Referring to Figure 8, the display window created by the terminal device for application C is located to the right of the second display window. The window size is adapted to application C. The display window created for application A, the display window created for application C, and the second display window present a three-dimensional wraparound layout.

[0086]

[0086] Thus, although the cloud desktop running in the cloud desktop server is still in a planar interaction mode, the cloud desktop can be streamed onto multiple display windows provided by the terminal device through the cloud desktop display scheme provided in this embodiment, forming a three-dimensional interactive form, thereby greatly improving the user experience.

[0087]

[0087] It should be understood that the above implementation is optional. In this embodiment, other methods can also be used to create a first display window for the removed target application, and it is not limited to this. For example, the terminal device can randomly select a display position outside the second display window and create a first display window at that display position. No further examples of implementation methods will be given here.

[0088]

[0088] Moreover, in this embodiment, users can adjust the first display window and the second display window in the terminal device, including but not limited to adjustments in position and size, so as to improve the display flexibility of the cloud desktop and target application in the terminal device, thereby improving the interactive convenience of the cloud desktop.

[0089]

[0089] Accordingly, in this embodiment, the cloud desktop server can trigger the terminal device to create a first display window for the target application. The cloud desktop server can provide the terminal device with the basis for determining the display position of the first display window as needed, such as the aforementioned movement direction and window specifications. The terminal device can determine a suitable display position for the first display window by combining its own window layout requirements and the relevant basis provided by the cloud desktop server, so that the first display window created in the terminal device conforms to the user's visual habits. Moreover, it is preferable to use the terminal device as the terminal device in this embodiment. In this way, based on the layout provided in the interactive field of view of the terminal device, the second display window used to display the cloud desktop and the first display window created for the moved target application can be arranged in a three-dimensional surround or tiled layout, thereby providing the user with an interactive experience in three-dimensional space, which can further improve the interactive convenience of the cloud desktop.

[0090]

[0090] In the above or the following embodiments, the cloud desktop server and the terminal device can also cooperate with each other to achieve independent interaction between the cloud desktop and the moved-out applications.

[0091]

[0091] In this embodiment, based on the display results achieved in the foregoing embodiments, the user can initiate interactive operations on the first display window and the second display window in the terminal device. The interactive operation on the first display window is the interactive operation on the target application that has been moved out, while the interactive operation on the second display window can be understood as the interactive operation with the cloud desktop.

[0092]

[0092] Based on this, the terminal device can respond to the interactive operation performed by the user in the first display window, generate interactive data for the target application, and send the interactive data to the cloud desktop server.

[0093] For cloud desktop servers, the interaction position on the target application's screen can be determined based on the interaction data and the dedicated coordinate system maintained for the target application, so as to respond to the interaction.

[0093]

[0094] It is understood that in this embodiment, coordinate systems are maintained separately for the cloud desktop and the target application. This allows the cloud desktop server to distinguish the required coordinate system after the user's interactive operations on the terminal device are mapped to it. In one exemplary solution, the terminal device can carry the identifier of the display window where the interactive operation occurs in the interactive data. The cloud desktop server can maintain the identifier of the display window where the cloud desktop is located, as well as the identifiers of the display windows of each application removed from the cloud desktop. Thus, the cloud desktop server can distinguish the interactive object targeted by the interactive operation based on the identifiers of the display windows carried in the interactive data. It should be understood that here, the interactive object can be the cloud desktop or an application removed from the cloud desktop. As mentioned earlier, the removed application becomes an interactive object parallel to the cloud desktop.

[0094]

[0095] Based on this, the cloud desktop server can determine the interactive object executed by the interactive operation and use the coordinate system maintained for the interactive object to determine the corresponding interactive position on the interactive object. Furthermore, based on the determined interactive position, the cloud desktop server can locate the control to be operated on on the interactive object. These controls may include, but are not limited to, buttons, dialog boxes, input boxes, and progress bars, etc., without further examples. It should be understood that the interaction data also includes information such as the operation type. Combining the various information in the interaction data with the aforementioned determined interactive position, the cloud desktop server can complete the response to the interactive operation.

[0095]

[0096] In this embodiment, the interactive operation can be a mouse operation, a keyboard operation, or a touch operation, etc., and no specific limitation is made on the interaction method.

[0096]

[0097] Accordingly, in this embodiment, the cloud desktop server and the terminal device can cooperate with each other to support users to perform independent interactive operations on the cloud desktop and applications removed from the cloud desktop. This makes the applications removed from the cloud desktop independent interactive objects, no longer affected by the obstruction of other applications in the cloud desktop, thereby effectively improving the interactive convenience of the cloud desktop.

[0097]

[0098] It should be noted that some processes described in the above embodiments and accompanying drawings include multiple operations that appear in a specific order. However, it should be clearly understood that these operations may not be executed in the order they appear in this document, or they may be executed in parallel. The operation numbers, such as 101, 102, etc., are merely used to distinguish different operations, and the numbers themselves do not represent any execution order. Furthermore, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should also be noted that the terms "first," "second," etc., used in this document are used to distinguish different display streams, display windows, display positions, etc., and do not represent a sequential order, nor do they limit "first" and "second" to different types.

[0098]

[0099] Figure 9a is a schematic diagram of the structure of a cloud desktop server provided in another exemplary embodiment of the present disclosure. As shown in Figure 9a, the cloud desktop server may include: a memory 80, a processor 81, and a communication component 82.

[0099]

[0100] Processor 81, coupled to memory 80 and communication component 82, is configured to execute a computer program in memory 80 for: in response to detecting a user's application removal operation for a cloud desktop on a terminal device, stopping the provision of the application screen of the removed target application in the cloud desktop; issuing a trigger command to the terminal device to instruct the terminal device to create a first display window for the removed target application, the first display window being located outside a second display window for displaying the cloud desktop; and sending a first display stream constructed for the target application and a second display stream constructed for the cloud desktop to the terminal device, so that the terminal device can display the first display stream using the first display window and the second display stream using the second display window.

[0100]

[0101] In an optional embodiment, when the processor 81 stops providing the application screen of the removed target application in the cloud desktop, it may specifically be configured to: create a dedicated desktop for the target application outside the cloud desktop; move the target application from the cloud desktop to the dedicated desktop, so as to stop providing the application screen of the target application in the cloud desktop.

[0101]

[0102] In an optional embodiment, when the processor 81 stops providing the application screen of the removed target application in the cloud desktop, it may specifically be configured to: minimize the target application in the cloud desktop to stop providing the application screen of the target application in the cloud desktop.

[0102]

[0103] In an optional embodiment, the processor 81 may further be configured to: generate window requirement information for the target application based on the application removal operation, the window requirement information describing the position requirement for the first display window; and provide the window requirement information to the terminal device so that the terminal device can determine the display position for the first display window according to the window requirement information.

[0103]

[0104] In an optional embodiment, the processor 81 may further be configured to: receive interaction data for the target application provided by the terminal device, the interaction data being generated by the user performing an interaction operation in the first display window; determine the interaction position corresponding to the interaction operation on the application screen of the target application according to the interaction data and a dedicated coordinate system maintained for the target application, so as to respond to the interaction operation.

[0104]

[0105] In an optional embodiment, the processor 81 may also be configured to: if it receives a response failure instruction returned by the terminal device in response to the trigger instruction when the terminal device does not support displaying multiple display windows simultaneously, then refuse to remove the target application from the cloud desktop, so as to stop providing the application screen and subsequent operations of the removed target application in the cloud desktop.

[0105]

[0106] Furthermore, as shown in Figure 9a, the cloud desktop server also includes other components such as a power supply component 83. Figure 9a only schematically shows some of the components and does not imply that the cloud desktop server only includes the components shown in Figure 9a.

[0106]

[0107] It is worth noting that the technical details of the above embodiments of the cloud desktop server can be found in the relevant descriptions of the cloud desktop server in the foregoing system embodiments. To save space, they will not be repeated here, but this should not cause any loss to the scope of protection of this disclosure.

[0107]

[0108] Figure 9b is a schematic diagram of the structure of a terminal device provided in another exemplary embodiment of the present disclosure. As shown in Figure 9b, the terminal device may include: a memory 90, a processor 91, a communication component 92, and a display component 93.

[0108]

[0109] Processor 91, coupled to memory 90, communication component 92, and display component 93, is configured to execute a computer program in memory 90 for: responding to a user's application removal operation on the cloud desktop, sending operation information to the cloud desktop server so that the cloud desktop server detects the application removal operation and issues a trigger command; creating a first display window for the removed target application through display component 93 according to the trigger command, the first display window being located outside a second display window for displaying the cloud desktop; receiving, through communication component 92, a first display stream constructed for the target application and a second display stream constructed for the cloud desktop after the cloud desktop server detects the application removal operation, wherein the application screen of the target application has been stopped in the cloud desktop; displaying the first display stream through the first display window through display component 93; and displaying the second display stream through the second display window through display component 93.

[0109]

[0110] In one optional embodiment, when the processor 91 creates a first display window for the removed target application outside the second display window used to display the cloud desktop, it may specifically be configured to: receive window requirement information provided by the cloud desktop server, the window requirement information describing the position requirement for the first display window; determine a second display position for the first display window that meets the position requirement based on the window requirement information and a first display position corresponding to the second display window; and create the first display window at the second display position.

[0110]

[0111] In one optional embodiment, if the terminal device supports virtual reality interaction, when the processor 91 determines a second display position that meets the position requirements for the first display window based on the window requirement information and the first display position corresponding to the second display window, it can specifically be used to: obtain the first display position corresponding to the second display window in the interactive field of view provided by the terminal device; and determine the second display position for the first display window in the interactive field of view based on the first display position and the target application's movement direction relative to the cloud desktop, window size, required window spacing and / or layout method contained in the window requirement information.

[0111]

[0112] In one optional embodiment, the layout in the interactive field of view adopts a three-dimensional surround layout.

[0112]

[0113] In an optional embodiment, the processor 91 may further be used to: generate interactive data for the target application in response to an interactive operation performed by the user in the first display window; and send the interactive data to the cloud desktop server so that the cloud desktop server can determine the interactive position corresponding to the interactive operation on the application screen of the target application according to the interactive data and a dedicated coordinate system maintained for the target application, so as to respond to the interactive operation.

[0113]

[0114] In an optional embodiment, the processor 91 can also be used to: upon receiving the trigger instruction, if the terminal device does not support displaying multiple display windows simultaneously, send a response failure instruction to the cloud desktop server so that the cloud desktop server refuses to remove the target application from the cloud desktop.

[0114]

[0115] Furthermore, as shown in Figure 9b, the terminal device may also include other components such as a power supply component 94 and an audio component 95. Figure 9 only schematically shows some components and does not imply that the terminal device only includes the components shown in Figure 9b.

[0115]

[0116] It is worth noting that the technical details of the various embodiments of the terminal device described above can be found in the relevant descriptions of the terminal device in the foregoing system embodiments. To save space, they will not be repeated here, but this should not cause any loss to the scope of protection of this disclosure.

[0116]

[0117] Accordingly, this disclosure also provides a computer-readable storage medium storing a computer program, which, when executed, can implement the steps in the above method embodiments.

[0117]

[0118] Accordingly, this disclosure also provides a computer program product, wherein the computer program contained herein, when executed, can implement the steps in the above method embodiments.

[0118]

[0119] The memory shown in Figures 9a and 9b is used to store computer programs and can be configured to store various other data to support operation on the computing platform. Examples of this data include instructions for any application or method operating on the computing platform, contact data, phone book data, messages, pictures, videos, etc. The memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory.

[0119] (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, disk or optical disk.

[0120]

[0120] The communication components in Figures 9a and 9b described above are configured to facilitate wired or wireless communication between the device containing the communication component and other devices. The device containing the communication component can access wireless networks based on communication standards, such as WiFi, 2G, 3G, 4G / LTE, 5G, and other mobile communication networks, or combinations thereof. In one exemplary embodiment, the communication component receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component further includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra-Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0121]

[0121] The display component in Figure 9b may include a screen, which may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may not only sense the boundaries of the touch or swipe action, but also detect the duration and pressure associated with the touch or swipe operation.

[0122]

[0122] The power supply components in Figures 9a and 9b provide power to various components of the device in which the power supply components are located. The power supply components may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device in which the power supply components are located.

[0123]

[0123] The audio component in Figure 9b can be configured to output and / or receive audio signals. For example, the audio component includes a microphone (MIC) configured to receive external audio signals when the device containing the audio component is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals can be further stored in memory or transmitted via a communication component. In some embodiments, the audio component also includes a speaker for outputting audio signals.

[0124]

[0124] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, systems, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0125]

[0125] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.

[0126]

[0126] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0127]

[0127] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0128]

[0128] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0129]

[0129] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0130]

[0130] The above description is merely an embodiment of this disclosure and is not intended to limit this disclosure. Various modifications and variations can be made to this disclosure by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

Claims 1. A cloud desktop display method, applicable to terminal devices, the method comprising: In response to a user's application removal operation on the cloud desktop, an operation information is sent to the cloud desktop server so that the cloud desktop server can detect the application removal operation and issue a trigger command. According to the trigger command, a first display window is created for the removed target application. The first display window is located outside the second display window used to display the cloud desktop. The system receives the first display stream constructed for the target application and the second display stream constructed for the cloud desktop after the cloud desktop server detects the application removal operation. The application screen of the target application has stopped being provided in the cloud desktop. The first display stream is displayed using the first display window; the second display stream is displayed using the second display window.

2. The method according to claim 1, wherein, In addition to the second display window used to display the cloud desktop, a first display window is created for the target application that has been removed, including: receiving window requirement information provided by the cloud desktop server, the window requirement information describing the position requirement for the first display window; determining a second display position for the first display window that meets the position requirement based on the window requirement information and a first display position corresponding to the second display window; and creating the first display window at the second display position.

3. The method according to claim 2, wherein, Based on the window requirement information and the first display position corresponding to the second display window, a second display position that meets the position requirement is determined for the first display window, including: if the terminal device supports virtual reality interaction, obtaining the first display position corresponding to the second display window in the interactive field of view provided by the terminal device; and determining the second display position for the first display window in the interactive field of view based on the first display position and the target application's movement direction relative to the cloud desktop, window size, required window spacing and / or layout method contained in the window requirement information.

4. The method according to claim 3, wherein, The layout in the interactive field of view adopts a three-dimensional surround layout.

5. The method according to claim 1, further comprising: In response to the user's interactive operation in the first display window, interactive data for the target application is generated; The interaction data is sent to the cloud desktop server, so that the cloud desktop server can determine the interaction position of the interaction operation on the application screen of the target application according to the interaction data and the dedicated coordinate system maintained for the target application, so as to respond to the interaction operation.

6. The method according to claim 1, further comprising: Upon receiving the trigger command, if the terminal device does not support displaying multiple display windows simultaneously, it will send a command to the terminal device. The cloud desktop server issues a failure response command so that it refuses to remove the target application from the cloud desktop.

7. A cloud desktop display method, applicable to a cloud desktop server, the method comprising: In response to detecting that a user has performed an application removal operation on the cloud desktop on the terminal device, the application screen of the removed target application is stopped from being displayed on the cloud desktop; A trigger command is sent to the terminal device to instruct the terminal device to create a first display window for the target application that has been removed. The first display window is located outside the second display window used to display the cloud desktop. The first display stream constructed for the target application and the second display stream constructed for the cloud desktop are sent to the terminal device, so that the terminal device can display the first display stream using the first display window and the second display stream using the second display window.

8. The method according to claim 7, wherein, Stopping the display of the target application that has been removed from the cloud desktop includes: creating a dedicated desktop for the target application outside the cloud desktop; and moving the target application from the cloud desktop to the dedicated desktop to stop the display of the target application's display in the cloud desktop.

9. The method according to claim 7, wherein, Stopping the display of the target application being removed from the cloud desktop includes: minimizing the target application in the cloud desktop to stop the display of the target application's display in the cloud desktop.

10. The method according to claim 7, further comprising: Based on the application removal operation, window requirement information is generated for the target application, and the window requirement information is used to describe the position requirement for the first display window; The window requirement information is provided to the terminal device so that the terminal device can determine the display position of the first display window according to the window requirement information.

11. The method according to claim 7, further comprising: The terminal device receives interactive data for the target application, the interactive data being generated by the user performing interactive operations in the first display window; Based on the interaction data and the dedicated coordinate system maintained for the target application, determine the interaction position on the application screen of the target application corresponding to the interaction operation, in order to respond to the interaction operation.

12. The method according to claim 7, further comprising: If the terminal device receives a response failure instruction in response to the trigger command when it does not support displaying multiple display windows simultaneously, then the target application will not be removed from the cloud desktop, and the application screen and subsequent operations of the removed target application will no longer be executed on the cloud desktop.

13. A cloud desktop display system, comprising a cloud desktop server and a terminal device; the terminal device is used to execute the cloud desktop display method according to any one of claims 1-6; the cloud desktop server is used to execute the cloud desktop display method according to any one of claims 7-12.

14. A cloud desktop server, comprising a memory, a processor, and a communication component; the memory being used to store one or more computer instructions; the processor being coupled to the memory and the communication component, and being used to execute the one or more computer instructions to perform the cloud desktop display method according to any one of claims 7-12.

15. A terminal device, comprising a memory, a processor, a communication component, and a display component; the memory being used to store one or more computer instructions; the processor being coupled to the memory, the communication component, and the display component, and being used to execute the one or more computer instructions to perform the cloud desktop display method according to any one of claims 1-6.

16. A computer-readable storage medium for storing a computer program, wherein, When the computer program is executed by one or more processors, the one or more processors are caused to perform the cloud desktop display method according to any one of claims 1-12.

17. A computer program product, comprising a computer program, wherein, When the computer program is executed by one or more processors, the one or more processors are caused to perform the cloud desktop display method according to any one of claims 1-12.

Images