Application window processing method, terminal device, server and storage medium
By configuring cloud applications corresponding to local applications in the cloud desktop and displaying local application windows when switching operation focus, the problem of delay-sensitive applications in cloud computing is solved, and smooth user experience and interactive optimization are achieved.
Patent Information
- Application Number
- CN202210520952.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-05-12
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2042-05-12
AI Technical Summary
In cloud computing, applications such as audio and video playback and audio and video conferencing that are sensitive to delays have lag problems on cloud desktops, affecting the user experience.
By deploying local applications on terminal devices and configuring corresponding cloud applications in cloud desktops, users can operate local applications by operating cloud applications on cloud desktops, using local resources to provide smooth services and optimize interactive experience. The specific implementation method includes displaying a window of a cloud application in the cloud desktop and displaying a window of a local application when switching focus, so that it covers the cloud application window, and the user can directly operate the local application.
It realizes the provision of smooth application services on the cloud desktop, optimizes the user experience, avoids application lag, and simplifies the switching process between local applications and cloud applications.
Smart Images

Figure CN114895824B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of cloud computing, and in particular to a method for processing an application window, a terminal device, a server, and a storage medium. Background Art
[0002] Cloud computing is a comprehensive service solution involving cloud resources, transmission protocols, cloud terminals and other technologies. Cloud computing mainly refers to the use of open cloud terminals through transmission protocols to provide desktops, applications, hardware and other resources to users in an on-demand and elastically allocated service model, which is conducive to the realization of single-machine multi-user.
[0003] Generally speaking, all applications in cloud computers run on the virtual desktop (i.e., cloud desktop) provided by the cloud server. The media data on the server is transmitted to the local terminal by using streaming technology, so that the application window can be presented in the local terminal. Since the server takes a certain amount of time to transmit media data, some applications on the cloud desktop that are sensitive to delays, such as audio and video playback, audio and video conferencing, etc., will experience obvious lags, affecting the user experience. Summary of the invention
[0004] The embodiment of the present application provides a method for processing an application window, a terminal device, a server, and a storage medium to solve the problems existing in the related technologies. The technical solution is as follows:
[0005] In a first aspect, an embodiment of the present application provides a method for processing an application window, including:
[0006] Displaying a window of the first cloud application in the cloud desktop, wherein a position of the window of the first cloud application corresponds to a position of the window of the first local application;
[0007] In response to the operation focus of the cloud desktop being switched to the first cloud application, the window of the first local application is displayed on the window of the first cloud application.
[0008] In a second aspect, an embodiment of the present application provides a method for processing an application window, including:
[0009] Sending a desktop data stream to a terminal device; wherein the desktop data stream is used by the terminal device to display a cloud desktop and display a window of a first cloud application in the cloud desktop, wherein the window position of the first cloud application corresponds to the window position of the first local application; and the terminal device is used to display the window of the first local application on the window of the first cloud application when the operation focus of the cloud desktop is switched to the first cloud application.
[0010] In a third aspect, an embodiment of the present application provides a terminal device, including:
[0011] A first cloud application processing module, configured to display a window of the first cloud application in the cloud desktop, wherein a position of the window of the first cloud application corresponds to a position of a window of the first local application;
[0012] The local application display module is used to display the window of the first local application on the window of the first cloud application in response to the operation focus of the cloud desktop being switched to the first cloud application.
[0013] In a fourth aspect, an embodiment of the present application provides a server, including:
[0014] The first sending module is used to send a desktop data stream to a terminal device; wherein the desktop data stream is used to display a cloud desktop and display a window of a first cloud application in the cloud desktop, and the window position of the first cloud application corresponds to the window position of a first local application of the terminal device; the terminal device is used to display the window of the first local application on the window of the first cloud application when the operation focus of the cloud desktop is switched to the first cloud application.
[0015] In a fifth aspect, an embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory, and the processor implements the method provided in any embodiment of the present application when executing the computer program.
[0016] In a sixth aspect, an embodiment of the present application provides a server, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor implements the method provided in any embodiment of the present application when executing the computer program.
[0017] In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the method provided in any embodiment of the present application is implemented.
[0018] According to the technical solution of the embodiment of the present application, the window of the first cloud application is displayed in the cloud desktop. The user can wake up the window of the first local application to display on the upper layer of the window of the first cloud application by putting the focus on the window of the first cloud application. Since the window position of the first cloud application corresponds to the window position of the first local application, the display effect at this time is to display the window of the first local application on the cloud desktop by covering the window of the first cloud application. The user can directly operate the first local application and experience the smooth service provided by the first local application through local resources. It can be seen that the embodiment of the present application configures the first cloud application corresponding to the first local application in the cloud desktop, so that the user can operate the first local application in the way of operating the cloud application on the cloud desktop, use local resources to provide smooth application services, and optimize the interactive experience.
[0019] The above summary is for illustrative purposes only and is not intended to be limiting in any way. In addition to the illustrative aspects, embodiments and features described above, further aspects, embodiments and features of the present application will be readily apparent by reference to the accompanying drawings and the following detailed description. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In the accompanying drawings, unless otherwise specified, the same reference numerals throughout the multiple drawings represent the same or similar parts or elements. These drawings are not necessarily drawn to scale. It should be understood that these drawings only depict some embodiments disclosed in the present application and should not be regarded as limiting the scope of the present application.
[0021] Figure 1 A schematic diagram of an application scenario of the method for processing an application window in an embodiment of the present application;
[0022] Figure 2 is a flowchart of a method for processing an application window according to an embodiment of the present application;
[0023] Figure 3 Schematic diagram of the display screen of the terminal device in the embodiment of the present application Figure 1 ;
[0024] Figure 4 Schematic diagram of the display screen of the terminal device in the embodiment of the present application Figure 2 ;
[0025] Figure 5 Schematic diagram of the display screen of the terminal device in the embodiment of the present application Figure 3 ;
[0026] Figure 6 is a flowchart of a method for processing an application window according to another embodiment of the present application;
[0027] Figure 7 An interactive flow chart of an application example of the method provided in an embodiment of the present application;
[0028] Figure 8 is a structural block diagram of a terminal device according to an embodiment of the present application;
[0029] Fig. 9 is a structural block diagram of a server according to an embodiment of the present application;
[0030] Fig.10 A structural block diagram of an electronic device for implementing the method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0031] In the following, only some exemplary embodiments are briefly described. As those skilled in the art will appreciate, the described embodiments may be modified in various ways without departing from the spirit or scope of the present application. Therefore, the drawings and descriptions are considered to be exemplary and non-restrictive in nature.
[0032] In order to more clearly demonstrate the application window processing method provided in the embodiment of the present application, an application scenario that can be used to implement the method is first introduced.
[0033] Figure 1 A schematic diagram of an exemplary application scenario of the method for processing application windows in an embodiment of the present application is shown. In this application scenario, the server deployed on the cloud can virtualize the host corresponding to the cloud desktop, including resources such as processor, memory, hard disk, etc., thereby reducing the configuration requirements for the terminal device used by the front end to interact with the user. For example, the front end can use a thin client to interact with the user. After the cloud desktop component is installed on the terminal device, the server can be accessed through a specific communication protocol. The server will send the desktop data stream corresponding to the cloud desktop to the terminal device. The cloud desktop component on the terminal device can present the cloud desktop based on the desktop data stream, so that the user can operate the cloud desktop on the terminal device, and the corresponding operation instructions will be sent to the server to enable the server to run the cloud desktop according to the instructions, so as to achieve a user experience consistent with operating a local computer.
[0034] Similar to local computers, multiple applications can also be deployed in cloud desktops, such as document editing applications, audio and video applications, and conference applications. Among them, for applications that are sensitive to latency, such as audio and video playback applications and video conferencing applications, the transmission of desktop data streams increases latency, which can easily cause lag. Based on this, you can consider deploying latency-sensitive applications on the local operating system of the terminal device and running these applications using the local resources of the terminal device. However, since the local applications and cloud desktops deployed on the local operating system of the terminal device are independent of each other, users will have very obvious experience problems when using local applications and cloud desktops. For example, the switching steps between cloud desktops and local applications are complicated; for another example, the window of the local application is either completely displayed on the upper layer of the cloud desktop or completely blocked by the screen of the cloud desktop.
[0035] Based on this, the embodiments of the present application propose a hybrid application interaction mode of end-cloud integration to break the independent management restrictions between local applications and cloud desktops and provide users with a better interactive experience. Figure 1, the application data of the local application is transmitted to the server, so as to synthesize the desktop data stream of the cloud desktop based on the application data on the server. The desktop data stream is sent to the terminal device, and the cloud desktop component of the terminal device can render the cloud desktop based on the desktop data stream. At the same time, the instructions on the cloud desktop can also be transmitted to the server and the local application.
[0036] In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present application.
[0037] Figure 2 A flowchart of a method for processing an application window according to an embodiment of the present application is shown. Optionally, the method may be executed by a terminal device, for example, by a cloud desktop component and / or a cloud application component in the terminal device, but is not limited thereto. Figure 2 As shown, the method may include:
[0038] S210, displaying a window of the first cloud application in the cloud desktop, wherein a position of the window of the first cloud application corresponds to a position of the window of the first local application;
[0039] S220: In response to the operation focus of the cloud desktop being switched to the first cloud application, displaying the window of the first local application on the window of the first cloud application.
[0040] In an embodiment of the present application, the first local application may include an application deployed on a local operating system of a terminal device and running based on resources of the terminal device. Optionally, the first local application may be an application that is sensitive to latency and is required when using a cloud desktop, such as an audio player application, a video player application, a conference application, etc. that needs to play audio and / or video.
[0041] In an embodiment of the present application, the first cloud application may be an application running on a server, which is used to simulate a first local application in a cloud desktop displayed on a terminal device. Exemplarily, the window position of the first cloud application corresponds to the window position of the first local application, which may mean that the window coordinates of the first cloud application are the same as the window coordinates of the first local application, or that the window of the first cloud application overlaps the window of the first local application. In this way, if the first local application is displayed on the cloud desktop, the window of the first local application covers the window of the first cloud application, and the user can perform interactive operations on the window of the first local application, or switch to other areas on the cloud desktop except the first cloud application to operate. If the cloud desktop is displayed on the first local application, the window of the first cloud application in the cloud desktop covers the window of the first local application, and the user can perform interactive operations on the cloud desktop.
[0042] Exemplarily, the cloud desktop component in the terminal device or the related component of the first local application can transmit the application data of the first local application to the server, so that the server determines the window position of the first cloud application based on the application data, determines the desktop data stream based on the window position of the first cloud application and the related data of other cloud applications, and sends the desktop data stream to the cloud desktop component. In this way, the cloud desktop component can render the first cloud application corresponding to the position of the first local application, and the window position and size of the first cloud application can be adjusted following the window of the first local application. Optionally, the application data of the first local application can include the window coordinates of the first local application.
[0043] Optionally, the application data of the first local application may include a window image of the first local application, and the window image of the first cloud application is determined based on the window image of the first local application, for example, the window of the first cloud application follows the window of the first local application to display the same screen content.
[0044] In the embodiment of the present application, the operation focus of the cloud desktop may refer to the application that can currently receive user input or is currently used to interact with the user. For example, when the user needs to operate an application on the cloud desktop, the user can move the mouse and click the window of the application, or click the shortcut key for switching focus on the keyboard to activate the input cursor in the window of the application, thereby switching the operation focus of the cloud interface to the application.
[0045] Generally speaking, when the operation focus of the cloud desktop is switched to the first cloud application, the cloud desktop is awakened to the foreground display of the terminal device, and in the cloud desktop, the first cloud application is also awakened to the foreground display, and the window of the first cloud application, as a window for interacting with the user, will not be covered by the windows of other cloud applications. In an embodiment of the present application, according to the above step S220, when the operation focus of the cloud desktop is switched to the first cloud application, the window of the first local application will also be displayed on the window of the first cloud application, that is, the window of the first local application will cover the window of the first cloud application for display, and the window of the first local application will be displayed in the foreground. For details, please refer to Figure 3 The display screen of the terminal device is shown. At this time, the user can see the window of the first local application and the windows of other applications in the cloud desktop, such as the second cloud application.
[0046] When the user operates on the window of the first local application, the first local application obtains the operation focus. Since the first local application runs based on local resources, the images it presents are native images rendered by the terminal device. Therefore, the user can obtain the most native local application operation experience with the highest efficiency. Figure 4The display screen of the terminal device shown can make the window of the first local application cover part or all of the cloud desktop by moving the window of the first local application or adjusting the window size of the first local application. At the same time, in the cloud desktop rendered by the terminal device based on the desktop data stream, the window of the first cloud application follows the window of the first local application to occupy part or all of the cloud desktop, but the window of the first cloud application is not visible.
[0047] It can be seen that the embodiment of the present application configures a first cloud application corresponding to the first local application in the cloud desktop, and when the operation focus is switched to the first cloud application, the first local application is displayed at the forefront, so that the user can wake up the first local application to the foreground by waking up the cloud application, use local resources to provide smooth application services, and optimize the interactive experience.
[0048] Optionally, in some exemplary embodiments, the above method may further include:
[0049] In response to the operation focus of the cloud desktop being switched to the second cloud application in the cloud desktop, the window of the first local application is placed in the background.
[0050] For example, in Figure 3 or Figure 4 In the display screen shown, the user can click the second cloud application in the cloud desktop when the window of the first local application is in the foreground, so that the operation focus of the cloud desktop is switched to the second cloud application. At this time, the cloud desktop is awakened to the foreground display of the terminal device, and the second cloud application is awakened to the foreground display in the cloud desktop. Figure 5 In the display screen shown, the window of the second cloud application is a window for interacting with the user and will not be covered by the windows of other cloud applications. According to the above exemplary implementation, when the operation focus of the cloud desktop is switched to the second cloud application in the cloud desktop, the window of the first local application will be placed in the background, and the cloud desktop will be displayed on the upper layer of the window of the first local application. Afterwards, the user can operate the window of the second cloud application, or switch the operation focus to the first cloud application, such as clicking on the first cloud application, to wake up the first local application to the foreground. Through such a processing method, when the first cloud application loses the operation focus, the first local application is not visible, but the first local application can still be re-awakened to the foreground on the cloud desktop, thereby realizing the switching of the first local application and other cloud applications on the cloud desktop, so that the interactive experience of the first local application is consistent with the interactive experience of the cloud application, and the application jams can be avoided when using the cloud desktop, and a good user experience is provided.
[0051] Optionally, in some exemplary embodiments, before step S210, displaying the window of the first cloud application in the cloud desktop, the method further includes:
[0052] In response to detecting a first user operation on a preset icon in the cloud desktop, a first cloud application and a first local application are started.
[0053] The preset icon is, for example, an icon of the first cloud application or other icons for redirecting to the first local application. The first user operation is, for example, an operation for starting an application, such as a single-click operation or a double-click operation. When the first user operation is detected, both the first cloud application and the first local application are started. After the first local application is started, the window of the first cloud application is adjusted following the window of the first local application.
[0054] Optionally, in some exemplary embodiments, the above step S210, displaying the window of the first cloud application in the cloud desktop, includes:
[0055] Sending a window image of a first local application to a server; wherein the window data of the first local application is used to determine a window image of a first cloud application in a cloud desktop, and the window image of the first cloud application is used to determine a desktop data stream of the cloud desktop;
[0056] Receive desktop data stream sent by the server;
[0057] Based on the desktop data stream, a cloud desktop is displayed and a window of a first cloud application is displayed in the cloud desktop.
[0058] According to the above exemplary implementation, the application data of the first local application sent by the terminal device to the server includes the window image of the first local application. The server determines the window image of the first cloud application based on the window image, and then synthesizes the desktop data stream based on the window image of the first cloud application. Finally, the terminal device displays based on the desktop data stream, and can display the cloud desktop and display the window of the first cloud application in the cloud desktop, and the window of the first cloud application follows the window of the first local application to display the corresponding image.
[0059] In this way, the window of the first cloud application can not only simulate the position and size of the window of the first local application, but also simulate the window image of the first local application. When the user places the window of the first local application in the background, the window of the first cloud application allows the user to capture information on the first local application in a timely manner.
[0060] Optionally, in some exemplary embodiments, the above method further comprises:
[0061] In response to detecting a second user operation on the cloud desktop, an instruction corresponding to the second user operation is sent to the server, so that the server forwards the instruction to the application component of the first local application.
[0062] Among them, the second user operation may include preset operations detected in any area on the cloud desktop, such as click, drag and other operations. For example, when a click operation is detected on a preset icon on the cloud desktop, the start instruction is forwarded to the application component of the first local application through the server to start the first local application. For another example, when a user operation of switching the operation focus to the second cloud application is detected on the cloud desktop, the focus switching instruction is forwarded to the application component of the first local application through the server, so that the first local application is placed in the background. For another example, when the first local application is placed in the background, a user operation of switching the operation focus to the first cloud application is detected on the first cloud application on the cloud desktop, and the corresponding instruction can be forwarded to the application component of the first local application through the server, so that the first local application is awakened to the foreground display.
[0063] Corresponding to the above method, the embodiment of the present application also provides a method for processing an application window executed by a server. Figure 6 As shown, the method may include:
[0064] S610. Send a desktop data stream to a terminal device; wherein the desktop data stream is used to display a cloud desktop and display a window of a first cloud application in the cloud desktop, and a window position of the first cloud application corresponds to a window position of a first local application.
[0065] The terminal device is used to display the window of the first local application on the window of the first cloud application when the operation focus of the cloud desktop is switched to the first cloud application.
[0066] Optionally, the method may further include:
[0067] Receiving a window image of a first local application sent by a terminal device;
[0068] Determine a window image of a first cloud application in the cloud desktop based on the window image of the first local application;
[0069] Based on the window image of the first cloud application, a desktop data stream is determined.
[0070] In actual applications, the above step of determining the window image of the first cloud application based on the window image of the first local application can be set according to application requirements.
[0071] Exemplarily, the server may obtain relevant information such as image size based on the window image of the first local application, determine the properties of the window of the first cloud application based on the relevant information, and then obtain the window image of the first cloud application based on the properties and the preset image. The server may also use the window image of the first local application as the window image of the first cloud application in the cloud desktop. The server may also compress the window image of the first local application to obtain the window image of the first cloud application.
[0072] Optionally, the method may further include:
[0073] Receiving an instruction sent by a cloud desktop component in a terminal device; wherein the instruction corresponds to a second user operation detected by the terminal device on the cloud desktop;
[0074] Send instructions to the local application component in the terminal device.
[0075] That is, when the cloud desktop component detects a second user operation on the cloud desktop, the server can forward the user operation instruction to the local application component for the cloud desktop component to provide the cloud desktop with the ability to wake up the first local application.
[0076] The various technical features in the above method can be implemented according to the specific technical details in the aforementioned embodiments, which will not be described in detail here.
[0077] In order to more clearly present the technical ideas of the present application, the interaction process involved in the above-mentioned method of the embodiment of the present application is described below through a specific application example.
[0078] Figure 7 The interactive flow chart of the application example is shown. Among them, the first cloud application runs on the cloud server and is used to create a corresponding window for rendering based on the received window image of the local application. The first cloud application can also be called a shadow application (ShadowApp).
[0079] like Figure 7 As shown in the figure, the interaction process on the cloud desktop includes:
[0080] 1. In the cloud desktop, click the icon of the redirected application (i.e. the preset icon mentioned above), the first cloud application will be started, and the local cloud application will be started. After that, the image of the local application will be transmitted to the cloud, and the cloud will create a window of the first cloud application and render it.
[0081] 2. If you click on the window of the first cloud application, the first cloud application will transmit instructions to the local application and wake up the local application to the foreground.
[0082] 3. If you click on the window of the second cloud application, instructions will be transmitted to the first cloud application and the first local application, and the first cloud application and the first local application will be placed in the background.
[0083] It can be seen that according to the method of the embodiment of the present application, a first cloud application corresponding to the first local application is configured in the cloud desktop, so that the user can operate the first local application in the same way as the cloud application on the cloud desktop, utilize local resources to provide smooth application services, and optimize the interactive experience.
[0084] As an implementation of the above methods, the present application embodiment also provides a terminal device, such as Figure 8 As shown, the terminal device may include:
[0085] A first cloud application processing module 810 is used to display a window of the first cloud application in the cloud desktop, wherein the window position of the first cloud application corresponds to the window position of the first local application;
[0086] The local application display module 820 is used to display the window of the first local application on the window of the first cloud application in response to the operation focus of the cloud desktop being switched to the first cloud application.
[0087] Optionally, the terminal device may further include:
[0088] The background processing module is used to place the window of the first local application in the background in response to the operation focus of the cloud desktop being switched to the second cloud application in the cloud desktop.
[0089] Optionally, the terminal device may further include:
[0090] The application startup module is used to start a first cloud application and a first local application in response to detecting a first user operation on a preset icon in the cloud desktop.
[0091] Optionally, the first cloud application processing module 810 may include:
[0092] A local image sending unit, configured to send a window image of a first local application to a server; wherein the window data of the first local application is used to determine a window image of a first cloud application in a cloud desktop, and the window image of the first cloud application is used to determine a desktop data stream of the cloud desktop;
[0093] A data stream receiving unit, used for receiving a desktop data stream sent by a server;
[0094] The cloud application display unit is used to display the cloud desktop and display the window of the first cloud application in the cloud desktop based on the desktop data stream.
[0095] Optionally, the terminal device may further include:
[0096] The instruction processing module is used to send an instruction corresponding to the second user operation to the server in response to detecting the second user operation on the cloud desktop, so that the server forwards the instruction to the application component of the first local application.
[0097] The present application also provides a server, such as Fig. 9 As shown, the server includes:
[0098] The first sending module 910 is used to send a desktop data stream to a terminal device; wherein the desktop data stream is used to display a cloud desktop and display a window of a first cloud application in the cloud desktop, and the window position of the first cloud application corresponds to the window position of a first local application of the terminal device; the terminal device is used to display the window of the first local application on the window of the first cloud application when the operation focus of the cloud desktop is switched to the first cloud application.
[0099] The technical details of each module in the above-mentioned terminal device or server can be implemented with reference to the aforementioned method embodiment and have the same beneficial effects, so they will not be repeated here.
[0100] The embodiment of the present application also provides an electronic device for implementing the above method. The electronic device is, for example, the above terminal device or server. Fig.10 FIG. 1 is a block diagram showing a structure of an electronic device according to an embodiment of the present application. Fig.10 As shown, the electronic device includes: a memory 1010 and a processor 1020, wherein the memory 1010 stores a computer program that can be run on the processor 1020. When the processor 1020 executes the computer program, the processing method of the application window in the above embodiment is implemented. The number of the memory 1010 and the processor 1020 can be one or more.
[0101] The electronic device also includes:
[0102] The communication interface 1030 is used to communicate with external devices and perform data exchange transmission.
[0103] If the memory 1010, the processor 1020 and the communication interface 1030 are implemented independently, the memory 1010, the processor 1020 and the communication interface 1030 can be connected to each other through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.10 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0104] Optionally, in a specific implementation, if the memory 1010, the processor 1020 and the communication interface 1030 are integrated on a chip, the memory 1010, the processor 1020 and the communication interface 1030 can communicate with each other through an internal interface.
[0105] An embodiment of the present application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the method provided in any embodiment of the present application.
[0106] An embodiment of the present application also provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the method provided in any embodiment of the present application is implemented.
[0107] An embodiment of the present application also provides a chip, which includes a processor for calling and executing instructions stored in the memory from the memory, so that a communication device equipped with the chip executes the method provided by the embodiment of the present application.
[0108] An embodiment of the present application also provides a chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method provided in the embodiment of the application.
[0109] It should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that the processor may be a processor supporting the Advanced RISC Machines (ARM) architecture.
[0110] Further, optionally, the above-mentioned memory may include a read-only memory and a random access memory, and may also include a non-volatile random access memory. The memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may include a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available. For example, static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (DR RAM).
[0111] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
[0112] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and the features of different embodiments or examples, unless they are contradictory.
[0113] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0114] Any process or method description in the flow chart or otherwise described herein can be understood to represent a module, fragment or portion of a code including one or more executable instructions for implementing the steps of a specific logical function or process. And the scope of the preferred embodiment of the present application includes other implementations, in which the functions may not be performed in the order shown or discussed, including in a substantially simultaneous manner or in a reverse order according to the functions involved.
[0115] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, which can be embodied in any computer-readable medium for use by an instruction execution system, apparatus or device (such as a computer-based system, a system including a processor or other system that can fetch instructions from an instruction execution system, apparatus or device and execute instructions), or used in combination with these instruction execution systems, apparatuses or devices.
[0116] It should be understood that the various parts of the present application can be implemented with hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented with software or firmware stored in a memory and executed by a suitable instruction execution system. All or part of the steps of the above embodiment method can be completed by instructing the relevant hardware through a program, which can be stored in a computer-readable storage medium, and when the program is executed, it includes one of the steps of the method embodiment or a combination thereof.
[0117] In addition, each functional unit in each embodiment of the present application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. If the above-mentioned integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The storage medium can be a read-only memory, a disk or an optical disk, etc.
[0118] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for processing an application window, comprising: Displaying a window of a first cloud application in a cloud desktop, wherein the window position of the first cloud application overlaps with the window of a first local application; the first cloud application is determined based on the application data of the first local application, and is used to simulate the first local application in the cloud desktop; the operation focus of the cloud desktop is generated based on user input or is currently used to interact with the user; sending a window image of the first local application to a server; wherein the window data of the first local application is used to determine the window image of the first cloud application in the cloud desktop, and the window image of the first cloud application is used to determine the desktop data stream of the cloud desktop; receiving the desktop data stream sent by the server; based on the desktop data stream, displaying the cloud desktop and displaying the window of the first cloud application in the cloud desktop; In response to the operation focus of the cloud desktop being switched to the first cloud application, displaying the window of the first local application on the window of the first cloud application; In response to the operation focus of the cloud desktop being switched to the second cloud application in the cloud desktop, the window of the first local application is placed in the background.
2. The method according to claim 1, wherein: Before displaying the window of the first cloud application in the cloud desktop, the method further includes: In response to detecting a first user operation on a preset icon in the cloud desktop, the first cloud application and the first local application are started.
3. The method according to any one of claims 1 to 2, wherein: The method further comprises: In response to detecting a second user operation on the cloud desktop, an instruction corresponding to the second user operation is sent to a server, so that the server forwards the instruction to an application component of the first local application.
4. A method for processing an application window, comprising: Sending a desktop data stream to a terminal device; wherein the desktop data stream is used to display a cloud desktop, and display a window of a first cloud application in the cloud desktop, and the window position of the first cloud application overlaps with the window of a first local application of the terminal device; the terminal device is used to display the window of the first local application on the window of the first cloud application when the operation focus of the cloud desktop is switched to the first cloud application; the first cloud application is determined based on the application data of the first local application, and is used to simulate the first local application in the cloud desktop; the operation focus of the cloud desktop is generated based on user input or is currently used to interact with the user; receiving a window image of the first local application sent by the terminal device; wherein the window data of the first local application is used to determine the window image of the first cloud application in the cloud desktop, and the window image of the first cloud application is used to determine the desktop data stream of the cloud desktop; In response to the operation focus of the cloud desktop being switched to the second cloud application in the cloud desktop, the window of the first local application is placed in the background.
5. The method according to claim 4, wherein: The method further comprises: Receiving a window image of the first local application sent by the terminal device; Determine a window image of a first cloud application in the cloud desktop based on the window image of the first local application; The desktop data stream is determined based on the window image of the first cloud application.
6. The method according to claim 4 or 5, wherein: The method further comprises: Receiving an instruction sent by a cloud desktop component in the terminal device; wherein the instruction corresponds to a second user operation detected by the terminal device on the cloud desktop; The instruction is sent to a local application component in the terminal device.
7. A terminal device, comprising: A first cloud application processing module is used to display a window of a first cloud application in a cloud desktop, wherein the window position of the first cloud application overlaps with the window of a first local application; the first cloud application is determined based on the application data of the first local application, and is used to simulate the first local application in the cloud desktop; the operation focus of the cloud desktop is generated based on user input or currently used to interact with the user; a window image of the first local application is sent to a server; wherein the window data of the first local application is used to determine the window image of the first cloud application in the cloud desktop, and the window image of the first cloud application is used to determine the desktop data stream of the cloud desktop; the desktop data stream sent by the server is received; based on the desktop data stream, the cloud desktop is displayed and the window of the first cloud application is displayed in the cloud desktop; a local application display module, configured to display a window of the first local application on a window of the first cloud application in response to the operation focus of the cloud desktop being switched to the first cloud application; The background processing module is used to place the window of the first local application in the background in response to the operation focus of the cloud desktop being switched to the second cloud application in the cloud desktop.
8. A server, comprising: A first sending module is used to send a desktop data stream to a terminal device; wherein the desktop data stream is used to display a cloud desktop and display a window of a first cloud application in the cloud desktop, and the window position of the first cloud application overlaps with the window of a first local application of the terminal device; the terminal device is used to display the window of the first local application on the window of the first cloud application when the operation focus of the cloud desktop is switched to the first cloud application; the first cloud application is determined based on the application data of the first local application and is used to simulate the first local application in the cloud desktop; the operation focus of the cloud desktop is generated based on user input or is currently used to interact with the user; receiving a window image of the first local application sent by the terminal device; wherein the window data of the first local application is used to determine the window image of the first cloud application in the cloud desktop, and the window image of the first cloud application is used to determine the desktop data stream of the cloud desktop; in response to the operation focus of the cloud desktop being switched to the second cloud application in the cloud desktop, placing the window of the first local application in the background.
9. A terminal device, comprising a memory, a processor, and a computer program stored in the memory, wherein the processor implements the method according to any one of claims 1 to 3 when executing the computer program.
10. A server, comprising a memory, a processor and a computer program stored in the memory, wherein the processor implements the method according to any one of claims 4 to 6 when executing the computer program.
11. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Redirection window control method and device, virtual machine and redirection system
CN108563479A
Mobile communication device based on virtual mobile infrastructure and related input method switching method thereof
CN109783165A
Fusion scheduling method and device
CN110413365A
Seamless connection method and system of local virtual desktop and remote virtual desktop
CN110769048A
Application program access method and device and communication system
CN111372115A
