A key event processing method, device, control device and readable storage medium

By processing and transmitting key events on the cloud desktop, the problem that the cloud desktop overlays the local application window cannot receive key events, and the cross-process delivery and unified processing of key events are realized, improving the user experience.

CN114840351BActive Publication Date: 2024-11-29ALIBABA (CHINA) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210271131.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-18
Publication Date
2024-11-29
Estimated Expiration
2042-03-18

AI Technical Summary

Technical Problem

The local application window covered by the cloud desktop cannot receive the system's key events, resulting in poor user experience.

Method used

By responding to the user's input key events on the cloud desktop, it is stored in the key processing queue, and after the cloud desktop application determines that the event is a local application event, it is transmitted to the target local application for processing, breaking the isolation between the cloud desktop and the local application state.

Benefits of technology

The local application window covering the cloud desktop can receive the system's key events, improve the user experience, and uniformly handle the key logic between different cloud desktops and local applications, which is suitable for cross-process key event processing across engine environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114840351B_ABST
    Figure CN114840351B_ABST
Patent Text Reader

Abstract

The present application provides a key event processing method, device, control device and readable storage medium, the method comprising: in response to a key event input by a user on a displayed cloud desktop, processing the key event through a cloud desktop application, and storing the key event in a key processing queue; the key event is sent by the user by operating the area displayed on the cloud desktop; in response to a consumption instruction returned by the cloud desktop application, consuming the key event in the key processing queue and transmitting it to a target local application associated with the key event. In this way, the isolation between the cloud desktop application and other local applications is broken, so that the local application window covered by the cloud desktop can receive the system's key events and enter a normal working state.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of cloud computing technology, and in particular to a key event processing method, apparatus, control device and readable storage medium. Background Art

[0002] Cloud desktop is a new model that replaces traditional computers by virtualizing the processor, memory, hard disk and other components contained in the computer host. By installing the local application of cloud desktop on the terminal, you can use cloud desktop and various cloud applications on cloud desktop. However, due to limitations such as data transmission, the actual use effect of some cloud applications is poor compared with local applications, and it is necessary to use cloud desktop in combination with local applications.

[0003] However, different local applications are isolated from each other. When the cloud desktop covers another local application window, the local application window at the bottom cannot receive the system's key events. Summary of the invention

[0004] The problem that this application solves is that the local application window covered by the cloud desktop cannot receive the system's key events.

[0005] To solve the above problems, the first aspect of the present application provides a key event processing method, comprising:

[0006] In response to a key event input by a user on a displayed cloud desktop, the key event is processed by a cloud desktop application, and the key event is stored in a key processing queue; the key event is sent by the user by operating an area displayed on the cloud desktop;

[0007] In response to the consumption instruction returned by the cloud desktop application, the key event in the key processing queue is consumed and transmitted to the target local application associated with the key event.

[0008] A second aspect of the present application provides a key event processing device, which includes:

[0009] A key storage module, which is used to respond to a key event input by a user on the displayed cloud desktop, process the key event through the cloud desktop application, and store the key event in a key processing queue; the key event is sent by the user by operating the area displayed on the cloud desktop;

[0010] A key consumption module is used to consume the key events in the key processing queue in response to the consumption instructions returned by the cloud desktop application, and transmit them to the target local application associated with the key events.

[0011] A third aspect of the present application provides a control device, comprising: a memory and a processor;

[0012] The memory is used to store programs;

[0013] The processor, coupled to the memory, is configured to execute the program to:

[0014] In response to a key event input by a user on a displayed cloud desktop, the key event is processed by a cloud desktop application, and the key event is stored in a key processing queue; the key event is sent by the user by operating an area displayed on the cloud desktop;

[0015] In response to the consumption instruction returned by the cloud desktop application, the key event in the key processing queue is consumed and transmitted to the target local application associated with the key event.

[0016] A fourth aspect of the present application provides a computer-readable storage medium on which a computer program is stored, and the program is executed by a processor to implement the key event processing method described above.

[0017] In this application, a key processing queue is set to temporarily store key events. After the cloud desktop application determines that the key event is a key event of other local applications, the key event is transmitted to the associated local application for processing, breaking the isolation between the cloud desktop application and other local applications, so that the local application window covered by the cloud desktop can receive the system's key events and enter normal working state.

[0018] The key event processing method in this application can uniformly process the key logic between different cloud desktop applications and other local applications, break the limitations of application management, and improve the user experience. This method can be applied to cross-engine environments and cross-process key event processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a schematic diagram of a key event processing method according to the present application;

[0020] Figure 2 is a flowchart of a key event processing method according to an embodiment of the present application;

[0021] Figure 3 is a flowchart of a key event processing method according to another embodiment of the present application;

[0022] Figure 4 This is an example where the target local application window and the cloud application window on the cloud desktop are independent of each other;

[0023] Figure 5 This is an example where the window of a target local application on a cloud desktop is blocked by the window of a cloud application;

[0024] Figure 6 An example of covering a window of a cloud application for a window of a target local application on a cloud desktop;

[0025] Figure 7 is a structural block diagram of a key event processing device according to an embodiment of the present application;

[0026] Figure 8 4 is a structural block diagram of a control device according to an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific embodiments of the present application are described in detail below in conjunction with the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0028] It should be noted that, unless otherwise specified, the technical terms or scientific terms used in this application should have the common meanings understood by technicians in the field to which this application belongs.

[0029] Local applications are isolated from each other. The key logic of traditional local applications can only be transmitted between windows of a single local application. When one local application window covers another local application window, the underlying local application window cannot receive the system's key events.

[0030] The cloud desktop application is a local application, but during the specific operation of the cloud desktop application, the actual processing of its content is completed through the cloud. After opening the cloud desktop application, the cloud desktop will cover the windows of all local applications. In this way, the local applications at the bottom cannot receive the system's key events; nor can they respond to any operations of key events.

[0031] Although there are many cloud applications on the cloud desktop, due to limitations such as data transmission, some functions of cloud applications have poorer performance than local applications. For example, DingTalk's video and conference functions require a large amount of data transmission due to the requirements of clarity and real-time performance. When using DingTalk in the cloud desktop for video or conference, its clarity and latency are poorer than those of the local DingTalk.

[0032] In order to solve this problem, it is necessary to use some local applications when using the cloud desktop. However, due to the mutual isolation of local applications, the above solution cannot be implemented.

[0033] In response to the above problems, the present application provides a new key interaction solution that can uniformly process the key logic between cloud desktop applications and other local applications, breaking the limitations of application management.

[0034] For ease of understanding, the following terms that may be used are explained here:

[0035] Application redirection: A technology that uses redirection technology to redirect local applications to the cloud.

[0036] The present application embodiment provides a key event processing method, which can be executed by a key event processing device, and the key event processing device can be integrated in electronic devices such as pads, computers, servers, computers, server clusters, data centers, etc. Figure 2 Combination Figure 1 As shown, it is a flowchart of a key event processing method according to an embodiment of the present application; wherein the key event processing method includes:

[0037] S200, in response to a key event input by a user on a displayed cloud desktop, processing the key event by a cloud desktop application, and storing the key event in a key processing queue; the key event is sent by the user by operating an area displayed on the cloud desktop;

[0038] Among them, in the processing of the key event by the cloud desktop application, when the key event is an operation on a cloud application on the cloud desktop or an operation on a blank area on the cloud desktop, the cloud desktop application returns a non-consumption instruction; when the key event is an operation on a local application, the cloud desktop application returns a consumption instruction.

[0039] S300, in response to the consumption instruction returned by the cloud desktop application, consume the key event in the key processing queue and transmit it to the target local application associated with the key event.

[0040] When a user needs to operate a local application or a cloud application on a cloud desktop, the user operates on the cloud desktop with a mouse or keyboard, generating a key event. After a key event is generated, it will be processed by the cloud desktop application on the one hand, and stored in the key processing queue on the other hand; the cloud desktop application processes the key event and obtains a processing result in the form of an instruction; if the key event is an operation on a cloud application on the cloud desktop or an operation on a blank area on the cloud desktop, the processing result is a non-consumption instruction; if the key event is an operation on a local application, the processing result is a consumption instruction.

[0041] In another embodiment, the key event is not generated by the user operating the cloud desktop through a mouse or keyboard, but by the user operating the cloud desktop by touching or sliding the touch screen; it can also be generated by the user operating the cloud desktop through voice control of voice software, or by another user operating the cloud desktop through remote operation. It can be understood that any user's operation on the cloud desktop can generate a key event. The specific operation method is not limited in this application.

[0042] After receiving the consumption instruction, the key processing queue will directly consume the associated key event and transmit it to the local application associated with the key event, that is, the target local application, which will process the key event.

[0043] Specifically, the consumption of the key events in the key processing queue is to transmit the key events outward and pop the key events from the key processing queue; the non-consumption instruction is to not transmit the key events and directly pop them from the key processing queue.

[0044] In this way, by setting up a key processing queue to temporarily store key events, after the cloud desktop application determines that the key event is a key event of other local applications, the key event is transmitted to the associated local application for processing, breaking the isolation between the cloud desktop application and other local applications, so that the local application window covered by the cloud desktop can receive the system's key events and enter normal working state.

[0045] The present application embodiment provides another key event processing method, which is similar to the key event processing method described above, except that the method further includes:

[0046] S400, in response to a non-consumption instruction returned by the cloud desktop application, popping the key event from the key processing queue.

[0047] The cloud desktop contains the display area of ​​the target local application, the display area of ​​the cloud application and other areas. The key events generated by clicking on the above different areas are operations on the target local application, cloud application and other areas (blank areas) respectively; among them, operations on other areas are generally regarded as invalid operations. Operations and invalid operations on cloud applications are operations within the cloud desktop application and can be processed normally by the cloud desktop application. The specific processing process will not be repeated here.

[0048] The click operations on the display area and other areas of the cloud application are not operations on other local applications. There is no need to transmit the key events stored in the key processing queue. They can be directly popped out from the key processing queue. Therefore, the cloud desktop application returns a non-consumption instruction corresponding to directly popping out the key event.

[0049] The embodiment of the present application provides another key event processing method, which is similar to the key event processing method described above, except that before responding to the key event input by the user on the displayed cloud desktop, the method further includes:

[0050] S100, redirecting the target local application to the cloud desktop.

[0051] The system includes multiple local applications, among which the target local application can be the one that needs to be opened when the cloud desktop application is executed.

[0052] In one implementation, the target local application is determined according to the usage scenario requirements. For example, in an application scenario where video is required, local applications such as DingTalk and **Video are used as target local applications; in an application scenario where music is required, local applications such as Tiantian*Ying and **Music are used as target local applications.

[0053] In another embodiment, a local application list is set, and if the local application is in the local application list, it is used as the target local application, and if the local application is not in the local application list, it is used as a common local application.

[0054] Specifically, when the cloud desktop application is opened, the information of the currently opened local application and the local application list are obtained. If the currently opened local application is recorded in the local application list, it is used as the target local application.

[0055] In addition, if a local application has advantages over the corresponding cloud application on the cloud desktop in some aspects such as video, audio, display, timbre, fluency, etc., the application can be recorded in the local application list.

[0056] By redirecting the target local application to the cloud desktop, the target local application can be displayed on the cloud desktop, and the user can operate the target local application according to the window of the target local application displayed on the cloud desktop.

[0057] In one embodiment, Figure 3 As shown, the S100, redirecting the target local application to the cloud desktop, includes:

[0058] S101, obtaining window parameters of a target local application;

[0059] S102: Setting a target area associated with the window on the cloud desktop according to the window parameters, and displaying the window in the target area.

[0060] A window management module is provided in the system, through which windows opened by local applications are managed; through the window management module, window parameters of the target local application can be obtained.

[0061] After the window parameters of the target local application are obtained on the cloud desktop according to step S101, a target area for displaying the window of the target local application may be set on the cloud desktop.

[0062] By setting the target area, an association relationship is established between the target area and the window displaying the target local application. In this way, after the user clicks on the target area to generate a key event, the information in the key event can be directly associated with the target local application. The association relationship can exist in the form of a mapping table, a mapping formula or other forms. The specific form is not limited in this application.

[0063] For example, the location information of the event is set in the key event, and when the key event in the key processing queue is transmitted, the target local application associated with the location information is directly determined through the association relationship and transmitted to the target local application.

[0064] In one implementation, the S100 of redirecting the target local application to the cloud desktop further includes:

[0065] S103: Adjust the level of the target area on the cloud desktop.

[0066] Different levels are set on the cloud desktop. Specifically, the levels may include a first level for corresponding cloud applications, a second level for corresponding target local applications, and a third level for corresponding other areas. After a key event is generated, the cloud desktop application can process the key event according to the level to obtain a corresponding processing result.

[0067] In another embodiment, the levels may include only a second level corresponding to the target local application and a first level corresponding to the cloud application or other areas; it may also include more than three levels, such as for multiple cloud applications, each cloud application is set with a level; the specific level setting is not limited in this application.

[0068] Set the levels, and then perform unified operations on one or more of the levels, for example, perform unified operations on the second level corresponding to the target local application. When the window of the target local application changes, you only need to adjust the level of the changed window part to achieve the adjustment effect.

[0069] Set the level, and then you can directly get the processing result according to the level of the key event, shortening the processing time of the key event.

[0070] In one implementation, the window is displayed in the target area by setting the target area as a transparent area.

[0071] Directly setting the target area as a transparent area can display the lower layer window on the cloud desktop through the transparent area, and the user can operate at the corresponding position of the window through the window displayed in the transparent area to generate a key event. The specific implementation method of setting the target area as a transparent area is not repeated here.

[0072] After obtaining the window parameters of the target local application through the system's window management module, the window parameters are uploaded to the cloud desktop. Combined with the correspondence between the cloud desktop and the local desktop, the area corresponding to the window on the cloud desktop is determined, and the area is set as the target area. The target area is set as a transparent area and the level is changed.

[0073] Specifically, the window parameters include window size parameters and window position parameters.

[0074] In another embodiment, the window is displayed in the target area by displaying a dotted line of the window in the target area. This method of displaying the window by dotted lines can retain the uniformity of the color and pattern of the cloud desktop itself, but the text and pattern content of a certain size in the window is displayed more fuzzy.

[0075] In one implementation, there are multiple target local applications, and the multiple target local applications can be simultaneously displayed on the cloud desktop for the user to operate.

[0076] The display of the target local application on the cloud desktop can be to display its window, or to display its application icon and its icon in the taskbar at the same time under the premise of displaying the window; for the target local application, it has a corresponding window only when it is opened, so the target local application displayed on the cloud desktop must be the activated target local application. In this application, operations on the unactivated target local application are meaningless operations and are not elaborated in this application.

[0077] When there are multiple target local applications, they are displayed as multiple windows stacked together on the local desktop system, where the window on the top is the currently displayed window. The display of multiple target local applications on the cloud desktop can be to display only the window of the current target local application, or to display the windows of all target local applications, or to display the windows of some target local applications. The selection of the specific displayed windows is not limited in this application.

[0078] When the window of the target local application is displayed on the cloud desktop, at least one window of the cloud application will also be displayed. When the window of the target local application partially overlaps with the window of the cloud application, it can be stipulated that the window of the target local application blocks the window of the cloud application, or it can be stipulated that the window of the cloud application blocks the window of the target local application, or it can be stipulated that among the windows of the target local application and the windows of the cloud application, the window of the most recently operated application blocks the windows of other applications; the specific blocking rules can be set and adjusted according to needs, and this application does not impose any restrictions on this.

[0079] like Figure 4 , Figure 5 , Figure 6 As shown, it is an example of the positional relationship between the window of the target local application and the window of the cloud application displayed on the cloud desktop; wherein, the window of the target local application and the window of the cloud application can be independent of each other or partially overlapped, and the window of the target local application may block the window of the cloud application or be blocked by the window of the cloud application.

[0080] In one implementation, when the window of the target local application is blocked, the blocked area of ​​the window is determined, and the blocked area is clipped within the target area.

[0081] Specifically, the window parameters of the cloud application are obtained, the window parameters of the target local application are uploaded to the cloud desktop, the cloud desktop application calculates the folding area, and the folding area (occluded area) of the window of the target local application is cropped within the target area through a cropping solution.

[0082] In one implementation, after the obstructed area is clipped from the target area, the level of the clipped obstructed area is adjusted to a level associated with the obstructing cloud application.

[0083] In one embodiment, the key event includes level information for identifying levels, and the cloud desktop application determines the level of the key event according to the level information, and returns a consumption instruction or a non-consumption instruction according to the level.

[0084] Among them, the hierarchical information used to identify the hierarchy is the information based on which the cloud desktop application can determine the hierarchy of the key event, that is, the hierarchical information. Its specific form can be specific hierarchical data, or other information that has a direct or indirect mapping relationship with the hierarchical data, such as location information, area information, etc., or it can be a hierarchical identifier, location identifier, area identifier, etc. that refers to the above information.

[0085] The key events may include interface click events and keyboard click events, wherein an interface click event is a key event triggered by a user clicking on the interface with a mouse or finger, and a keyboard click event is a key event triggered by a user inputting information through a keyboard or other means. The former has obvious position information, while the latter does not have position information and its position information needs to be determined based on the current flashing cursor, etc.

[0086] For example, a key event has a timestamp, and the timestamp of each key event is different. The timestamp can be used as the event identifier of the key event; a key event has location information, and the location information has a mapping relationship with area information such as the target area. Each target area has pre-set level information, and the cloud desktop application can determine the area and its specific level based on the location information.

[0087] In one embodiment, in processing the key event through the cloud desktop application, after receiving the key event, the local program of the cloud desktop application forwards it to the cloud program of the cloud desktop application, and receives a consumption instruction or a non-consumption instruction returned by the cloud program.

[0088] After the user triggers a key event by single-clicking, double-clicking, or right-clicking, the key event contains an event identifier for identifying the key event, as well as location information; after the key event is triggered, the local program of the cloud desktop application receives the key event and forwards it to the cloud program of the cloud desktop application. The cloud program determines the hierarchical information and the corresponding area based on the location information of the key event, and determines the corresponding processing result based on the hierarchical information; the areas corresponding to the key events include the target area, the cloud application area, and the invalid area. If the area corresponding to the current key event is the target area, the processing result of the cloud program of the cloud desktop application is a consumption instruction; if the area corresponding to the current key event is the cloud application area, then The cloud program of the cloud desktop application can be forwarded to the corresponding cloud application for processing in the cloud or directly processed by the cloud program and return a non-consumption instruction; if the area corresponding to the current key event is an invalid area, the processing result of the cloud program of the cloud desktop application is a non-consumption instruction; the local program of the cloud desktop application sends the consumption instruction and the non-consumption instruction directly to the key processing queue; after receiving the consumption instruction, the key processing queue determines the key event to be consumed according to the event identifier in the consumption instruction, determines the target local application associated with the position relationship according to the mapping of the position relationship in the key event, and transmits the associated key event to the target local application, which processes and executes the key event.

[0089] In one embodiment, a key processing queue is set inside the cloud desktop application. By adding a key processing queue inside the cloud desktop application, after a key event is generated, on the one hand, it is forwarded to the cloud program for processing by the local program of the cloud desktop application, and on the other hand, it is stored in the key processing queue inside the cloud desktop application; after the cloud program returns the processing result, the key processing queue decides whether to consume the key event in the queue based on the processing result.

[0090] In another embodiment, the key processing queue is set outside the cloud desktop application. After a key event is generated, it is forwarded to the cloud program for processing by the local program of the cloud desktop application on the one hand, and stored in the key processing queue on the other hand; after the cloud program returns the processing result, the local program of the cloud desktop application forwards it to the key processing queue, and the key processing queue decides whether to consume the key event in the queue based on the processing result.

[0091] The method in the present application can be implemented through a C++ program on a fixed terminal such as a computer, and can be implemented through a Java program on a mobile terminal.

[0092] In the present application, the key processing queue includes multiple key events. After the key processing queue receives a consumption instruction or a non-consumption instruction, it determines the key event to be processed and executes the instruction based on the event identifier in the instruction.

[0093] In the present application, multiple key events in the key processing queue are sorted in a preset order. After the key processing queue receives a consumption instruction or a non-consumption instruction, it determines the key event to be processed based on the event identifier in the instruction, and processes the sorted key events in sequence. After processing the key event, it consumes or does not consume according to the instruction.

[0094] The key event processing method in this application can uniformly process the key logic between different cloud desktop applications and other local applications, break the limitations of application management, and improve the user experience. This method can be applied to cross-engine environments and cross-process key event processing.

[0095] This application uses the method of setting a transparent area to transparently transmit the window screen of the target local application to the cloud desktop; the system's key events are simultaneously transmitted to the cloud desktop application and the key processing queue, and a decision is made whether to consume the event stack of the key processing queue based on the internal hierarchy and click position of the cloud desktop. In this way, the system's key events are consumed and processed from the application level according to the hierarchy and sequence of the internal applications of the cloud desktop, breaking the limitation that key events cannot be effectively transmitted between applications, and enabling key events to be effectively transmitted across processes.

[0096] An embodiment of the present application provides a key event processing device, which is used to execute the key event processing method described in the above content of the present application. The key event processing device is described in detail below.

[0097] like Figure 7 As shown, the key event processing device includes:

[0098] A key storage module 102, which is used to respond to a key event input by a user on the displayed cloud desktop, process the key event through the cloud desktop application, and store the key event in a key processing queue; the key event is sent by the user by operating the area displayed on the cloud desktop;

[0099] The key consumption module 103 is used to consume the key events in the key processing queue in response to the consumption instruction returned by the cloud desktop application, and transmit them to the target local application associated with the key events.

[0100] In one embodiment, the device further comprises:

[0101] The key pop-up module 104 is used to pop the key event from the key processing queue in response to the non-consumption instruction returned by the cloud desktop application.

[0102] In one embodiment, in processing the key event through the cloud desktop application, the key storage module 102 is also used for: when the key event is an operation on a cloud application on the cloud desktop or an operation on a blank area on the cloud desktop, the cloud desktop application returns a non-consumption instruction; when the key event is an operation on a local application, the cloud desktop application returns a consumption instruction.

[0103] In one embodiment, the device further comprises:

[0104] The redirection module 101 is used to redirect the target local application to the cloud desktop.

[0105] The redirection module 101 is also used for:

[0106] Get the window parameters of the target local application;

[0107] A target area associated with the window is set on the cloud desktop according to the window parameters, and the window is displayed in the target area.

[0108] The redirection module 101 is also used for:

[0109] Adjust the level of the target area on the cloud desktop.

[0110] The redirection module 101 is also used for:

[0111] The window is displayed in the target area by setting the target area as a transparent area.

[0112] The redirection module 101 is also used for:

[0113] When the window of the target local application is blocked, the blocked area of ​​the window is determined, and the blocked area is clipped within the target area.

[0114] In one embodiment, the key event includes hierarchical information for identifying the hierarchy, and the key storage module 102 is further used for: the cloud desktop application determines the hierarchy of the key event according to the hierarchical information, and returns a consumption instruction or a non-consumption instruction according to the hierarchy.

[0115] The key storage module 102 is also used for: in the process of processing the key event through the cloud desktop application, after the local program of the cloud desktop application receives the key event, forwarding it to the cloud program of the cloud desktop application, and receiving the consumption instruction or non-consumption instruction returned by the cloud program.

[0116] The key event processing device provided in the above-mentioned embodiment of the present application and the key event processing method provided in the embodiment of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0117] The above describes the internal functions and structure of the key event processing device. Figure 8 As shown, in practice, the key event processing apparatus can be implemented as a control device, including: a memory 301 and a processor 303 .

[0118] The memory 301 may be configured to store programs.

[0119] In addition, the memory 301 may also be configured to store various other data to support operations on the control device. Examples of such data include instructions for any application or method operating on the control device, contact data, phone book data, messages, pictures, videos, etc.

[0120] The memory 301 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0121] The processor 303 is coupled to the memory 301 and is configured to execute a program in the memory 301 to:

[0122] In response to a key event input by a user on a displayed cloud desktop, the key event is processed by a cloud desktop application, and the key event is stored in a key processing queue; the key event is sent by the user by operating an area displayed on the cloud desktop;

[0123] In response to the consumption instruction returned by the cloud desktop application, the key event in the key processing queue is consumed and transmitted to the target local application associated with the key event.

[0124] In one implementation, the processor 303 is specifically configured to:

[0125] In response to a non-consumption instruction returned by the cloud desktop application, the key event is popped out from the key processing queue.

[0126] In one implementation, in processing the key event by the cloud desktop application, the processor 303 is specifically configured to:

[0127] When the key event is an operation on a cloud application on the cloud desktop or an operation on a blank area on the cloud desktop, the cloud desktop application returns a non-consumption instruction; when the key event is an operation on a local application, the cloud desktop application returns a consumption instruction.

[0128] In one implementation, the processor 303 is specifically configured to:

[0129] The method redirects the target local application to the cloud desktop before responding to a key event input by the user on the displayed cloud desktop.

[0130] In one implementation, the processor 303 is specifically configured to:

[0131] Get the window parameters of the target local application;

[0132] A target area associated with the window is set on the cloud desktop according to the window parameters, and the window is displayed in the target area.

[0133] In one implementation, the processor 303 is specifically configured to:

[0134] Adjust the level of the target area on the cloud desktop.

[0135] In one implementation, the processor 303 is specifically configured to:

[0136] The window is displayed in the target area by setting the target area as a transparent area.

[0137] In one implementation, the processor 303 is specifically configured to:

[0138] When the window of the target local application is blocked, the blocked area of ​​the window is determined, and the blocked area is clipped within the target area.

[0139] In one embodiment, the key event includes hierarchical information for identifying the hierarchy, and the processor 303 is specifically used for: the cloud desktop application determines the hierarchy of the key event according to the hierarchical information, and returns a consumption instruction or a non-consumption instruction according to the hierarchy.

[0140] In one implementation, the processor 303 is specifically configured to:

[0141] In the process of processing the key event through the cloud desktop application, after receiving the key event, the local program of the cloud desktop application forwards it to the cloud program of the cloud desktop application, and receives a consumption instruction or a non-consumption instruction returned by the cloud program.

[0142] In this application, Figure 8 Only some components are shown schematically, which does not mean that the control device only includes Figure 8 Components shown.

[0143] The control device provided in this embodiment is based on the same inventive concept as the key event processing method provided in the embodiment of the present application, and has the same beneficial effects as the method adopted, run or implemented by the application program stored therein.

[0144] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0145] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0146] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0147] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0148] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0149] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0150] The present application also provides a computer-readable storage medium corresponding to the key event processing method provided in the aforementioned embodiment, on which a computer program (ie, a program product) is stored. When the computer program is run by a processor, it will execute the key event processing method provided in any of the aforementioned embodiments.

[0151] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0152] The computer-readable storage medium provided in the above-mentioned embodiments of the present application and the key event processing method provided in the embodiments of the present application are based on the same inventive concept and have the same beneficial effects as the methods adopted, run or implemented by the application programs stored therein.

[0153] It should be noted that in the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present application can be practiced without these specific details. In some instances, well-known structures and technologies are not shown in detail so as not to obscure the understanding of this description.

[0154] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0155] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0156] The above is only the embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A key event processing method, It is characterized in that include: In response to a key event input by a user on a displayed cloud desktop, the key event is processed by a cloud desktop application, and the key event is stored in a key processing queue; the key event is sent by the user by operating an area displayed on the cloud desktop; In response to the consumption instruction returned by the cloud desktop application, the key event in the key processing queue is consumed and transmitted to the target local application associated with the key event, wherein when the key event is an operation on the local application, the cloud desktop application returns the consumption instruction; The key event includes hierarchical information for identifying hierarchies, and the cloud desktop application determines the level of the key event based on the hierarchical information, and returns a consumption instruction or a non-consumption instruction based on the level, wherein the hierarchical information includes hierarchical data, and location information or area information that is mapped to the hierarchical data.

2. The method according to claim 1, It is characterized in that Also includes: In response to a non-consumption instruction returned by the cloud desktop application, the key event is popped out from the key processing queue.

3. The method according to claim 1 or 2, It is characterized in that In the processing of the key event by the cloud desktop application, when the key event is an operation on a cloud application on the cloud desktop or an operation on a blank area on the cloud desktop, the cloud desktop application returns a non-consumption instruction.

4. The method according to claim 1 or 2, It is characterized in that Before responding to a key event input by a user on the displayed cloud desktop, the method further includes: Redirect the target local application to the cloud desktop.

5. The method according to claim 4, It is characterized in that The redirecting the target local application to the cloud desktop includes: Obtaining window parameters of the target local application; A target area associated with the window is set on the cloud desktop according to the window parameters, and the window is displayed in the target area.

6. The method according to claim 5, It is characterized in that The redirecting the target local application to the cloud desktop further includes: Adjust the level of the target area on the cloud desktop.

7. The method according to claim 5, It is characterized in that The window is displayed in the target area by setting the target area as a transparent area.

8. The method according to claim 5, It is characterized in that When the window of the target local application is blocked, the blocked area of ​​the window is determined, and the blocked area is clipped within the target area.

9. The method according to claim 1 or 2, It is characterized in that In the process of processing the key event through the cloud desktop application, after receiving the key event, the local program of the cloud desktop application forwards it to the cloud program of the cloud desktop application, and receives a consumption instruction or a non-consumption instruction returned by the cloud program.

10. A key event processing device, It is characterized in that include: A key storage module, which is used to respond to a key event input by a user on the displayed cloud desktop, process the key event through the cloud desktop application, and store the key event in a key processing queue; the key event is sent by the user by operating the area displayed on the cloud desktop; A key consumption module, which is used to consume the key event in the key processing queue in response to the consumption instruction returned by the cloud desktop application, and transmit it to the target local application associated with the key event, wherein when the key event is an operation on the local application, the cloud desktop application returns the consumption instruction; The key storage module also includes: the key event includes hierarchical information for identifying the hierarchy, the cloud desktop application determines the hierarchy of the key event according to the hierarchical information, and returns a consumption instruction or a non-consumption instruction according to the hierarchy, wherein the hierarchical information includes hierarchical data, and location information or area information that is mapped to the hierarchical data.

11. The device according to claim 10, It is characterized in that Also includes: A redirection module is used to redirect the target local application to the cloud desktop.

12. A control device, It is characterized in that include: Memory and processor; The memory is used to store programs; The processor, coupled to the memory, is configured to execute the program to: In response to a key event input by a user on a displayed cloud desktop, the key event is processed by a cloud desktop application, and the key event is stored in a key processing queue; the key event is sent by the user by operating an area displayed on the cloud desktop; In response to the consumption instruction returned by the cloud desktop application, the key event in the key processing queue is consumed and transmitted to the target local application associated with the key event, wherein when the key event is an operation on the local application, the cloud desktop application returns the consumption instruction; The key event includes hierarchical information for identifying hierarchies, and the cloud desktop application determines the level of the key event based on the hierarchical information, and returns a consumption instruction or a non-consumption instruction based on the level, wherein the hierarchical information includes hierarchical data, and location information or area information that is mapped to the hierarchical data.

13. A computer-readable storage medium having a computer program stored thereon, It is characterized in that The program is executed by a processor to implement the method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Method and device for publishing local application of cloud desktop, equipment and medium

    CN113778583A

  • Apparatus and method for application sharing in a graphic user interface

    US5758110A