Control event processing method and device

Abstract

The present application provides a method and device for processing manipulation events, the method comprising: when a first user applies to use a cloud application, allocating a virtual keyboard to the first user; when a second user applies to use the cloud application, allocating a virtual handle to the second user, wherein the physical input devices used by the first user and the second user are keyboards; a system receiving a first manipulation event sent by the first user's terminal device, and sending the keyboard event to the cloud server through the virtual keyboard, and a system receiving a second manipulation event sent by the second user's terminal device, and sending the handle event to the cloud server through the virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, the keyboard event being the same as the first manipulation event, or being generated based on the first manipulation event, and the handle event being the same as the second manipulation event, or being generated based on the second manipulation event, so as to enable at least two keyboard users to use a cloud application that supports both handle and keyboard manipulation.

Description

Technical Field

[0001] The present invention relates to the field of cloud applications, and in particular to a method and device for processing control events. Background Art

[0002] Currently, the controller input solution is supported in the cloud application field, which allows multiple users to use the controller to control the same cloud application running on the cloud server that supports controller and keyboard control. The screen of the cloud application is pushed to the user for decoding and rendering after rendering, acquisition, and encoding. In specific implementation, the controller can be mapped to an independent input interface of the cloud server through virtualization technology. This solution supports up to 4 users to use the cloud application through the controller. However, since keyboard input cannot be isolated, that is, the keyboard input of multiple users will be recognized as a single keyboard input in the cloud server, resulting in the inability to distinguish the keyboard input of different users, so that this solution can only support controller users and cannot support at least two keyboard users.

[0003] Therefore, how to provide a solution that enables at least two keyboard users to use cloud applications that support handle and keyboard control has become a technical problem that needs to be solved urgently. Summary of the Invention

[0004] In order to solve the technical problems existing in the prior art, the embodiments of the present application provide a method and device for handling control events.

[0005] In a first aspect, an embodiment of the present application provides a method for processing a manipulation event, which is applied to a cloud server and includes:

[0006] When a first user applies to use a cloud application, a virtual keyboard is allocated to the first user, and when a second user applies to use the cloud application, a virtual handle is allocated to the second user, wherein the physical input devices used by the first user and the second user are keyboards;

[0007] A system that receives a first manipulation event sent by a terminal device of a first user and sends a keyboard event to a cloud server through a virtual keyboard, and a system that receives a second manipulation event sent by a terminal device of a second user and sends a handle event to a cloud server through a virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the keyboard event is the same as the first manipulation event, or is generated based on the first manipulation event, and the handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0008] In a second aspect, an embodiment of the present application further provides a method for handling manipulation events, which is applied to a cloud server and includes:

[0009] When a first user applies to use a cloud application, a first virtual handle is allocated to the first user; when a second user applies to use the cloud application, a second virtual handle is allocated to the second user, wherein the physical input devices used by the first user and the second user are keyboards;

[0010] A system that receives a first manipulation event sent by a terminal device of a first user and sends the first handle event to a cloud server through a first virtual handle, and a system that receives a second manipulation event sent by a terminal device of a second user and sends the second handle event to a cloud server through a second virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the first handle event is the same as the first manipulation event, or is generated based on the first manipulation event, and the second handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0011] In a third aspect, an embodiment of the present application further provides a method for processing a manipulation event, which is applied to a terminal device and includes:

[0012] A manipulation event is determined based on a keyboard event generated by a user manipulating the keyboard, and the manipulation event is sent to a cloud server, so that the cloud server sends the keyboard event to the cloud server system through a virtual keyboard pre-assigned to the user, or sends the handle event to the cloud server system through a virtual handle pre-assigned to the user, wherein the manipulation event is a keyboard event generated by a user manipulating the keyboard, or is generated based on a keyboard event generated by a user manipulating the keyboard.

[0013] In a fourth aspect, an embodiment of the present application further provides a manipulation event processing device, which is applied to a cloud server and includes:

[0014] A first allocating unit is configured to allocate a virtual keyboard to the first user when the first user applies to use the cloud application, and allocate a virtual controller to the second user when the second user applies to use the cloud application, wherein the physical input devices used by the first user and the second user are keyboards;

[0015] The first sending unit is used to receive a first manipulation event sent by a terminal device of a first user, and send the keyboard event to the system of the cloud server through a virtual keyboard, and to receive a second manipulation event sent by a terminal device of a second user, and send the handle event to the system of the cloud server through a virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the keyboard event is the same as the first manipulation event, or is generated based on the first manipulation event, and the handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0016] In a fifth aspect, an embodiment of the present application further provides a manipulation event processing device, which is applied to a cloud server and includes:

[0017] a second allocating unit, configured to allocate a first virtual handle to the first user when the first user applies to use the cloud application, and allocate a second virtual handle to the second user when the second user applies to use the cloud application, wherein the physical input devices used by the first user and the second user are keyboards;

[0018] The second sending unit is used to receive a first manipulation event sent by a terminal device of a first user, and send the first handle event to a system of a cloud server through a first virtual handle, and to receive a second manipulation event sent by a terminal device of a second user, and send the second handle event to a system of a cloud server through a second virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the first handle event is the same as the first manipulation event, or is generated based on the first manipulation event, and the second handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0019] In a sixth aspect, an embodiment of the present application further provides a manipulation event processing device, applied to a terminal device, comprising:

[0020] A determination unit is used to determine a manipulation event based on a keyboard event generated by a user manipulating a keyboard, and send the manipulation event to a cloud server so that the cloud server sends the keyboard event to the cloud server system through a virtual keyboard pre-assigned to the user, or sends the handle event to the cloud server system through a virtual handle pre-assigned to the user, wherein the manipulation event is a keyboard event generated by a user manipulating a keyboard, or is generated based on a keyboard event generated by a user manipulating a keyboard.

[0021] In summary, the control event processing method and device provided in the embodiments of the present application, for at least two keyboard users, only assign a virtual keyboard to one user at most, and assign virtual handles to other users, and send the keyboard events / handle events corresponding to the keyboard events generated by different users manipulating the keyboard to the cloud server system through the virtual keyboard / virtual handle. That is to say, at most, it is allowed to simulate keyboard input based on the keyboard input of one user, and simulate handle input based on the keyboard input of other users, and the cloud server supports the input of multiple handles, so that the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A flowchart of a method for handling a manipulation event provided in an embodiment of the present application;

[0023] Figure 2 A flowchart of another method for handling control events provided in an embodiment of the present application;

[0024] Figure 3A flowchart of another method for handling control events provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of the structure of a control event processing device provided in an embodiment of the present application;

[0026] Figure 5 A schematic diagram of the structure of another control event processing device provided in an embodiment of the present application;

[0027] Figure 6 A schematic diagram of the structure of another control event processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of illustration and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this application illustrate the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowcharts can be implemented out of sequence, and steps without logical context can be reversed or implemented simultaneously. In addition, those skilled in the art, under the guidance of the contents of this application, can add one or more other operations to the flowchart, or remove one or more operations from the flowchart.

[0029] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application generally described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present application.

[0030] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0031] Reference Figure 1 As shown, the embodiment of the present application provides a flow chart of a method for handling a manipulation event, which is applied to a cloud server and includes:

[0032] S10. When a first user applies to use a cloud application, a virtual keyboard is allocated to the first user. When a second user applies to use the cloud application, a virtual controller is allocated to the second user. The physical input devices used by the first user and the second user are keyboards.

[0033] In this embodiment, it should be noted that the cloud application is an application running in the cloud server. The cloud application applicable to this embodiment is a cloud application that requires the participation of at least two users (such as multi-person same-screen games). The applicable scenarios include at least two users using a physical keyboard to control the cloud application. In this scenario, a virtual keyboard will be assigned to one keyboard user (i.e., the first user), and a virtual handle will be assigned to the other keyboard user (i.e., the second user). The timing of creating the virtual keyboard and virtual handle can be set as needed, such as creating them when the corresponding user applies to use the cloud application or before the corresponding user applies to use the cloud application.

[0034] S11. A system that receives a first manipulation event sent by a terminal device of a first user and sends a keyboard event to a cloud server through a virtual keyboard, and a system that receives a second manipulation event sent by a terminal device of a second user and sends a handle event to a cloud server through a virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the keyboard event is the same as the first manipulation event, or is generated based on the first manipulation event, and the handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0035] In this embodiment, it should be noted that the keyboard event generated by the first user operating the keyboard ultimately needs to be converted into the keyboard event in step S11 and sent to the cloud server system through the virtual keyboard. There are two situations: first, the keyboard event generated by the first user operating the keyboard is the same as the keyboard event in step S11; second, the keyboard event generated by the first user operating the keyboard needs to be mapped to the keyboard event in step S11, for example, the keyboard event generated by pressing the A key is mapped to the keyboard event generated by pressing the B key of the cloud server keyboard, or the keyboard event generated by pressing the A key is mapped to the keyboard event generated by pressing the A key of the cloud server keyboard (the keyboard event generated by pressing the A key is different from the keyboard event generated by pressing the A key of the cloud server keyboard). Accordingly, the first manipulation event can be data from any stage of the entire process of converting the keyboard event generated by the first user manipulating the keyboard into the keyboard event in step S11. If the first manipulation event is the keyboard event in step S11, the cloud server directly sends the first manipulation event to the cloud server system via the virtual keyboard. If the first manipulation event is not the keyboard event in step S11, the cloud server needs to convert the first manipulation event into the keyboard event in step S11 and then send the keyboard event in step S11 to the cloud server system via the virtual keyboard. In other words, the process of converting the keyboard event generated by the first user manipulating the keyboard into the keyboard event in step S11 can be performed by the first user's terminal device, or by the cloud server, or by the first user's terminal device and the cloud server in collaboration.

[0036] Similarly, the keyboard events generated by the second user manipulating the keyboard ultimately need to be converted into handle events in step S11 and sent to the cloud server system via the virtual handle. The mapping relationship between some keyboard keys and handle interaction components involved can be shown in the following table:

[0037] Mapping relationship table of some keyboard keys and handle interaction components

[0038] keyboard keys Mapping handle operations Functional Description W Push the left stick up The character moves forward S Push the left stick down The character moves backward A Push the left stick left The character moves left D Push the left stick right The character moves right ↑ Up arrow key Menu Up Select ↓ Arrow key down Menu down selection ← Arrow key left Menu left selection → Arrow key right Menu right selection Space A key pressed Confirm / Jump / Interact J B key pressed Cancel / Dodge K X key pressed Attack / Skill 1 L Y key pressed Special Skills / Switch Weapons E Push the right stick up Adjust the viewing angle upwards Q Push the right stick down Adjust the viewing angle downward U Left trigger pressed Aim / Defend O Right trigger pressed Shooting / Acceleration M Start key pressed Open the game menu ， Select key pressed Map / status switching Shift Left trigger halfway pressed Walking / Sneaking Ctrl Right trigger half-press Precision operation mode

[0039] According to the mapping relationship in the above table, if the second user presses the W key on the keyboard, the keyboard event generated by pressing the W key will eventually be converted into a handle event generated by pushing the left joystick up. The mapping relationship between keyboard keys and handle interaction components in the above table is only a simple implementation method. Other simple or more complex mapping relationships between keyboard keys and handle interaction components can be set as needed, such as mapping relationships between multiple / single keyboard keys and single / multiple handle components. The conversion process of keyboard events into handle events is similar to the process of converting keyboard events generated by the first user manipulating the keyboard into keyboard events in step S11. It can be executed independently by the second user's terminal device or cloud server, or by the second user's terminal device and cloud server in collaboration. The content of the second manipulation event is determined by the conversion method. For example, if it is executed independently by the second user's terminal device, the second manipulation event is the handle event finally converted. For another example, if it is executed independently by the cloud server, the second manipulation event is the keyboard event generated by the second user manipulating the keyboard. For another example, if it is executed jointly by the second user's terminal device and cloud server, the second manipulation event is the execution result of the second user's terminal device. It can be data at any stage of the entire process of converting the keyboard event generated by the second user manipulating the keyboard into the handle event in step S11. The handle event in step S11 may also include a virtual handle identifier to distinguish inputs from different keyboards.

[0040] In addition, it should be noted that for at least two keyboard keys that need to be manipulated separately, if the first user / second user manipulates the at least two keyboard keys at the same time, what is ultimately sent to the cloud server system through the virtual keyboard / virtual handle is the keyboard event / handle event corresponding to the last manipulated keyboard key.

[0041] The control event processing method provided in the embodiment of the present application, for at least two keyboard users, only allocates a virtual keyboard to one user, and allocates virtual handles to other users, and sends the keyboard events / handle events corresponding to the keyboard events generated by different users manipulating the keyboard to the cloud server system through the virtual keyboard / virtual handle. That is to say, it is only allowed to simulate keyboard input based on the keyboard input of one user, and simulate handle input based on the keyboard input of other users. The cloud server supports the input of multiple handles, so that the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control.

[0042] Based on the aforementioned method embodiment, the process of generating a handle event may include:

[0043] Map the second manipulation event to an intermediate handle event, and add the virtual handle identifier to the intermediate handle event to obtain a handle event; or

[0044] The identifier of the virtual handle is added to the middle handle event to obtain a handle event, wherein the second control event is the middle handle event.

[0045] In this embodiment, it should be noted that the cloud server can independently complete the conversion process from keyboard events to controller events. Specifically, it can receive a keyboard event sent by the second user's terminal device as the second manipulation event, first map the keyboard event to an intermediate controller event, and then add the virtual controller identifier to the intermediate controller event to obtain the controller event. Alternatively, the second user's terminal device and the cloud server can collaboratively complete the conversion process from keyboard events to controller events. For example, the second user's terminal device can first map the keyboard event to an intermediate controller event, send the intermediate controller event to the cloud server as the second manipulation event, and then the cloud server can add the virtual controller identifier to the intermediate controller event to obtain the controller event. Alternatively, the second user's terminal device can independently complete the conversion process from keyboard events to controller events. Specifically, it can first map the keyboard event to an intermediate controller event, then add the virtual controller identifier to the intermediate controller event to obtain the controller event, and then send the controller event to the cloud server as the second manipulation event. The intermediate controller event can indicate that a specific controller component has been manipulated, such as indicating that the A key has been pressed. The controller event of the system sent to the cloud server via the virtual controller will include the virtual controller identifier compared to the intermediate controller event.

[0046] Reference Figure 2 As shown, the embodiment of the present application provides a flow chart of a method for handling a manipulation event, which is applied to a cloud server and includes:

[0047] S20. When a first user applies to use the cloud application, assign a first virtual handle to the first user; when a second user applies to use the cloud application, assign a second virtual handle to the second user, wherein the physical input devices used by the first user and the second user are keyboards;

[0048] In this embodiment, it should be noted that the applicable scenario of this embodiment is different from Figure 1 The embodiment shown is applicable to the same scenario, but the processing process is the same as Figure 1 The embodiment shown is slightly different. Figure 1 The illustrated embodiment does not assign a virtual keyboard to one keyboard user, but assigns different virtual handles to different keyboard users, that is, assigns a first virtual handle to the first user, a second virtual handle to the second user, a third virtual handle different from the first and second virtual handles to the third user, and so on.

[0049] S21. A system that receives a first manipulation event sent by a terminal device of a first user, and sends the first handle event to a cloud server through a first virtual handle, and a system that receives a second manipulation event sent by a terminal device of a second user, and sends the second handle event to a cloud server through a second virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the first handle event is the same as the first manipulation event, or is generated based on the first manipulation event, and the second handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0050] In this embodiment, it should be noted that the keyboard events generated by the keyboard input of different users need to be converted into handle events and sent to the cloud server system through the corresponding virtual handle. In this way, the keyboard input of different keyboard users can be simulated as different handle inputs on the cloud server side, thereby achieving the isolation of keyboard inputs of different keyboard users. The handle events corresponding to different users are distinguished by the identifiers of the virtual handles assigned to the users. The process of converting keyboard events into handle events can be referred to Figure 1 The embodiments shown will not be described in detail here.

[0051] The control event processing method provided in the embodiment of the present application assigns virtual handles to at least two keyboard users, and sends handle events corresponding to keyboard events generated by different users operating the keyboard to the cloud server system through the virtual handle. In other words, the handle input is simulated based on the keyboard input of these users, and the cloud server supports the input of multiple handles. In this way, the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control.

[0052] Based on the aforementioned method embodiment, the process of generating the first handle event may include:

[0053] Mapping the first manipulation event to an intermediate handle event, and adding the identifier of the first virtual handle to the intermediate handle event to obtain the first handle event; or

[0054] The identifier of the first virtual handle is added to the middle handle event to obtain a first handle event, wherein the first manipulation event is the middle handle event.

[0055] Reference Figure 3 As shown, an embodiment of the present application provides a flow chart of a method for handling a manipulation event, which is applied to a terminal device and includes:

[0056] S30. Determine a manipulation event based on a keyboard event generated by the user manipulating the keyboard, and send the manipulation event to a cloud server, so that the cloud server sends the keyboard event to the cloud server's system through a virtual keyboard pre-assigned to the user, or sends the handle event to the cloud server's system through a virtual handle pre-assigned to the user, wherein the manipulation event is a keyboard event generated by the user manipulating the keyboard, or is generated based on a keyboard event generated by the user manipulating the keyboard.

[0057] In this embodiment, it should be noted that this embodiment is Figure 1 The illustrated embodiments and Figure 2 The execution logic of the terminal device side corresponding to the embodiment shown. The terminal device is only responsible for determining the control event and sending the control event to the cloud server. The execution logic of the cloud server side can refer to Figure 1 The illustrated embodiments and Figure 2 In the embodiment shown, the content of the control event can be referred to Figure 1 The first manipulation event and the second manipulation event in the illustrated embodiment are not described in detail here.

[0058] The control event processing method provided in the embodiment of the present application determines the control event based on the keyboard event generated by the user manipulating the keyboard, and sends the control event to the cloud server, so that the cloud server can send the keyboard events / handle events corresponding to the keyboard events generated by different users manipulating the keyboard to the cloud server system through the virtual keyboard / virtual handle. In other words, it is only allowed to simulate keyboard input based on the keyboard input of one user at most, and simulate handle input based on the keyboard input of other users. The cloud server supports the input of multiple handles, so that the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control.

[0059] Based on the aforementioned method embodiment, the control event is a keyboard event obtained by mapping the keyboard event generated by the user operating the keyboard, or a handle event obtained by mapping the keyboard event generated by the user operating the keyboard, or data obtained by adding a virtual handle identifier to the handle event mapped to the keyboard event generated by the user operating the keyboard.

[0060] Reference Figure 4 As shown, an embodiment of the present application provides a structural diagram of a manipulation event processing device, which is applied to a cloud server and includes:

[0061] A first allocating unit 40 is configured to allocate a virtual keyboard to the first user when the first user applies to use the cloud application, and allocate a virtual controller to the second user when the second user applies to use the cloud application, wherein the physical input devices used by the first user and the second user are keyboards;

[0062] The first sending unit 41 is used to receive a first manipulation event sent by a terminal device of a first user, and send the keyboard event to the system of the cloud server through a virtual keyboard, and to receive a second manipulation event sent by a terminal device of a second user, and send the handle event to the system of the cloud server through a virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the keyboard event is the same as the first manipulation event, or is generated based on the first manipulation event, and the handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0063] The control event processing device provided in the embodiment of the present application, for at least two keyboard users, only allocates a virtual keyboard to one user, and allocates virtual handles to other users, and sends the keyboard events / handle events corresponding to the keyboard events generated by different users manipulating the keyboard to the cloud server system through the virtual keyboard / virtual handle. That is to say, it is only allowed to simulate keyboard input based on the keyboard input of one user, and simulate handle input based on the keyboard input of other users. The cloud server supports the input of multiple handles, so that the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control.

[0064] Reference Figure 5 As shown, an embodiment of the present application provides a structural diagram of a manipulation event processing device, which is applied to a cloud server and includes:

[0065] A second allocation unit 50 is configured to allocate a first virtual handle to the first user when the first user applies to use the cloud application, and allocate a second virtual handle to the second user when the second user applies to use the cloud application, wherein the physical input devices used by the first user and the second user are keyboards;

[0066] The second sending unit 51 is used to receive a first manipulation event sent by a terminal device of a first user, and send the first handle event to the system of the cloud server through a first virtual handle, and to receive a second manipulation event sent by a terminal device of a second user, and send the second handle event to the system of the cloud server through a second virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the first handle event is the same as the first manipulation event, or is generated based on the first manipulation event, and the second handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

[0067] The control event processing device provided in the embodiment of the present application assigns virtual handles to at least two keyboard users, and sends handle events corresponding to keyboard events generated by different users operating the keyboard to the cloud server system through the virtual handle. In other words, the handle input is simulated based on the keyboard input of these users, and the cloud server supports the input of multiple handles. In this way, the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control.

[0068] Reference Figure 6 As shown, an embodiment of the present application provides a structural diagram of a manipulation event processing device, which is applied to a terminal device, including:

[0069] The determination unit 60 is used to determine the manipulation event based on the keyboard event generated by the user manipulating the keyboard, and send the manipulation event to the cloud server, so that the cloud server sends the keyboard event to the cloud server system through a virtual keyboard pre-assigned to the user, or sends the handle event to the cloud server system through a virtual handle pre-assigned to the user, wherein the manipulation event is a keyboard event generated by the user manipulating the keyboard, or is generated based on the keyboard event generated by the user manipulating the keyboard.

[0070] The control event processing device provided in the embodiment of the present application determines the control event based on the keyboard event generated by the user operating the keyboard, and sends the control event to the cloud server, so that the cloud server can send the keyboard events / handle events corresponding to the keyboard events generated by different users operating the keyboard to the cloud server system through the virtual keyboard / virtual handle. In other words, it is only allowed to simulate keyboard input based on the keyboard input of one user at most, and simulate handle input based on the keyboard input of other users. The cloud server supports the input of multiple handles, so that the keyboard input of different users can be distinguished, thereby enabling at least two keyboard users to use cloud applications that support handle and keyboard control.

[0071] The control event processing device provided in the embodiment of the present application has the same implementation process as the control event processing method provided in the embodiment of the present application, and the effect that can be achieved is also the same as the control event processing method provided in the embodiment of the present application, which will not be repeated here.

[0072] The above are only specific embodiments of the present application, but the scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for handling a manipulation event, characterized in that: Applicable to cloud servers, including: When a first user applies to use a cloud application, a virtual keyboard is allocated to the first user, and when a second user applies to use the cloud application, a virtual handle is allocated to the second user, wherein the physical input devices used by the first user and the second user are keyboards; A system that receives a first manipulation event sent by a terminal device of a first user and sends a keyboard event to a cloud server through a virtual keyboard, and a system that receives a second manipulation event sent by a terminal device of a second user and sends a handle event to a cloud server through a virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the keyboard event is the same as the first manipulation event, or is generated based on the first manipulation event, and the handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

2. The method according to claim 1, wherein The process of generating a handle event includes: Map the second manipulation event to an intermediate handle event, and add the virtual handle identifier to the intermediate handle event to obtain a handle event; or The identifier of the virtual handle is added to the middle handle event to obtain a handle event, wherein the second control event is the middle handle event.

3. A method for handling a manipulation event, characterized in that: Applicable to cloud servers, including: When a first user applies to use a cloud application, a first virtual handle is allocated to the first user; when a second user applies to use the cloud application, a second virtual handle is allocated to the second user, wherein the physical input devices used by the first user and the second user are keyboards; A system that receives a first manipulation event sent by a terminal device of a first user and sends the first handle event to a cloud server through a first virtual handle, and a system that receives a second manipulation event sent by a terminal device of a second user and sends the second handle event to a cloud server through a second virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the first handle event is the same as the first manipulation event, or is generated based on the first manipulation event, and the second handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

4. The method according to claim 3, wherein The process of generating the first handle event includes: Mapping the first manipulation event to an intermediate handle event, and adding the identifier of the first virtual handle to the intermediate handle event to obtain the first handle event; or The identifier of the first virtual handle is added to the middle handle event to obtain a first handle event, wherein the first manipulation event is the middle handle event.

5. A method for handling a manipulation event, characterized in that: A first terminal device applied to at least two terminal devices includes: A first manipulation event is determined based on a keyboard event generated by a first user manipulating a keyboard, and the first manipulation event is sent to a cloud server so that the cloud server sends the keyboard event to the cloud server system through a virtual keyboard pre-assigned to the first user. Moreover, after receiving a second manipulation event sent by a second terminal device of the second user, the cloud server sends the handle event to the cloud server system through a virtual handle pre-assigned to the second user, wherein the at least two terminal devices include a first terminal device and a second terminal device, the first terminal device is any one of the at least two terminal devices, the first manipulation event is a keyboard event generated by the first user manipulating a keyboard connected to the first terminal device, or is generated based on a keyboard event generated by the first user manipulating a keyboard connected to the first terminal device, and the second manipulation event is a keyboard event generated by the second user manipulating a keyboard connected to the second terminal device, or is generated based on a keyboard event generated by the second user manipulating a keyboard connected to the second terminal device.

6. The method according to claim 5, wherein The first control event is a keyboard event mapped to a keyboard event generated by a first user operating a keyboard connected to a first terminal device; the second control event is a handle event mapped to a keyboard event generated by a second user operating a keyboard connected to a second terminal device, or data obtained by adding a virtual handle identifier to a handle event mapped to a keyboard event generated by a second user operating a keyboard connected to a second terminal device.

7. A manipulation event processing device, characterized in that: Applicable to cloud servers, including: A first allocating unit is configured to allocate a virtual keyboard to the first user when the first user applies to use the cloud application, and allocate a virtual controller to the second user when the second user applies to use the cloud application, wherein the physical input devices used by the first user and the second user are keyboards; The first sending unit is used to receive a first manipulation event sent by a terminal device of a first user, and send the keyboard event to the system of the cloud server through a virtual keyboard, and to receive a second manipulation event sent by a terminal device of a second user, and send the handle event to the system of the cloud server through a virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the keyboard event is the same as the first manipulation event, or is generated based on the first manipulation event, and the handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

8. A manipulation event processing device, characterized in that: Applicable to cloud servers, including: a second allocating unit, configured to allocate a first virtual handle to the first user when the first user applies to use the cloud application, and allocate a second virtual handle to the second user when the second user applies to use the cloud application, wherein the physical input devices used by the first user and the second user are keyboards; The second sending unit is used to receive a first manipulation event sent by a terminal device of a first user, and send the first handle event to a system of a cloud server through a first virtual handle, and to receive a second manipulation event sent by a terminal device of a second user, and send the second handle event to a system of a cloud server through a second virtual handle, so as to enable the first user and the second user to manipulate different application objects in the cloud application, wherein the first handle event is the same as the first manipulation event, or is generated based on the first manipulation event, and the second handle event is the same as the second manipulation event, or is generated based on the second manipulation event.

9. A manipulation event processing device, characterized in that: A first terminal device applied to at least two terminal devices includes: A determination unit is used to determine a first manipulation event based on a keyboard event generated by a first user manipulating a keyboard, and send the first manipulation event to a cloud server so that the cloud server sends the keyboard event to the cloud server system through a virtual keyboard pre-assigned to the first user. Moreover, after receiving a second manipulation event sent by a second terminal device of a second user, the cloud server sends the handle event to the cloud server system through a virtual handle pre-assigned to the second user, wherein the at least two terminal devices include a first terminal device and a second terminal device, the first terminal device is any one of the at least two terminal devices, the first manipulation event is a keyboard event generated by the first user manipulating a keyboard connected to the first terminal device, or is generated based on a keyboard event generated by the first user manipulating a keyboard connected to the first terminal device, and the second manipulation event is a keyboard event generated by the second user manipulating a keyboard connected to the second terminal device, or is generated based on a keyboard event generated by the second user manipulating a keyboard connected to the second terminal device.

Images