Control event processing method and device

Abstract

The invention provides a control event processing method and device, and the method comprises the steps: receiving first intermediate data and / or second intermediate data sent by a mobile device, and determining a first mouse event and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data; and sending the first mouse event to a system of a cloud server through a virtual mouse so as to move a target object of the cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard, and the target object is located at the first specific position of the cloud application picture rendered by the cloud application, so that a user can accurately move the application object of the cloud application which only supports keyboard and mouse control.

Description

Technical Field

[0001] The present invention relates to the field of cloud applications, and particularly to a method and device for handling manipulation events. Background Art

[0002] By simulating the input of a physical gamepad with a virtual gamepad, a user can use a cloud application (such as a cloud game) that supports gamepad control through a mobile device (such as a mobile phone, iPad, etc.). However, for some cloud applications that only support keyboard and mouse control (such as cloud games of the MOBA type), due to the lack of a physical mouse, the user cannot perform precise movement operations on application objects that can only be achieved with a mouse.

[0003] Therefore, how to provide a solution that enables a user to perform precise movement operations on application objects of a cloud application that only supports keyboard and mouse control has become a technical problem to be solved urgently. Summary of the Invention

[0004] In view of the technical problems existing in the prior art, an embodiment of the present application provides a method and device for handling manipulation events.

[0005] In a first aspect, an embodiment of the present application provides a method for handling manipulation events, which is applied to a cloud server and includes: Receiving first intermediate data and / or second intermediate data sent by a mobile device, and determining a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, where the first intermediate data includes source data, intermediate result data, or target result data in the process of obtaining the first mouse event according to the movement data of a virtual joystick, and the second intermediate data includes source data, intermediate result data, or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick; Sending the first mouse event to the system of the cloud server through a virtual mouse to move a target object of a cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard to move the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen rendered by the cloud application.

[0006] In a second aspect, an embodiment of the present application further provides a method for handling manipulation events, which is applied to a mobile device and includes: Determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, send the first mouse event to the system of the cloud server through a virtual mouse, and send the second mouse event to the system of the cloud server through a virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard, wherein the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0007] In a third aspect, an embodiment of the present application further provides a control event processing device, which is applied to a cloud server and includes: A determination unit, configured to receive the first intermediate data and / or the second intermediate data sent by the mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, wherein the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick; A sending unit, configured to send the first mouse event to the system of the cloud server through a virtual mouse to move the target object of the cloud application to the first position, and send the second mouse event to the system of the cloud server through a virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

[0008] In a fourth aspect, an embodiment of the present application further provides a control event processing device, which is applied to a mobile device and includes: A processing unit is configured to determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to a cloud server, so that the cloud server determines a first mouse event, and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data, and send the first mouse event to the system of the cloud server through a virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard. The first intermediate data includes source data, intermediate result data, or target result data in the process of obtaining the first mouse event based on the movement data of the virtual joystick. The second intermediate data includes source data, intermediate result data, or target result data in the process of obtaining the second mouse event or the first keyboard key event based on the movement data of the virtual joystick.

[0009] In summary, the control event processing method and device provided by the embodiments of the present application generate a first mouse event for controlling the movement of the target object for controlling the cloud application based on the user's manipulation of the virtual joystick, and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen, and send the first mouse event to the system of the cloud server through a virtual mouse, send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient. Description of the Drawings

[0010] Figure 1 It is a schematic flowchart of a control event processing method provided by an embodiment of the present application; Figure 2 It is a schematic flowchart of another control event processing method provided by an embodiment of the present application; Figure 3 It is a schematic structural diagram of a control event processing device provided by an embodiment of the present application; Figure 4 It is a schematic structural diagram of another control event processing device provided by an embodiment of the present application. Detailed Embodiments

[0011] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this application. It should be understood that the accompanying drawings in this application are only for the purposes of illustration and description, and are not used to limit the protection scope of this application. Additionally, it should be understood that the schematic drawings are not drawn to actual scale. The flowcharts used in this application illustrate the operations implemented according to some embodiments of this application. It should be understood that the operations in the flowchart may not be implemented in sequence, and steps without logical context relationships may be reversed or implemented simultaneously. Moreover, those skilled in the art can add one or more other operations to the flowchart or remove one or more operations from the flowchart under the guidance of the content of this application.

[0012] In addition, the described embodiments are only some embodiments of this application, rather than all embodiments. The components of the embodiments of this application usually described and illustrated in the accompanying drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of this application claimed, but merely represents the selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative efforts fall within the protection scope of this application.

[0013] It should be noted that the term "including" will be used in the embodiments of this application to indicate the existence of the features stated thereafter, but does not exclude the addition of other features.

[0014] Referring to Figure 1 As shown, the embodiments of this application provide a schematic flowchart of a method for handling manipulation events, which is applied to a cloud server and includes: S10. Receive the first intermediate data and / or the second intermediate data sent by a mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data. Among them, the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of a virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick; In this embodiment, it should be noted that during the process of using the cloud application, the user can manipulate the virtual joystick (drawn by the mobile device) on the user interface where the cloud application screen of the mobile device is located, obtain the first intermediate data and / or the second intermediate data according to the movement data of the virtual joystick, and send the first intermediate data and / or the second intermediate data to the cloud server. After receiving the first intermediate data and / or the second intermediate data, the cloud server will determine the first mouse event and the second mouse event or the first keyboard key event according to the first intermediate data and / or the second intermediate data. The first intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, that is, the first intermediate data includes the movement data of the virtual joystick or the result of any intermediate step in the process of obtaining the first mouse event according to the movement data of the virtual joystick or the first mouse event. The first mouse event may include the mouse event generated by clicking the left mouse button, the mouse event generated by double-clicking the left mouse button, the mouse event generated by clicking the right mouse button, etc. The second intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick, that is, the second intermediate data includes the movement data of the virtual joystick or the result of any intermediate step in the process of obtaining the second mouse event according to the movement data of the virtual joystick or the second mouse event or the result of any intermediate step in the process of obtaining the first keyboard key event according to the movement data of the virtual joystick or the first keyboard key event. The second mouse event may include the mouse event generated by moving the mouse, etc. The first keyboard key event may include the keyboard key event generated by pressing a specific key on the keyboard.

[0015] S11. A system that sends the first mouse event to the cloud server through a virtual mouse to move the target object of the cloud application to the first position, and a system that sends the second mouse event to the cloud server through a virtual mouse or a system that sends the first keyboard key event to the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen so that the target object is located at the first specific position of the cloud application screen rendered by the cloud application.

[0016] In this embodiment, it should be noted that the cloud server can create a virtual mouse and a virtual keyboard, and send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard. Among them, the first mouse event is used to drive the target object to move to the first position, and the second mouse event and the first keyboard key event are used to drive the perspective of the cloud application screen to move. The final effect is that in the cloud application screen rendered by the cloud application, the target object is located at the first specific position, such as the center position. In this way, after the cloud server encodes the cloud application screen rendered by the cloud application and sends it to the mobile device, the target object is located at the second specific position in the cloud application screen decoded and rendered by the mobile device.

[0017] The manipulation event processing method provided by the embodiment of the present application generates a first mouse event for controlling the movement of the target object of the cloud application and a second mouse event or a first keyboard key event for controlling the movement of the perspective of the cloud application screen based on the user's manipulation of the virtual joystick, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, and drives the movement of the target object and the perspective of the cloud application screen, so that the target object is located at the first specific position of the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient.

[0018] Based on the foregoing method embodiment, the process of obtaining the first mouse event according to the movement data of the virtual joystick may include: Determine the first position according to the movement data of the virtual joystick, and generate the first mouse event according to the first position; The process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick includes: Determine the first position according to the movement data of the virtual joystick, and generate the second mouse event or the first keyboard key event according to the first position.

[0019] In this embodiment, it should be noted that the calculation process of the first position may include: determining the movement displacements of the target object on the X-axis and Y-axis according to the movement data of the virtual joystick; determining the end position of the target object's movement according to the movement displacements of the target object in the X-axis direction and Y-axis direction. For example, end position = current position of the target object + (movement displacement of the virtual joystick in the X-axis direction × target distance, movement displacement of the virtual joystick in the Y-axis direction × target distance), where target distance = movement speed of the target object × time window. When calculating the movement speed of the target object, the movement video of the target object when the user uses the application on the PC can be recorded by a high-speed camera, and the movement distance of the target object between two adjacent frames is divided by the frame interval between two adjacent frames as the movement speed of the target object. The time window is the time interval for detecting the movement state of the virtual joystick, which can be set as needed, such as set to 100 ms; determining the corresponding position of the end position on the cloud application screen rendered by the cloud server as the first position. It can be understood that the sizes of the cloud application screen displayed on the mobile device and the cloud application screen rendered by the cloud server may not be the same. Therefore, it is necessary to find the corresponding position of the end position on the cloud application screen displayed on the mobile device on the cloud application screen rendered by the cloud server, and this position is the first position. For example, the aspect ratios of the cloud application screen displayed on the mobile device and the cloud application screen rendered by the cloud server are the same. Taking the position corresponding to the vertex at the upper left corner of the cloud application screen as the coordinate origin, denoting the width and height of the cloud application screen displayed on the mobile device as a1 and b1 respectively, and the width and height of the cloud application screen rendered by the cloud server as a2 and b2 respectively, the coordinates of the end position are (x1, y1), and the coordinates of the first position are (x2, y2), then x2 = x1 × a2 / a1, y2 = y1 × b2 / b1. The first mouse event is the mouse event generated by simulating the manipulation of the mouse at the first position, and the second mouse event / first keyboard key event is the mouse event / keyboard key event generated when simulating the adjustment of the viewing angle of the cloud application screen to a specific viewing angle. After the simulation manipulation, at the specific viewing angle, the target object is located at the first specific position on the cloud application screen.

[0020] Based on the foregoing method embodiment, the method may further include: Determining the second keyboard key event; Sending the second keyboard key event to the system of the cloud server through the virtual keyboard to implement skill release.

[0021] In this embodiment, it should be noted that when implementing a skill release operation, it can be achieved by simulating specific key operations on the keyboard. Specifically, the key operations required to implement the skill release can be determined, and the key events generated by these key operations are used as the second keyboard key events, and the second keyboard key events are sent to the system of the cloud server through the virtual keyboard. The second keyboard key events can be sent by the mobile device to the cloud server or obtained by mapping the touch screen events for virtual keys sent by the mobile device. For example, when the user clicks on a specific virtual key on the cloud application screen displayed on the mobile device, the mobile device sends the corresponding touch screen event to the cloud server, and the cloud server maps the touch screen event into the second keyboard key event; and if the mobile device sends the second keyboard key events to the cloud server, the mobile device needs to map the touch screen events into the second keyboard key events.

[0022] Based on the foregoing method embodiments, the method may further include: Detect whether the target object in the cloud application screen is located at a first specific position. If the target object in the cloud application screen is not located at the first specific position, then determine a third mouse event, or determine a fourth mouse event or a third keyboard key event; Send the third mouse event to the system of the cloud server through the virtual mouse to move the target object to a second position, or send the fourth mouse event to the system of the cloud server through the virtual mouse or send the third keyboard key event to the system of the cloud server through the virtual keyboard to perform a perspective movement on the cloud application screen so that the target object is located at the first specific position of the cloud application screen rendered by the cloud.

[0023] In this embodiment, it should be noted that the cloud server can detect the position of the target object in the cloud application screen rendered by the cloud application through image recognition. When the target object in the cloud application screen is not located at the first specific position, the position of the target object is adjusted or the perspective of the cloud application screen is adjusted by simulating mouse operations or specific keyboard key operations, so that the target object is located at the first specific position in the cloud application screen. For example, by generating a third mouse event that can drive the target object to move to the second position and sending the third mouse event to the system of the cloud server, the target object is moved to the second position. The final effect achieved is that in the cloud application screen rendered by the cloud application, the target object is located at the first specific position. For another example, by generating a fourth mouse event or a third keyboard key event that can drive the perspective of the cloud application screen to move and sending the fourth mouse event or the third keyboard key event to the system of the cloud server, the perspective of the cloud application screen is moved to a specific perspective. The final effect achieved is that in the cloud application screen rendered by the cloud application (the perspective of the cloud application screen is a specific perspective), the target object is located at the first specific position. In addition, it should be noted that this embodiment can be executed when the cloud server renders the first frame of the cloud application screen containing the target object. At this time, the first frame of the cloud application screen rendered by the cloud server may not be sent to the mobile device, but the cloud application screen rendered after adjusting the position of the target object or the perspective of the cloud application screen is sent to the mobile device. In this way, it can be achieved that in the first frame of the cloud application screen rendered and displayed by the mobile device, the target object is located at the second specific position.

[0024] Referring to Figure 2 As shown, an embodiment of the present application provides a schematic flowchart of a method for processing manipulation events, which is applied to a mobile device and includes: S20. Determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard. Among them, the first intermediate data includes the source data, or the intermediate result data, or the target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes the source data, or the intermediate result data, or the target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0025] The manipulation event processing method provided by the embodiment of the present application generates first intermediate data and / or second intermediate data based on the user's manipulation of the virtual joystick, and sends the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server generates a first mouse event for controlling the movement of the target object for controlling the cloud application and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen according to the first intermediate data and / or the second intermediate data, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, drives the movement of the target object and the perspective of the cloud application screen, and makes the target object located at the first specific position of the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient.

[0026] Based on the foregoing method embodiment, the method may further include: Obtain a touch screen event generated by the user's manipulation of the virtual button, and send the touch screen event to the cloud server, so that the cloud server maps the touch screen event into a second keyboard key event and sends the second keyboard key event to the system of the cloud server through the virtual keyboard; or Obtain a touch screen event generated by the user's manipulation of the virtual button, map the touch screen event into a second keyboard key event, and send the second keyboard key event to the cloud server, so that the cloud server sends the second keyboard key event to the system of the cloud server through the virtual keyboard.

[0027] Based on the foregoing method embodiment, the method may further include: Receive the encoded cloud application screen sent by the cloud server, decode the encoded cloud application screen, detect whether the target object in the decoded cloud application screen is located at the second specific position. If the target object in the decoded cloud application screen is not located at the second specific position, determine a third mouse event, or determine a fourth mouse event or a third keyboard key event; Send the third mouse event to the cloud server, or send the fourth mouse event or the third keyboard key event to the cloud server, so that the cloud server sends the third mouse event to the system of the cloud server through the virtual mouse, or sends the fourth mouse event to the system of the cloud server through the virtual mouse or sends the third keyboard key event to the system of the cloud server through the virtual keyboard.

[0028] In this embodiment, it should be noted that, compared with the previous embodiment in which the cloud server detects the cloud application screen, in this embodiment, the mobile device is used to detect the cloud application screen, and the mobile device generates a third mouse event, or generates a fourth mouse event or a third keyboard key event. The process of generating these manipulation events is the same as the process of generating the corresponding manipulation events in the previous embodiment in which the cloud server detects the cloud application screen, and will not be elaborated here. In addition, it should be noted that, in addition to the method of sending the third mouse event to the cloud server, the source data or the result of any intermediate step in the process of generating the third mouse event can also be sent to the cloud server, so that the cloud server generates the third mouse event according to the received data. Similarly, in addition to the method of sending the fourth mouse event or the third keyboard key event to the cloud server, the source data or the result of any intermediate step in the process of generating the fourth mouse event or the source data or the result of any intermediate step in the process of generating the third keyboard key event can also be sent to the cloud server, so that the cloud server generates the fourth mouse event or the third keyboard key event according to the received data.

[0029] Referring to Figure 3 As shown, an embodiment of the present application provides a structural schematic diagram of a manipulation event processing device, which is applied to a cloud server and includes: A determination unit 30, configured to receive first intermediate data and / or second intermediate data sent by a mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, where the first intermediate data includes source data, intermediate result data, or target result data in the process of obtaining the first mouse event according to the movement data of a virtual joystick, and the second intermediate data includes source data, intermediate result data, or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick; A sending unit 31, configured to send the first mouse event to the system of the cloud server through a virtual mouse, so as to move a target object of the cloud application to a first position, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard, so as to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

[0030] The control event processing device provided by the embodiment of the present application generates a first mouse event for controlling the movement of the target object of the cloud application and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen based on the user's manipulation of the virtual joystick, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient.

[0031] Referring to Figure 4 As shown, the embodiment of the present application provides a schematic structural diagram of a control event processing device, which is applied to a mobile device and includes: A processing unit 40, configured to determine first intermediate data and / or second intermediate data, and send the first intermediate data and / or second intermediate data to the cloud server, so that the cloud server determines a first mouse event, a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard, where the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0032] The control event processing device provided by the embodiment of the present application generates first intermediate data and / or second intermediate data based on the user's manipulation of the virtual joystick, and sends the first intermediate data and / or second intermediate data to the cloud server, so that the cloud server generates a first mouse event for controlling the movement of the target object of the cloud application and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen according to the first intermediate data and / or the second intermediate data, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient.

[0033] The control event processing device provided by the embodiment of the present application has the same implementation process as the control event processing method provided by the embodiment of the present application, and can achieve the same effects as the control event processing method provided by the embodiment of the present application, which will not be elaborated here.

[0034] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for handling a manipulation event, characterized in that: Applied to cloud servers, including: Receive first intermediate data and / or second intermediate data sent by a mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, wherein the first intermediate data includes source data or intermediate result data or target result data in a process of obtaining the first mouse event according to movement data of a virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in a process of obtaining the second mouse event or the first keyboard key event according to movement data of the virtual joystick; The first mouse event is sent to the system of the cloud server via the virtual mouse to move the target object of the cloud application to the first position, and the second mouse event is sent to the system of the cloud server via the virtual mouse or the first keyboard key event is sent to the system of the cloud server via the virtual keyboard to move the perspective of the cloud application screen so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

2. The method according to claim 1, characterized in that The process of obtaining the first mouse event according to the movement data of the virtual joystick includes: Determine a first position according to the movement data of the virtual joystick, and generate a first mouse event according to the first position; The process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick includes: A first position is determined according to the movement data of the virtual joystick, and a second mouse event or a first keyboard key event is generated according to the first position.

3. The method according to claim 1 or 2, characterized in that Also includes: Determine a second keyboard key event; The second keyboard key event is sent to the cloud server system through the virtual keyboard to realize skill release.

4. The method according to claim 3, characterized in that The determining of the second keyboard key event includes: Receiving a second keyboard key event sent by the user's mobile device; or A touch screen event for a virtual key sent by a user's mobile device is received, and the touch screen event is mapped into a second keyboard key event.

5. The method according to claim 1, characterized in that Also includes: Detecting whether the target object in the cloud application screen is located at a first specific position, and if the target object in the cloud application screen is not located at the first specific position, determining a third mouse event, or determining a fourth mouse event or a third keyboard key event; The third mouse event is sent to the system of the cloud server via the virtual mouse to move the target object to the second position, or the fourth mouse event is sent to the system of the cloud server via the virtual mouse or the third keyboard key event is sent to the system of the cloud server via the virtual keyboard to move the perspective of the cloud application screen so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

6. A method for handling a manipulation event, characterized in that: Applicable to mobile devices, including: Determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines the first mouse event and the second mouse event or the first keyboard key event based on the first intermediate data and / or the second intermediate data, sends the first mouse event to the cloud server system through the virtual mouse, and sends the second mouse event to the cloud server system through the virtual mouse or sends the first keyboard key event to the cloud server system through the virtual keyboard, wherein the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event based on the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event based on the movement data of the virtual joystick.

7. The method according to claim 6, characterized in that Also includes: A system for acquiring a touch screen event generated by a user manipulating a virtual key, sending the touch screen event to a cloud server so that the cloud server maps the touch screen event to a second keyboard key event, and sending the second keyboard key event to the cloud server through the virtual keyboard; or Acquire a touch screen event generated by a user operating a virtual key, map the touch screen event into a second keyboard key event, and send the second keyboard key event to a cloud server so that the cloud server sends the second keyboard key event to the cloud server system through a virtual keyboard.

8. The method according to claim 6 or 7, characterized in that Also includes: Receiving the encoded cloud application screen sent by the cloud server, decoding the encoded cloud application screen, detecting whether the target object in the decoded cloud application screen is located at the second specific position, and if the target object in the decoded cloud application screen is not located at the second specific position, determining a third mouse event, or determining a fourth mouse event or a third keyboard key event; Send the third mouse event to the cloud server, or send the fourth mouse event or the third keyboard key event to the cloud server, so that the cloud server sends the third mouse event to the cloud server's system through the virtual mouse, or sends the fourth mouse event to the cloud server's system through the virtual mouse or sends the third keyboard key event to the cloud server's system through the virtual keyboard.

9. A control event processing device, characterized in that: Applied to cloud servers, including: a determination unit, configured to receive first intermediate data and / or second intermediate data sent by a mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, wherein the first intermediate data includes source data or intermediate result data or target result data in a process of obtaining the first mouse event according to movement data of a virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in a process of obtaining the second mouse event or the first keyboard key event according to movement data of the virtual joystick; A sending unit is used to send a first mouse event to the system of the cloud server through a virtual mouse to move a target object of the cloud application to a first position, and to send a second mouse event to the system of the cloud server through a virtual mouse or to send a first keyboard key event to the system of the cloud server through a virtual keyboard to move the perspective of the cloud application screen so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

10. A control event processing device, characterized in that: Applicable to mobile devices, including: A processing unit is used to determine first intermediate data and / or second intermediate data, and send the first intermediate data and / or second intermediate data to a cloud server so that the cloud server determines a first mouse event and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data, and sends the first mouse event to the cloud server system via a virtual mouse, and sends the second mouse event to the cloud server system via a virtual mouse or sends the first keyboard key event to the cloud server system via a virtual keyboard, wherein the first intermediate data includes source data or intermediate result data or target result data in a process of obtaining the first mouse event based on movement data of a virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in a process of obtaining the second mouse event or the first keyboard key event based on movement data of the virtual joystick.

Images