Manipulation Event Handling Method and Device

Abstract

The present application provides a method and apparatus for handling manipulation events. The method includes: receiving first intermediate data and / or second intermediate data sent by a mobile device, determining a first mouse event, and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data; sending the first mouse event to the system of a cloud server through a virtual mouse to move a target object of a cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application, and accurate positioning operations on the application object of the cloud application that only supports keyboard and mouse manipulation can be realized by a user.

Description

Technical Field

[0001] The present invention relates to the field of cloud applications, and particularly to a method and device for handling manipulation events. Background Art

[0002] By simulating the input of a gamepad through a virtual gamepad, a user can use a cloud application (such as a cloud game) that supports gamepad manipulation through a mobile device (such as a mobile phone, iPad, etc.). However, for some cloud applications that only support keyboard and mouse manipulation (such as a cloud game of the MOBA type of Multiplayer Online Battle Arena), due to the lack of a physical mouse, the user cannot perform the precise movement operation of an application object that can only be achieved with a mouse.

[0003] Therefore, how to provide a solution that can enable a user to perform the precise movement operation of an application object of a cloud application that only supports keyboard and mouse manipulation has become a technical problem to be solved urgently. Summary of the Invention

[0004] In view of the technical problems existing in the prior art, an embodiment of the present application provides a method and device for handling manipulation events.

[0005] In a first aspect, an embodiment of the present application provides a method for handling manipulation events, which is applied to a cloud server and includes:

[0006] Receiving first intermediate data and / or second intermediate data sent by a mobile device, and determining a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, where the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of a virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick;

[0007] Sending the first mouse event to the system of the cloud server through a virtual mouse, so as to move the target object of the cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard, so as to perform a perspective movement on the cloud application screen, and enable the target object to be located at a first specific position of the cloud application screen rendered by the cloud application.

[0008] In a second aspect, an embodiment of the present application further provides a method for handling manipulation events, which is applied to a mobile device and includes:

[0009] Determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, and send the first mouse event to the system of the cloud server through a virtual mouse, and send the second mouse event to the system of the cloud server through a virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard, wherein the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0010] In a third aspect, an embodiment of the present application further provides a control event processing device, which is applied to a cloud server and includes:

[0011] A determination unit, configured to receive the first intermediate data and / or the second intermediate data sent by the mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, wherein the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick;

[0012] A sending unit, configured to send the first mouse event to the system of the cloud server through a virtual mouse to move the target object of the cloud application to the first position, and send the second mouse event to the system of the cloud server through a virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

[0013] In a fourth aspect, an embodiment of the present application further provides a control event processing device, which is applied to a mobile device and includes:

[0014] A processing unit is configured to determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to a cloud server, so that the cloud server determines a first mouse event, and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data, and send the first mouse event to the system of the cloud server through a virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard. The first intermediate data includes source data, intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick. The second intermediate data includes source data, intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0015] In summary, the manipulation event processing method and apparatus provided in the embodiments of the present application generate a first mouse event for controlling the movement of a target object for a cloud application based on the user's manipulation of a virtual joystick, and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen, and send the first mouse event to the system of the cloud server through a virtual mouse, send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen, thereby realizing precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a schematic flowchart of a manipulation event processing method provided by an embodiment of the present application;

[0017] Figure 2 It is a schematic flowchart of another manipulation event processing method provided by an embodiment of the present application;

[0018] Figure 3 It is a schematic structural diagram of a manipulation event processing apparatus provided by an embodiment of the present application;

[0019] Figure 4 It is a schematic structural diagram of another manipulation event processing apparatus provided by an embodiment of the present application. DETAILED DESCRIPTION

[0020] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of this application. It should be understood that the accompanying drawings in this application are only for the purposes of illustration and description, and are not used to limit the protection scope of this application. Additionally, it should be understood that the schematic drawings are not drawn to scale. The flowcharts used in this application illustrate the operations implemented according to some embodiments of this application. It should be understood that the operations in the flowchart may not be implemented in sequence, and steps without a logical context relationship may be reversed or implemented simultaneously. In addition, those skilled in the art may add one or more other operations to the flowchart or remove one or more operations from the flowchart under the guidance of the content of this application.

[0021] In addition, the described embodiments are only some of the embodiments of this application, rather than all of the embodiments. The components of the embodiments of this application usually described and illustrated in the accompanying drawings here may be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents the selected embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative efforts belong to the scope of protection of this application.

[0022] It should be noted that the term "including" will be used in the embodiments of this application to indicate the existence of the subsequently stated features, but does not exclude the addition of other features.

[0023] Refer to Figure 1 As shown, the embodiments of this application provide a schematic flowchart of a method for handling manipulation events, which is applied to a cloud server and includes:

[0024] S10. Receive the first intermediate data and / or the second intermediate data sent by a mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data. Among them, the first intermediate data includes the source data, or the intermediate result data, or the target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes the source data, or the intermediate result data, or the target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick;

[0025] In this embodiment, it should be noted that during the process of using the cloud application, the user can manipulate the virtual joystick (drawn by the mobile device) on the user interface where the cloud application screen of the mobile device is located, obtain the first intermediate data and / or the second intermediate data based on the movement data of the virtual joystick, and send the first intermediate data and / or the second intermediate data to the cloud server. After receiving the first intermediate data and / or the second intermediate data, the cloud server will determine the first mouse event and the second mouse event or the first keyboard key event based on the first intermediate data and / or the second intermediate data. The first intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the first mouse event based on the movement data of the virtual joystick, that is, the first intermediate data includes the movement data of the virtual joystick or the result of any intermediate step in the process of obtaining the first mouse event based on the movement data of the virtual joystick or the first mouse event. The first mouse event may include the mouse event generated by clicking the left mouse button, the mouse event generated by double-clicking the left mouse button, the mouse event generated by clicking the right mouse button, etc. The second intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the second mouse event or the first keyboard key event based on the movement data of the virtual joystick, that is, the second intermediate data includes the movement data of the virtual joystick or the result of any intermediate step in the process of obtaining the second mouse event based on the movement data of the virtual joystick or the second mouse event or the result of any intermediate step in the process of obtaining the first keyboard key event based on the movement data of the virtual joystick or the first keyboard key event. The second mouse event may include the mouse event generated by moving the mouse, etc. The first keyboard key event may include the keyboard key event generated by pressing a specific key on the keyboard.

[0026] S11. A system that sends the first mouse event to the cloud server through a virtual mouse to move the target object of the cloud application to the first position, and a system that sends the second mouse event to the cloud server through a virtual mouse or a system that sends the first keyboard key event to the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen so that the target object is located at the first specific position of the cloud application screen rendered by the cloud application.

[0027] In this embodiment, it should be noted that the cloud server can create a virtual mouse and a virtual keyboard, and send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard. Among them, the first mouse event is used to drive the target object to move to the first position, and the second mouse event and the first keyboard key event are used to drive the perspective of the cloud application screen to move. The final effect is that in the cloud application screen rendered by the cloud application, the target object is located at the first specific position, such as the center position. In this way, after the cloud server encodes the cloud application screen rendered by the cloud application and sends it to the mobile device, the target object in the cloud application screen decoded and rendered by the mobile device is located at the second specific position.

[0028] The method for processing manipulation events provided in the embodiment of the present application generates a first mouse event for controlling the movement of the target object of the cloud application and a second mouse event or a first keyboard key event for controlling the movement of the perspective of the cloud application screen based on the user's manipulation of the virtual joystick, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, and drives the movement of the target object and the perspective of the cloud application screen, so that the target object is located at the first specific position of the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient.

[0029] Based on the foregoing method embodiment, the process of obtaining the first mouse event according to the movement data of the virtual joystick may include:

[0030] Determine the first position according to the movement data of the virtual joystick, and generate the first mouse event according to the first position;

[0031] The process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick includes:

[0032] Determine the first position according to the movement data of the virtual joystick, and generate the second mouse event or the first keyboard key event according to the first position.

[0033] In this embodiment, it should be noted that the calculation process of the first position may include: determining the moving displacements of the target object on the X-axis and Y-axis according to the moving data of the virtual joystick; determining the end position of the target object's movement according to the moving displacements of the target object in the X-axis direction and Y-axis direction. For example, end position = current position of the target object + (moving displacement of the virtual joystick in the X-axis direction × target distance, moving displacement of the virtual joystick in the Y-axis direction × target distance), where target distance = moving speed of the target object × time window. When calculating the moving speed of the target object, the moving video of the target object when the user uses the application on the PC can be recorded by a high-speed camera, and the moving distance between two adjacent frames of the target object is divided by the frame interval between two adjacent frames as the moving speed of the target object. The time window is the time interval for detecting the moving state of the virtual joystick and can be set as needed, for example, set to 100 ms; determining the corresponding position of the end position on the cloud application screen rendered by the cloud server as the first position. It can be understood that the sizes of the cloud application screen displayed on the mobile device and the cloud application screen rendered by the cloud server may not be the same. Therefore, it is necessary to find the corresponding position of the end position on the cloud application screen displayed on the mobile device on the cloud application screen rendered by the cloud server, and this position is the first position. For example, the aspect ratios of the cloud application screen displayed on the mobile device and the cloud application screen rendered by the cloud server are the same. Taking the position corresponding to the vertex at the upper left corner of the cloud application screen as the coordinate origin, denoting the width and height of the cloud application screen displayed on the mobile device as a1 and b1 respectively, and the width and height of the cloud application screen rendered by the cloud server as a2 and b2 respectively, the coordinates of the end position are (x1, y1), and the coordinates of the first position are (x2, y2), then x2 = x1 × a2 / a1, y2 = y1 × b2 / b1. The first mouse event is the mouse event generated by simulating the manipulation of the mouse at the first position, and the second mouse event / first keyboard key event is the mouse event / keyboard key event generated when simulating the adjustment of the perspective of the cloud application screen to a specific perspective. After the simulation manipulation and at the specific perspective, the target object is located at the first specific position on the cloud application screen.

[0034] Based on the foregoing method embodiment, the method may further include:

[0035] Determining the second keyboard key event;

[0036] Sending the second keyboard key event to the system of the cloud server through the virtual keyboard to implement skill release.

[0037] In this embodiment, it should be noted that when implementing a skill release operation, it can be achieved by simulating specific key operations on the keyboard. Specifically, the key operations required to implement the skill release can be determined, and the key events generated by the key operations are used as the second keyboard key events, and the second keyboard key events are sent to the system of the cloud server through the virtual keyboard. The second keyboard key events can be sent by the mobile device to the cloud server or obtained by mapping the touch screen events of the mobile device for virtual keys. For example, when the user clicks on a specific virtual key on the cloud application screen displayed on the mobile device, the mobile device sends the corresponding touch screen event to the cloud server, and the cloud server maps the touch screen event into the second keyboard key event; if the mobile device sends the second keyboard key events to the cloud server, the mobile device needs to map the touch screen events into the second keyboard key events.

[0038] Based on the foregoing method embodiment, the method may further include:

[0039] Detect whether the target object in the cloud application screen is located at a first specific position. If the target object in the cloud application screen is not located at the first specific position, determine a third mouse event, or determine a fourth mouse event or a third keyboard key event;

[0040] Send the third mouse event to the system of the cloud server through the virtual mouse to move the target object to a second position, or send the fourth mouse event to the system of the cloud server through the virtual mouse or send the third keyboard key event to the system of the cloud server through the virtual keyboard to perform a perspective movement on the cloud application screen so that the target object is located at the first specific position of the cloud application screen rendered by the cloud application.

[0041] In this embodiment, it should be noted that the cloud server can detect the position of the target object in the cloud application screen rendered by the cloud application through image recognition. When the target object in the cloud application screen is not located at the first specific position, the position of the target object is adjusted or the perspective of the cloud application screen is adjusted by simulating mouse operations or specific keyboard key operations, so that the target object is located at the first specific position in the cloud application screen. For example, by generating a third mouse event that can drive the target object to move to the second position and sending the third mouse event to the system of the cloud server, the target object is moved to the second position. The final effect achieved is that in the cloud application screen rendered by the cloud application, the target object is located at the first specific position. For another example, by generating a fourth mouse event or a third keyboard key event that can drive the perspective of the cloud application screen to move and sending the fourth mouse event or the third keyboard key event to the system of the cloud server, the perspective of the cloud application screen is moved to a specific perspective. The final effect achieved is that in the cloud application screen rendered by the cloud application (the perspective of the cloud application screen is the specific perspective), the target object is located at the first specific position. In addition, it should be noted that this embodiment can be executed when the cloud server renders the first frame of the cloud application screen containing the target object. At this time, the first frame of the cloud application screen rendered by the cloud server may not be sent to the mobile device, but the cloud application screen rendered after adjusting the position of the target object or the perspective of the cloud application screen is sent to the mobile device. In this way, it can be achieved that in the first frame of the cloud application screen rendered and displayed by the mobile device, the target object is located at the second specific position.

[0042] Referring to Figure 2 As shown, an embodiment of the present application provides a flowchart of a method for processing manipulation events, which is applied to a mobile device and includes:

[0043] S20. Determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard. Among them, the first intermediate data includes the source data, or intermediate result data, or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes the source data, or intermediate result data, or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0044] The manipulation event processing method provided by the embodiments of the present application generates first intermediate data and / or second intermediate data based on the user's manipulation of a virtual joystick, and sends the first intermediate data and / or the second intermediate data to a cloud server, so that the cloud server generates a first mouse event for controlling the movement of a target object in a cloud application and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen according to the first intermediate data and / or the second intermediate data, and sends the first mouse event to the system of the cloud server through a virtual mouse, sends the second mouse event to the system of the cloud server through a virtual mouse, or sends the first keyboard key event to the system of the cloud server through a virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position in the cloud application screen, thereby realizing the precise positioning operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise positioning operation of the application object, and the operation is relatively convenient.

[0045] Based on the foregoing method embodiments, the method may further include:

[0046] Obtain a touch screen event generated by the user's manipulation of a virtual button, and send the touch screen event to the cloud server, so that the cloud server maps the touch screen event into a second keyboard key event, and sends the second keyboard key event to the system of the cloud server through a virtual keyboard; or

[0047] Obtain a touch screen event generated by the user's manipulation of a virtual button, map the touch screen event into a second keyboard key event, and send the second keyboard key event to the cloud server, so that the cloud server sends the second keyboard key event to the system of the cloud server through a virtual keyboard.

[0048] Based on the foregoing method embodiments, the method may further include:

[0049] Receive the encoded cloud application screen sent by the cloud server, decode the encoded cloud application screen, detect whether the target object in the decoded cloud application screen is located at a second specific position. If the target object in the decoded cloud application screen is not located at the second specific position, determine a third mouse event, or determine a fourth mouse event or a third keyboard key event;

[0050] Send the third mouse event to the cloud server, or send the fourth mouse event or the third keyboard key event to the cloud server, so that the cloud server sends the third mouse event to the system of the cloud server through a virtual mouse, or sends the fourth mouse event to the system of the cloud server through a virtual mouse, or sends the third keyboard key event to the system of the cloud server through a virtual keyboard.

[0051] In this embodiment, it should be noted that, compared with the previous embodiment in which the cloud server detects the cloud application screen, in this embodiment, the mobile device is used to detect the cloud application screen, and the mobile device is used to generate a third mouse event, or generate a fourth mouse event or a third keyboard key event. The process of generating these manipulation events is the same as the process of generating the corresponding manipulation events in the previous embodiment in which the cloud server detects the cloud application screen, and will not be elaborated here. In addition, it should be noted that, in addition to the method of sending the third mouse event to the cloud server, the source data or the result of any intermediate step in the process of generating the third mouse event can also be sent to the cloud server, so that the cloud server generates the third mouse event according to the received data. Similarly, in addition to the method of sending the fourth mouse event or the third keyboard key event to the cloud server, the source data in the process of generating the fourth mouse event or the result of any intermediate step in the process of generating the fourth mouse event or the source data in the process of generating the third keyboard key event or the result of any intermediate step in the process of generating the third keyboard key event can also be sent to the cloud server, so that the cloud server generates the fourth mouse event or the third keyboard key event according to the received data.

[0052] Referring to Figure 3 As shown, an embodiment of the present application provides a structural schematic diagram of a manipulation event processing device, which is applied to a cloud server and includes:

[0053] A determination unit 30, configured to receive first intermediate data and / or second intermediate data sent by a mobile device, and determine a first mouse event, and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, where the first intermediate data includes source data, intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data, intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick;

[0054] A sending unit 31, configured to send the first mouse event to the system of the cloud server through a virtual mouse, so as to move the target object of the cloud application to a first position, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through a virtual keyboard, so as to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

[0055] The control event processing device provided by the embodiment of the present application generates a first mouse event for controlling the movement of the target object of the cloud application and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen based on the user's manipulation of the virtual joystick, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen, thereby realizing the precise movement operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise movement operation of the application object, and the operation is relatively convenient.

[0056] Referring to Figure 4 As shown, the embodiment of the present application provides a schematic structural diagram of a control event processing device, which is applied to a mobile device and includes:

[0057] A processing unit 40, configured to determine first intermediate data and / or second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines a first mouse event and a second mouse event or a first keyboard key event according to the first intermediate data and / or the second intermediate data, send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard, where the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

[0058] The control event processing device provided by the embodiment of the present application generates first intermediate data and / or second intermediate data based on the user's manipulation of the virtual joystick, and sends the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server generates a first mouse event for controlling the movement of the target object of the cloud application and a second mouse event or a first keyboard key event for controlling the perspective movement of the cloud application screen according to the first intermediate data and / or the second intermediate data, and sends the first mouse event to the system of the cloud server through the virtual mouse, sends the second mouse event to the system of the cloud server through the virtual mouse or sends the first keyboard key event to the system of the cloud server through the virtual keyboard, driving the movement of the target object and the perspective of the cloud application screen, so that the target object is located at a first specific position on the cloud application screen, thereby realizing the precise movement operation of the application object. Moreover, the entire solution only needs to manipulate the virtual joystick to realize the precise movement operation of the application object, and the operation is relatively convenient.

[0059] The control event processing device provided by the embodiment of the present application has the same implementation process as the control event processing method provided by the embodiment of the present application, and can achieve the same effects as the control event processing method provided by the embodiment of the present application, which will not be elaborated herein.

[0060] The above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should be covered by the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for handling manipulation events, characterized in that, Applied to a cloud server, including: Receiving first intermediate data and / or second intermediate data sent by a mobile device, determining a first mouse event, and a second mouse event or a first keyboard key event based on the first intermediate data and / or the second intermediate data, wherein the first intermediate data includes source data, or intermediate result data, or target result data in the process of obtaining the first mouse event according to the movement data of a virtual joystick, and the second intermediate data includes source data, or intermediate result data, or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick; Sending the first mouse event to the system of the cloud server through a virtual mouse to move the target object of the cloud application to a first position, and sending the second mouse event to the system of the cloud server through the virtual mouse or sending the first keyboard key event to the system of the cloud server through a virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at a first specific position of the cloud application screen rendered by the cloud application.

2. The method according to claim 1, characterized in that, The process of obtaining the first mouse event according to the movement data of the virtual joystick includes: Determining a first position according to the movement data of the virtual joystick, and generating a first mouse event according to the first position; The process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick includes: Determining a first position according to the movement data of the virtual joystick, and generating a second mouse event or a first keyboard key event according to the first position.

3. The method according to claim 1 or 2, characterized in that, It further includes: Determining a second keyboard key event; Sending the second keyboard key event to the system of the cloud server through the virtual keyboard to implement skill release.

4. The method according to claim 3, wherein The determining of the second keyboard key event includes: Receiving a second keyboard key event sent by the user's mobile device; or Receiving a touch screen event for a virtual button sent by the user's mobile device, and mapping the touch screen event into a second keyboard key event.

5. The method according to claim 1, characterized in that, It further includes: Detecting whether the target object in the cloud application screen is located at the first specific position. If the target object in the cloud application screen is not located at the first specific position, determining a third mouse event, or determining a fourth mouse event or a third keyboard key event; Sending the third mouse event to the system of the cloud server through the virtual mouse to move the target object to a second position, or sending the fourth mouse event to the system of the cloud server through the virtual mouse or sending the third keyboard key event to the system of the cloud server through the virtual keyboard to perform a perspective movement on the cloud application screen, so that the target object is located at the first specific position of the cloud application screen rendered by the cloud application.

6. A method for handling manipulation events, characterized in that, Applied to a mobile device, including: Determine the first intermediate data and / or the second intermediate data, and send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines the first mouse event, and the second mouse event or the first keyboard key event according to the first intermediate data and / or the second intermediate data, and send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard, wherein the first intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

7. The method according to claim 6, wherein Further included: Obtain the touch screen event generated by the user manipulating the virtual button, and send the touch screen event to the cloud server, so that the cloud server maps the touch screen event into the second keyboard key event, and send the second keyboard key event to the system of the cloud server through the virtual keyboard; Or Obtain the touch screen event generated by the user manipulating the virtual button, map the touch screen event into the second keyboard key event, and send the second keyboard key event to the cloud server, so that the cloud server sends the second keyboard key event to the system of the cloud server through the virtual keyboard.

8. The method according to claim 6 or 7, characterized in that, Further included: Receive the encoded cloud application screen sent by the cloud server, decode the encoded cloud application screen, detect whether the target object in the decoded cloud application screen is located at the second specific position, if the target object in the decoded cloud application screen is not located at the second specific position, then determine the third mouse event, or determine the fourth mouse event or the third keyboard key event; Send the third mouse event to the cloud server, or send the fourth mouse event or the third keyboard key event to the cloud server, so that the cloud server sends the third mouse event to the system of the cloud server through the virtual mouse, or sends the fourth mouse event to the system of the cloud server through the virtual mouse or sends the third keyboard key event to the system of the cloud server through the virtual keyboard.

9. An event handling device for manipulation, characterized in that, Applied to the cloud server, including: A determination unit, configured to receive the first intermediate data and / or the second intermediate data sent by the mobile device, and determine the first mouse event, and the second mouse event or the first keyboard key event according to the first intermediate data and / or the second intermediate data, wherein the first intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes the source data or the intermediate result data or the target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick; A sending unit, which is used to send a first mouse event to the system of a cloud server through a virtual mouse, so as to move a target object of a cloud application to a first position, and send a second mouse event to the system of the cloud server through the virtual mouse or send a first keyboard key event to the system of the cloud server through a virtual keyboard, so as to perform a perspective movement on the cloud application screen and make the target object located at a first specific position of the cloud application screen rendered by the cloud application.

10. An event handling device for manipulation, characterized in that, Applied to a mobile device, including: A processing unit, which is used to determine first intermediate data and / or second intermediate data, send the first intermediate data and / or the second intermediate data to the cloud server, so that the cloud server determines a first mouse event according to the first intermediate data and / or the second intermediate data, and a second mouse event or a first keyboard key event, send the first mouse event to the system of the cloud server through the virtual mouse, and send the second mouse event to the system of the cloud server through the virtual mouse or send the first keyboard key event to the system of the cloud server through the virtual keyboard, wherein the first intermediate data includes source data or intermediate result data or target result data in the process of obtaining the first mouse event according to the movement data of the virtual joystick, and the second intermediate data includes source data or intermediate result data or target result data in the process of obtaining the second mouse event or the first keyboard key event according to the movement data of the virtual joystick.

Images