Cloud game streaming processing method and device, equipment and storage medium

By receiving and converting key and mouse operation events on the iOS streaming client, the operation inaccuracy caused by the protocol differences between iOS and non-iOS systems is solved, and the unbiased key and mouse operation experience of cloud game streaming is achieved.

CN118921395APending Publication Date: 2024-11-08HANGZHOU WULIAN TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410973382.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

In the cloud game streaming scenario, due to the different key and mouse message protocols of the iOS system and non-iOS systems, the key and mouse operation events of the iOS system cannot be accurately sent to the host side of the non-iOS system, and accurate game operation control cannot be achieved.

Method used

By receiving key and mouse operation events, we obtain the mapping relationship corresponding to the types of key and mouse operation events. Based on the mapping relationship, the key and mouse operation events of the iOS system are converted into operation events on the host side and transmitted to the host side to ensure that the iOS streaming client and There is no deviation in keyboard and mouse operations between hosts of non-iOS systems.

Benefits of technology

It realizes the accuracy and non-bias operation of keyboard and mouse when streaming cloud games between iOS and non-iOS systems, ensuring that users have a good keyboard and mouse operation experience on iOS streaming clients.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118921395A_ABST
    Figure CN118921395A_ABST
Patent Text Reader

Abstract

The invention provides a cloud game streaming processing method and device, equipment and a storage medium, and the method comprises the steps that an iOS streaming client receives a keyboard and mouse operation event, and the keyboard and mouse operation event comprises a keyboard key event and / or a mouse operation event; obtaining a mapping relation corresponding to the type of the keyboard and mouse operation event; based on the mapping relation, converting the keyboard and mouse operation event into an operation event for the host end; and transmitting the operation event to the host end. According to the method and the device, the keyboard and mouse operation event of the iOS streaming client is converted into the operation event for the host end through the mapping relation, the keyboard and mouse operation event can be accurately sent to the host end, when the iOS streaming client performs streaming with the host end of a non-iOS system, the host end can be normally operated by using a local keyboard and mouse without deviation, and the operation efficiency is improved. And the user is ensured to have good keyboard and mouse operation experience at the iOS streaming client.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of cloud gaming technology, and in particular to a cloud gaming streaming processing method, device, equipment and storage medium. Background Art

[0002] With the popularization of mobile Internet, the widespread promotion of the fifth-generation mobile communication technology (5G), and the continuous advancement of artificial intelligence (AI) technology, games are entering a new stage of development. Games are an important application scenario for computers. With the help of high-performance computers, some large-scale games can render realistic pictures and bring excellent experience to players. But at the same time, these games generally have high requirements for computer performance. Many players cannot experience the above games due to the limitations of low-end hardware, and buying a computer that can run the above games smoothly will be a considerable expense. The emergence of cloud games has solved the above problems very well.

[0003] Cloud gaming is a gaming method based on cloud computing technology, which allows players to enjoy high-quality gaming experience by connecting to cloud servers through the Internet without the need for high-performance hardware. Since the game is actually run on the cloud server rather than the local client, it greatly reduces the threshold for players to enter the gaming world.

[0004] The local client and cloud server can use different operating systems, and different operating systems may use different keyboard and mouse message protocols. When cloud games are streamed between different operating systems, the game operation data sent by the local client to the cloud server may not be able to accurately operate the cloud server due to the differences in keyboard and mouse message protocols. Summary of the invention

[0005] In view of this, the purpose of this application is to provide a cloud game streaming processing method, device, equipment and storage medium, which can accurately send keyboard and mouse operation events to the host side. When the iOS streaming client is streaming with a non-iOS system host side, the local keyboard and mouse can be used to operate the host side normally and without deviation. The specific technical solution is as follows:

[0006] In a first aspect, the present application provides a cloud game streaming processing method, which is applied to an iOS streaming client, and the method includes:

[0007] Receiving keyboard and mouse operation events, wherein the keyboard and mouse operation events include keyboard key events and / or mouse operation events;

[0008] Obtaining a mapping relationship corresponding to the type of the keyboard and mouse operation event;

[0009] Based on the mapping relationship, converting the keyboard and mouse operation events into operation events for the host side;

[0010] The operation event is transmitted to the host end.

[0011] In a possible implementation, the acquiring the mapping relationship corresponding to the type of the keyboard and mouse operation event includes:

[0012] If the keyboard and mouse operation event is the keyboard key event, a keyboard mapping table is obtained, where the keyboard mapping table represents a mapping relationship between iOS keyboard information and host-side keyboard information.

[0013] In a possible implementation, the acquiring the mapping relationship corresponding to the type of the keyboard and mouse operation event includes:

[0014] If the keyboard and mouse operation event is a mouse button event in the mouse operation event, a mouse button mapping relationship is obtained, where the mouse button mapping relationship represents a mapping relationship between iOS mouse button information and host-side mouse button information.

[0015] In a possible implementation, if the keyboard and mouse operation event is a mouse wheel event in the mouse operation event, the receiving of the keyboard and mouse operation event includes:

[0016] Receiving a moving state of a transparent canvas, the transparent canvas being located at an upper layer of a display area of ​​the cloud game in the iOS streaming client;

[0017] If the moving state of the transparent canvas is upward or downward, it is determined that the mouse wheel event occurs.

[0018] In a possible implementation, before receiving the keyboard and mouse operation event, the method further includes:

[0019] Obtaining window information of the cloud game on the iOS streaming client;

[0020] A transparent canvas is created in an upper layer of the display area of ​​the cloud game based on the window information.

[0021] In a second aspect, the present application further provides a cloud game streaming processing device, which is applied to an iOS streaming client, and the device includes:

[0022] A receiving module, used for receiving keyboard and mouse operation events, wherein the keyboard and mouse operation events include keyboard key events and / or mouse operation events;

[0023] An acquisition module, used for acquiring a mapping relationship corresponding to the type of the keyboard and mouse operation event;

[0024] A conversion module, used for converting the keyboard and mouse operation events into operation events for a host end based on the mapping relationship;

[0025] The transmission module is used to transmit the operation event to the host end.

[0026] In a possible implementation, if the keyboard and mouse operation event is the keyboard key event, the acquisition module is specifically used to:

[0027] A keyboard mapping table is obtained, wherein the keyboard mapping table represents a mapping relationship between iOS keyboard information and host-side keyboard information.

[0028] In a possible implementation, if the keyboard and mouse operation event is a mouse wheel event in the mouse operation event, the receiving module includes:

[0029] A receiving unit, configured to receive a moving state of a transparent canvas, wherein the transparent canvas is located at an upper layer of a display area of ​​the cloud game in the iOS streaming client;

[0030] The determination unit is used to determine the occurrence of the mouse wheel event if the moving state of the transparent canvas is upward or downward.

[0031] In a third aspect, the present application further provides a computer device, including: a memory and a processor;

[0032] Wherein, the memory is used to store computer programs;

[0033] The processor is used to execute the computer program in the memory to implement the method described in the first aspect or any one of the first aspects.

[0034] In a fourth aspect, the present application further provides a computer-readable storage medium storing instructions, which, when executed on a computer, enables the computer to execute the method described in the first aspect or any one of the first aspects.

[0035] In an embodiment of the present application, an iOS streaming client receives a keyboard and mouse operation event, which includes a keyboard key event and / or a mouse operation event; obtains a mapping relationship corresponding to the type of the keyboard and mouse operation event; based on the mapping relationship, converts the keyboard and mouse operation event into an operation event for the host side; and transmits the operation event to the host side. The embodiment of the present application converts the keyboard and mouse operation events of the iOS streaming client into operation events for the host side through a mapping relationship, and can accurately send the keyboard and mouse operation events to the host side. When the iOS streaming client is streaming with a host side of a non-iOS system, it can use the local keyboard and mouse to operate the host side normally and without deviation, ensuring that the user has a good keyboard and mouse operation experience on the iOS streaming client. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0037] Figure 1 A flow chart of a cloud game streaming processing method provided by an embodiment of the present application is shown;

[0038] Figure 2 A block diagram of a keyboard and mouse optimization strategy based on iOS cloud game streaming provided by an embodiment of the present application is shown;

[0039] Figure 3 A schematic diagram of the structure of a cloud game streaming processing device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0040] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0041] Cloud gaming is different from traditional gaming. It is a gaming implementation method based on cloud computing, cloud control, rendering and network transmission. It uploads computing power and the game actually runs on the host side of the cloud edge computing node, rather than on the user's local client. The client receives the audio and video data sent by the host side to present the game sound and picture locally. At the same time, the user operates the remote host through the local keyboard and mouse, and sends the game operation control data to the host side to control the game.

[0042] Cloud game streaming is a technology that transmits game images from the host to the client in real time over the Internet. In the cloud game streaming scenario, the client and host can use different operating systems, and the keyboard and mouse message protocols used by different operating systems may be different. When cloud game streaming is performed between different operating systems, the game operation data sent by the client to the host may not be able to accurately operate the host due to the differences in keyboard and mouse message protocols.

[0043] At present, the main operating systems include Apple's mobile operating system iPhone Operating System (iOS), Windows system and Android system. In the embodiment of the present application, the operating system other than the iOS system is referred to as a non-iOS system. The iOS system is a closed source system, and developers do not have the conditions to read the source code flexibly enough to improve certain functions. The interfaces and applications open to developers are not as many as those of non-iOS systems, which makes the iOS system not as active as non-iOS systems in terms of developer activity and system wide use. Implementing more, more open and freer services on the iOS system will be subject to certain restrictions.

[0044] As for the keyboard and mouse function of the iOS system, since the keyboard and mouse message protocol of the iOS system is different from that of the non-iOS system, in the scenario of cloud game streaming between the client using the iOS system and the host using the non-iOS system, if the keyboard and mouse messages obtained by the iOS system are directly sent to the non-iOS system, it will cause confusion and the host cannot be accurately operated. In addition, since the iOS system does not provide users with an effective mouse wheel implementation method, it is impossible to obtain the iOS system's wheel message, and it is also impossible to send the wheel message of the client using the iOS system to the host to implement and operate the host's wheel effect.

[0045] Therefore, an embodiment of the present application provides a cloud game streaming processing method, which can accurately send the keyboard and mouse messages of the iOS system to the host side, and enable the iOS system to use local keyboard and mouse operations to remotely control the host side normally and without deviation when streaming cloud games with non-iOS systems, including users being able to have a very good real-time keyboard and mouse operation experience on the iOS system client.

[0046] See also Figure 1 , shows a flow chart of a cloud game streaming processing method provided by an embodiment of the present application. The embodiment of the present application is applied to an iOS streaming client. The embodiment of the present application at least includes the following steps:

[0047] S11, receiving keyboard and mouse operation events.

[0048] After the user starts the cloud game on the iOS streaming client, he operates the cloud game through the keyboard and / or mouse, and the iOS streaming client can receive keyboard and mouse operation events. Keyboard and mouse operation events may include keyboard key events and / or mouse operation events, and mouse operation events may include mouse key events and mouse wheel events.

[0049] When the user starts the cloud game and clicks a keyboard key, the iOS streaming client can override funcpressesBegan(_presses:Set <uipress>, with event: UIPressesEvent?) and override func pressesEnded(_ presses: Set <uipress>,with event:UIPressesEvent? ) to receive keyboard key events. The specific code is as follows:

[0050] override func pressesBegan(_presses:Set <uipress>,with event:UIPressesEvent? ){

[0051] / / Logger.log("pressesBegan=\(event)")

[0052] isConnectThirdKbd=true

[0053] kbdDispatcher.pressesBegan(presses,with:event)

[0054] super.pressesBegan(presses,with:event)

[0055] }

[0056] / / kbdDispatcher refers to the ThirdKbdDispatcher class, which then calls methods in the class

[0057] override func pressesEnded(_presses:Set <uipress>,with event:UIPressesEvent? ){

[0058] / / Logger.log("pressesEnded=\(event)")

[0059] kbdDispatcher.pressesEnded(presses,with:event)

[0060] super.pressesEnded(presses,with:event)

[0061] }

[0062] Among them, the system class that receives keyboard key events inherits UIViewController. For the convenience of judgment, pressing a keyboard key will trigger the code corresponding to the above pressesBegan, and pressing a keyboard key and then the keyboard key popping up will trigger the code corresponding to the above pressesEnded. Keyboard keys include letter keys, numeric keys, and key combinations. Key combinations can include command prompts (cmd), shift single key or function keys formed by a combination of other keys, ctrl single key or function keys formed by a combination of other keys, etc.

[0063] When the user starts the cloud game and clicks the mouse button, the iOS streaming client can implement mouse tracking through the system callback method. The specific code is as follows:

[0064] func pointerInteraction(_interaction:UIPointerInteraction,regionForrequest:UIPointerRegionRequest,defaultRegion:UIPointerRegion)->UIPointerRegion?

[0065] {ifenableFollow{

[0066] MouseAdapter.shared.sendMouseAbsLocal(x:request.location.x,y:request.location.y)

[0067] }return defaultRegion}

[0068] The code corresponding to pointerInteraction is a system callback method, which is run by the iOS streaming client system. The code MouseAdapter.shared.sendMouseAbsLocal(x:request.location.x,y:request.location.y) is a mouse tracking method, which can obtain the coordinates of the click point when the user clicks the screen with the mouse, so that the mouse on the host side can be displayed at the position corresponding to the click point.

[0069] Since a mouse generally has a left button and a right button, in order to distinguish more accurately, the mouse button events of the embodiment of the present application may include a left mouse button event and a right mouse button event. The embodiment of the present application may determine whether the mouse clicked by the user is the left mouse button or the right mouse button through the following code:

[0070] override func touchesBegan(_touches:Set <uitouch>,with event:UIEvent)

[0071] By running the code corresponding to touchesBegan, you can get event.buttonMask. The value of event.buttonMask is used to distinguish the left and right mouse buttons. If the value of event.buttonMask is 0, it means the mouse button is the left button, and if the value of event.buttonMask is 2, it means the mouse button is the right button.

[0072] Since the iOS system does not provide an application programming interface (API) to receive mouse wheel events, the embodiment of the present application can create a custom MouseScrollView in the game interface of the cloud game. MouseScrollView inherits UIScrollView, and the property of UIScrollView is that it can scroll, so MouseScrollView can implement the customized content of receiving mouse wheel events. The embodiment of the present application determines the state of the mouse wheel by judging the movement state of MouseScrollView. If the MouseScrollView slides up, it means that the user operates the mouse wheel to slide the game interface down. If the MouseScrollView slides down, it means that the user operates the mouse wheel to slide the game interface up. MouseScrollView is referred to as a transparent canvas below.

[0073] Specifically, the embodiment of the present application obtains the window information of the cloud game on the iOS streaming client, and creates a transparent canvas in the upper layer of the display area of ​​the cloud game based on the window information, so that the transparent canvas is located in the upper layer of the display area of ​​the cloud game on the iOS streaming client.

[0074] One way to receive keyboard and mouse operation events is:

[0075] Receive the moving status of the transparent canvas;

[0076] If the moving state of the transparent canvas is upward or downward, it is determined that a mouse wheel event occurs.

[0077] The embodiment of the present application can accurately receive mouse wheel events by creating a transparent canvas.

[0078] Since there are two modes for triggering screen scrolling, namely finger triggering and mouse wheel triggering, for the transparent canvas that captures mouse wheel events, the finger triggering mode needs to be blocked, and only the mouse wheel triggering is retained. In addition, the transparent canvas is set to invisible to prevent the finger scrolling of the iOS streaming client from accidentally triggering the wheel scrolling of the host.

[0079] S12, obtaining a mapping relationship corresponding to the type of keyboard and mouse operation events.

[0080] The embodiment of the present application stores mapping relationships corresponding to different keyboard and mouse operation events in advance in the iOS streaming client. After receiving the keyboard and mouse operation event, the iOS streaming client can obtain the mapping relationship corresponding to the type of the keyboard and mouse operation event from the mapping relationship stored in itself according to the type of the received keyboard and mouse operation event.

[0081] like Figure 2 As shown, the embodiment of the present application can determine the type of keyboard and mouse operation events and determine the mapping relationship according to the type of keyboard and mouse operation events.

[0082] Specifically, if the keyboard and mouse operation event is a keyboard key event, a keyboard mapping table is obtained, wherein the keyboard mapping table represents the mapping relationship between iOS keyboard information and host-side keyboard information.

[0083] Example contents of a keyboard mapping table may include:

[0084] GlobalAllKbdMap

[2041] =[KeyEvent.KEYCODE_ESCAPE];

[0085] GlobalAllKbdMap

[2058] =[KeyEvent.KEYCODE_F1].

[0086] Among them, 2041 and 2058 are iOS keyboard information, which are obtained by running the code for receiving keyboard key events; ESCAPE and F1 are host-side keyboard information.

[0087] If the mouse and keyboard operation event is a mouse button event, a mouse button mapping relationship is obtained, wherein the mouse button mapping relationship represents a mapping relationship between iOS mouse button information and host-side mouse button information.

[0088] An example of a mouse button mapping relationship may be:

[0089] SendMouseEvent(x:0,y:0,z:0,flag:MOUSE_LEFT_BUTTON_UP).

[0090] Among them, x and y are the coordinates of the mouse button click location, that is, the iOS mouse button information, which is obtained by running the mouse tracking code; z is the center axis value. If no mouse wheel event occurs, the z value is 0; flag is a flag bit, which indicates the status of the mouse button. The flag flag can include left button pressed (MOUSE_LEFT_BUTTON_DOWN), left button popped up (MOUSE_LEFT_BUTTON_UP), right button pressed (MOUSE_RIGHT_BUTTON_DOWN), and right button popped up (MOUSE_RIGHT_BUTTON_UP).

[0091] Since the mouse button events may include the left mouse button events and the right mouse button events, the mouse button mapping relationship may also include the left mouse button mapping relationship and the right mouse button mapping relationship.

[0092] An example of the left mouse button mapping relationship may be:

[0093] SendMouseEvent(x:0,y:0,z:0,flag:MOUSE_LEFT_BUTTON_UP);

[0094] An example of a right mouse button mapping relationship may be:

[0095] SendMouseEvent(x:0,y:0,z:0,flag:MOUSE_RIGHT_BUTTON_UP).

[0096] If the mouse and keyboard operation event is a mouse wheel event, the mouse wheel mapping relationship is obtained, wherein the mouse wheel mapping relationship represents the mapping relationship between the iOS mouse wheel information and the host mouse wheel information.

[0097] An example of a mouse wheel mapping relationship may be:

[0098] SendMouseEvent(x:0,y:0,z:1,flag:0);

[0099] SendMouseEvent(x:0,y:0,z:-1,flag:0).

[0100] Among them, the z value of 1 indicates that the transparent canvas is moving upward, and the z value of -1 indicates that the transparent canvas is moving downward.

[0101] The embodiment of the present application customizes the mapping relationship corresponding to different keyboard and mouse operation events, so that the mapping relationship corresponds to the keyboard and mouse operation events of the host side, and can accurately convert the keyboard and mouse operation events of the iOS streaming client into the keyboard and mouse operation events of the host side, so that the iOS streaming client can use the local keyboard and mouse to operate the host side normally and without deviation.

[0102] S13, based on the mapping relationship, converting the keyboard and mouse operation events into operation events for the host side.

[0103] After obtaining the mapping relationship corresponding to the type of the keyboard and mouse operation event, the keyboard and mouse operation event is converted into an operation event for the host side based on the obtained mapping relationship, so that the host side can accurately complete the keyboard and mouse operation event according to the operation event.

[0104] The mapping relationship of the embodiment of the present application can convert the keyboard and mouse message protocol used by the iOS streaming client into the keyboard and mouse message protocol used by the host side, so that the host side can accurately identify keyboard and mouse operation events, thereby realizing control of the cloud game.

[0105] S14, transmitting the operation event to the host side.

[0106] After converting the keyboard and mouse operation events into operation events for the host side, the operation events are transmitted to the host side, so that the same operation effects as the iOS streaming client can be achieved on the host side, such as sliding, clicking and other operations of the iOS streaming client.

[0107] In an embodiment of the present application, an iOS streaming client receives a keyboard and mouse operation event, which includes a keyboard key event and / or a mouse operation event; obtains a mapping relationship corresponding to the type of the keyboard and mouse operation event; based on the mapping relationship, converts the keyboard and mouse operation event into an operation event for the host side; and transmits the operation event to the host side. The embodiment of the present application converts the keyboard and mouse operation events of the iOS streaming client into operation events for the host side through a mapping relationship, and can accurately send the keyboard and mouse operation events to the host side. When the iOS streaming client is streaming with a host side of a non-iOS system, it can use the local keyboard and mouse to operate the host side normally and without deviation, ensuring that the user has a good keyboard and mouse operation experience on the iOS streaming client.

[0108] In addition, the specific contents of the keyboard mapping table may include:

[0109] GlobalAllKbdMap

[2041] =[KeyEvent.KEYCODE_ESCAPE];

[0110] GlobalAllKbdMap

[2058] =[KeyEvent.KEYCODE_F1];

[0111] GlobalAllKbdMap

[2059] =[KeyEvent.KEYCODE_F2];

[0112] GlobalAllKbdMap

[2060] =[KeyEvent.KEYCODE_F3];

[0113] GlobalAllKbdMap

[2061] =[KeyEvent.KEYCODE_F4];

[0114] GlobalAllKbdMap

[2062] =[KeyEvent.KEYCODE_F5];

[0115] GlobalAllKbdMap

[2063] =[KeyEvent.KEYCODE_F6];

[0116] GlobalAllKbdMap

[2064] =[KeyEvent.KEYCODE_F7];

[0117] GlobalAllKbdMap

[2065] =[KeyEvent.KEYCODE_F8];

[0118] GlobalAllKbdMap

[2066] =[KeyEvent.KEYCODE_F9];

[0119] GlobalAllKbdMap

[2067] =[KeyEvent.KEYCODE_F10];

[0120] GlobalAllKbdMap

[2068] =[KeyEvent.KEYCODE_F11];

[0121] GlobalAllKbdMap

[2069] =[KeyEvent.KEYCODE_F12];

[0122] GlobalAllKbdMap

[2053] =[KeyEvent.KEYCODE_GRAVE];

[0123] GlobalAllKbdMap

[2030] =[KeyEvent.KEYCODE_1];

[0124] GlobalAllKbdMap

[2031] =[KeyEvent.KEYCODE_2];

[0125] GlobalAllKbdMap

[2032] =[KeyEvent.KEYCODE_3];

[0126] GlobalAllKbdMap

[2033] =[KeyEvent.KEYCODE_4];

[0127] GlobalAllKbdMap

[2034] =[KeyEvent.KEYCODE_5];

[0128] GlobalAllKbdMap

[2035] =[KeyEvent.KEYCODE_6];

[0129] GlobalAllKbdMap

[2036] =[KeyEvent.KEYCODE_7];

[0130] GlobalAllKbdMap

[2037] =[KeyEvent.KEYCODE_8];

[0131] GlobalAllKbdMap

[2038] =[KeyEvent.KEYCODE_9];

[0132] GlobalAllKbdMap

[2039] =[KeyEvent.KEYCODE_0];

[0133] GlobalAllKbdMap

[2045] =[KeyEvent.KEYCODE_MINUS];

[0134] GlobalAllKbdMap

[2046] =[KeyEvent.KEYCODE_EQUALS];

[0135] GlobalAllKbdMap

[2042] =[KeyEvent.KEYCODE_DEL];

[0136] GlobalAllKbdMap

[2043] =[KeyEvent.KEYCODE_TAB];

[0137] GlobalAllKbdMap

[2020] =[KeyEvent.KEYCODE_Q];

[0138] GlobalAllKbdMap

[2026] =[KeyEvent.KEYCODE_W];

[0139] GlobalAllKbdMap

[2008] =[KeyEvent.KEYCODE_E];

[0140] GlobalAllKbdMap

[2021] =[KeyEvent.KEYCODE_R];

[0141] GlobalAllKbdMap

[2023] =[KeyEvent.KEYCODE_T];

[0142] GlobalAllKbdMap

[2028] =[KeyEvent.KEYCODE_Y];

[0143] GlobalAllKbdMap

[2024] =[KeyEvent.KEYCODE_U];

[0144] GlobalAllKbdMap

[2012] =[KeyEvent.KEYCODE_I];

[0145] GlobalAllKbdMap

[2018] =[KeyEvent.KEYCODE_O];

[0146] GlobalAllKbdMap

[2019] =[KeyEvent.KEYCODE_P];

[0147] GlobalAllKbdMap

[2047] =[KeyEvent.KEYCODE_LEFT_BRACKET];

[0148] GlobalAllKbdMap

[2048] =[KeyEvent.KEYCODE_RIGHT_BRACKET];

[0149] GlobalAllKbdMap

[2049] =[KeyEvent.KEYCODE_BACKSLASH];

[0150] GlobalAllKbdMap

[2057] =[KeyEvent.KEYCODE_CAPS_LOCK];

[0151] GlobalAllKbdMap

[2004] =[KeyEvent.KEYCODE_A];

[0152] GlobalAllKbdMap

[2022] =[KeyEvent.KEYCODE_S];

[0153] GlobalAllKbdMap

[2007] =[KeyEvent.KEYCODE_D];

[0154] GlobalAllKbdMap

[2009] =[KeyEvent.KEYCODE_F];

[0155] GlobalAllKbdMap

[2010] =[KeyEvent.KEYCODE_G];

[0156] GlobalAllKbdMap

[2011] =[KeyEvent.KEYCODE_H];

[0157] GlobalAllKbdMap

[2013] =[KeyEvent.KEYCODE_J];

[0158] GlobalAllKbdMap

[2014] =[KeyEvent.KEYCODE_K];

[0159] GlobalAllKbdMap

[2015] =[KeyEvent.KEYCODE_L];

[0160] GlobalAllKbdMap

[2051] =[KeyEvent.KEYCODE_SEMICOLON];

[0161] GlobalAllKbdMap

[2052] =[KeyEvent.KEYCODE_APOSTROPHE];

[0162] GlobalAllKbdMap

[2040] =[KeyEvent.KEYCODE_ENTER];

[0163] GlobalAllKbdMap

[2225] =[KeyEvent.KEYCODE_SHIFT_LEFT];

[0164] GlobalAllKbdMap

[2029] =[KeyEvent.KEYCODE_Z];

[0165] GlobalAllKbdMap

[2027] =[KeyEvent.KEYCODE_X];

[0166] GlobalAllKbdMap

[2006] =[KeyEvent.KEYCODE_C];

[0167] GlobalAllKbdMap

[2025] =[KeyEvent.KEYCODE_V];

[0168] GlobalAllKbdMap

[2005] =[KeyEvent.KEYCODE_B];

[0169] GlobalAllKbdMap

[2017] =[KeyEvent.KEYCODE_N];

[0170] GlobalAllKbdMap

[2016] =[KeyEvent.KEYCODE_M];

[0171] GlobalAllKbdMap

[2054] =[KeyEvent.KEYCODE_COMMA];

[0172] GlobalAllKbdMap

[2055] =[KeyEvent.KEYCODE_PERIOD];

[0173] GlobalAllKbdMap

[2056] =[KeyEvent.KEYCODE_SLASH];

[0174] GlobalAllKbdMap

[2229] =[KeyEvent.KEYCODE_SHIFT_RIGHT];

[0175] GlobalAllKbdMap

[2224] =[KeyEvent.KEYCODE_CTRL_LEFT];

[0176] GlobalAllKbdMap

[2227] =[KeyEvent.KEYCODE_WINDOW];

[0177] GlobalAllKbdMap

[2226] =[KeyEvent.KEYCODE_ALT_LEFT];

[0178] GlobalAllKbdMap

[2044] =[KeyEvent.KEYCODE_SPACE];

[0179] GlobalAllKbdMap

[2230] =[KeyEvent.KEYCODE_ALT_RIGHT];

[0180] GlobalAllKbdMap

[2101] =[KeyEvent.KEYCODE_MENU];

[0181] GlobalAllKbdMap

[2228] =[KeyEvent.KEYCODE_CTRL_RIGHT];

[0182] GlobalAllKbdMap

[2070] =[KeyEvent.KEYCODE_SYSRQ];

[0183] GlobalAllKbdMap

[2071] =[KeyEvent.KEYCODE_SCROLL_LOCK];

[0184] GlobalAllKbdMap

[2072] =[KeyEvent.KEYCODE_BREAK];

[0185] GlobalAllKbdMap

[2073] =[KeyEvent.KEYCODE_INSERT];

[0186] GlobalAllKbdMap

[2074] =[KeyEvent.KEYCODE_HOME];

[0187] GlobalAllKbdMap

[2075] =[KeyEvent.KEYCODE_PAGE_UP];

[0188] GlobalAllKbdMap

[2076] =[KeyEvent.KEYCODE_DEL];

[0189] GlobalAllKbdMap

[2077] =[KeyEvent.KEYCODE_MOVE_END];

[0190] GlobalAllKbdMap

[2078] =[KeyEvent.KEYCODE_PAGE_DOWN];

[0191] GlobalAllKbdMap

[2082] =[KeyEvent.KEYCODE_DPAD_UP];

[0192] GlobalAllKbdMap

[2080] =[KeyEvent.KEYCODE_DPAD_LEFT];

[0193] GlobalAllKbdMap

[2081] =[KeyEvent.KEYCODE_DPAD_DOWN];

[0194] GlobalAllKbdMap

[2079] =[KeyEvent.KEYCODE_DPAD_RIGHT];

[0195] GlobalAllKbdMap

[2083] =[KeyEvent.KEYCODE_NUM_LOCK];

[0196] GlobalAllKbdMap

[2084] =[KeyEvent.KEYCODE_SLASH];

[0197] GlobalAllKbdMap

[2085] =[KeyEvent.KEYCODE_STAR];

[0198] GlobalAllKbdMap

[2086] =[KeyEvent.KEYCODE_MINUS];

[0199] GlobalAllKbdMap

[2095] =[KeyEvent.KEYCODE_7];

[0200] GlobalAllKbdMap

[2096] =[KeyEvent.KEYCODE_8];

[0201] GlobalAllKbdMap

[2097] =[KeyEvent.KEYCODE_9];

[0202] GlobalAllKbdMap

[2087] =[KeyEvent.KEYCODE_PLUS];

[0203] GlobalAllKbdMap

[2092] =[KeyEvent.KEYCODE_4];

[0204] GlobalAllKbdMap

[2093] =[KeyEvent.KEYCODE_5];

[0205] GlobalAllKbdMap

[2094] =[KeyEvent.KEYCODE_6];

[0206] GlobalAllKbdMap

[2089] =[KeyEvent.KEYCODE_1];

[0207] GlobalAllKbdMap

[2090] =[KeyEvent.KEYCODE_2];

[0208] GlobalAllKbdMap

[2091] =[KeyEvent.KEYCODE_3];

[0209] GlobalAllKbdMap

[2088] =[KeyEvent.KEYCODE_ENTER];

[0210] GlobalAllKbdMap

[2098] =[KeyEvent.KEYCODE_0];

[0211] GlobalAllKbdMap

[2099] =[KeyEvent.KEYCODE_PERIOD].

[0212] It should be noted that the content of the keyboard mapping table can be set according to the actual scenario needs, and the embodiments of the present application are not limited thereto.

[0213] Next, a cloud game streaming processing device provided by the present application is introduced. The cloud game streaming processing device introduced below and the cloud game streaming processing method introduced above can refer to each other.

[0214] See also Figure 3 , shows a schematic diagram of the structure of a cloud game streaming processing device provided by the present application, the device comprising:

[0215] A receiving module 301 is used to receive keyboard and mouse operation events, where the keyboard and mouse operation events include keyboard key events and / or mouse operation events;

[0216] An acquisition module 302 is used to acquire a mapping relationship corresponding to the type of the keyboard and mouse operation event;

[0217] A conversion module 303, used for converting the keyboard and mouse operation events into operation events for the host end based on the mapping relationship;

[0218] The transmission module 304 is used to transmit the operation event to the host end.

[0219] In the embodiment of the present application, if the keyboard and mouse operation event is the keyboard key event, the acquisition module 302 is specifically used to:

[0220] A keyboard mapping table is obtained, wherein the keyboard mapping table represents a mapping relationship between iOS keyboard information and host-side keyboard information.

[0221] In the embodiment of the present application, if the keyboard and mouse operation event is a mouse button event in the mouse operation event, the acquisition module 302 is specifically used to:

[0222] A mouse button mapping relationship is obtained, where the mouse button mapping relationship represents a mapping relationship between iOS mouse button information and host-side mouse button information.

[0223] In the embodiment of the present application, if the keyboard and mouse operation event is a mouse wheel event in the mouse operation event, the receiving module 301 includes:

[0224] A receiving unit, configured to receive a moving state of a transparent canvas, wherein the transparent canvas is located at an upper layer of a display area of ​​the cloud game in the iOS streaming client;

[0225] The determination unit is used to determine the occurrence of the mouse wheel event if the moving state of the transparent canvas is upward or downward.

[0226] In the embodiment of the present application, the device further includes:

[0227] A window acquisition module, used to obtain the window information of the cloud game on the iOS streaming client;

[0228] A creation module is used to create a transparent canvas on an upper layer of a display area of ​​the cloud game based on the window information.

[0229] The embodiment of the present application also provides a computer device, including: a memory and a processor;

[0230] Wherein, the memory is used to store computer programs;

[0231] The processor is used to execute the computer program in the memory to implement the method described in the above method embodiment.

[0232] The embodiment of the present application also provides a computer-readable storage medium storing instructions, which, when executed on a computer, enables the computer to execute the method described in the above method embodiment.

[0233] In an embodiment of the present application, the iOS streaming client receives keyboard and mouse operation events through a receiving module, and the keyboard and mouse operation events include keyboard key events and / or mouse operation events; obtains the mapping relationship corresponding to the type of the keyboard and mouse operation event through an acquisition module; converts the keyboard and mouse operation event into an operation event for the host side based on the mapping relationship through a conversion module; and transmits the operation event to the host side through a transmission module. The embodiment of the present application converts the keyboard and mouse operation events of the iOS streaming client into operation events for the host side through a mapping relationship, and can accurately send the keyboard and mouse operation events to the host side. When the iOS streaming client is streaming with a host side of a non-iOS system, it can use the local keyboard and mouse to operate the host side normally and without deviation, ensuring that the user has a good keyboard and mouse operation experience on the iOS streaming client.

[0234] It should be noted that the same or similar parts between the various embodiments can be referred to each other. As for the device embodiment and the system embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0235] For the above-mentioned embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should know that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0236] Finally, it should be noted that, in this article, the term "comprises", "includes" or any other variation thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0237] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

[0238] The above is only a preferred implementation of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.< / uitouch> < / uipress> < / uipress> < / uipress> < / uipress>

Claims

1. A cloud game streaming processing method, It is characterized in that Applied to an iOS streaming client, the method includes: Receiving keyboard and mouse operation events, wherein the keyboard and mouse operation events include keyboard key events and / or mouse operation events; Obtaining a mapping relationship corresponding to the type of the keyboard and mouse operation event; Based on the mapping relationship, converting the keyboard and mouse operation events into operation events for the host side; The operation event is transmitted to the host end.

2. The method according to claim 1, It is characterized in that The obtaining of the mapping relationship corresponding to the type of the keyboard and mouse operation event includes: If the keyboard and mouse operation event is the keyboard key event, a keyboard mapping table is obtained, where the keyboard mapping table represents a mapping relationship between iOS keyboard information and host-side keyboard information.

3. The method according to claim 1, It is characterized in that The obtaining of the mapping relationship corresponding to the type of the keyboard and mouse operation event includes: If the keyboard and mouse operation event is a mouse button event in the mouse operation event, a mouse button mapping relationship is obtained, where the mouse button mapping relationship represents a mapping relationship between iOS mouse button information and host-side mouse button information.

4. The method according to any one of claims 1 to 3, It is characterized in that If the keyboard and mouse operation event is a mouse wheel event in the mouse operation event, the receiving of the keyboard and mouse operation event includes: Receiving a moving state of a transparent canvas, the transparent canvas being located at an upper layer of a display area of ​​the cloud game in the iOS streaming client; If the moving state of the transparent canvas is upward or downward, it is determined that the mouse wheel event occurs.

5. The method according to any one of claims 1 to 3, It is characterized in that Before receiving the keyboard and mouse operation event, the method further includes: Obtaining window information of the cloud game on the iOS streaming client; A transparent canvas is created in an upper layer of the display area of ​​the cloud game based on the window information.

6. A cloud game streaming processing device, It is characterized in that Applied to iOS streaming client, the device includes: A receiving module, used for receiving keyboard and mouse operation events, wherein the keyboard and mouse operation events include keyboard key events and / or mouse operation events; An acquisition module, used for acquiring a mapping relationship corresponding to the type of the keyboard and mouse operation event; A conversion module, used for converting the keyboard and mouse operation events into operation events for a host end based on the mapping relationship; The transmission module is used to transmit the operation event to the host end.

7. The device according to claim 6, It is characterized in that If the keyboard and mouse operation event is the keyboard key event, the acquisition module is specifically used to: A keyboard mapping table is obtained, wherein the keyboard mapping table represents a mapping relationship between iOS keyboard information and host-side keyboard information.

8. The device according to claim 6 or 7, It is characterized in that If the keyboard and mouse operation event is a mouse wheel event in the mouse operation event, the receiving module includes: A receiving unit, configured to receive a moving state of a transparent canvas, wherein the transparent canvas is located at an upper layer of a display area of ​​the cloud game in the iOS streaming client; The determination unit is used to determine the occurrence of the mouse wheel event if the moving state of the transparent canvas is upward or downward.

9. A computer device, It is characterized in that include: Memory and processor; The memory is used to store computer programs; The processor is configured to execute the computer program in the memory to implement the method according to any one of claims 1 to 5.

10. A computer-readable storage medium, It is characterized in that The device stores instructions which, when executed on a computer, cause the computer to execute the method according to any one of claims 1 to 5.