Operation control method and device of cloud game, computer device and storage medium

Abstract

The present disclosure provides a cloud game operation control method and device, computer equipment and a storage medium, wherein the method is applied to a cloud game platform, and the method comprises the following steps: determining game state information of a target cloud game currently running by a cloud game client; determining at least one operation instruction set matched with the game state information based on the game state information, and indicating the at least one operation instruction set to the cloud game client; the operation instruction set is obtained by performing operation instruction identification processing based on a target game video matched with the game state information; the target game video is a game operation video corresponding to a game operation result meeting a target condition; in response to receiving a target operation instruction set selected by the cloud game client, generating game picture data after the cloud game client executes the target operation instruction set, and sending the game picture data to the cloud game client.

Description

Technical Field

[0001] This disclosure relates to the field of cloud gaming technology, and more specifically, to a cloud gaming operation control method, apparatus, computer equipment, and storage medium. Background Technology

[0002] During gameplay, players will face various tasks. For some players, such as new players or those with limited gaming experience, completing the game often requires repeatedly trying different control commands to see if they can succeed. This necessitates multiple playthroughs and consumes a significant amount of time, resulting in a poor user experience.

[0003] Therefore, how to reduce the cost of trial and error in player interaction and improve the interactive experience while allowing players to interact normally is a problem worth studying. Summary of the Invention

[0004] This disclosure provides at least one cloud gaming operation control method, apparatus, computer device, and storage medium.

[0005] In a first aspect, embodiments of this disclosure provide an operation control method for cloud gaming, applied to a cloud gaming platform, comprising: determining game state information of a target cloud game currently running on a cloud gaming client; determining at least one set of operation instructions matching the game state information based on the game state information, and instructing the at least one set of operation instructions to the cloud gaming client; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video matching the game state information; the target game video is a game operation video whose corresponding game operation result meets target conditions; and in response to receiving feedback from the cloud gaming client of the selected target set of operation instructions, generating game screen data corresponding to the execution of the target set of operation instructions by the cloud gaming client, and sending it to the cloud gaming client.

[0006] In one optional implementation, the operation instruction set is obtained by performing operation instruction recognition processing on the target game video in the following manner: filtering out multiple key frames including virtual game objects from the target game video; performing semantic recognition processing on the multiple key frames to determine the object behavior information of the virtual game objects; and generating the operation instruction set based on the object behavior information.

[0007] In an optional implementation, the method further includes: after acquiring multiple operation instruction sets based on multiple target game videos, generating tag information corresponding to each operation instruction set according to game-related data in the target game videos; the step of instructing the at least one operation instruction set to the cloud gaming client includes: instructing the multiple operation instruction sets and their respective corresponding tag information to the cloud gaming client.

[0008] In one optional implementation, the step of indicating the plurality of operation instruction sets and their corresponding tag information to the cloud gaming client includes: determining the correlation scores between the plurality of operation instruction sets and the game status information of the cloud gaming client based on the tag information of the plurality of operation instruction sets; determining the operation result scores of the plurality of operation instruction sets based on the tag information of the plurality of operation instruction sets; sorting the plurality of operation instruction sets based on the correlation scores and operation result scores; and indicating the sorted plurality of operation instruction sets and their corresponding tag information to the cloud gaming client.

[0009] Secondly, embodiments of this disclosure provide an operation control method for cloud gaming, applied to a cloud gaming client, comprising: displaying a game interface of a target cloud game; displaying at least one set of operation instructions matching the current game state information of the game; the set of operation instructions being obtained after operation instruction recognition processing based on a target game video matching the game state information; determining the target set of operation instructions in response to the selection of a target set of operation instructions from the at least one set of operation instructions; receiving game screen data after executing the target set of operation instructions, and displaying the current game screen based on the game screen data.

[0010] In one optional implementation, the operation instruction set is generated by semantically recognizing multiple keyframes including virtual game objects in the target game video and then using the object behavior information of the recognized virtual game objects; the target game video is a game operation video whose corresponding game operation results meet the target conditions.

[0011] In one optional implementation, displaying at least one set of operation instructions that matches the current game state information of the game match includes: displaying the at least one set of operation instructions and tag information corresponding to each set of operation instructions; the tag information is used to indicate the game attribute information corresponding to the set of operation instructions, and the game attribute information is used for the user to select a target set of operation instructions.

[0012] In one optional implementation, after displaying the at least one set of operation instructions, the method further includes: in response to a preview instruction for any of the operation instruction sets, acquiring preview screen data in response to the preview instruction; and displaying a game preview screen corresponding to the preview screen data outside the current game screen.

[0013] In one optional implementation, after displaying the at least one set of operation instructions, the method further includes: in response to a synchronous preview instruction for a plurality of the operation instruction sets, acquiring preview screen data generated in response to the synchronous preview instruction; and synchronously displaying game preview screens corresponding to the plurality of preview screen data outside the current game screen.

[0014] In one optional implementation, the preview screen data is obtained according to the following steps: obtaining mixed screen data after mixing the preview screen data and the current game screen data; displaying the game preview screen includes: dividing the game display page into multiple display areas based on the number of game screens corresponding to the mixed screen data, and displaying the current game screen and at least one game preview screen in the multiple display areas respectively.

[0015] Thirdly, this disclosure also provides a cloud gaming operation control device applied to a cloud gaming platform, comprising: a first determining module, configured to determine game status information of a target cloud game currently running on a cloud gaming client; a first sending module, configured to determine at least one set of operation instructions matching the game status information based on the game status information, and to instruct the at least one set of operation instructions to the cloud gaming client; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video matching the game status information; the target game video is a game operation video whose corresponding game operation result meets the target conditions; and a second sending module, configured to, in response to receiving feedback from the cloud gaming client of the selected target set of operation instructions, generate game screen data corresponding to the execution of the target set of operation instructions by the cloud gaming client, and send it to the cloud gaming client.

[0016] In one optional implementation, the operation instruction set is obtained by performing operation instruction recognition processing on the target game video in the following manner: filtering out multiple key frames including virtual game objects from the target game video; performing semantic recognition processing on the multiple key frames to determine the object behavior information of the virtual game objects; and generating the operation instruction set based on the object behavior information.

[0017] In an optional embodiment, the device further includes a processing module, configured to: after acquiring multiple operation instruction sets obtained based on multiple target game videos, generate tag information corresponding to each operation instruction set according to game-related data in the target game videos; when the first sending module instructs the at least one operation instruction set to the cloud gaming client, it is configured to: instruct the multiple operation instruction sets and their respective corresponding tag information to the cloud gaming client.

[0018] In one optional implementation, when the first sending module indicates the plurality of operation instruction sets and their respective corresponding tag information to the cloud gaming client, it is configured to: determine the correlation score between the plurality of operation instruction sets and the game status information of the cloud gaming client based on the tag information of the plurality of operation instruction sets; and determine the operation result score of the plurality of operation instruction sets based on the tag information of the plurality of operation instruction sets; sort the plurality of operation instruction sets based on the correlation score and the operation result score, and indicate the sorted plurality of operation instruction sets and their respective corresponding tag information to the cloud gaming client.

[0019] Fourthly, this disclosure also provides a cloud gaming operation control device applied to a cloud gaming client, comprising: a first display module for displaying the game interface of a target cloud game; a second display module for displaying at least one set of operation instructions matching the current game state information of the game; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video matching the game state information; a second determination module for determining the target set of operation instructions in response to the selection of the target set of operation instructions in the at least one set of operation instructions; and a third display module for receiving game screen data after the cloud gaming client executes the target set of operation instructions, and displaying the current game screen based on the game screen data.

[0020] In one optional implementation, the operation instruction set is generated by semantically recognizing multiple keyframes including virtual game objects in the target game video and then using the object behavior information of the recognized virtual game objects; the target game video is a game operation video whose corresponding game operation results meet the target conditions.

[0021] In one optional implementation, when the first display module displays at least one set of operation instructions that matches the current game state information of the game match, it is configured to: display the at least one set of operation instructions and tag information corresponding to each set of operation instructions; the tag information is used to indicate the game attribute information corresponding to the set of operation instructions, and the game attribute information is used for the user to select a target set of operation instructions.

[0022] In one optional implementation, after displaying the at least one set of operation instructions, the second display module is further configured to: in response to a preview instruction for any of the operation instruction sets, acquire preview screen data fed back in response to the preview instruction; and display a game preview screen corresponding to the preview screen data outside the current game screen.

[0023] In one optional implementation, after displaying the at least one set of operation instructions, the second display module is further configured to: in response to a synchronous preview instruction for the plurality of operation instruction sets, acquire preview screen data generated in response to the synchronous preview instruction respectively; and synchronously display game preview screens corresponding to the plurality of preview screen data respectively outside the current game screen.

[0024] In one optional implementation, the preview screen data is obtained according to the following steps: obtaining mixed screen data after mixing the preview screen data and the current game screen data; when displaying the game preview screen, the second display module is used to: divide the game display page into multiple display areas based on the number of game screens corresponding to the mixed screen data, and display the current game screen and at least one of the game preview screens in the multiple display areas respectively.

[0025] Fifthly, an optional implementation of this disclosure also provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is configured to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the steps in any of the possible implementations of the first aspect or the second aspect described above are performed.

[0026] In a sixth aspect, an optional implementation of this disclosure also provides a computer-readable storage medium storing a computer program that, when run, performs the steps of any of the possible implementations of the first or second aspect described above.

[0027] This disclosure provides a cloud gaming operation control method, apparatus, computer device, and storage medium. The cloud gaming platform can provide a set of operation instructions matching the current game state information of the target cloud game. Here, the operation instruction set is obtained by identifying and processing operation instructions from a target game video that matches the game state information. For example, if there are historical game videos of other users completing games under similar game states, the operation instruction set used when completing those games can be obtained through the identification and processing of those historical game videos. In this way, game players can refer to these predictable operation instruction sets to quickly complete the game without having to manually select different operation instructions and repeatedly try different games. This reduces the cost of trial and error and improves the interactive experience while allowing players to interact normally with the game.

[0028] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0029] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. These drawings are incorporated in and constitute a part of this specification. They illustrate embodiments conforming to this disclosure and, together with the specification, serve to explain the technical solutions of this disclosure. It should be understood that the following drawings only show some embodiments of this disclosure and should not be considered as limiting the scope. Those skilled in the art can obtain other related drawings based on these drawings without creative effort.

[0030] Figure 1 A schematic diagram of a cloud gaming system architecture provided by an embodiment of this disclosure is shown;

[0031] Figure 2 This diagram illustrates a specific structural schematic of a cloud gaming system provided in an embodiment of the present disclosure;

[0032] Figure 3 A flowchart of an operation control method for cloud gaming provided in an embodiment of this disclosure is shown;

[0033] Figure 4a A schematic diagram illustrating a plurality of operation instruction sets provided in an embodiment of this disclosure is shown;

[0034] Figure 4b A schematic diagram illustrating another set of multiple operation instructions provided in an embodiment of this disclosure is shown;

[0035] Figure 5aThis illustration shows a schematic diagram of a game preview screen under an operation instruction set provided by an embodiment of the present disclosure;

[0036] Figure 5b This illustration shows a schematic diagram of a game preview screen under multiple operation instruction sets provided by an embodiment of the present disclosure;

[0037] Figure 6 A flowchart of another cloud gaming operation control method provided by an embodiment of this disclosure is shown;

[0038] Figure 7 A schematic diagram of an operation control device for cloud gaming provided in an embodiment of this disclosure is shown;

[0039] Figure 8 A schematic diagram of another cloud gaming operation control device provided in an embodiment of this disclosure is shown;

[0040] Figure 9 A schematic diagram of a computer device provided in an embodiment of this disclosure is shown. Detailed Implementation

[0041] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown herein can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0042] Research has found that during gameplay, because the game tasks have a certain level of difficulty, users with insufficient gaming experience, such as novice players, need to select different operation commands each time and try multiple times in the game to complete it. This requires players to spend a lot of time selecting different combinations of operation methods and repeatedly playing the game, resulting in a poor interactive experience.

[0043] Based on the above research, this disclosure provides a cloud gaming operation control method. The cloud gaming platform can provide the cloud gaming client with an operation instruction set that matches the current game state information of the target cloud game. Here, the operation instruction set is obtained by identifying and processing operation instructions from a target game video that matches the game state information. For example, if there are historical game videos of other users completing the game under similar game states, the operation instruction set used when completing that game can be obtained through the identification and processing of those historical game videos. In this way, game players can refer to and select these predictable operation instruction sets to quickly complete the game, without having to manually select different operation instructions and repeatedly try different gameplay scenarios. This reduces the cost of trial and error and improves the interactive experience while allowing players to interact normally with the game.

[0044] The shortcomings of the above solutions are the result of the inventor's practical experience and careful research. Therefore, the discovery process of the above problems and the solutions proposed in this disclosure below should be considered as the inventor's contribution to this disclosure.

[0045] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0046] To facilitate understanding of this embodiment, a detailed description of the cloud gaming operation control method disclosed in this disclosure is provided first. The execution entity of the cloud gaming operation control method provided in this disclosure is generally a computer device with a certain computing capability. This computer device may include, for example, a terminal device, a server, or other processing devices. The terminal device may be a user equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, in-vehicle device, wearable device, etc. In some possible implementations, the cloud gaming operation control method can be implemented by the processor calling computer-readable instructions stored in memory.

[0047] The cloud gaming discussed in this disclosure specifically refers to online game services that do not require downloading and installation locally. Users can play games on different platforms, even without a game console, that are not installed locally. Users can access the cloud gaming platform via devices such as TVs, computers, and mobile phones. No game download or installation is required; a network connection is all that's needed to run the game, thus overcoming the limitations of game content across different platforms.

[0048] In this disclosure, the cloud gaming system architecture is first briefly described. For example... Figure 1 The diagram shown is a schematic representation of a cloud gaming system architecture provided in this embodiment of the present disclosure, involving a cloud gaming client 11, a cloud gaming platform 12, and a cloud gaming runtime 13. The cloud gaming client 11 communicates with the cloud gaming platform 12, and the cloud gaming platform 12 communicates with the cloud gaming runtime 13.

[0049] The following is a brief description of the functions that can be achieved at each end of the system.

[0050] For cloud gaming clients (cloud gaming client SDKs), the carrier can be an application or platform capable of running cloud games. A cloud gaming client can provide players with a visual interface, allowing them to play cloud games on that interface. The cloud gaming client can also establish a connection with the cloud gaming platform, transmitting user-selected commands to the platform and receiving game screen data that the cloud gaming platform needs to render and display to the player.

[0051] Specifically, a cloud gaming platform may include the following modules: a transmission module for connecting to the cloud gaming client (cloud gaming client SDK) and the cloud gaming toolkit (GameSDK) in the cloud gaming runtime to transmit game data and operation commands; a control module for controlling player operation permissions and integrating player-uploaded operation commands; a scheduling module for installing, deleting, updating, uploading, and delisting cloud games to the cloud gaming runtime; a permission management module for obtaining and verifying the running permissions of the cloud gaming client; a storage module for storing player user data and game data; and a configuration module for providing a visual interface for configuring games and gameplay. Additionally, a data processing module, such as an artificial intelligence (AI) module, is included for processing data and information. In this embodiment, this includes, but is not limited to, tasks such as speech recognition, video analysis, tagging, data sorting, and information combination, as detailed in the following specific descriptions of this embodiment.

[0052] Specifically, the cloud gaming runtime refers to the machine that actually runs the cloud game. It establishes a connection with the cloud gaming platform, transmits data to it, and executes operation commands transmitted by the platform. This includes a cloud gaming toolkit and game processing logic. The cloud gaming runtime toolkit is integrated within the cloud game and handles interactions related to command uploading, maintenance, and replay within the cloud game; it also interacts with the cloud gaming platform to perform similar functions.

[0053] The specific structural diagrams for the cloud gaming client, cloud gaming platform, and cloud gaming runtime in the above-described system are as follows: Figure 2 As shown. The cloud gaming runtime environment lists two different cloud games. The cloud gaming client environment lists multiple cloud gaming clients, exemplified by labels such as User 1, User 2, etc.

[0054] The operation control method for cloud gaming provided in the embodiments of this disclosure will be described below.

[0055] First, let's take a cloud gaming platform as an example. Here, the cloud gaming platform, independent of the cloud gaming client and the cloud gaming runtime, plays the role of information transmission. In cloud gaming, the cloud gaming client receives user-triggered operation commands and displays the game screen to the user, completing the interaction between the user and the cloud game. The cloud gaming runtime determines the screen data under the operation commands to complete the game's execution. The cloud gaming platform can handle other data processing operations, such as transmitting operation commands and screen data, and may also include organizing recommended operation commands or recognizing operation commands in the screen, thus reducing the workload of the cloud gaming client and the cloud gaming runtime.

[0056] See Figure 3 The diagram shown is a flowchart of a cloud gaming operation control method provided in this embodiment of the present disclosure. The method includes steps S301 to S303, wherein:

[0057] S301: Determine the game status information of the target cloud game currently running on the cloud gaming client;

[0058] S302: Based on the game state information, determine at least one set of operation instructions that matches the game state information, and instruct the cloud gaming client to provide the at least one set of operation instructions; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information; the target game video is a game operation video whose corresponding game operation result meets the target conditions.

[0059] S303: In response to receiving the target operation instruction set selected by the cloud gaming client, generate game screen data corresponding to the execution of the target operation instruction set by the cloud gaming client, and send it to the cloud gaming client.

[0060] Regarding S301 above, the cloud gaming client will first be described. Here, the cloud gaming client can specifically be a cloud gaming client corresponding to a new user under the target cloud game, or it can be a cloud gaming client that has been used multiple times to play games under the target cloud game. The game player corresponding to the cloud gaming client is also the user in this embodiment of the disclosure.

[0061] For a cloud gaming client, multiple cloud games can be run, for example in... Figure 2 The list includes several cloud games. The available cloud games can encompass various game genres, such as strategy games (like board games, puzzle games, and match-3 games), combat games (like monster-fighting games and shooting games), or action games (like billiards games and other sports games).

[0062] In a cloud gaming platform, the cloud game currently running on the cloud gaming client can be identified, referred to as the target cloud game in this embodiment. The game status information of the target cloud game can be expressed through various game description dimensions. For example, from the perspective of the cloud game itself, the current game stage or task being completed can be used to determine the game status information. From the perspective of the virtual game character selected by the user, the specific virtual game character selected, the available operation commands, and the remaining health of the virtual game character can also be used to determine the game status information. From the perspective of the virtual game character's opponent, such as a game monster character, the specific game monster character being faced and the remaining health of the current game monster character can also be used to determine the game status information. Therefore, the game status information can be summarized and described using different dimensions according to the actual situation to illustrate the progress of the current cloud game and the status of the virtual characters of each party. The level of detail in the summary and the different perspectives selected can be determined according to the actual situation and are not limited here.

[0063] Regarding S302 above, after the cloud gaming platform determines the game status information corresponding to the currently running target cloud game, it can use the game status information to provide at least one set of operation instructions to the cloud gaming client.

[0064] Here, when providing the operation instruction set to the cloud gaming client, the specific goal is to provide users with optional operation instructions that enable them to complete the target cloud game. Therefore, the operation instruction set provided here is specifically selected based on the operation instruction set that matches the game state information. When the operation instruction set is obtained by identifying and processing existing game videos, the selected game operation video is referred to as the target game video in this embodiment. The game operation result corresponding to the target game video meets the target conditions. The basic target conditions may include completing the current level or defeating the virtual game monster, that is, completing the game task or passing the game. Further, it may also include achieving a high score or completing the game quickly, etc. In some possible cases, such a target game video may also be referred to as a highlight history video.

[0065] For game operation videos, these can be recorded by any user while playing the target cloud game, or obtained from authorized video recordings. In one possibility, at least one corresponding operation command can be obtained during or after the user runs the target cloud game, forming an operation command set. Specifically, operation commands can be recorded in two different ways: in one possibility, user authorization can be obtained before starting the target cloud game, and operation commands can be continuously recorded during the game's operation; in another possibility, with user authorization, the operation commands triggered during the target cloud game can be collected and compiled all at once after the game ends. Alternatively, other feasible methods can be used to record operation commands in the target cloud game, which will not be listed here.

[0066] In another possible scenario, since the above solution may require retaining the game operation commands while also maintaining their corresponding operation commands, it would occupy a significant amount of storage resources. Therefore, this embodiment of the disclosure also provides a method for determining the operation command set by recognizing and processing the operation commands of the target game video.

[0067] In a specific implementation, the operation instruction set can be obtained by performing operation instruction recognition processing on the target game video in the following manner: filtering out multiple key frames including virtual game objects from the target game video; performing semantic recognition processing on the multiple key frames to determine the object behavior information of the virtual game objects; and generating the operation instruction set based on the object behavior information.

[0068] The above method will be explained in detail below. First, the specific purpose of the identification and processing of the target game video is to identify and determine which operation commands were selected during the cloud gaming process corresponding to the recorded game video. Different operation commands can be reflected in the actions, dialogues, special effects, and sound effects of the user-controlled virtual game character and virtual opponent character in the video screen. Therefore, key frames of the target game video can be filtered to obtain multiple key frames including virtual game objects (i.e., the aforementioned virtual game character and virtual opponent character).

[0069] Then, semantic recognition processing is performed on these keyframes. Specifically, this may include processing the keyframes and their corresponding audio data to determine the object behavior information of the virtual game objects. For example, a Multimodal Large Language Model (MLLM) can be used for image preprocessing of the keyframes, and then the corresponding operation descriptions can be identified for the virtual game objects within them. For instance, by performing semantic recognition processing on multiple keyframes, it can be determined that a virtual game character, under the control of operation commands, completes a forward punch action in the target cloud game. In this case, the forward punch action of the virtual game character is taken as the object behavior information of the virtual game object.

[0070] Next, based on the determined object behavior information of the virtual game object, an operation instruction set can be generated. Specifically, the object behavior information of the virtual game object can be analyzed by examining the expected results of each operation instruction in the target cloud game on the virtual game object. For example, continuing the above example, if it can be determined that operation instruction 1 controls the virtual game character to perform a forward movement, and operation instruction 2 controls the virtual game character to perform a punch movement, then based on the object behavior information of the virtual game object: the forward and punch movements, it is easy to match the operation instructions specifically including operation instruction 1 and operation instruction 2, and determine the corresponding operation instruction set as operation instruction 1 and operation instruction 2.

[0071] The above is only one optional implementation method. Other methods that can achieve the same effect under the same idea are also within the protection scope of the embodiments disclosed herein, but will not be listed and described one by one here.

[0072] After acquiring multiple sets of operation instructions based on multiple target game videos, the cloud gaming platform can further generate tag information corresponding to each set of operation instructions based on game-related data in the target game videos.

[0073] Here, game-related data can specifically include game event markers, game data, player data, and game ratings in cloud gaming. For example, game event markers can be used to identify what specific game task or stage a target game video is performing; game data can include damage values ​​dealt to virtual opponents; player data can include game rewards and the status of virtual game characters; and game ratings can be based on the time taken to complete the game. Since the content of different cloud games varies, the specific game-related data will differ depending on the cloud game; this is only one possible example. When using game-related data to determine tag information, a tag with features across multiple dimensions can be obtained by following the different dimensions of the game-related data described above.

[0074] Thus, when the cloud gaming platform instructs the cloud gaming client to at least one set of operation commands obtained above, it can provide the client with multiple sets of operation commands and their corresponding tag information. For the cloud gaming client, the tag information can be used to sort and display multiple operation commands, or to display game-related data under selected dimensions, such as the time taken to complete a cloud game, allowing the user to select the necessary set of operation commands to complete the target cloud game.

[0075] Here, regarding the situation described above where tag information can be used to sort multiple sets of operation instructions, in one possible scenario, the sorting task can also be completed by the cloud gaming platform.

[0076] In practice, the cloud gaming platform can determine the correlation scores between the multiple operation instruction sets and the game status information of the cloud gaming client based on the tag information of the multiple operation instruction sets; and determine the operation result scores of the multiple operation instruction sets based on the tag information of the multiple operation instruction sets; sort the multiple operation instruction sets according to the correlation scores and operation result scores, and indicate the sorted multiple operation instruction sets and their corresponding tag information to the cloud gaming client.

[0077] Here, we first explain how to determine the operation result scores for multiple operation command sets based on tag information. The operation result score specifically reflects the quality of the operation command set for the target cloud game. Operation quality is reflected in whether the game can be completed quickly, whether it can be completed with relatively simple operation command selection, or whether a high score can be obtained, etc. When determining the operation result score, a weighted comprehensive calculation can be performed using the various dimensions for evaluating operation quality described above, or only one can be selected for calculation, depending on the type of target cloud game.

[0078] For example, in combat games, such as monster-fighting games, the focus is on defeating monsters quickly and achieving high game rewards. Therefore, the score for the operation result can be determined using the corresponding data under these two dimensions of the tag information. However, for strategy-oriented card games, the focus might be on ending the game with fewer steps. In this case, the score for the operation result would be more concerned with the time and number of action commands used to complete the game. This operation result score can then be used to help players in the target cloud game determine whether listing the set of action commands can help them complete the game tasks in the target cloud game.

[0079] In actual cloud gaming, different users have different game progress and select different virtual game objects. Therefore, operation commands that other users could use to complete a game in their previous games may not be applicable to the current user's target cloud game. This is because the game state cannot be perfectly matched. Therefore, in addition to ranking the operation command sets based on the operation result scores described above, we can also determine the correlation scores between multiple operation command sets and the game state information of the cloud gaming client, and then perform a comprehensive ranking.

[0080] Here, when determining the correlation between the operation instruction set and the game state information, for example, the correlation can be determined from the following multiple judgment methods: whether the operation instruction in the operation instruction set can be selected when the game state information reflects the current game state of the cloud gaming client, whether the virtual game character indicated is consistent with the virtual game character currently selected by the user, whether the virtual opponent character that can be targeted is consistent with the virtual opponent character currently being faced, etc.

[0081] For example, in a racing-themed cloud game, two sets of operation commands can be identified, denoted as command set a and command set b. Based on the tag information corresponding to command sets a and b, it can be determined that under command a, the vehicle used is vehicle c1; under command a, the vehicle used is vehicle c2. Therefore, if it can be determined that the vehicle selected in the cloud gaming client's game state information is c1, even if vehicle c2 is similar to vehicle c1, the relevance score of command set a will be higher than that of command set b.

[0082] In this way, we can use tag information to determine the relevance score, and then comprehensively judge the ranking of operation instruction sets based on the operation result score. In some possible cases, if the operation result score of a certain operation instruction set is very high, but its relevance score is low, such as a very short racing time, but the specific reason is that the selected vehicle itself has a large difference in performance from the vehicle currently being played in the cloud gaming client, then such an operation instruction set is not suitable for priority recommendation, and will not be ranked high in the comprehensive ranking for priority display.

[0083] In this way, the cloud gaming platform can sort multiple operation instruction sets according to relevance scores and operation result scores, and then indicate the sorted operation instruction sets and their corresponding tag information to the cloud gaming client.

[0084] For cloud gaming clients, at least one set of received operation instructions can be displayed so that users can select the target set of operation instructions to play the target cloud game, or preview it.

[0085] For example, see Figure 4a The diagram illustrates multiple sets of operation instructions provided in this embodiment of the present disclosure. The main screen displays a user-controlled virtual game character and the currently facing game monster. In the lower left corner of the screen, selectable operation instructions are displayed, including control buttons B1, B2, and B3 corresponding to operation instructions 1, 2, and 3, respectively. In the upper right corner of the screen, multiple sets of operation instructions are displayed, numbered a, b, and c. Taking the operation instruction set corresponding to number a as an example, it specifically includes two recommended instructions: operation instruction 1 and operation instruction 2.

[0086] Here, while displaying multiple operation command sets, some information from the tag information can also be shown. For example, the username provided by the user authorized to provide the operation command set, or game records achieved using the operation command set, can be displayed so that users can refer to this information to select a suitable target operation command set.

[0087] For example, see Figure 4b The diagram shown is a schematic representation of another set of operation instructions provided in this embodiment of the present disclosure, which is different from the above. Figure 4a The system displays not only the instruction set number and the instructions within it, but also historical game records. For example, the instruction set numbered 'a' corresponds to the historical game record information "Defeat the monster in 5 minutes".

[0088] After the cloud gaming client displays the operation list, users can select operation command sets. There are two different ways to select operation command sets: in one way, the selected operation command set is used within the cloud game the user is currently playing; in the other way, the selected operation command set is used to enable split-screen game preview.

[0089] The following will explain the two different situations mentioned above.

[0090] First, in the first scenario, the user can select any set of operation instructions from the operation list and use it in the currently running cloud game. The cloud gaming client can, in response to the selection of a target set of operation instructions from at least one set of operation instructions, instruct the cloud gaming platform to use that target set of operation instructions.

[0091] Here, in order to distinguish between the two different cases of selection operation instruction sets, the discrimination settings of selection operations can be set in advance. For example, under the single-click selection operation, it is determined that the target operation instruction set selected by the user is applied to the currently playing cloud game itself, while under the double-click selection operation, the corresponding operation intention is to preview the result of the operation instruction.

[0092] When it is determined that the target operation instruction set will be applied to the currently running cloud game itself, specifically corresponding to step S303 above, the cloud game platform can instruct the cloud game runtime to execute the target instruction set; the cloud game runtime can determine the execution result of the instruction in the cloud game based on the target instruction set, and feed back the corresponding post-operation game screen data to the cloud game platform; after receiving the post-operation game screen data fed back by the cloud game runtime, the cloud game platform sends the post-operation game screen data back to the cloud game client; the cloud game client displays the post-operation game screen to the user based on the fed-back post-operation game screen data.

[0093] Secondly, regarding the second scenario, when it is determined that the selection operation instruction for the target operation instruction set is to be previewed, the cloud gaming client can specifically respond to the preview instruction for the operation instruction set in the operation list, obtain the preview screen data fed back by the cloud gaming platform in response to the preview instruction, and display the game preview screen corresponding to the preview screen data outside the current game screen.

[0094] Alternatively, in response to a synchronous preview instruction for multiple sets of operation instructions in the operation list, the cloud gaming platform obtains preview screen data generated by the multiple synchronous preview instructions respectively; outside the current game screen, the game preview screen corresponding to the multiple preview screen data is displayed synchronously.

[0095] In other words, when users select to preview game screens affected by the operation command set, they can select one or more to preview.

[0096] In specific implementation, the preview screen data can be obtained in the following way: obtain the mixed screen data after the cloud gaming platform has mixed the preview screen data and the current game screen data.

[0097] The following explains the specific method by which the cloud gaming platform feeds back mixed-stream screen data based on the user's selected set of operation commands.

[0098] First, when the cloud gaming platform receives a preview command from the cloud gaming client for any set of operation commands in the operation list, it can determine the preview screen data corresponding to the preview command; mix the preview screen data and the current game screen data, and feed the mixed screen data obtained after mixing back to the cloud gaming client.

[0099] In other words, after the cloud gaming client receives a preview instruction for any set of operation instructions, it can send that preview instruction or the set of operation instructions specified by the preview instruction back to the cloud gaming platform, so that the cloud gaming platform can obtain preview screen data accordingly. Here, the preview screen data can specifically be the result data returned by the cloud gaming runtime after the cloud gaming platform sends the set of operation instructions to the cloud gaming runtime, and the process is similar to the process corresponding to the user playing cloud games.

[0100] Thus, for cloud gaming platforms, the screen data that can be obtained from the cloud gaming runtime includes the game screen after the operation when playing the cloud game itself, as well as the preview screen data obtained in response to the aforementioned preview command.

[0101] In order to enable users to simultaneously view the game screen of the cloud game itself, as well as the preview screen corresponding to the selected operation command set, the cloud gaming platform can specifically choose to perform mixed streaming processing on the preview screen data and the current game screen when sending the game screen to the cloud gaming client, and then feed back the mixed screen data to the cloud gaming client.

[0102] Secondly, if the instruction received by the cloud gaming platform is a synchronous preview instruction, that is, the user has selected multiple sets of operation instructions in the operation list for synchronous preview, in response to receiving the synchronous preview instruction from the cloud gaming client for multiple sets of operation instructions in the operation list, the platform determines the preview screen data corresponding to each synchronous preview instruction; mixes the multiple preview screen data with the current game screen data, and feeds back the mixed screen data after mixing to the cloud gaming client.

[0103] The difference from the above embodiments is that, when multiple selectable operation instruction sets are determined and a preview display is performed, the preview screen data during mixing specifically includes multiple sets. During mixing, as the amount of screen data to be mixed increases, different mixing methods can be adopted accordingly.

[0104] The mixed streaming described here specifically refers to the ability to transmit multiple frames simultaneously, rather than sequentially or by scheduling multiple interfaces to transmit different frames separately. Therefore, it achieves the beneficial effects of synchronous transmission and reduced interface usage.

[0105] After the cloud gaming platform performs stream mixing on the preview screen data, it can send the mixed screen data to the cloud gaming client. Upon receiving the mixed screen data, the cloud gaming client can display the current game screen and at least one game preview screen.

[0106] In specific implementation, when displaying a game preview screen, the cloud gaming client can adopt the following method: based on the number of game screens corresponding to the mixed-stream screen data, the game display page is divided into multiple display areas, and the current game screen and at least one of the game preview screens are displayed in the multiple display areas respectively.

[0107] For ease of description, examples are provided below. Corresponding to the two scenarios described above for previewing operations, in one possible case, the preview operation command set is only one, which includes the current game screen. Specifically, the mixed-stream screen data includes two game screens, meaning the number of game screens is "2". In this case, the game display page can be divided into an area displaying the current game screen and an area displaying the game preview screen, and these two can be displayed separately.

[0108] For example, see Figure 5a The diagram shown is a schematic representation of a game preview screen under an operation instruction set provided in an embodiment of this disclosure. The diagram includes an area displaying the current game screen, labeled Area A; and at its associated location, an area displaying the game preview screen, labeled Area B.

[0109] In another possible scenario, the preview operation command set includes multiple sets, such as two, which includes the current game screen. The mixed-stream screen data specifically includes three game screens, meaning the number of game screens is "3". In this case, the game display page can be divided into an area displaying the current game screen and an area displaying the game preview screen. The area displaying the game preview screen can be further divided according to the number of selected operation command sets, and the corresponding game preview screens under each operation command set can be displayed accordingly.

[0110] For example, see Figure 5b The diagram illustrates a preview of a game screen under multiple operation command sets, as provided in an embodiment of this disclosure. The diagram includes an area displaying the current game screen, labeled Area A; and an associated area displaying the game preview screen, labeled Area B. Area B specifically displays the game preview screens corresponding to the two selected operation command sets. Furthermore, for ease of differentiation, the screens can be labeled using the numbers of the selected operation command sets.

[0111] In this way, the cloud gaming client can display the current game screen and at least one game preview screen.

[0112] The following describes the cloud gaming operation control method provided in this embodiment of the disclosure, taking a cloud gaming client as the execution subject as an example. Here, the cloud gaming client can specifically be a cloud gaming client corresponding to a new user under the target cloud game, or it can be a cloud gaming client that has played games multiple times under the target cloud game. The game player corresponding to the cloud gaming client is also the user in this embodiment of the disclosure.

[0113] See Figure 6 The diagram shows a flowchart of another cloud gaming operation control method provided in this disclosure, applied to a cloud gaming client. The method includes steps S601 to S604, wherein:

[0114] S601: Displays the game interface of the target cloud game;

[0115] S602: Display at least one set of operation instructions that matches the current game state information of the game; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information;

[0116] S603: In response to the selection of a target operation instruction set in the at least one operation instruction set, determine the target operation instruction set;

[0117] S604: Receive game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data.

[0118] For details of the above steps, please refer to the corresponding descriptions in the above embodiments. They will not be repeated here, but only briefly described.

[0119] Regarding the S601 mentioned above, the cloud gaming client specifically displays the game match page for the target cloud game to the user. The game match page can display the ongoing game screen, operation icons corresponding to user-selectable commands, and other information related to the user or cloud gaming, such as user information.

[0120] Regarding S602 above, the game match page can specifically display at least one set of operation instructions that matches the current game state information. According to the description of the above embodiment, the set of operation instructions can specifically be obtained by voice recognition of a target game video. The target game video is a game operation video whose corresponding game operation result meets the target conditions. For a detailed explanation of the target conditions, please refer to the above embodiment.

[0121] Specifically, the acquired target game video contains multiple keyframes of virtual game objects in cloud gaming. The actions and fighting effects of the virtual game objects displayed on these keyframes can reflect what control commands were specifically selected for the virtual game objects.

[0122] Based on this, semantic recognition can be performed on multiple keyframes including virtual game objects to obtain object behavior information of virtual game objects, such as the hitting action of virtual game objects. Based on the pre-determined correspondence between triggering actions and operation instructions, the specific set of operation instructions to be selected in the target game video can be determined.

[0123] In specific implementation, when displaying at least one set of operation instructions that matches the current game state information, the at least one set of operation instructions and the tag information corresponding to each set of operation instructions can be displayed; the tag information is used to indicate the game attribute information corresponding to the set of operation instructions, and the game attribute information is used for the user to refer to and select the target set of operation instructions.

[0124] Here, the tag information specifically serves to mark operation command sets and provide users with selection references through the information they convey. Specifically, the tag information can be determined using game attribute information, which may include information expressing game completion status such as game completion time and game rewards, or icon information representing specific actions such as turning and jumping. For example, a turning icon indicates that a certain operation command set is used to turn the vehicle, or a label like "Game completion time: within 5 minutes" indicates that using a certain operation command set will allow cloud gaming control to complete the game objective within 5 minutes. Therefore, users can make informed selections from multiple operation command sets based on the corresponding tag information.

[0125] Regarding S603 above, for the multiple operation command sets displayed, the user can select one or more as the target operation command set. The selected target operation command set is also the operation command set used to complete the game under cloud gaming. After the cloud gaming client confirms the target operation command set selected by the user, it is sent to the cloud gaming platform, which then feeds back to the cloud gaming runtime. Finally, the cloud gaming platform returns the video stream data determined by the cloud gaming runtime based on the target operation command set to the cloud gaming client, so that the user can watch the game screen.

[0126] Thus, regarding S604 above, the cloud gaming client can receive game screen data after executing the target operation instruction set and display the current game screen based on the game screen data. Here, for the multiple operation instruction sets provided by the cloud gaming platform, specific options can be selected for preview, that is, as described in the above embodiment, in addition to the current game screen, the game preview screens corresponding to the selected operation instruction sets are displayed synchronously.

[0127] The methods for obtaining preview screen data and the specific methods for displaying the game preview screen can be found in the detailed descriptions in the above embodiments, and will not be repeated here.

[0128] Using the cloud gaming operation control method provided in this disclosure, the cloud gaming platform can provide the cloud gaming client with an operation instruction set that matches the current game state information when the target cloud game is running. Here, the operation instruction set is obtained by identifying and processing operation instructions from a target game video that matches the game state information. For example, if there are historical game videos of other users completing the game in similar game states, the operation instruction set used when completing that game can be obtained through the identification and processing of those historical game videos. In this way, game players can refer to and select these operation instruction sets that indicate a predictable success rate in the game, quickly completing the game without having to manually select different operation instructions and repeatedly try different gameplay scenarios. This reduces the cost of trial and error and improves the interactive experience while allowing players to interact normally with the game.

[0129] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0130] Based on the same inventive concept and applied to cloud gaming platforms, this disclosure also provides a cloud gaming operation control device corresponding to the cloud gaming operation control method. Since the principle of the device in this disclosure for solving the problem is similar to the cloud gaming operation control method described above in this disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0131] Reference Figure 7 As shown, this is an embodiment of a cloud gaming operation control device provided in this disclosure, applied to a cloud gaming platform. The device includes: a first determining module 71, a first sending module 72, and a second sending module 73; wherein,

[0132] The first determining module 71 is used to determine the game status information of the target cloud game currently running on the cloud gaming client;

[0133] The first sending module 72 is configured to determine at least one set of operation instructions that matches the game state information based on the game state information, and to send the at least one set of operation instructions to the cloud gaming client; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information; the target game video is a game operation video whose corresponding game operation result meets the target conditions.

[0134] The second sending module 73 is used to respond to receiving the target operation instruction set selected by the cloud gaming client, generate game screen data after the cloud gaming client executes the target operation instruction set, and send it to the cloud gaming client.

[0135] In one optional implementation, the operation instruction set is obtained by performing operation instruction recognition processing on the target game video in the following manner: filtering out multiple key frames including virtual game objects from the target game video; performing semantic recognition processing on the multiple key frames to determine the object behavior information of the virtual game objects; and generating the operation instruction set based on the object behavior information.

[0136] In an optional embodiment, the device further includes a processing module 74, configured to: after acquiring multiple operation instruction sets based on multiple target game videos, generate tag information corresponding to each operation instruction set according to game-related data in the target game videos; when the first sending module 72 instructs the cloud gaming client to the at least one operation instruction set, it is configured to: instruct the cloud gaming client to the multiple operation instruction sets and their respective corresponding tag information.

[0137] In one optional implementation, when the first sending module 72 instructs the cloud gaming client with the plurality of operation instruction sets and their corresponding tag information, it is configured to: determine the correlation scores between the plurality of operation instruction sets and the game status information of the cloud gaming client based on the tag information of the plurality of operation instruction sets; and determine the operation result scores of the plurality of operation instruction sets based on the tag information of the plurality of operation instruction sets; sort the plurality of operation instruction sets based on the correlation scores and operation result scores, and instruct the sorted plurality of operation instruction sets and their corresponding tag information to the cloud gaming client.

[0138] In addition, for cloud gaming clients, this disclosure also provides a cloud gaming operation control device corresponding to the cloud gaming operation control method. Since the principle of the device in this disclosure for solving the problem is similar to the cloud gaming operation control method described above, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0139] Reference Figure 8 As shown, this is an embodiment of a cloud gaming operation control device provided in this disclosure, applied to a cloud gaming client. The device includes: a first display module 81, a second display module 82, a second determination module 83, and a third display module 84; wherein,

[0140] The first display module 81 is used to display the game interface of the target cloud game;

[0141] The second display module 82 is used to display at least one set of operation instructions that matches the current game state information of the game; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information;

[0142] The second determining module 83 is configured to determine the target operation instruction set in response to the selection of a target operation instruction set in the at least one operation instruction set.

[0143] The third display module 84 is used to receive game screen data after the target operation instruction set is executed based on the cloud gaming client, and to display the current game screen based on the game screen data.

[0144] In one optional implementation, the operation instruction set is generated by semantically recognizing multiple keyframes including virtual game objects in the target game video and then using the object behavior information of the recognized virtual game objects; the target game video is a game operation video whose corresponding game operation results meet the target conditions.

[0145] In one optional implementation, when the first display module 81 displays at least one set of operation instructions that matches the current game state information of the game match, it is configured to: display the at least one set of operation instructions and the tag information corresponding to each set of operation instructions; the tag information is used to indicate the game attribute information corresponding to the set of operation instructions, and the game attribute information is used for the user to select the target set of operation instructions.

[0146] In one optional implementation, after displaying the at least one set of operation instructions, the second display module 82 is further configured to: in response to a preview instruction for any of the operation instruction sets, acquire preview screen data in response to the preview instruction; and display a game preview screen corresponding to the preview screen data outside the current game screen.

[0147] In one optional implementation, after displaying the at least one set of operation instructions, the second display module 82 is further configured to: in response to a synchronous preview instruction for the plurality of operation instruction sets, acquire preview screen data generated in response to the synchronous preview instruction respectively; and synchronously display game preview screens corresponding to the plurality of preview screen data respectively outside the current game screen.

[0148] In one optional implementation, the preview screen data is obtained according to the following steps: obtaining mixed screen data after mixing the preview screen data and the current game screen data; when displaying the game preview screen, the second display module 82 is used to: divide the game display page into multiple display areas based on the number of game screens corresponding to the mixed screen data, and display the current game screen and at least one of the game preview screens in the multiple display areas respectively.

[0149] The processing flow of each module in each device and the interaction flow between each module can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.

[0150] This disclosure also provides a computer device, such as... Figure 9 The diagram shown is a schematic representation of a computer device structure provided in an embodiment of this disclosure, including:

[0151] Processor 10 and memory 20; the memory 20 stores machine-readable instructions executable by processor 10, and processor 10 executes the machine-readable instructions stored in memory 20. When the machine-readable instructions are executed by processor 10, processor 10 performs the following steps:

[0152] The system determines the game status information of the target cloud game currently running on the cloud gaming client; based on the game status information, it determines at least one set of operation instructions that matches the game status information, and instructs the cloud gaming client to use the at least one set of operation instructions; the set of operation instructions is obtained by performing operation instruction recognition processing on the target game video that matches the game status information; the target game video is a game operation video whose corresponding game operation result meets the target conditions; in response to receiving the target operation instruction set selected by the cloud gaming client, it generates game screen data corresponding to the execution of the target operation instruction set by the cloud gaming client, and sends it to the cloud gaming client.

[0153] Alternatively, processor 10 performs the following steps:

[0154] Display the game interface of the target cloud game; display at least one set of operation instructions that matches the current game state information of the game; the set of operation instructions is obtained by operation instruction recognition processing based on the target game video that matches the game state information; in response to the selection of the target operation instruction set in the at least one set of operation instructions, determine the target operation instruction set; receive game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data.

[0155] The aforementioned memory 20 includes a main memory 210 and an external memory 220; the main memory 210, also known as internal memory, is used to temporarily store the computational data in the processor 10, as well as the data exchanged with external memory 220 such as a hard disk. The processor 10 exchanges data with the external memory 220 through the main memory 210.

[0156] The specific execution process of the above instructions can be referred to the steps of the cloud gaming operation control method described in the embodiments of this disclosure, and will not be repeated here.

[0157] This disclosure also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the cloud gaming operation control method described in the above-described method embodiments. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0158] This disclosure also provides a computer program product carrying program code. The program code includes instructions that can be used to execute the steps of the cloud gaming operation control method described in the above method embodiments. For details, please refer to the above method embodiments, which will not be repeated here.

[0159] The aforementioned computer program product can be implemented through hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied in a computer storage medium; in another optional embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0160] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division; in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces; the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.

[0161] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0162] In addition, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0163] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0164] Finally, it should be noted that the above-described embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. A method for operating control of cloud gaming, characterized in that, Applied to cloud gaming platforms, including: Determine the game status information of the target cloud game currently running on the cloud gaming client; Based on the game state information, at least one set of operation instructions matching the game state information is determined, and the at least one set of operation instructions is instructed to the cloud gaming client; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video matching the game state information; the target game video is a game operation video whose corresponding game operation result meets the target conditions; In response to receiving the selected target operation instruction set from the cloud gaming client, the system generates game screen data corresponding to the execution of the target operation instruction set by the cloud gaming client, and sends it to the cloud gaming client so that the cloud gaming client can display the post-operation game screen to the user based on the feedback post-operation game screen data. The operation instruction set is obtained by performing operation instruction recognition processing on the target game video in the following manner: Multiple keyframes, including virtual game objects, are selected from the target game video; Semantic recognition processing is performed on the multiple keyframes to determine the object behavior information of the virtual game object; The operation instruction set is generated based on the object behavior information.

2. The method of claim 1, wherein, The method further includes: After acquiring multiple sets of operation instructions based on multiple target game videos, tag information corresponding to each set of operation instructions is generated according to game-related data in the target game videos; The step of instructing the cloud gaming client with the at least one set of operation instructions includes: Multiple sets of operation instructions and their corresponding tag information are sent to the cloud gaming client.

3. The method according to claim 2, characterized in that, The step of instructing the cloud gaming client with multiple sets of operation instructions and their corresponding tag information includes: Based on the tag information of the multiple operation instruction sets, determine the correlation scores between the multiple operation instruction sets and the game status information of the cloud gaming client; And, based on the tag information of the multiple operation instruction sets, determine the operation result score of the multiple operation instruction sets; Based on the correlation score and operation result score, the multiple operation instruction sets are sorted, and the sorted multiple operation instruction sets and their corresponding tag information are indicated to the cloud gaming client.

4. A cloud gaming operation control method, characterized in that, Applied to cloud gaming clients, including: Displays the game interface of the target cloud game; Display at least one set of operation instructions that matches the current game state information of the game; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information; In response to the selection of a target operation instruction set in the at least one operation instruction set, the target operation instruction set is determined; Receive game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data. The operation instruction set is generated by semantically recognizing multiple keyframes including virtual game objects in the target game video and then using the object behavior information of the recognized virtual game objects; the target game video is a game operation video whose corresponding game operation results meet the target conditions.

5. The method according to claim 4, characterized in that, Display at least one set of operation instructions that matches the current game state information of the game match, including: Display at least one set of operation instructions, and tag information corresponding to each set of operation instructions; the tag information is used to indicate the game attribute information corresponding to the set of operation instructions, and the game attribute information is used for users to refer to and select the target set of operation instructions.

6. The method according to claim 4, characterized in that, After displaying the at least one set of operation instructions, the method further includes: In response to a preview command for any of the operation command sets, acquire preview screen data fed back in response to the preview command; In addition to the current game screen, a game preview screen corresponding to the aforementioned preview screen data is displayed.

7. The method according to claim 4, characterized in that, After displaying the at least one set of operation instructions, the method further includes: In response to a synchronous preview command for multiple sets of operation commands, preview screen data generated in response to the synchronous preview command is acquired; In addition to the current game screen, game preview screens corresponding to the various preview screen data are displayed simultaneously.

8. The method according to claim 6 or 7, characterized in that, The preview screen data is obtained by following these steps: Obtain the mixed screen data after mixing the preview screen data and the current game screen data; The game preview screen is shown, including: Based on the number of game screens corresponding to the mixed-stream screen data, the game display page is divided into multiple display areas, and the current game screen and at least one game preview screen are displayed in the multiple display areas respectively.

9. A cloud gaming operation control device, characterized in that, Applied to cloud gaming platforms, including: The first determining module is used to determine the game status information of the target cloud game currently running on the cloud gaming client; The first sending module is configured to determine at least one set of operation instructions that matches the game state information based on the game state information, and to send the at least one set of operation instructions to the cloud gaming client; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information; the target game video is a game operation video whose corresponding game operation result meets the target conditions. The second sending module is used to, in response to receiving the target operation instruction set selected by the cloud gaming client, generate game screen data corresponding to the execution of the target operation instruction set by the cloud gaming client, and send it to the cloud gaming client so that the cloud gaming client can display the game screen after the operation to the user based on the feedback game screen data after the operation. The operation instruction set is obtained by performing operation instruction recognition processing on the target game video in the following manner: Multiple keyframes, including virtual game objects, are selected from the target game video; Semantic recognition processing is performed on the multiple keyframes to determine the object behavior information of the virtual game object; The operation instruction set is generated based on the object behavior information.

10. A cloud gaming operation control device, characterized in that, Applied to cloud gaming clients, including: The first display module is used to display the game interface of the target cloud game; The second display module is used to display at least one set of operation instructions that matches the current game state information of the game match; the set of operation instructions is obtained by performing operation instruction recognition processing on a target game video that matches the game state information; The second determining module is configured to determine the target operation instruction set in response to the selection of a target operation instruction set in the at least one operation instruction set. The third display module is used to receive game screen data after the target operation instruction set is executed based on the cloud gaming client, and to display the current game screen based on the game screen data. The operation instruction set is generated by semantically recognizing multiple keyframes including virtual game objects in the target game video and then using the object behavior information of the recognized virtual game objects; the target game video is a game operation video whose corresponding game operation results meet the target conditions.

11. A computer device, characterized in that, include: The processor and the memory, wherein the memory stores machine-readable instructions executable by the processor, the processor is configured to execute the machine-readable instructions stored in the memory, and when the machine-readable instructions are executed by the processor, the processor performs the steps of the cloud gaming operation control method as described in any one of claims 1 to 8.

12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, which, when executed by a computer device, causes the computer device to perform the steps of the cloud gaming operation control method as described in any one of claims 1 to 8.

Images