Cloud game operation control method and apparatus, computer device, and storage medium

The cloud gaming platform recognizes and provides matching operation instruction sets, which solves the problem of poor interactive experience for novice players in the game, and achieves a fast level-through and an efficient gaming experience.

WO2024260102A1PCT designated stage expired Publication Date: 2024-12-26BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/089738
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-06-20
Filing Date
2024-04-25
Publication Date
2024-12-26

AI Technical Summary

Technical Problem

Gamers, especially novice players, need to try different operating instructions many times when completing the game, resulting in poor interactive experience and long time, and it is impossible to pass the level quickly.

Method used

The cloud game platform provides a matching operation instruction set based on game status information, uses the target game video to identify and process the operation instruction, and generates and sends the operation instruction set to the cloud game client to reduce the number of times players try on their own.

Benefits of technology

It improves the game interactive experience, reduces the trial and error costs of players in the game, and allows players to complete game tasks quickly.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024089738_26122024_PF_FP_ABST
    Figure CN2024089738_26122024_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure provides a cloud game operation control method and apparatus, a computer device, and a storage medium. The method is applied to a cloud game platform, and comprises: determining game state information of a cloud game client currently running a target cloud game; on the basis of the game state information, determining at least one operation instruction set matched with the game state information, and indicating the at least one operation instruction set to the cloud game client, wherein the operation instruction set is obtained by performing recognition processing on an operation instruction on the basis of a target game video matched with the game state information, and the target game video is a game operation video corresponding to which a game operation result satisfies a target condition; and in response to receiving a target operation instruction set fed back and selected by the cloud game client, generating game picture data after the cloud game client correspondingly executes the target operation instruction set, and sending the game picture data to the cloud game client.
Need to check novelty before this filing date? Find Prior Art

Description

Cloud gaming operation control method, device, computer equipment, and storage medium

[0001] This application claims priority to Chinese Patent Application No. 202310736086.3 filed on June 20, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] The present disclosure relates to a method, apparatus, computer equipment, and storage medium for controlling cloud gaming operations. Background Art

[0003] During the game, players will face different game tasks. For some gamers, such as new players and those with little gaming experience, the only way to complete the game is to repeatedly select different operation commands and try to complete each level one by one. This requires players to play the game repeatedly, which takes a long time to complete, and the interactive experience is poor.

[0004] Therefore, how to reduce the cost of trial and error and improve the interactive experience while players can interact with the game normally is a problem worth studying.

[0005] Summary of the Invention

[0006] The embodiments of the present disclosure at least provide a method, apparatus, computer device, and storage medium for controlling the operation of a cloud game.

[0007] In the first aspect, an embodiment of the present disclosure provides an operation control method for cloud games, which is applied to a cloud game platform, including: determining the game status information of a target cloud game currently running on a cloud game client; based on the game status information, determining at least one operation instruction set that matches the game status information, and indicating the at least one operation instruction set to the cloud game client; the operation instruction set is obtained after operation instruction recognition processing is performed on a target game video that matches the game status information; the target game video is a game operation video whose corresponding game operation result meets the target conditions; in response to receiving the target operation instruction set selected by the cloud game client, generating game screen data after the cloud game client executes the target operation instruction set, and sending it to the cloud game client.

[0008] In an optional embodiment, the operation instruction set is obtained after the target game video is subjected to operation instruction recognition processing in the following manner: multiple key frames including virtual game objects are screened from the target game video; semantic recognition processing is performed on the multiple key frames to determine the object behavior information of the virtual game object; and the operation instruction set is generated based on the object behavior information.

[0009] In an optional embodiment, the method further includes: after obtaining multiple operation instruction sets based on multiple target game videos, generating label information corresponding to each operation instruction set according to game-related data in the target game video; indicating the at least one operation instruction set to the cloud game client includes: indicating the multiple operation instruction sets and their corresponding label information to the cloud game client.

[0010] In an optional embodiment, indicating the multiple operation instruction sets and their corresponding label information to the cloud game client includes: determining the correlation scores between the multiple operation instruction sets and the game status information of the cloud game client based on the label information of the multiple operation instruction sets; and determining the operation result scores of the multiple operation instruction sets based on the label information of the multiple operation instruction sets; sorting the multiple operation instruction sets according to the correlation scores and the operation result scores, and indicating the sorted multiple operation instruction sets and their corresponding label information to the cloud game client.

[0011] In a second aspect, an embodiment of the present disclosure provides an operation control method for cloud games, which is applied to a cloud game client, including: displaying a game match interface of a target cloud game; displaying at least one operation instruction set that matches the current game status information of the game match; the operation instruction set is obtained after operation instruction recognition processing is performed based on a target game video that matches the game status information; in response to a target operation instruction set being selected in the at least one operation instruction set, determining the target operation instruction set; receiving game screen data after executing the target operation instruction set, and displaying the current game screen based on the game screen data.

[0012] In an optional embodiment, the operation instruction set is generated by semantically identifying multiple key frames of a virtual game object in the target game video, using the object behavior information of the virtual game object obtained by identification; the target game video is a game operation video in which the corresponding game operation results meet the target conditions.

[0013] In an optional embodiment, displaying at least one operation instruction set that matches the current game status information of the game match includes: displaying the at least one operation instruction set, and label information corresponding to each of the operation instruction sets; the label information is used to indicate game attribute information corresponding to the operation instruction set, and the game attribute information is used for user reference to select the target operation instruction set.

[0014] In an optional embodiment, after displaying the at least one operation instruction set, it also includes: in response to a preview instruction for any of the operation instruction sets, obtaining preview screen data in response to the preview instruction feedback; and displaying a game preview screen corresponding to the preview screen data outside the current game screen.

[0015] In an optional embodiment, after displaying the at least one operation instruction set, it also includes: in response to synchronous preview instructions for multiple operation instruction sets, obtaining preview screen data generated respectively in response to the synchronous preview instructions; and synchronously displaying game preview screens corresponding to the multiple preview screen data respectively in addition to the current game screen.

[0016] In an optional embodiment, the preview screen data is obtained according to the following steps: obtaining mixed screen data after mixing the preview screen data and the current game screen data; displaying the game preview screen, including: based on the number of game screens corresponding to the mixed screen data, dividing the game display page into multiple display areas, and displaying the current game screen and at least one of the game preview screens in the multiple display areas respectively.

[0017] In a third aspect, an embodiment of the present disclosure further provides an operation control device for cloud gaming, which is applied to a cloud gaming platform and includes: a first determination module for determining the game status information of a target cloud game currently being run by a cloud gaming client; a first sending module for determining, based on the game status information, at least one operation instruction set that matches the game status information, and indicating the at least one operation instruction set to the cloud gaming client; the operation instruction set is obtained after operation instruction recognition processing is performed on a target game video that matches the game status information; the target game video is a game operation video whose corresponding game operation result meets the target conditions; a second sending module for generating, in response to receiving feedback from the cloud gaming client on the target operation instruction set selected, game screen data after the cloud gaming client executes the target operation instruction set, and sending the data to the cloud gaming client.

[0018] In an optional embodiment, the operation instruction set is obtained after the target game video is subjected to operation instruction recognition processing in the following manner: multiple key frames including virtual game objects are screened from the target game video; semantic recognition processing is performed on the multiple key frames to determine the object behavior information of the virtual game object; and the operation instruction set is generated based on the object behavior information.

[0019] In an optional embodiment, the device also includes a processing module for: after obtaining multiple operation instruction sets based on multiple target game videos, generating label information corresponding to each operation instruction set according to game-related data in the target game video; when the first sending module indicates the at least one operation instruction set to the cloud game client, it is used to: indicate the multiple operation instruction sets and their corresponding label information to the cloud game client.

[0020] In an optional embodiment, when the first sending module indicates the multiple operation instruction sets and their corresponding label information to the cloud game client, it is used to: determine the correlation scores between the multiple operation instruction sets and the game status information of the cloud game client based on the label information of the multiple operation instruction sets; and determine the operation result scores of the multiple operation instruction sets based on the label information of the multiple operation instruction sets; sort the multiple operation instruction sets according to the correlation scores and the operation result scores, and indicate the sorted multiple operation instruction sets and their corresponding label information to the cloud game client.

[0021] In a fourth aspect, an embodiment of the present disclosure further provides an operation control device for a cloud game, which is applied to a cloud game client, and includes: a first display module for displaying a game match interface of a target cloud game; a second display module for displaying at least one operation instruction set that matches the current game status information of the game match; the operation instruction set is obtained after operation instruction recognition processing is performed on a target game video that matches the game status information; a second determination module for determining the target operation instruction set in response to selection of a target operation instruction set in the at least one operation instruction set; a third display module for receiving game screen data after the cloud game client executes the target operation instruction set, and displaying the current game screen based on the game screen data.

[0022] In an optional embodiment, the operation instruction set is generated by semantically identifying multiple key frames of a virtual game object in the target game video, using the object behavior information of the virtual game object obtained by identification; the target game video is a game operation video in which the corresponding game operation results meet the target conditions.

[0023] In an optional embodiment, when displaying at least one operation instruction set that matches the current game status information of the game match, the first display module is used to: display the at least one operation instruction set, and label information corresponding to each of the operation instruction sets; the label information is used to indicate the game attribute information corresponding to the operation instruction set, and the game attribute information is used for user reference to select the target operation instruction set.

[0024] In an optional embodiment, after displaying the at least one operation instruction set, the second display module is further used to: respond to a preview instruction for any of the operation instruction sets, obtain preview screen data in response to the preview instruction feedback; and display a game preview screen corresponding to the preview screen data outside the current game screen.

[0025] In an optional embodiment, after displaying the at least one operation instruction set, the second display module is further used to: respond to synchronous preview instructions for multiple operation instruction sets, obtain preview screen data generated respectively in response to the synchronous preview instructions; and synchronously display game preview screens corresponding to the multiple preview screen data in addition to the current game screen.

[0026] In an optional embodiment, the preview screen data is obtained according to the following steps: obtaining mixed screen data after mixing the preview screen data and the current game screen data; when displaying the game preview screen, the second display module is used to: divide the game display page into multiple display areas based on the number of game screens corresponding to the mixed screen data, and display the current game screen and at least one of the game preview screens in the multiple display areas respectively.

[0027] In a fifth aspect, an optional implementation of the present disclosure further provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the machine-readable instructions perform the steps in any possible implementation of the above-mentioned first aspect or second aspect.

[0028] In a sixth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed, the steps of any possible implementation of the first aspect or the second aspect are executed.

[0029] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the embodiments. The drawings herein are incorporated into and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and, together with the specification, are used to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For those of ordinary skill in the art, other relevant drawings can be obtained based on these drawings without inventive effort.

[0031] FIG1 shows a schematic diagram of a cloud gaming system architecture provided by an embodiment of the present disclosure;

[0032] FIG2 shows a schematic diagram of a specific structure of a cloud gaming system provided by an embodiment of the present disclosure;

[0033] FIG3 shows a flow chart of an operation control method for a cloud game provided by an embodiment of the present disclosure;

[0034] FIG4a shows a schematic diagram of a plurality of operation instruction sets provided by an embodiment of the present disclosure;

[0035] FIG4 b shows another schematic diagram of multiple operation instruction sets provided by an embodiment of the present disclosure;

[0036] FIG5a shows a schematic diagram of a game preview screen for previewing an operation instruction set provided by an embodiment of the present disclosure;

[0037] FIG5 b shows a schematic diagram of a game preview screen for previewing multiple operation instruction sets provided by an embodiment of the present disclosure;

[0038] FIG6 shows a flowchart of another cloud game operation control method provided by an embodiment of the present disclosure;

[0039] FIG7 shows a schematic diagram of an operation control device for a cloud game provided by an embodiment of the present disclosure;

[0040] FIG8 shows a schematic diagram of another cloud game operation control device provided by an embodiment of the present disclosure;

[0041] FIG9 shows a schematic diagram of a computer device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work are within the scope of protection of the present disclosure.

[0043] Research has found that due to the inherent difficulty of the game's missions, inexperienced users, such as novice players, are often faced with the challenge of selecting different commands and attempting multiple attempts to complete the game. This requires players to spend considerable time selecting and combining different commands and repeatedly playing the game, resulting in a poor interactive experience.

[0044] Based on the above research, the present disclosure provides an operation control method for cloud games, and the cloud game platform can provide the cloud game client with an operation instruction set that matches the current game status information based on the game status information when the target cloud game is currently running. Here, the operation instruction set is obtained by identifying and processing the operation instructions of the target game video that matches the game status information. For example, if there are historical game videos of other users completing the game in a similar game state, the operation instruction set selected when passing the game can be obtained by identifying and processing the historical game video. In this way, game players can refer to and select these operation instruction sets that can be expected to pass the game, and complete the game quickly without having to select different operation instructions on their own and repeat the game multiple times to try, thereby reducing the cost of interactive trial and error and improving the interactive experience while players interact with the game normally.

[0045] The defects in the above solutions are the results obtained by the inventors after practice and careful research. Therefore, the process of discovering the above problems and the solutions proposed by this disclosure for the above problems below should be the contributions made by the inventors to this disclosure during the disclosure process.

[0046] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings.

[0047] To facilitate understanding of this embodiment, a cloud game operation control method disclosed in an embodiment of the present disclosure is first introduced in detail. The execution subject of the cloud game operation control method provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities. The computer device includes, for example: a terminal device or a server or other processing device. The terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the cloud game operation control method can be implemented by a processor calling computer-readable instructions stored in a memory.

[0048] The cloud gaming referred to in the embodiments of this disclosure specifically refers to an online gaming service that eliminates the need for local download and installation. This allows users to play games that are not locally installed across devices, even without a game console. Users can access the cloud gaming platform through devices such as televisions, computers, and mobile phones, eliminating the need for downloading or installing games. Simply maintaining an internet connection allows them to play games, thus overcoming the limitations of game content across different platforms.

[0049] In the embodiments of the present disclosure, a brief description of the cloud gaming system architecture is first provided. Figure 1 shows a schematic diagram of a cloud gaming system architecture provided in the embodiments of the present disclosure, involving a cloud gaming client 11, a cloud gaming platform 12, and a cloud gaming runtime 13. The cloud gaming client 11 communicates with the cloud gaming platform 12, and the cloud gaming platform 12 communicates with the cloud gaming runtime 13.

[0050] The following first briefly describes the functions that can be achieved at each end in the system.

[0051] The cloud gaming client (cloud gaming client SDK) can be an application or operating platform capable of running cloud gaming. The cloud gaming client can provide players with a visual interface on which they can play cloud gaming. The cloud gaming client can establish a connection with the cloud gaming platform, transmit user-selected operating instructions to the cloud gaming platform, and receive game screen data that the cloud gaming platform needs to render and display to players.

[0052] For the cloud game platform, it can specifically include the following modules: a transmission module for connecting to the cloud game client (cloud game client SDK) and the cloud game toolkit (GameSDK) in the cloud game running end to transmit game data and operation instructions; a control module for controlling the player's operation permissions and integrating the operation instructions uploaded by the player; a scheduling module for installing, deleting, updating, putting on the shelves, and removing cloud games from the cloud game running end; a permission management module for obtaining and verifying the operation permissions of the cloud game client; a storage module for storing the player's user data and game data; a configuration module for providing a visual interface for configuring the game and the gameplay. In addition, a data processing module is also included, such as an artificial intelligence (AI) module for processing data, information, etc. In the embodiment of the present disclosure, it includes but is not limited to completing tasks such as voice recognition, video analysis, labeling, data sorting, and information combination. For details, please refer to the following specific description in the embodiment of the present disclosure.

[0053] The cloud gaming runtime, specifically the cloud gaming runtime machine, is the actual machine that runs the cloud gaming. It can establish a connection with the cloud gaming platform, transmit data to the cloud gaming platform, and execute operational instructions transmitted by the cloud gaming platform. This includes a cloud gaming toolkit and game processing logic. The cloud gaming runtime toolkit is integrated within the cloud gaming system and performs functions related to cloud gaming, such as command upload, maintenance, and replay. Furthermore, it interacts with the cloud gaming platform for functions related to command upload, maintenance, and replay.

[0054] The cloud gaming client, cloud gaming platform, and cloud gaming runtime in the above-described system are shown in Figure 2. Two different cloud games are listed in the cloud gaming runtime. Under the cloud gaming client, multiple cloud gaming clients corresponding to user 1, user 2, and so on are exemplarily listed.

[0055] The following describes the cloud gaming control method provided by the embodiments of the present disclosure.

[0056] First, let's take the cloud gaming platform as an example. Here, the cloud gaming platform is independent of the cloud gaming client and the cloud gaming runtime, and plays the role of information transmission. At the same time, in the cloud gaming, the cloud gaming client receives the user-triggered operation instructions and displays the game screen to the user, completing the interaction between the user and the cloud gaming. The cloud gaming runtime determines the screen data under the operation instructions and completes the game operation. The cloud gaming platform can undertake other data processing operations, such as the transmission of operation instructions, screen data, etc., and can also include the organization of recommended operation instructions, or the recognition of operation instructions in the screen, etc., to reduce the task burden of the cloud gaming client and the cloud gaming runtime.

[0057] FIG3 is a flowchart of a method for controlling a cloud game operation according to an embodiment of the present disclosure. The method includes steps S301 to S303, wherein:

[0058] S301: Determine the game status information of the target cloud game currently being run by the cloud game client;

[0059] S302: Based on the game state information, determine at least one operation instruction set that matches the game state information, and indicate the at least one operation instruction set to the cloud game client; the operation instruction set is obtained by performing operation instruction recognition processing based on a target game video that matches the game state information; the target game video is a game operation video whose corresponding game operation result meets a target condition;

[0060] S303: In response to receiving the target operation instruction set selected by the cloud game client, generating game screen data after the cloud game client executes the target operation instruction set, and sending it to the cloud game client.

[0061] Regarding S301 above, the cloud gaming client is first described. Here, the cloud gaming client can specifically be a cloud gaming client corresponding to a new user in the target cloud game, or it can also be a cloud gaming client that has played the target cloud game multiple times. The corresponding game player in the cloud gaming client is also the user in the disclosed embodiment.

[0062] A cloud gaming client can run multiple cloud games, such as the multiple cloud games listed in Figure 2. The optional cloud games can specifically involve different game types, such as strategy games, such as chess and card games, box-pushing games, elimination games, etc., combat games, such as monster-killing games and shooting games, or operation games, such as table tennis games and other sports games.

[0063] Under the cloud gaming platform, the cloud game currently being run by the cloud gaming client can be determined, which is referred to as the target cloud game in the disclosed embodiment. The game status information of the target cloud game can be specifically expressed through a variety of different game description dimensions. For example, from the perspective of the cloud game, which game stage is currently being played, or which game task is being completed, can be used to determine the game status information; from the perspective of the virtual game character selected by the user, which specific virtual game character is currently selected, what are the corresponding operation instructions that can be selected, and how much life value the virtual game character has left can also be used to determine the game status information; from the perspective of the opponent of the virtual game character, such as the game monster character, which game monster character is specifically facing, and how much life value the current game monster character has left can also be used to determine the game status information. Therefore, the game status information can be summarized in different dimensions according to the actual situation to illustrate the progress of the current cloud game and the status of the virtual characters of the game parties. The degree of detail and the different angles selected during the specific summary can be determined according to the actual situation and are not limited here.

[0064] With respect to the above S302, after the cloud gaming platform determines the game status information corresponding to the currently running target cloud game, it can use the game status information to provide at least one operation instruction set to the cloud gaming client.

[0065] Here, since when providing the operation instruction set to the cloud game client, it is specifically hoped that the user can be provided with optional operation instructions that can complete the target cloud game, the operation instruction set provided here is specifically selected to select the operation instruction set that matches the game state information; when the operation instruction set is obtained by identifying and processing the existing game video, the selected game operation video is referred to as the target game video in the embodiment of this disclosure. The game operation result corresponding to the target game video here meets the target conditions. The target conditions can include completing the current level or defeating the virtual game monster, that is, completing the game task or clearing the game. Further, it can also be achieving a high score or completing it quickly, etc. In some possible cases, such a target game video can also be called a highlight history video.

[0066] As for the game operation video, it can be a recording obtained by any user under the target cloud game when playing the target cloud game, or it can be obtained from a video that can be authorized to obtain. In one possible case, when the user runs the target cloud game or after the operation is completed, at least one corresponding operation instruction can be obtained to form an operation instruction set. Specifically, for example, the following two different methods can be used to record the operation instructions: in one possible case, the user's authorization can be accepted before the target cloud game is started, and the operation instructions can be continuously recorded during the operation of the target cloud game; in another possible case, after the target cloud game is finished, the operation instructions triggered in the target cloud game can be sorted and collected at one time with the user's authorization. Alternatively, other feasible methods can be used to record the operation instructions in the target cloud game, which will not be listed one by one here.

[0067] In another possible scenario, since the above solution may require maintaining the corresponding operation instructions while retaining the game operation instructions, a large amount of storage resources will be occupied. Therefore, the present embodiment also specifically provides a method for determining the operation instruction set by identifying the operation instructions of the target game video.

[0068] In a specific implementation, the operation instruction set can be obtained after the target game video is subjected to operation instruction recognition processing in the following manner: multiple key frames including virtual game objects are screened from the target game video; semantic recognition processing is performed on the multiple key frames to determine the object behavior information of the virtual game object; and the operation instruction set is generated based on the object behavior information.

[0069] The above method is described in detail below. First, for the target game video, the specific purpose of the recognition process is to identify and determine which operation instructions were selected in the cloud game process corresponding to the recording of the game video. Different operation instructions can be specifically reflected in the actions, dialogues, special effects, and sound effects of the virtual game characters and virtual opponent characters controlled by the user in the video screen. Therefore, for the above different aspects, the key frames of the target game video can be screened first to obtain multiple key frames including virtual game objects (that is, the above virtual game characters and virtual opponent characters).

[0070] Then, these key frames are subjected to semantic recognition processing, which may specifically include processing the key frames and the corresponding audio data under the key frames to determine the object behavior information of the virtual game object. Exemplarily, a multimodal large language model (MLLM) can be used to pre-process the key frame images, and then identify the corresponding operation descriptions for the virtual game objects therein. For example, by performing semantic recognition processing on multiple key frames, it is determined that the virtual game character therein has completed the forward punching action under the control of the operation instruction in the target cloud game, and the forward punching action of the virtual game character is used as the object behavior information of the virtual game object.

[0071] Then, an operation instruction set can be generated based on the determined object behavior information of the virtual game object. Specifically, the object behavior information of the virtual game object can be analyzed based on the expected results of each operation instruction on the virtual game object under the target cloud game. For example, continuing the above example, if under the target cloud game, it can be determined that operation instruction 1 controls the virtual game character to complete the forward action, and operation instruction 2 controls the virtual game character to complete the punching action, then through the object behavior information of the virtual game object: forward punching action, it can be easily matched to obtain the operation instructions specifically including operation instruction 1 and operation instruction 2, and the corresponding operation instruction set is determined to be operation instruction 1 and operation instruction 2.

[0072] The above only provides an optional implementation method. Other methods that can achieve the same effect under this concept are also within the protection scope of the embodiments of the present disclosure, but they will not be listed and described one by one here.

[0073] After obtaining multiple operation instruction sets based on multiple target game videos, the cloud gaming platform can also generate label information corresponding to each operation instruction set based on the game-related data in the target game videos.

[0074] Here, the game-related data may specifically include game event tags, game data, player data, and game scores in the cloud game. For example, the game event tags can be used to identify what kind of game task the target game video is performing, or which game stage is completed; the game data can be the damage value generated for the virtual opponent character, etc.; the player data can include the game income obtained, and the character status of the virtual game character, etc.; the game score can be a score obtained based on the time to complete the game, etc. Here, since the content of the game is different in different cloud games, the specific game-related data will vary depending on the cloud game. This is just one possible example. When using game-related data to determine the label information, it is specifically possible to obtain a label information with characteristics under multiple dimensions according to the different dimensions of the above-mentioned game-related data.

[0075] In this way, when the cloud gaming platform indicates the at least one obtained operation instruction set to the cloud gaming client, it can also indicate multiple operation instruction sets and the tag information corresponding to each operation instruction set to the cloud gaming client. For the cloud gaming client, the tag information can be used to sort and display multiple operation instructions. It can also be used to display game-related data under some or all selected dimensions to the user, such as the time it takes to complete the cloud game, so that the user can select the required operation instruction set based on the data to complete the target cloud game.

[0076] Here, with respect to the above description of the situation where tag information can be used to sort multiple operation instruction sets, in one possible case, the sorting task can also be completed by the cloud gaming platform.

[0077] In a specific implementation, the cloud gaming platform can determine the correlation scores between the multiple operation instruction sets and the game status information of the cloud gaming client based on the tag information of the multiple operation instruction sets; and determine the operation result scores of the multiple operation instruction sets based on the tag information of the multiple operation instruction sets; sort the multiple operation instruction sets based on the correlation scores and the operation result scores, and indicate the sorted multiple operation instruction sets and their corresponding tag information to the cloud gaming client.

[0078] Here, we first explain how to determine the operation result scores of multiple operation instruction sets based on tag information. The operation result score is specifically used to reflect the operation quality of the operation instruction set for the target cloud game. The operation quality is reflected in whether the game can be completed quickly, or whether the game can be completed with a relatively simple operation instruction selection, or whether a higher score can be obtained, etc. When determining the operation result score, you can refer to the various dimensions of evaluating operation quality described above for weighted comprehensive calculation, or you can select only one of them for calculation, which can be determined according to the type of target cloud game.

[0079] For example, for combat games, such as fighting monsters, the focus is on whether the monsters can be defeated as quickly as possible and whether the game benefits can be obtained. Therefore, the corresponding data under these two dimensions under the tag information can be used to determine the operation result score. For strategy-oriented chess and card games, more emphasis may be placed on whether the game can be completed after fewer operation steps. When determining the operation result score, more attention will be paid to the time and number of operation instructions used to complete the game. The operation result score obtained here will be used to enable players in the target cloud game to judge whether the operation instruction set listed can help them pass the game tasks in the target cloud game.

[0080] In the actual target cloud game process, due to different players' different game progress in the target cloud game and different selected virtual game objects, the operation instructions that other users can use to clear the game in the past may not be applicable to the target cloud game played by the current user. This is because the game status cannot be fully matched. Therefore, in addition to sorting the operation instruction sets based on the operation result scores described above, it is also possible to determine the correlation scores between multiple operation instruction sets and the game status information of the cloud game client for comprehensive sorting.

[0081] Here, when determining the correlation between the operation instruction set and the game status information, illustratively, the above correlation can be determined from the following multiple judgment methods: whether the operation instructions in the operation instruction set can be selected in the current game state of the cloud game client reflected by the game status information, whether the indicated virtual game character is consistent with the virtual game character selected by the current user, whether the targetable virtual opponent character is consistent with the virtual opponent character currently faced, etc.

[0082] For example, in a racing cloud game, two command sets can be identified, designated as command set a and command set b. Based on the tag information corresponding to command set a and command set b, it can be determined that the vehicle used for command set a is vehicle c1, and the vehicle used for command set b is vehicle c2. If the cloud game client's game status indicates that vehicle c1 is selected, even if vehicle c2 is similar to vehicle c1, command set a will have a higher relevance score than command set b.

[0083] In this way, the tag information can be used to determine the relevance score, and then the operation result score can be used to comprehensively judge the ranking of the operation instruction set. In some possible examples, if an operation instruction set has a high operation result score but a low relevance score, such as a very short racing time, but the performance of the selected vehicle itself is significantly different from the vehicle currently playing the cloud game on the cloud game client, then such an operation instruction set is not suitable for priority recommendation and will not be ranked high for priority display after comprehensive sorting.

[0084] In this way, the cloud gaming platform can sort multiple operation instruction sets according to the relevance scores and operation result scores, and then indicate the sorted multiple operation instruction sets and their corresponding label information to the cloud gaming client.

[0085] As for the cloud game client, at least one received operation instruction set can be displayed so that the user can select a target operation instruction set to play a target cloud game or preview it.

[0086] For example, see Figure 4a, which is a schematic diagram of a plurality of operation instruction sets provided in an embodiment of the present disclosure. In the figure, the main screen displays the virtual game character controlled by the user and the game monster character currently facing. In the lower left corner of the screen, optional operation instructions are displayed, including control buttons B1, B2 and B3 corresponding to operation instruction 1, operation instruction 2 and operation instruction 3 respectively. In the upper right corner of the screen, multiple operation instruction sets are displayed, numbered a, b, and c respectively. Taking the operation instruction set corresponding to number a as an example, it specifically includes two recommended instructions, including operation instruction 1 and operation instruction 2.

[0087] Here, while displaying multiple operation instruction sets, some information in the tag information can also be displayed. For example, the username authorized by the user who provided the operation instruction set, or the game records achieved using the operation instruction set, etc. can be displayed, so that users can refer to this information and select the appropriate target operation instruction set.

[0088] For example, see Figure 4b, which shows another example of displaying multiple instruction sets in accordance with an embodiment of the present disclosure. Compared to Figure 4a, which only displays the instruction set number and the instruction within it, it also displays historical game record information. For example, the instruction set numbered a corresponds to the historical game record information "Defeat the monster in 5 minutes."

[0089] After the cloud gaming client displays the list of operations, the user can select an operation set. This selection involves two different methods: one method uses the selected operation set for the user's current cloud game; the other method uses the selected operation set for the user to preview the split-screen game.

[0090] The following describes the two different situations respectively.

[0091] First, for the first case, the user can select any operation instruction set from the operation list and use it in the currently ongoing cloud game. In response to the target operation instruction set being selected from the at least one operation instruction set, the cloud game client can indicate the target operation instruction set to the cloud game platform.

[0092] Here, in order to distinguish the different situations of the two selection operation instruction sets, the selection operation discrimination settings can be made in advance. For example, in a single-click selection operation, the target operation instruction set selected by the user is determined to be applied to the currently ongoing cloud game itself, while in a double-click selection operation, the corresponding operation intention is to preview the results of the operation instruction.

[0093] When it is determined that the target operation instruction set is applied to the currently ongoing cloud game itself, specifically corresponding to the above-mentioned step S303, the cloud game platform can indicate the target instruction set to the cloud game running end; the cloud game running end can determine the instruction execution result in the cloud game based on the target instruction set, and feedback the corresponding post-operation game screen data to the cloud game platform; after the cloud game platform obtains the post-operation game screen data fed back by the cloud game running end, it transmits the post-operation game screen data back to the cloud game client; the cloud game client displays the post-operation game screen to the user based on the feedback post-operation game screen data.

[0094] Secondly, for the second situation, when it is determined to preview the selection operation instructions of the target operation instruction set, the cloud game client can specifically respond to the preview instructions for the operation instruction set in the operation list, and obtain the preview screen data fed back by the cloud game platform in response to the preview instructions; in addition to the current game screen, display the game preview screen corresponding to the preview screen data.

[0095] Alternatively, in response to synchronous preview instructions for multiple operation instruction sets in the operation list, preview screen data generated by the cloud gaming platform for the multiple synchronous preview instructions are obtained; and in addition to the current game screen, game preview screens corresponding to the multiple preview screen data are synchronously displayed.

[0096] That is, when the user selects to preview the game screen affected by the operation instruction set, the user can select one or more to preview.

[0097] In a specific implementation, the preview screen data may be obtained in the following manner: obtaining mixed screen data obtained by the cloud gaming platform mixing the preview screen data and the current game screen data.

[0098] Next, the specific method of how the cloud gaming platform feeds back mixed-stream image data based on the operation instruction set selected by the user is described.

[0099] First, in response to receiving a preview instruction from the cloud gaming client for any operation instruction set in the operation list, the cloud gaming platform can determine the preview screen data corresponding to the preview instruction; perform mixed streaming processing on the preview screen data and the current game screen data, and feed back the obtained mixed screen data after mixed streaming to the cloud gaming client.

[0100] That is, after the cloud gaming client receives a preview instruction for any set of operation instructions, it can feed the preview instruction or the set of operation instructions indicated by the preview instruction back to the cloud gaming platform, so that the cloud gaming platform can obtain preview screen data based on it. Here, the preview screen data can specifically be the result data fed back by the cloud gaming running terminal after the cloud gaming platform sends the set of operation instructions to the cloud gaming running terminal. The process is similar to the corresponding process when the user plays the cloud game mentioned above.

[0101] In this way, for the cloud game platform, the screen data that can be obtained from the cloud game running end specifically includes the post-operation game screen obtained when the cloud game itself is being played, and the preview screen data obtained for the above-mentioned preview instructions.

[0102] In order to enable users to synchronously watch the game screen of the cloud game itself and the preview screen corresponding to the selected operation instruction set, when sending the game screen to the cloud game client, the cloud game platform can specifically choose to mix the preview screen data and the current game screen, and feed back the mixed screen data after mixing to the cloud game client.

[0103] Secondly, if the instruction received by the cloud gaming platform is a synchronous preview instruction, that is, the user has specifically selected multiple operation instruction sets in the operation list for synchronous preview, in response to receiving the synchronous preview instructions of the cloud gaming client for multiple operation instruction sets in the operation list, the preview screen data corresponding to each of the synchronous preview instructions is determined; the multiple preview screen data and the current game screen data are mixed, and the mixed screen data obtained after the mixed stream processing is fed back to the cloud gaming client.

[0104] The difference from the above embodiment is that, when multiple selected operation instruction sets are determined and preview display is performed, the preview screen data during the mixing process specifically includes multiple. During the mixing process, due to the increase in the screen data to be mixed, different mixing methods can be adopted accordingly.

[0105] The purpose of stream mixing described here is to transmit multiple images simultaneously, rather than sequentially or using multiple interfaces to transmit different images separately. This can achieve the beneficial effects of synchronous transmission and reduce interface usage.

[0106] After the cloud gaming platform performs mixed stream processing on the preview screen data, it can send the mixed stream data to the cloud gaming client. After receiving the mixed stream data, the cloud gaming client can display the current game screen and at least one game preview screen.

[0107] In a specific implementation, when the cloud gaming client displays the game preview screen, it can specifically adopt the following method: based on the number of game screens corresponding to the mixed stream screen data, the game display page is divided into multiple display areas, and the current game screen and at least one of the game preview screens are displayed in the multiple display areas respectively.

[0108] For ease of description, the following example illustrates this. Corresponding to the two aforementioned scenarios for previewing operations, in one possible scenario, there is only one previewed operation instruction set, which includes the current game screen. The mixed stream screen data specifically includes two game screens, meaning the number of game screens is "2." In this case, the game display page can be divided into an area for displaying the current game screen and an area for displaying the game preview screen, each of which can be displayed separately.

[0109] For example, see Figure 5a, which shows a schematic diagram of a game preview screen for a set of operation instructions provided by an embodiment of the present disclosure. This schematic diagram includes an area for displaying the current game screen, labeled Area A; and an area for displaying the game preview screen, labeled Area B, located in a related position.

[0110] In another possible scenario, the preview includes multiple operation instruction sets, for example, two, including the current game screen. The mixed stream screen data specifically includes three game screens, meaning the number of game screens is "3." In this case, the game display page can be divided into an area for displaying the current game screen and an area for displaying the game preview screen. The area displaying the game preview screen can be divided according to the number of selected operation instruction sets, and the corresponding game preview screen for each operation instruction set can be displayed accordingly.

[0111] For example, see Figure 5b, which shows a schematic diagram of a game preview screen for previewing multiple operation instruction sets provided by an embodiment of the present disclosure. This schematic diagram includes an area for displaying the current game screen, labeled Area A; and an associated area for displaying the game preview screen, labeled Area B. Area B specifically displays the game preview screens corresponding to the two selected operation instruction sets. Furthermore, to facilitate differentiation, the screens can be specifically labeled using the number of the selected operation instruction set.

[0112] In this way, the cloud gaming client can display the current game screen and at least one game preview screen.

[0113] The following describes the cloud gaming control method provided by the embodiments of the present disclosure, using a cloud gaming client as an example. The cloud gaming client can be a cloud gaming client corresponding to a new user of the target cloud game, or a cloud gaming client that has played the target cloud game multiple times. The corresponding game player of the cloud gaming client is also the user in the embodiments of the present disclosure.

[0114] 6 , which is a flow chart of another cloud game operation control method provided by an embodiment of the present disclosure, and is applied to a cloud game client, the method includes steps S601 to S604, wherein:

[0115] S601: Displaying the game interface of the target cloud game;

[0116] S602: Displaying at least one operation instruction set that matches the current game state information of the game match; the operation instruction set is obtained by performing operation instruction recognition processing based on the target game video that matches the game state information;

[0117] S603: In response to a target operation instruction set being selected from the at least one operation instruction set, determining the target operation instruction set;

[0118] S604: Receive game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data.

[0119] The above steps may be specifically described in the corresponding description in the above embodiments, which will not be repeated here and will only be briefly described here.

[0120] Regarding S601 above, the cloud game client specifically provides the user with a display of the game page for the target cloud game. The game page may display the ongoing game screen and the corresponding operation icon for the user to select the operation command, etc. In addition, other information related to the user or the cloud game, such as user information, may also be displayed.

[0121] Regarding S602 above, the game match page may specifically display at least one set of operation instructions that matches the current game state information of the game match. According to the description in the above embodiment, the set of operation instructions may specifically be obtained by performing voice recognition on a target game video. The target game video is a game operation video whose corresponding game operation results meet target conditions. For a detailed description of the target conditions, please refer to the above embodiment.

[0122] Specifically, the acquired target game video contains multiple key frames of virtual game objects under cloud gaming, and the actions, fighting effects, etc. corresponding to the virtual game objects displayed on these key frames can reflect what specific control instructions are selected for the virtual game objects.

[0123] On this basis, by performing semantic recognition on multiple key frames including virtual game objects, the object behavior information of the virtual game objects can be obtained, such as the hitting actions of the virtual game objects, etc., and according to the correspondence between the predetermined excitation actions and the operation instructions, the specific operation instruction set selected under the target game video can be determined.

[0124] In a specific implementation, when displaying at least one operation instruction set that matches the current game status information of the game match, the at least one operation instruction set and the label information corresponding to each of the operation instruction sets can be specifically displayed; the label information is used to indicate the game attribute information corresponding to the operation instruction set, and the game attribute information is used for user reference to select the target operation instruction set.

[0125] Here, the label information can specifically play the role of marking the operation instruction set, and can provide the user with a selection reference through the information it expresses. Specifically, the label information can be determined using the game attribute information. The game attribute information here can specifically include information expressing the degree of game completion, such as the game clearance time and game revenue, and can also express icon information of specific actions such as turning and jumping. For example, through the turning icon, it is indicated that the function of a certain operation instruction set is to achieve vehicle steering, or by marking "Game clearance time: within 5 minutes", it is indicated that the use of a certain operation instruction set can enable the cloud game control to complete the game goal within 5 minutes. Therefore, users can make reference selections from multiple operation instruction sets through the corresponding label information.

[0126] With respect to the above S603, for the multiple operation instruction sets displayed, the user can specifically select one or more of them as the target operation instruction set. The selected target operation instruction set is also the operation instruction set used to complete the game under the cloud game. After the cloud game client confirms the target operation instruction set selected by the user, it is sent to the cloud game platform, and the cloud game platform feeds back to the cloud game running end. The cloud game platform then returns the video stream data determined by the cloud game running end according to the target operation instruction set to the cloud game client so that the user can watch the game screen.

[0127] In this way, with respect to the above S604, the cloud gaming client can receive the game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data. Here, for the multiple operation instruction sets provided by the cloud gaming platform, specific selections can be made for preview, that is, as described in the above embodiment, the game preview screens corresponding to the selected operation instruction sets are synchronously displayed in addition to the current game screen.

[0128] Here, the method of obtaining the preview screen data and the specific method of displaying the game preview screen can be found in the specific description of the above embodiment, and will not be repeated here.

[0129] By using the cloud game operation control method provided by the embodiment of the present disclosure, the cloud game platform can provide the cloud game client with an operation instruction set that matches the current game status information based on the game status information when the target cloud game is currently running. Here, the operation instruction set is obtained by identifying and processing the operation instructions of the target game video that matches the game status information. For example, if there are historical game videos of other users completing the game in a similar game state, the operation instruction set selected when passing the game can be obtained by identifying and processing the historical game video. In this way, game players can refer to and select these operation instruction sets that can be expected to pass the game, and complete the game quickly without having to select different operation instructions on their own and repeat the game multiple times to try, thereby reducing the cost of interactive trial and error and improving the interactive experience while players are interacting with the game normally.

[0130] Those skilled in the art will understand that in the above-mentioned method of the specific implementation method, the writing order of each step does not mean a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0131] Based on the same inventive concept and applied to a cloud gaming platform, an operation control device for a cloud gaming corresponding to the operation control method for a cloud gaming is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned operation control method for a cloud gaming in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0132] 7 , an operation control device for a cloud game provided by an embodiment of the present disclosure is applied to a cloud game platform. The device includes: a first determining module 71 , a first sending module 72 , and a second sending module 73 ; wherein,

[0133] The first determination module 71 is used to determine the game status information of the target cloud game currently being run by the cloud game client;

[0134] A first sending module 72 is configured to determine, based on the game state information, at least one operation instruction set that matches the game state information, and to indicate the at least one operation instruction set to the cloud game client; the operation instruction set is obtained by performing operation instruction recognition processing based on a target game video that matches the game state information; the target game video is a game operation video whose corresponding game operation result meets a target condition;

[0135] The second sending module 73 is used to generate game screen data after the cloud game client executes the target operation instruction set in response to receiving the target operation instruction set selected by the cloud game client, and send it to the cloud game client.

[0136] In an optional embodiment, the operation instruction set is obtained after the target game video is subjected to operation instruction recognition processing in the following manner: multiple key frames including virtual game objects are screened from the target game video; semantic recognition processing is performed on the multiple key frames to determine the object behavior information of the virtual game object; and the operation instruction set is generated based on the object behavior information.

[0137] In an optional embodiment, the device also includes a processing module 74, which is used to: after obtaining multiple operation instruction sets based on multiple target game videos, generate label information corresponding to each operation instruction set according to game-related data in the target game video; when the first sending module 72 indicates the at least one operation instruction set to the cloud game client, it is used to: indicate the multiple operation instruction sets and their corresponding label information to the cloud game client.

[0138] In an optional embodiment, when the first sending module 72 indicates the multiple operation instruction sets and their corresponding label information to the cloud game client, it is used to: determine the correlation scores between the multiple operation instruction sets and the game status information of the cloud game client based on the label information of the multiple operation instruction sets; and determine the operation result scores of the multiple operation instruction sets based on the label information of the multiple operation instruction sets; sort the multiple operation instruction sets according to the correlation scores and the operation result scores, and indicate the sorted multiple operation instruction sets and their corresponding label information to the cloud game client.

[0139] In addition, when applied to a cloud game client, an operation control device for a cloud game corresponding to the operation control method for a cloud game is also provided in an embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the operation control method for a cloud game in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0140] 8 , an operation control device for a cloud game provided by an embodiment of the present disclosure is applied to a cloud game client. The device includes: a first display module 81 , a second display module 82 , a second determination module 83 , and a third display module 84 ; wherein,

[0141] The first display module 81 is used to display the game interface of the target cloud game;

[0142] A second display module 82 is configured to display at least one operation instruction set that matches the current game state information of the game match; the operation instruction set is obtained by performing operation instruction recognition processing based on a target game video that matches the game state information;

[0143] A second determining module 83 is configured to determine the target operation instruction set in response to the target operation instruction set being selected from the at least one operation instruction set;

[0144] The third display module 84 is used to receive game screen data after the cloud game client executes the target operation instruction set, and display the current game screen based on the game screen data.

[0145] In an optional embodiment, the operation instruction set is generated by semantically identifying multiple key frames of a virtual game object in the target game video, using the object behavior information of the virtual game object obtained by identification; the target game video is a game operation video in which the corresponding game operation results meet the target conditions.

[0146] In an optional embodiment, when displaying at least one operation instruction set that matches the current game status information of the game match, the first display module 81 is used to: display the at least one operation instruction set, and label information corresponding to each of the operation instruction sets; the label information is used to indicate the game attribute information corresponding to the operation instruction set, and the game attribute information is used for user reference to select the target operation instruction set.

[0147] In an optional embodiment, after displaying the at least one operation instruction set, the second display module 82 is further used to: respond to a preview instruction for any of the operation instruction sets, obtain preview screen data in response to the preview instruction feedback; and display a game preview screen corresponding to the preview screen data outside the current game screen.

[0148] In an optional embodiment, after displaying the at least one operation instruction set, the second display module 82 is further used to: respond to synchronous preview instructions for multiple operation instruction sets, obtain preview screen data generated in response to the synchronous preview instructions; and synchronously display game preview screens corresponding to the multiple preview screen data in addition to the current game screen.

[0149] In an optional embodiment, the preview screen data is obtained according to the following steps: obtaining mixed screen data after the preview screen data and the current game screen data are mixed; when displaying the game preview screen, the second display module 82 is used to: based on the number of game screens corresponding to the mixed screen data, divide the game display page into multiple display areas, and display the current game screen and at least one of the game preview screens in the multiple display areas respectively.

[0150] For descriptions of the processing flow of each module in each device and the interaction flow between each module, reference can be made to the relevant descriptions in the above method embodiments, which will not be described in detail here.

[0151] The present disclosure also provides a computer device, as shown in FIG9 , which is a schematic diagram of the structure of the computer device provided by the present disclosure, including:

[0152] A processor 10 and a memory 20; the memory 20 stores machine-readable instructions executable by the processor 10, and the processor 10 is configured to execute the machine-readable instructions stored in the memory 20. When the machine-readable instructions are executed by the processor 10, the processor 10 performs the following steps:

[0153] Determine the game status information of the target cloud game currently running on the cloud game client; based on the game status information, determine at least one operation instruction set that matches the game status information, and indicate the at least one operation instruction set to the cloud game client; the operation instruction set is obtained after operation instruction recognition processing is performed based on the target game video that matches the game status information; the target game video is a game operation video whose corresponding game operation result meets the target conditions; in response to receiving the target operation instruction set selected by the cloud game client, generate game screen data after the cloud game client executes the target operation instruction set, and send it to the cloud game client.

[0154] Alternatively, the processor 10 performs the following steps:

[0155] Display the game match interface of the target cloud game; display at least one operation instruction set that matches the current game status information of the game match; the operation instruction set is obtained after operation instruction recognition processing is performed based on the target game video that matches the game status information; in response to the target operation instruction set in the at least one operation instruction set being selected, determine the target operation instruction set; receive game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data.

[0156] The above-mentioned memory 20 includes internal memory 210 and external memory 220; the memory 210 here is also called internal memory, which is used to temporarily store the calculation data in the processor 10, as well as the data exchanged with the external memory 220 such as the hard disk. The processor 10 exchanges data with the external memory 220 through the internal memory 210.

[0157] The specific execution process of the above instructions can refer to the steps of the cloud game operation control method described in the embodiment of the present disclosure, and will not be repeated here.

[0158] The present disclosure also provides a computer-readable storage medium having a computer program stored thereon. When executed by a processor, the computer program executes the steps of the cloud gaming operation control method described in the above method embodiment. The storage medium may be a volatile or non-volatile computer-readable storage medium.

[0159] The embodiments of the present disclosure also provide a computer program product, which carries program code. The instructions included in the program code can be used to execute the steps of the cloud game operation control method described in the above method embodiment. Please refer to the above method embodiment for details, which will not be repeated here.

[0160] The computer program product may be implemented in hardware, software, or a combination thereof. In one embodiment, the computer program product is implemented as a computer storage medium. In another embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0161] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems and devices described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0162] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0163] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0164] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0165] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The scope of protection of the present disclosure is not limited thereto. Although the present disclosure has been described in detail with reference to the above-described embodiments, those skilled in the art should understand that any person skilled in the art can modify or easily conceive of changes to the technical solutions described in the above-described embodiments within the technical scope disclosed in the present disclosure, or replace some of the technical features therein with equivalents. Such modifications, changes, or replacements do not deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure shall be subject to the scope of protection of the claims.

Claims

1. A cloud game operation control method, applied to a cloud game platform, comprising: Determine the game status information of the target cloud game currently being run by the cloud game client; Based on the game state information, at least one operation instruction set matching the game state information is determined, and the at least one operation instruction set is indicated to the cloud game client; the operation instruction set is obtained after operation instruction recognition processing is performed based on a target game video matching the game state information; the target game video is a game operation video whose corresponding game operation result meets the target condition; In response to receiving the target operation instruction set selected by the cloud game client, the game screen data after the cloud game client executes the target operation instruction set is generated and sent to the cloud game client.

2. The method according to claim 1, wherein: The operation instruction set is obtained by performing operation instruction recognition processing on the target game video in the following manner: Filtering and obtaining multiple key frames including virtual game objects from the target game video; Performing semantic recognition processing on the multiple key frames to determine object behavior information of the virtual game object; Based on the object behavior information, the operation instruction set is generated.

3. The method according to claim 1 or 2, further comprising: After obtaining a plurality of the operation instruction sets based on the plurality of the target game videos, generating label information corresponding to each of the operation instruction sets according to the game-related data in the target game videos; The step of indicating the at least one operation instruction set to the cloud gaming client includes: Multiple operation instruction sets and their corresponding label information are indicated to the cloud game client.

4. The method according to claim 3, wherein: The step of indicating the plurality of operation instruction sets and their corresponding label information to the cloud game client includes: Determine, according to the tag information of the multiple operation instruction sets, the correlation scores between the multiple operation instruction sets and the game state information of the cloud game client respectively; and, determining operation result scores of the multiple operation instruction sets according to the label information of the multiple operation instruction sets; The multiple operation instruction sets are sorted according to the correlation scores and the operation result scores, and the sorted multiple operation instruction sets and their corresponding label information are indicated to the cloud game client.

5. A cloud game operation control method, applied to a cloud game client, comprising: Display the game interface of the target cloud game; Displaying at least one operation instruction set matching the current game state information of the game match; the operation instruction set is obtained after operation instruction recognition processing is performed based on the target game video matching the game state information; In response to a target operation instruction set being selected from the at least one operation instruction set, determining the target operation instruction set; Receive game screen data after executing the target operation instruction set, and display the current game screen based on the game screen data.

6. The method according to claim 5, wherein: The operation instruction set is generated by semantically identifying multiple key frames including the virtual game object in the target game video and using the object behavior information of the virtual game object obtained by identification; The target game video is a game operation video whose corresponding game operation result meets the target condition.

7. The method according to claim 5 or 6, wherein: Displaying at least one operation instruction set matching the current game state information of the game match, including: Display the at least one operation instruction set and the label information corresponding to each operation instruction set; the label information is used to indicate the game attribute information corresponding to the operation instruction set, and the game attribute information is used for reference by the user to select the target operation instruction set.

8. The method according to any one of claims 5 to 7, wherein: After displaying the at least one operation instruction set, the method further includes: In response to a preview instruction for any of the operation instruction sets, obtaining preview screen data fed back in response to the preview instruction; In addition to the current game screen, a game preview screen corresponding to the preview screen data is displayed.

9. The method according to any one of claims 5 to 7, wherein: After displaying the at least one operation instruction set, the method further includes: In response to a synchronous preview instruction for a plurality of the operation instruction sets, obtaining a synchronous preview instruction in response to the synchronous preview instruction Preview screen data generated by preview instructions respectively; In addition to the current game screen, game preview screens corresponding to the plurality of preview screen data are displayed synchronously.

10. The method according to claim 8 or 9, wherein: The preview screen data is obtained according to the following steps: Acquire mixed screen data after the preview screen data and the current game screen data are mixed; The game preview screen is displayed, including: Based on the number of game screens corresponding to the mixed stream screen data, the game display page is divided into multiple display areas, and the current game screen and at least one of the game preview screens are respectively displayed in the multiple display areas.

11. A cloud game operation control device, applied to a cloud game platform, comprising: A first determination module is configured to determine game status information of a target cloud game currently being run by a cloud game client; A first sending module is configured to determine, based on the game state information, at least one operation instruction set matching the game state information, and indicate the at least one operation instruction set to the cloud game client; the operation instruction set is obtained after operation instruction recognition processing is performed based on a target game video matching the game state information; the target game video is a game operation video whose corresponding game operation result meets the target condition; The second sending module is configured to generate game screen data after the cloud game client executes the target operation instruction set in response to receiving the target operation instruction set selected by the cloud game client, and send it to the cloud game client.

12. A cloud game operation control device, applied to a cloud game client, comprising: A first display module is configured to display a game interface of a target cloud game; A second display module is configured to display at least one operation instruction set matching the current game state information of the game match; the operation instruction set is obtained after operation instruction recognition processing is performed based on the target game video matching the game state information; A second determination module is configured to determine the target operation instruction set in response to the target operation instruction set being selected from the at least one operation instruction set; The third display module is configured to receive the target operation performed by the cloud game client The game screen data after the instruction set is generated, and the current game screen is displayed based on the game screen data.

13. A computer device comprising: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is configured to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor executes the steps of the cloud game operation control method as described in any one of claims 1 to 10.

14. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a computer device, the computer device executes the steps of the cloud game operation control method as described in any one of claims 1 to 10.

Citation Information

Patent Citations

  • Streaming media determining method and device and storage medium

    CN108066986A

  • Cloud game realizing method and device, cloud server, terminal and medium

    CN110368686A

  • Interaction method and device, and computer storage medium

    CN113230647A

  • Interaction control method and device, computer equipment and storage medium

    CN113975800A

  • Cloud game operation control method and device, computer equipment and storage medium

    CN116764198A