Game update mehtod and system, server, electronic device and storage medium

Abstract

Embodiments of the present application disclose a game updating method and system, a server, an electronic device and a storage medium. The method comprises: when game updating is performed, running a cloud game client image to generate a cloud game picture containing an updating trigger control; obtaining operation coordinates corresponding to the updating trigger control; simulating a trigger operation of triggering the updating trigger control in the cloud game picture according to the operation coordinates corresponding to the updating trigger control, to generate a trigger instruction for indicating triggering the updating trigger control based on the trigger operation; and automatically triggering updating of the cloud game client image according to the trigger instruction. The technical solution of the embodiments of the present application can complete automatic updating of a game through a cloud game server without awareness of a player, and greatly improve operation cost and operation quality of a product through automatic updating of the game.

Description

Technical Field

[0001] This application relates to the field of cloud technology, and more specifically, to a game update method and system, a cloud gaming server, an electronic device, and a computer-readable storage medium. Background Technology

[0002] Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing. It enables thin clients with relatively limited graphics processing and data processing capabilities to run high-quality games. In cloud gaming, the game does not reside on the player's terminal but runs on a cloud gaming server. The server renders the game scene as a video and audio stream, which is then transmitted to the player's terminal via the network. The player's terminal does not need powerful graphics processing and data processing capabilities; it only needs basic streaming media playback capabilities and the ability to receive player input commands and send them to the cloud gaming server.

[0003] As games are updated, the games running on cloud gaming servers also need to be updated. Currently, game updates are done manually, requiring a device to be started, the game to be loaded, and then the update interface to appear before manually clicking to update the game. However, with the increasing development of cloud gaming, the number of game updates will increase as more and more game categories are launched. As there are more game versions, the tedious manual operation will reduce the quality and efficiency of cloud gaming products. Summary of the Invention

[0004] To address the aforementioned technical issues, embodiments of this application provide a game update method and system, a cloud gaming server, an electronic device, and a computer-readable storage medium, enabling automatic game updates and significantly improving product operating costs and quality through automated game updates.

[0005] Other features and advantages of this application will become apparent from the following detailed description, or may be learned in part from practice of this application.

[0006] According to one aspect of the embodiments of this application, a game update method is provided, the method being applied to a cloud gaming server, the method comprising: when performing a game update, running a cloud gaming client image to generate a cloud gaming screen containing an update trigger control; obtaining operation coordinates corresponding to the update trigger control; simulating a trigger operation of the update trigger control in the cloud gaming screen based on the operation coordinates corresponding to the update trigger control, thereby generating a trigger instruction for instructing the triggering of the update trigger control based on the trigger operation; and automatically triggering an update of the cloud gaming client image according to the trigger instruction.

[0007] According to one aspect of the embodiments of this application, a game update system is provided, the game update system including a cloud gaming server and a user interface recognition server, the method including: when the cloud gaming server performs a game update, it runs a cloud gaming client image to generate a cloud gaming screen containing update trigger controls, and transmits the cloud gaming screen to the user interface recognition server; the user interface recognition server marks and recognizes the update trigger controls in the cloud gaming screen to obtain operation coordinates, and sends the operation coordinates to the cloud gaming server; the cloud gaming server simulates the trigger operation of the update trigger controls in the cloud gaming screen according to the operation coordinates corresponding to the update trigger controls, so as to generate a trigger instruction for instructing the clicking of the update trigger controls based on the trigger operation, and automatically triggers the update of the cloud gaming client image according to the trigger instruction.

[0008] According to one aspect of the embodiments of this application, a cloud gaming server is provided, the cloud gaming server including a cloud gaming module, an acquisition module, a generation module and an update module;

[0009] The cloud gaming module is used to run the cloud gaming client image when a game update is performed, so as to generate a cloud gaming screen containing update trigger controls.

[0010] The acquisition module is used to acquire the operation coordinates corresponding to the update trigger control;

[0011] The generation module is used to simulate the triggering operation of the update triggering control in the cloud gaming screen according to the operation coordinates corresponding to the update triggering control, so as to generate a triggering instruction for instructing the triggering of the update triggering control based on the triggering operation.

[0012] The update module is used to automatically trigger the update of the cloud gaming client image according to the trigger command.

[0013] According to one aspect of the embodiments of this application, an electronic device is provided, including a processor and a memory, wherein computer-readable instructions are stored on the memory, and when executed by the processor, the computer-readable instructions implement the game update method as described above.

[0014] According to one aspect of the embodiments of this application, a computer-readable storage medium is provided, on which computer-readable instructions are stored, which, when executed by a computer's processor, cause the computer to perform the game update method as described above.

[0015] According to one aspect of the embodiments of this application, a computer program product or computer program is provided, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the game update method provided in the various alternative embodiments described above.

[0016] In the technical solution provided by the embodiments of this application, by running a cloud gaming client image on a cloud gaming server, a cloud gaming screen containing update trigger controls is generated. The operation coordinates corresponding to the update trigger controls can be obtained. Then, by simulating the triggering operation of the update trigger controls, a trigger command is automatically generated. This trigger command is used to instruct the triggering of the update trigger controls. That is, by simulating the operation of a human to trigger the update trigger controls to generate trigger commands, automation is achieved. Then, the cloud client image is automatically updated according to the trigger commands, avoiding tedious manual operations. At the same time, compared with the prior art of updating through a real device, the technical solution provided by the embodiments of this application implements the update on a cloud gaming server, which is lower in cost and more flexible.

[0017] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0018] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. It is obvious that the drawings described below are merely some embodiments of this application, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort. In the drawings:

[0019] Figure 1 A schematic diagram of a cloud gaming architecture is shown;

[0020] Figure 2 A flowchart of a game update method according to an embodiment of this application is shown;

[0021] Figure 3 A flowchart of a game update method according to an embodiment of this application is shown;

[0022] Figure 4 A flowchart of a game update method according to an embodiment of this application is shown;

[0023] Figure 5 A schematic diagram of the architecture of a game update system according to an embodiment of this application is shown;

[0024] Figure 6 A flowchart of a game update method according to an embodiment of this application is shown;

[0025] Figure 7 A schematic diagram of the architecture of a cloud gaming server according to an embodiment of this application is shown;

[0026] Figure 8 A schematic diagram of the structure of a computer system suitable for implementing the electronic device of the present application is shown. Detailed Implementation

[0027] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0028] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities can be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.

[0029] The flowcharts shown in the accompanying drawings are merely illustrative and do not necessarily include all content and operations / steps, nor do they necessarily have to be performed in the described order. For example, some operations / steps can be broken down, while others can be combined or partially combined; therefore, the actual execution order may change depending on the specific circumstances.

[0030] It should also be noted that "multiple" as mentioned in this application refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0031] Cloud computing refers to the delivery and usage model of IT infrastructure, meaning obtaining necessary resources in an on-demand and easily scalable manner through a network. In a broader sense, cloud computing also refers to the delivery and usage model of services, meaning obtaining necessary services in an on-demand and easily scalable manner through a network. These services can be IT and software related, internet-related, or other services. Cloud computing is a product of the development and integration of traditional computer and network technologies such as grid computing, distributed computing, parallel computing, utility computing, network storage technologies, virtualization, and load balancing.

[0032] With the development of the internet, real-time data streams, and the diversification of connected devices, as well as the demands for search services, social networks, mobile commerce, and open collaboration, cloud computing has rapidly developed. Unlike previous parallel and distributed computing, cloud computing will fundamentally revolutionize the entire internet model and enterprise management model.

[0033] Cloud gaming is an online gaming technology based on cloud computing technology. Please see [link / reference]. Figure 1 , Figure 1 This is a schematic diagram of a cloud gaming architecture illustrated in an exemplary embodiment of this application. The cloud gaming architecture includes a terminal 10 and a cloud gaming server 20, which communicate with each other via a wired or wireless network.

[0034] The corresponding game runs on the cloud gaming server 20, and the game runs on the cloud gaming server 20 as a complete native APK (Android application package) package; the media player program runs on the terminal 10, playing the audio and video corresponding to the game screen.

[0035] Cloud gaming offloads the logic calculations and rendering to the cloud gaming server 20, which would otherwise be performed on terminal 10. The game screen and commands, after computation and rendering by the cloud gaming server 20, are compressed and transmitted to terminal 10 via the network. Terminal 10 only needs to perform simple decoding, screen display, and transmit device commands to the cloud gaming server 20. Terminal 10 can support the connection of input device 30 to generate device commands.

[0036] It should be noted that terminal 10 can be a smartphone, tablet, laptop, desktop computer, or other similar device, but is not limited to these. Cloud gaming server 20 is a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. Input device 30 can be a keyboard, mouse, game controller, or other similar devices; this is not limited to these.

[0037] Figure 2 This is a flowchart illustrating a game update method according to an exemplary embodiment. This method can be applied to... Figure 1 The implementation environment shown, and by Figure 1 The cloud gaming server 20 in the illustrated embodiment environment is specifically executed.

[0038] like Figure 2 As shown, in an exemplary embodiment, the game update method may include steps S110 to S140, which are described in detail below:

[0039] S110. When updating the game, run the cloud gaming client image to generate a cloud gaming screen containing update trigger controls.

[0040] The cloud gaming client image mentioned in this embodiment is a game image running on a cloud gaming server, including a basic operating system and a game package. To adapt to different terminal operating systems, the operating system can be divided into Android operating system and iOS operating system (Apple's mobile operating system). Thus, the game screen calculated and rendered by the cloud gaming server can fully match the terminals of different operating systems. When the cloud gaming client image runs on the cloud gaming server, there will be a complete content of the corresponding game, and a cloud gaming screen will be generated. When the game is updated, a cloud gaming screen containing update trigger controls will be generated. The update trigger control can be an application component, such as an "update" button, or it can be an area, such as an area including update text prompt information and a button.

[0041] S120. Obtain the operation coordinates corresponding to the update trigger control.

[0042] The operation coordinates corresponding to the update trigger control mentioned in this implementation are the positions of the update trigger control in the cloud gaming screen. For example, in the cloud gaming screen where the game is being updated, the top left corner is the origin, and the coordinates of each pixel include the horizontal and vertical coordinates. The horizontal and vertical coordinate areas of the pixel corresponding to the update trigger control are the operation coordinates.

[0043] S130. Based on the operation coordinates corresponding to the update trigger control, simulate the trigger operation of the update trigger control in the cloud gaming screen, and generate a trigger command to indicate the trigger of the update trigger control based on the trigger operation.

[0044] The cloud gaming server can determine the location of the update trigger control within the cloud gaming screen based on its corresponding operation coordinates. This allows it to control that location, simulating the triggering action of the update trigger control within the cloud gaming screen. In other words, it simulates the actual triggering of the update trigger control, mimicking human operation rather than actual user / administrator action. Based on this simulation, it accurately generates the trigger command to click the update trigger control within the cloud gaming screen. For example, if the "Update" button is located in the center of the cloud gaming screen, the corresponding triggering action is simulated, generating a trigger command to click the center position. This triggering action can be a single click, double click, long press, heavy press, or swipe, and the trigger command can be a single click, double click, long press, heavy press, or swipe command, but is not limited to these. In another embodiment, the simulated triggering action can also be a simulated voice operation, such as automatically playing the voice prompt "Click the update button" to trigger the update button.

[0045] S140. Automatically trigger the update of the cloud gaming client image according to the trigger command.

[0046] A trigger command is used to instruct the automatic updating of the cloud gaming client image. For example, when the "Update" button is clicked, it is automatically pressed, triggering the generation of a trigger command. After the trigger command is generated, the cloud server directly updates the cloud gaming client image without manual intervention. In some other embodiments, after the trigger command is generated, the cloud server stores it. When the cloud server runs the trigger command, it updates the cloud gaming client image. The update can be based on cloud gaming update content, which is game update content not included in the cloud gaming client image resulting from a game version update. This update content can be cloud gaming update content generated by the game application server. For example, if the currently running cloud gaming client image contains content A, and the new game version contains content B, then the cloud gaming update content is (BA), and the updated cloud gaming client image contains content B. The cloud gaming client image update is equivalent to a game update.

[0047] In this embodiment, by running a cloud gaming client image on a cloud gaming server, a cloud gaming screen containing update trigger controls is generated. The operation coordinates corresponding to the update trigger controls in the cloud gaming screen can be obtained. The trigger operation of the update trigger controls is simulated by the operation coordinates, and trigger commands are automatically generated. The generated trigger commands replace the existing manual operations. Thus, the cloud gaming server can realize the automated update of the cloud client image according to the trigger commands, avoiding tedious manual operations. At the same time, compared with the existing technology of updating through a real device, the technical solution provided by this application realizes the update on the cloud gaming server without manual operation, which is lower in cost and more flexible.

[0048] Figure 3 yes Figure 2 A flowchart in an exemplary embodiment prior to step S110 in the illustrated embodiment. (See attached flowchart.) Figure 3 As shown, before running the cloud gaming client image, the game update method also includes:

[0049] S301. Obtain the cloud gaming client image version sent by the image management server.

[0050] The image management server is used to manage the cloud gaming client image versions, including but not limited to initiating updates to cloud gaming client images and reclaiming old cloud gaming client images; the cloud gaming client image version is the identity identifier of the cloud gaming client image, and different games have different cloud gaming client image versions; in this implementation, the cloud gaming server directly receives the cloud gaming client image version sent by the image management server, that is, the cloud gaming server communicates directly with the image management server.

[0051] S302. Obtain the cloud gaming client image from the image server based on the cloud gaming client image version.

[0052] The image server is used to store cloud gaming client images or other images. In this embodiment, step S302 specifically involves sending the cloud gaming client image version to the image server, the image server finding the cloud gaming client image corresponding to the cloud gaming client image version, and then transmitting it back to the cloud gaming server. In another embodiment, step S302 specifically involves the cloud gaming server directly querying the image server for a match based on the cloud gaming client image version. When a match is found, the cloud gaming server directly retrieves the cloud client image from the image server.

[0053] The cloud gaming client image version is managed by an image management server. The cloud server obtains the corresponding cloud gaming client image from the image management server according to the cloud gaming client image version to ensure that the cloud gaming client image running on the cloud server is accurate.

[0054] In this embodiment, after updating the cloud gaming client image, the game update method further includes: after the update is completed, packaging the updated cloud gaming client image into a new image; and pushing the new image to the image server for storage.

[0055] To facilitate a smooth and rapid transition for players to the new version of the game, after the update, the updated cloud gaming client image will be packaged into a new image and pushed to the image server. This can be achieved using virtualization container software (such as Docker) to package the cloud gaming client image running on the cloud gaming server into a new image. The next time the new image is obtained, the cloud gaming server will use the already updated game image, allowing players to directly enter the game and experience the new version, resulting in a better user experience. Pushing the new image to the image server also makes it easier for other devices to obtain the image.

[0056] It should be noted that in this embodiment, it is necessary to ensure that the cloud gaming client image update is complete. Before packaging the updated cloud gaming client image into a new image, such as... Figure 4 As shown, game update methods also include:

[0057] S401. During the update process of the cloud gaming client image, a screenshot of the cloud gaming screen is taken to obtain the first captured image.

[0058] During the update process, the cloud gaming client image also runs on the cloud server, generating cloud gaming screenshots in real time. These screenshots can be taken either in real-time or at preset time intervals, such as every 2 seconds. In this embodiment, the first screenshot is not necessarily a specific image; it can be a collection of captured images, including one or more images.

[0059] In another embodiment, during the game update process, the cloud game screen will display a screen unique to the update process, such as an update progress bar. To avoid capturing too many images, the cloud game screen can be captured according to the update progress bar. For example, when the update progress bar reaches 80%, the cloud game screen is captured every 2 seconds to obtain the first captured image; when the update progress bar reaches 90%, the cloud game screen is captured in real time.

[0060] S402. Convert the image format of the first captured image, and transmit the converted first captured image to the user interface recognition server for annotation and recognition processing of the login control.

[0061] In this embodiment, to avoid transmitting too many images, the image format of the first captured image can be converted in batches. For example, if five captured images are collected, the image format of those five images is converted. Converting the image format of the first captured image facilitates adaptation to various forms of image transmission and allows the user recognition server to recognize various types of images. This can involve converting to Base64 image format, such as converting PNG, GIF, and JPG image formats to Base64. Base64 is one of the encoding methods used to transmit 8-bit byte code. Base64 encoding is a process from binary to characters and can be used to transmit longer identification information in an HTTP environment. Base64 encoding is unreadable and requires decoding to read. Therefore, the first captured image will not be altered during the transmission of the converted first captured image to the user interface server. In another embodiment, the image format of the first captured image can also be converted using Huffman coding, arithmetic coding, etc. The user interface server is used to annotate and recognize the login controls contained in the converted first captured image.

[0062] S403. Receive the update completion instruction transmitted by the user interface recognition server. The update completion instruction is generated by the user interface recognition server after recognizing the login control contained in the first cropped image after image format conversion. The update completion instruction is used to indicate that the cloud gaming client image update is complete.

[0063] When the user interface recognition server detects that the first captured image after image format conversion contains login controls, it generates an update completion instruction. The update completion instruction is used to indicate that the cloud gaming client image update is complete. After receiving the update completion instruction transmitted by the user interface recognition server, the cloud gaming server indicates that it has confirmed that the current cloud gaming client image has been updated. Then, it packages the currently running updated cloud gaming client image into a new image. The login controls include, but are not limited to, a "Login" button, account and password input boxes.

[0064] In another embodiment, the user interface recognition server recognizes that the first captured image after image format conversion contains an update progress bar, and the update progress bar is 100%, indicating that the game update is complete, and generates an update completion command.

[0065] By transmitting the content of the cloud gaming client image to the user interface recognition server for annotation and recognition during the cloud gaming client image update process, the accuracy and reliability of determining the completion of the cloud gaming client update are ensured.

[0066] In this embodiment, the step of obtaining the operation coordinates corresponding to the update trigger control in step S120 includes:

[0067] During the operation of the cloud gaming client image, a screenshot of the cloud gaming screen is taken to obtain the second captured image;

[0068] The image format of the second cropped image is converted, and the converted second cropped image is transmitted to the user interface recognition server for updating the annotation and recognition processing of the trigger control.

[0069] Receive the operation coordinates corresponding to the update trigger control transmitted by the server from the user interface.

[0070] In this embodiment, the cloud gaming server takes screenshots of the cloud gaming screen while running the cloud gaming client image. These screenshots can be taken in real-time or at preset time intervals, such as every 2 seconds. The second screenshot image after image format conversion in this embodiment is not necessarily a specific screenshot; it can be a collection of captured images, including one or more images.

[0071] In another embodiment, since the cloud gaming screen containing the update trigger control is generally the screen before the game starts or after the game ends, in order to avoid taking too many screenshots, screenshots can also be taken of the cloud gaming screen for a specific time period, for example, the cloud gaming screen from 00:00 when the game starts to 05:00 when the game starts.

[0072] The image format of the second captured image is converted to facilitate image transmission. This may involve Base64 encoding, converting image formats such as PNG, GIF, and JPG to Base64. The converted second screenshot image is then transmitted to the user interface recognition server.

[0073] In this embodiment, the user interface recognition server is also used to annotate and recognize the update trigger control contained in the second cropped image after image format conversion. When the update trigger control is annotated and recognized, the operation coordinates corresponding to the update trigger control are generated and transmitted to the cloud gaming server so that the cloud gaming server can automatically update the game according to the operation coordinates.

[0074] In one exemplary embodiment, the process of updating the cloud gaming client image includes:

[0075] When a trigger command is detected, the content to be updated contained in the cloud gaming client image is replaced according to the pre-loaded cloud gaming update content.

[0076] Before updating the cloud gaming client image, cloud gaming update content is pre-loaded to facilitate rapid updates later. In another embodiment, specifically, after the cloud gaming server generates a trigger command, cloud gaming update content is pre-loaded before updating the cloud gaming client image. This cloud gaming update content consists of game content not included in the cloud gaming client image; the update is performed using this unincluded game content.

[0077] When a trigger command is detected, it indicates that the update trigger control has been activated. For example, if the cloud gaming server clicks the "Update" button, the "Update" button is triggered, the cloud server detects the click command, and performs the update operation. If no trigger command is detected, the cloud gaming client image will not be updated.

[0078] The update operation specifically involves replacing the content to be updated in the cloud gaming client image with the pre-loaded cloud gaming update content, thereby updating the cloud gaming client image.

[0079] It is worth noting that, in order to facilitate the image management server to promptly obtain the update status of the cloud gaming client image, the game update method also includes: sending the update status containing the cloud gaming client image update node to the image management server. The update status includes the cloud gaming client image update node, which includes the cloud gaming server and the user interface recognition server, to inform the image management server where the current game update node is and which step the update process has reached. The update status also includes whether the cloud gaming client image is not updated, is updating, or has completed the update, thus realizing the notification of the game update process. For example, when the cloud gaming client image is not updated, and the current update step is the cloud gaming server running the cloud gaming client image, then the update status of the update node being on the cloud gaming server and the current cloud gaming client image not being updated is sent to the image management server. As another example, when the cloud gaming client image is not updated, and the current update step is the user interface recognition server performing annotation and recognition processing, then the update status of the update node being on the user interface recognition server, the update step being performed by the user interface recognition server, and the current cloud gaming client image not being updated is sent to the image management server.

[0080] By sending the update status of the cloud gaming client image update node to the image management server, the image management server can be informed of the game update status in a timely manner, so as to manage the game update process. For example, the image management server can also control the cloud server to pause the update of the cloud gaming client image, or control the cloud server to end the update of the cloud gaming client image.

[0081] Figure 1 The technical solution of the illustrated embodiment is described from the perspective of a cloud gaming server. The following is a combination of... Figure 5 and Figure 6 The technical solution of this application embodiment is described from the perspective of a game update system:

[0082] Figure 5 The diagram shows the architecture of a game update system, which includes a cloud gaming server 20, a user interface recognition server 40, an image management server 50, and an image server 60.

[0083] When updating a game, the cloud gaming server runs a cloud gaming client image to generate a cloud gaming screen containing update trigger controls, and then transmits the cloud gaming screen to the user interface recognition server.

[0084] The user interface recognition server marks and identifies the update trigger controls in the cloud gaming screen to obtain the operation coordinates, and then sends the operation coordinates to the cloud gaming server;

[0085] The cloud gaming server simulates the triggering operation of the update triggering control in the cloud gaming screen based on the operation coordinates corresponding to the update triggering control. Based on the triggering operation, a triggering command is generated to instruct the update triggering control to be triggered. The cloud gaming client image is automatically updated according to the triggering command.

[0086] In another embodiment, the cloud gaming server 20 includes a system container, such as an Android container. The Android container is a container for the cloud-rendered Android system of the cloud game, in which the Android operating system and the corresponding game run. The user transmits operations to the Android container through an operation stream, and the Android container returns the video stream to the user's local device to complete the cloud game interaction process. In some other embodiments, the Android container in the cloud gaming server 20 pulls the image, runs the cloud game client image, transmits the cloud game screen running in the container to the user interface recognition server 40, and generates operation instructions based on the operation coordinates returned by the user interface recognition server 40, thereby realizing the automatic update of the game.

[0087] In the technical solution provided in this embodiment, the cloud gaming server runs the cloud gaming client image and transmits the cloud gaming screen to the user interface recognition server for annotation and recognition processing. The cloud gaming server generates trigger commands based on the operation coordinates corresponding to the update trigger control by simulating human-triggered operations, and executes the cloud gaming update content to complete the automated game update, avoiding the tedious manual operation and improving efficiency. Game updates are performed on the cloud gaming server without the need for a real device, resulting in low usage costs and fully automated operation, which significantly improves the product's operating costs and operational quality.

[0088] based on Figure 5 The system shown, Figure 6 The following is a specific interaction flow, with the following steps:

[0089] S601, the image management server initiates an update to the cloud gaming client image and sends the cloud gaming client image version to the cloud gaming server.

[0090] When the image management server obtains cloud gaming update content for a certain game, it sends the update information to an idle cloud gaming server and sends the cloud gaming client image version corresponding to the cloud gaming update content.

[0091] S602. The cloud gaming server obtains the cloud gaming client image from the image server based on the cloud gaming client image version.

[0092] S603: When updating a game, the cloud gaming server runs a cloud gaming client image to generate a cloud gaming screen containing update trigger controls.

[0093] S604: During the operation of the cloud gaming client image, the cloud gaming server takes a screenshot of the cloud gaming screen, obtains the captured image, converts the image format of the captured image, and transmits the converted captured image to the user interface recognition server.

[0094] The cloud gaming server takes a screenshot of the cloud gaming screen every 2 seconds, retaining the complete screenshot. Five screenshots are then collected and converted to Base64 format.

[0095] S605 The user interface recognition server annotates and recognizes the update trigger controls in the cropped image after image format conversion to obtain operation coordinates, and sends the operation coordinates to the cloud gaming server.

[0096] In step S605, the user interface recognition server's annotation and recognition of the captured image after image format conversion specifically includes: the user interface recognition server pre-acquires the interface identifier corresponding to the cloud gaming client image. Different cloud gaming client images have different interface identifiers. When the captured image after image format conversion is identified as an update interface based on the interface identifier, the operation coordinates of the update trigger control in the update interface are marked. Specifically, the operation coordinates are marked by taking the upper left corner of the update interface as the origin of the pixel point, obtaining the horizontal and vertical coordinates of the corresponding pixel point of the update trigger control, and marking the range of the horizontal and vertical coordinates as the operation coordinates. The interface identifier is the identifier corresponding to different game interfaces. For example, the interface identifier of the update interface is an "update" icon or text. The user interface recognition server identifies the captured image based on the interface identifier by: identifying the interface identifier of the captured image, matching the acquired interface identifier with the identified interface identifier, and then identifying whether the captured image is an update interface.

[0097] In this embodiment, the interface identifier corresponding to the cloud gaming client image can be sent by the image management server to the cloud gaming server, and then by the cloud gaming server to the user interface recognition server.

[0098] S606. The cloud gaming server simulates the triggering operation of the update triggering control in the cloud gaming screen based on the operation coordinates corresponding to the update triggering control, and generates a triggering command to indicate the triggering of the update triggering control based on the triggering operation.

[0099] S607: The cloud gaming server automatically triggers the update of the cloud gaming client image based on the trigger command.

[0100] S608. During the update process of the cloud gaming client image, the cloud gaming server takes a screenshot of the cloud gaming screen, obtains the captured image, converts the image format of the captured image, and transmits the converted captured image to the user interface recognition server.

[0101] S609 The user interface recognition server performs annotation and recognition processing on the login controls in the image captured by image format conversion, generates an update completion instruction, and sends the update completion instruction to the cloud gaming server.

[0102] In step S609, the user interface recognition server annotates and recognizes the captured image, specifically including: the user interface recognition server matches the interface identifier of the captured image with the interface identifier of the login interface; when the match is successful, it indicates that the captured image is the login interface; when the screenshot image is identified as the login interface based on the interface identifier, the login control in the login interface is marked and an update completion instruction is generated; wherein the interface identifier of the login interface is a "login" icon or text.

[0103] The S610 cloud gaming server determines that the cloud gaming client update is complete based on the update completion instruction, packages the updated cloud gaming client image into a new image, and pushes the new image to the image server for storage.

[0104] In another embodiment, the user interface recognition server may also use image recognition technology to identify features in the captured image, such as using OCR (Optical Character Recognition) to determine whether there is text information such as "update" or "login" in the captured image. If there is text information such as "update" or "login", it indicates that the captured image is an update interface or a login interface.

[0105] The following describes an apparatus embodiment of this application, which can be used to execute the game update method described above in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the game update embodiments described above in this application.

[0106] Figure 7 A block diagram of a cloud gaming server according to an embodiment of the present application is shown. The cloud gaming server includes a cloud gaming module 701, an acquisition module 702, a generation module 703, and an update module 704.

[0107] The cloud gaming module 701 is used to run the cloud gaming client image when a game update is performed, so as to generate a cloud gaming screen containing update trigger controls.

[0108] Module 702 is used to obtain the operation coordinates corresponding to the update trigger control;

[0109] The generation module 703 is used to simulate the triggering operation of the update triggering control in the cloud gaming screen according to the operation coordinates corresponding to the update triggering control, so as to generate a triggering command to indicate the triggering of the update triggering control based on the triggering operation;

[0110] Update module 704 is used to automatically trigger the update of the cloud gaming client image based on the trigger command.

[0111] In some embodiments of this application, based on the foregoing scheme, the cloud gaming server further includes: a pull module, which is used to obtain the cloud gaming client image version sent by the image management server; and to obtain the cloud gaming client image from the image server according to the cloud gaming client image version.

[0112] In some embodiments of this application, based on the foregoing scheme, the cloud gaming server further includes: a push module, which is used to package the updated cloud gaming client image into a new image after the update is completed; and push the new image to the image server for storage.

[0113] In some embodiments of this application, based on the foregoing scheme, the cloud gaming server further includes: a transmission module, which is used to take a screenshot of the cloud gaming screen during the update process of the cloud gaming client image before packaging the updated cloud gaming client image into a new image, to obtain a first captured image; to convert the image format of the first captured image, and to transmit the first captured image after image format conversion to a user interface recognition server for annotation and recognition processing of login controls; and to receive an update completion instruction transmitted by the user interface recognition server, wherein the update completion instruction is generated by the user interface recognition server recognizing the login controls contained in the first captured image after image format conversion, and the update completion instruction is used to indicate that the cloud gaming client image update is complete.

[0114] In some embodiments of this application, based on the aforementioned scheme, the acquisition module 702 is specifically used to take a screenshot of the cloud game screen during the operation of the cloud game client image to obtain a second captured image; convert the image format of the second captured image, and transmit the second captured image after image format conversion to the user interface recognition server for annotation and recognition processing of the update trigger control; and receive the operation coordinates corresponding to the update trigger control transmitted by the user interface recognition server.

[0115] In some embodiments of this application, based on the aforementioned scheme, the update module 704 is specifically used to replace the content to be updated contained in the cloud gaming client image according to the pre-loaded cloud gaming update content when a trigger command is detected.

[0116] In some embodiments of this application, based on the foregoing scheme, the cloud gaming server further includes: a notification module, which is used to send the update status containing the cloud gaming client image update node to the image management server, wherein the cloud gaming client image update node includes the cloud gaming server.

[0117] It should be noted that the apparatus provided in the above embodiments and the method provided in the above embodiments belong to the same concept, and the specific way in which each module and unit performs operations has been described in detail in the method embodiments, and will not be repeated here.

[0118] Embodiments of this application also provide an electronic device, including a processor and a memory, wherein the memory stores computer-readable instructions that, when executed by the processor, implement the game update method as described above.

[0119] Figure 8 A schematic diagram of the structure of a computer system suitable for implementing the electronic device of the present application is shown.

[0120] It should be noted that, Figure 8The computer system 1600 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.

[0121] like Figure 8 As shown, the computer system 1600 includes a Central Processing Unit (CPU) 1601, which can perform various appropriate actions and processes based on programs stored in Read-Only Memory (ROM) 1602 or programs loaded from storage portion 1608 into Random Access Memory (RAM) 1603, such as performing the methods described in the above embodiments. Various programs and data required for system operation are also stored in RAM 1603. The CPU 1601, ROM 1602, and RAM 1603 are interconnected via bus 1604. An Input / Output (I / O) interface 1605 is also connected to bus 1604.

[0122] The following components are connected to I / O interface 1605: an input section 1606 including a keyboard, mouse, etc.; an output section 1607 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 1608 including a hard disk, etc.; and a communication section 1609 including a network interface card such as a LAN (Local Area Network) card, modem, etc. The communication section 1609 performs communication processing via a network such as the Internet. A drive 1610 is also connected to I / O interface 1605 as needed. Removable media 1611, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 1610 as needed so that computer programs read from them can be installed into storage section 1608 as needed.

[0123] Specifically, according to embodiments of this application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program including a computer program for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 1609, and / or installed from removable medium 1611. When the computer program is executed by central processing unit (CPU) 1601, it performs various functions defined in the system of this application.

[0124] It should be noted that the computer-readable medium shown in the embodiments of this application can be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this application, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying a computer-readable computer program. The transmitted data signal can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to wireless, wired, etc., or any suitable combination thereof.

[0125] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. Each block in a flowchart or block diagram may represent a module, segment, or portion of code, which contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0126] The units described in the embodiments of this application can be implemented in software or hardware, and the described units can also be located in a processor. The names of these units do not necessarily limit the specific unit itself.

[0127] Another aspect of this application provides a computer-readable storage medium having a computer program stored thereon that, when executed by a processor, implements the method described above. This computer-readable storage medium may be included in the electronic device described in the above embodiments, or it may exist independently and not assembled into the electronic device.

[0128] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiments of this application, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0129] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, touch terminal, or network device, etc.) to execute the method according to the embodiments of this application.

[0130] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein.

[0131] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A game update method, characterized in that, The method is applied to a system container of a cloud gaming server. The system container is a container for the cloud-rendered operating system of the cloud gaming system, and the operating system and the corresponding game run within the system container. The method includes: When updating the game, the image management server obtains the cloud game client image version sent when it receives the cloud game update content. Based on the cloud game client image version, the image is obtained from the image server. The cloud game client image is run to generate a cloud game screen containing update trigger controls. The cloud game client image is a game image running on the cloud game server, including the operating system and game package. Obtain the operation coordinates corresponding to the update trigger control; Based on the operation coordinates corresponding to the update trigger control, simulate the trigger operation of the update trigger control in the cloud gaming screen, and generate a trigger command to indicate the triggering of the update trigger control based on the trigger operation; When the trigger command is detected, the cloud gaming client image will be automatically updated. During the update process of the cloud gaming client image, the cloud gaming screen displays an update progress bar unique to the update process. When the update progress bar reaches the first threshold, the cloud gaming screen is captured at preset time intervals. When the update progress bar reaches the second threshold, the cloud gaming screen is captured in real time to obtain the first captured image. The image format of the first cropped image is converted to Base64 encoding format. The Base64 encoding format is used to convert binary data into character data to transmit identification information in the HTTP environment. The first cropped image after image format conversion is transmitted to the user interface recognition server for annotation and recognition processing of login controls. During the process of transmitting the first cropped image after image format conversion to the user interface recognition server, the first cropped image is not changed. The system receives an update completion instruction transmitted by the user interface recognition server. The update completion instruction is generated by the user interface recognition server upon recognizing a login control contained in the first cropped image after image format conversion. The update completion instruction is used to indicate that the cloud gaming client image update is complete. The update status containing the cloud gaming client image update node is sent to the image management server so that the image management server can manage the game update process; the cloud gaming client image update node includes the cloud gaming server or the user interface recognition server; Once the update is complete, the updated cloud gaming client image will be packaged into a new image, and the new image will be pushed to the image server for storage.

2. The game update method according to claim 1, characterized in that, The step of obtaining the operation coordinates corresponding to the update trigger control includes: During the operation of the cloud gaming client image, a screenshot is taken of the cloud gaming screen to obtain a second captured image; The image format of the second cropped image is converted, and the converted second cropped image is transmitted to the user interface recognition server for updating the annotation and recognition processing of the trigger control. Receive the operation coordinates corresponding to the update trigger control transmitted by the user interface identification server.

3. The game update method according to any one of claims 1-2, characterized in that, The step of automatically triggering an update of the cloud gaming client image upon receiving the trigger command includes: When the trigger command is detected, the content to be updated contained in the cloud gaming client image is replaced according to the pre-loaded cloud gaming update content.

4. A game update system, characterized in that, The game update system includes a cloud gaming server and a user interface recognition server, wherein: When the system container of the cloud gaming server updates the game, it runs the cloud gaming client image to generate a cloud gaming screen containing update trigger controls, and transmits the cloud gaming screen to the user interface recognition server. The system container is a container for the cloud-rendered operating system of the cloud game, and the operating system and the corresponding game run in the system container. The cloud gaming client image is a game image running on the cloud gaming server, including the operating system and the game package. The user interface recognition server marks and recognizes the update trigger control in the cloud game screen to obtain the operation coordinates, and sends the operation coordinates to the cloud game server; The system container of the cloud gaming server simulates the triggering operation of the update trigger control in the cloud gaming screen based on the operation coordinates corresponding to the update trigger control. It then generates a trigger command to instruct the update trigger control to be triggered, and automatically triggers the update of the cloud gaming client image according to the trigger command. During the update process, the cloud gaming screen displays an update progress bar specific to the update process. When the update progress bar reaches a first threshold, the cloud gaming screen is captured at preset time intervals. When the update progress bar reaches a second threshold, the cloud gaming screen is captured in real time to obtain a first captured image. The image format is converted to Base64 encoding format, which is used to convert binary data into character data for transmitting identification information in an HTTP environment. The first screenshot after image format conversion is transmitted to the user interface recognition server for annotation and recognition of login controls. During the transmission of the first screenshot after image format conversion to the user interface recognition server, the first screenshot is not modified. An update completion instruction is received from the user interface recognition server. The update completion instruction is generated by the user interface recognition server upon recognizing the login controls contained in the first screenshot after image format conversion. The update completion instruction is used to indicate that the cloud gaming client image update is complete. The game update system also includes a mirror server; the system container of the cloud game server obtains the cloud game client image version sent by the image management server when it obtains the cloud game update content, and obtains the cloud game client image from the mirror server according to the cloud game client image version; when the cloud game client image is updated, the cloud game server packages the updated cloud game client image into a new image and pushes the new image to the mirror server for storage.

5. The game update system according to claim 4, characterized in that, The user interface recognition server obtains the interface identifier corresponding to the cloud gaming client image; when the screenshot image after image conversion is identified as an update interface based on the interface identifier, the operation coordinates of the update trigger control in the update interface are marked; or when the screenshot image after image conversion is identified as a login interface based on the interface identifier, the login control in the login interface is marked, an update completion instruction is generated, and the update completion instruction is sent to the cloud gaming server.

6. A cloud gaming server, characterized in that, The system container of the cloud gaming server includes a cloud gaming module, an acquisition module, a generation module, and an update module. The system container is a container for the cloud-rendered operating system of the cloud game, and the operating system and the corresponding game run in the system container. The cloud gaming module is used to obtain the cloud gaming client image version sent by the image management server when the game is updated, obtain the cloud gaming client image from the image server according to the cloud gaming client image version, and run the cloud gaming client image to generate a cloud gaming screen containing update trigger controls. The cloud gaming client image is a game image running on the cloud gaming server, including the operating system and game package. The acquisition module is used to acquire the operation coordinates corresponding to the update trigger control; The generation module is used to simulate the triggering operation of the update triggering control in the cloud gaming screen according to the operation coordinates corresponding to the update triggering control, so as to generate a triggering instruction for instructing the update triggering control based on the triggering operation; The update module is used to automatically trigger an update of the cloud gaming client image when the trigger command is detected. The system also includes a transmission module, used to display an update progress bar specific to the update process during the cloud gaming client image update process, before packaging the updated cloud gaming client image into a new image. When the update progress bar reaches a first threshold, the cloud gaming screen is captured at preset time intervals; when the update progress bar reaches a second threshold, the cloud gaming screen is captured in real time to obtain a first captured image; the image format of the first captured image is converted to Base64 encoding format, which is used to convert binary data into character data for transmitting identification information in an HTTP environment; the first captured image after image format conversion is transmitted to a user interface recognition server for annotation and recognition of login controls, wherein the first captured image is not modified during the transmission of the first captured image after image format conversion to the user interface recognition server; and the system receives an update completion instruction transmitted by the user interface recognition server, which is generated by the user interface recognition server recognizing the login controls contained in the first captured image after image format conversion; the update completion instruction is used to indicate that the cloud gaming client image update is complete. It also includes a pull module, a push module, and a notification module. The pull module is used to obtain the cloud gaming client image version sent by the image management server; and to obtain the cloud gaming client image from the image server according to the cloud gaming client image version. The push module is used to package the updated cloud gaming client image into a new image after the update is completed; Push the new image to the image server for storage; The notification module is used to send the update status of the cloud gaming client image update node to the image management server, so that the image management server can manage the game update process; The cloud gaming client image update node includes the cloud gaming server or the user interface identification server.

7. An electronic device, characterized in that, include: Memory, which stores computer-readable instructions; A processor reads computer-readable instructions stored in memory to perform the method described in any one of claims 1-3.

8. A computer-readable storage medium, characterized in that, It stores computer-readable instructions that, when executed by the processor of a computer, cause the computer to perform the method described in any one of claims 1-3.

9. A computer program product, characterized in that, It includes a computer program carried on a computer-readable medium, the computer program comprising a computer program for performing the method of any one of claims 1-3.

Images