Screen display method, device, terminal device, and computer program

Abstract

The embodiments of the present application disclose a screen display method, an apparatus, a terminal device, and a storage medium, in which the method includes the steps of: rendering a game screen of the target game on a user interface based on game data distributed from a target container during the operation of the target game, where the target game is a cloud game running in the target container; obtaining control operations for the target game, and drawing an operation animation corresponding to the control operation on the user interface based on the control operation; and overlaying the operation animation on the game screen and displaying the game screen with the operation animation overlaid on the user interface, which can improve the smoothness when the terminal device draws the operation animation based on the control operation of the game user.

Description

[Technical field]

[0001] This application claims priority to a Chinese patent application filed with the China Patent Office on March 4, 2021, bearing application number 202110242486.X and entitled "Screen display method, device, terminal equipment and storage medium", the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of computer technology, and more particularly to screen displays. [Background technology]

[0003] With the continuous development of computer technology, more and more application programs are born accordingly to enrich users' work and life. For example, the emergence of various game application programs has greatly enriched users' leisure life. Currently, many kinds of game application programs have emerged, so that game users need to locally download different game application client terminals when they want to experience different game applications. Generally, the client terminal corresponding to the game application occupies a relatively large memory space of the terminal device, which affects the operation of the data of the terminal device. Therefore, if the game application can be run on the cloud server as a cloud game, the terminal device does not need to download the game client terminal when running the cloud game, and the cloud game client terminal accesses the cloud game on the cloud server, and the terminal device only renders and displays the game screen. Summary of the Invention [Problem to be solved by the invention]

[0004] In view of the above, the embodiments of the present application propose a screen display method, device, terminal device, and storage medium, which can improve the smoothness when the terminal device renders an operation animation based on the control operation of the game user. [Means for solving the problem]

[0005] In one aspect, an embodiment of the present application provides a screen display method, comprising: In the operation process of a target game, a game screen of the target game is rendered in a user interface based on game data distributed from a target container, and the target game is a cloud game running in the target container; acquiring a control operation for the target game, and drawing an operation animation corresponding to the control operation on the user interface based on the control operation; and overlaying the operation video on the game screen and displaying the game screen on which the operation video is overlaid in the user interface.

[0006] In a further aspect, embodiments herein provide a screen display device, comprising: A rendering unit is used for rendering a game screen of the target game in a user interface according to game data distributed from a target container during an operation process of the target game, the target game being a cloud game running in the target container; an acquisition unit used for acquiring a control operation for the target game; a drawing unit, which is used for drawing an operation animation corresponding to the control operation on the user interface according to the control operation; an overlay unit used for overlaying the operation video on the game screen; and a display unit used for displaying a game screen on which the operation animation is overlaid in the user interface.

[0007] In a further aspect, an embodiment of the present application provides a terminal device, comprising: a processor; an input device; an output device; and a memory, the processor, the input device, the output device and the memory being connected to each other, wherein the memory is adapted to store a computer program supporting execution of the method on the terminal device, the computer program comprising program instructions, the processor calling the program instructions to: In the operation process of a target game, a game screen of the target game is rendered in a user interface based on game data distributed from a target container, and the target game is a cloud game running in the target container; acquiring a control operation for the target game, and drawing an operation animation corresponding to the control operation on the user interface based on the control operation; overlaying the operation animation on the game screen, and displaying the game screen on which the operation animation is overlaid in the user interface.

[0008] In a further aspect, an embodiment of the present application provides a computer-readable storage medium having program instructions stored therein, the program instructions being used to perform the screen display method according to the above aspect when executed by a processor.

[0009] In yet another aspect, an embodiment of the present application provides a computer program product including instructions, which when run on a computer, cause the computer to perform the screen display method according to the previous aspect. Effect of the Invention

[0010] In an embodiment of the present application, during the operation process of a target game, a terminal device can request game data of the target game from a target container of a cloud server, and render a game screen of the target game on a user interface based on the game data; further, the terminal device can obtain a control operation for the target game, and based on the obtained control operation, draw an operation animation corresponding to the control operation on the user interface, and overlay and display the operation animation on the game screen; since the terminal device locally retains and executes the drawing of the operation animation of the control operation, the terminal device can improve the smoothness of drawing the operation animation based on the control operation of the game user, thereby achieving a gaming experience in which the game user performs game operations locally on the terminal device, and improving user satisfaction. [Brief description of the drawings]

[0011] [Figure 1a] FIG. 2 is a schematic diagram of a screen display system provided in an embodiment of the present application. [Figure 1b] FIG. 2 is a schematic diagram of device capabilities of a terminal device and a cloud server provided in an embodiment of the present application; [Diagram 2] 2 is a schematic flow chart of a screen display method provided in an embodiment of the present application; [Diagram 3] FIG. 2 is a schematic diagram of an interface for displaying a game screen and an operation video provided in an embodiment of the present application. [Figure 4] 2 is a schematic flow chart of a screen display method provided in an embodiment of the present application; [Figure 5a] FIG. 2 is a schematic diagram showing an operation cursor provided in an embodiment of the present application; [Figure 5b] FIG. 2 is a schematic diagram showing the movement trajectory of an operation cursor provided in an embodiment of the present application; [Figure 5c] 1 is a schematic diagram showing an operation animation of an operation cursor provided in an embodiment of the present application; [Figure 5d]FIG. 2 is a schematic diagram of a flow of a target game operation performed by a terminal device provided in an embodiment of the present application. [Figure 5e] FIG. 1 is a schematic diagram of a flow of a cloud server provided in an embodiment of the present application operating a target game. [Figure 6] FIG. 2 is a schematic block diagram of a screen display device provided in an embodiment of the present application. [Figure 7] FIG. 2 is a schematic block diagram of a terminal device provided in an embodiment of the present application; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] The embodiment of the present application proposes a method for displaying a game screen of a cloud game, whereby, in the process of operating a cloud game (e.g., a target game), a terminal device can obtain game data of the target game from a cloud server, and render the game screen based on the game data to display it on a user interface. At the same time, the terminal device can leave and draw an operation animation of a control operation for the target game locally on the terminal device, whereby the terminal device can overlay and display the locally drawn operation animation on the game screen of the target game, and then display the game screen on which the operation animation is overlaid on the user interface of the terminal device. As can be understood here, by drawing the operation animation locally, the terminal device can make the effect of the game user controlling the cloud game (i.e., the target game) through the terminal device the same as the effect of controlling a local game, that is, make the game effect of the game user controlling the cloud game through the terminal device and the operation effect of operating a local game on the terminal device indistinguishable from each other. As a result, in the process of operating a cloud game through a terminal device, a game user can achieve an operation experience of operating the game locally, and can realize an improvement in the satisfaction of the game user operating the cloud game. The cloud server is used to support the operation of multiple cloud games, and the cloud game (i.e., the target game) referred to in the embodiments of this application is any one of the cloud games supported by the cloud server.

[0013] Here, cloud gaming is an online gaming technology based on cloud computing technology, and may be called gaming on demand. Cloud gaming technology enables thin clients (e.g., terminal devices with relatively weak data computing capabilities) with relatively limited graphics processing and data computing capabilities to run high-quality games. Under the cloud gaming scenario, the game does not run on the terminal device that displays the game screen, but runs on a cloud-side server (or cloud server), and the game screen displayed on the terminal device is displayed by the cloud-side server rendering the game scene into a video / audio stream, and then the terminal device obtains the video / audio stream of the game scene from the cloud-side server via a network, and thereby renders and displays the screen based on the obtained video / audio stream. That is, cloud gaming is a game run on a cloud-side server, and the cloud-side server distributes game resources to the terminal device, thereby enabling the terminal device to render and display the game screen of the cloud game on the user interface. That is, as can be understood, the terminal device corresponding to the game user does not need to have strong graphics computing and data processing capabilities, but only needs to have the ability to play and render basic streaming media.

[0014] In one embodiment, the screen display method can be applied to a screen display system shown in FIG. 1a, which includes a terminal device 10 and a cloud server 11, and the cloud server 11 includes a plurality of system containers (may be abbreviated as containers). The cloud server 11 shown in FIG. 1a may include system container 1 to system container N, where N is an integer greater than 1, and any one of the system containers included in the cloud server 11 can run one or more games. Here, the terminal device 10 can send an operation request for a target game (any cloud game) to the cloud server 11, and if the target game is supported and run by a target container in the cloud server 11, assuming that the target container is the system container 1 in FIG. 1a, after the cloud server 11 receives the operation request sent from the terminal device 10, the cloud server 11 can launch the target game in the target container based on an operation parameter (e.g., a game identity identifier corresponding to the target game) included in the operation request, and can send game data of the target game to the terminal device 10. Therefore, in response to this, the terminal device 10 can render a game screen in a user interface based on the game data received from the cloud server 11, thereby displaying the game screen obtained by rendering in the user interface.

[0015] In one embodiment, after the terminal device 10 obtains the distributed game data from the cloud server 11, it can render and display the game screen on the user interface based on the obtained game data. Here, after the terminal device renders and displays the game screen on the user interface, the terminal device 10 detects the control operation for the target game, and can draw an operation animation corresponding to the control operation on the user interface based on the obtained control operation, thereby realizing the drawing of the operation animation corresponding to the control operation of the target game locally on the terminal device 10. As can be seen, by leaving and drawing the operation animation of the control operation of the target game locally, it is not necessary to request the cloud server 11 to draw the operation animation of the control operation. That is, by leaving and drawing the operation animation locally on the terminal device 10, it is possible to avoid the problem of delay in displaying the operation animation due to the problem of network delay when requesting the cloud server to draw the operation animation, so that the display of the control effect by the game user on the target user on the terminal device 10 is no different from that in the local case, thereby improving the game operation experience of the game user. In one embodiment, the terminal device 10 can draw an operation animation corresponding to the control operation on the user interface based on the acquired control operation for the target game, and then overlay the drawn operation animation on the game screen of the user interface. As a result, the game screen on which the operation animation is overlaid can be displayed on the user interface, and based on the overlay display of the locally drawn operation animation and the game screen obtained by rendering the game data acquired from the cloud server, when the game user operates the cloud game on the terminal device 10, the experience of performing a game operation locally can be achieved, and the game user's satisfaction with the operation of the cloud game can be improved.

[0016] In one embodiment, when the target game operated on the terminal device 10 is controlled by an operation cursor, the terminal device displays an icon of the operation cursor on the user interface; that is, in the process of operating the target game, the terminal device 10 locally leaves and draws an operation animation for controlling and executing the operation cursor, and then requests game data from the cloud server 11 to render the game screen of the cloud game. Here, the functional modules and corresponding basic capabilities when the terminal device 10 and the cloud server 11 perform the operation of the cloud game may be shown in FIG. 1b. The functional modules included in the terminal device 10 include a module for managing the operation cursor, a module for hiding / displaying the operation cursor, a module for drawing an operation animation, and a module for requesting response data of the control operation from the cloud server, while the basic capabilities of the terminal device 10 are network transmission capabilities and the ability to receive input of game data, and further, the functional modules included in the cloud server 11 include a module for starting the operation of the target game, a module for monitoring the state of the operation cursor, a module for acquiring an icon of the operation cursor, and a module for responding to the control operation. The basic capabilities of the cloud server 11 include network transmission capabilities, capabilities to receive request inputs, and capabilities to store game data. In one embodiment, the cloud server 11 can monitor the state of the operation cursor to determine whether it is necessary to draw the icon of the operation cursor on the terminal device 10. When necessary, the cloud server 11 can draw the icon of the operation cursor on the terminal device 10 by sending a rendering code to the terminal device 10. In addition, the above cloud server 11 can be a node in a blockchain distributed network, and can realize the transmission and storage of related data in the cloud server 11 to the blockchain network.

[0017] Please refer to FIG. 2, which is a schematic flowchart of a screen display method proposed in an embodiment of the present application. As shown in FIG. 2, the method may include S201 to S203.

[0018] S201: During the operation of a target game, a game screen of the target game is rendered in a user interface based on game data distributed from a target container.

[0019] In one embodiment, the target game is a cloud game that runs in a target container, where the target container is a system container used to support the operation of the target game in a cloud server. As can be understood, since the target game is a cloud game, when a terminal device runs the target game, the terminal device does not need to locally download a game client terminal of the target game, but runs the target game by requesting a target container in a cloud server. Specifically, a cloud game client terminal is running in the terminal device, and the cloud game client terminal is different from the target game client terminal, and the target game client terminal supports the operation of only one game (i.e., the target game). Meanwhile, the cloud game client terminal can support requesting the operation of multiple different cloud games from a cloud server.

[0020] In one embodiment, after the terminal device launches the cloud game client terminal, the user interface displays an indicator of the game client terminal corresponding to one or more cloud games. When a game user needs to launch and run a target game, the game user can select an indicator of the game client terminal of the target game displayed on the user interface. Meanwhile, after the terminal device detects that the game user has selected an indicator of the game client terminal of the target game, the terminal device can send an operation request of the target game to a target container of a cloud server used to support the operation of the target game. After obtaining the operation request for the target game, the target container can distribute game data of the target game to the terminal device, and the terminal device can render a game screen based on the game data distributed from the target container, thereby realizing the operation of the target game on the terminal device.

[0021] Since the terminal device can launch and operate different cloud games according to the cloud game client terminal, the terminal device does not need to download game client terminals corresponding to different games, and can realize launching and operating the cloud game in the terminal device by downloading only one cloud game client terminal. Moreover, in the process of operating the cloud game, the terminal device only renders a game screen based on game data for the cloud game acquired from the cloud server, and does not perform other processing on the game data, so that the demand for the data processing ability of the terminal device in the process of operating the cloud game of the terminal device can be reduced. This can expand the target users of the cloud game and improve the popularity of the cloud game. In one embodiment, when the terminal device operates a cloud game (e.g., a target game), the terminal device constantly requests game data from the cloud server, and in response, the cloud server constantly transmits the game data requested by the terminal device to the terminal device in the form of a data stream, and the terminal device can smoothly display the game screen of the target game in the user interface based on the acquired game data.

[0022] When the terminal device operates the target game based on the game data acquired from the cloud server, the terminal device can acquire the control operation of the target game by the game user, and can acquire response data of the control operation from the cloud server, thereby realizing the game operation of the target game. In one embodiment, in order to improve the operation experience of the game user, the terminal device can locally draw the operation animation of the control operation after acquiring the control operation of the target game by the game user. That is, by moving to S202 and executing S202, the terminal device can locally draw the operation animation of the control operation and then display it by overlaying it on the game screen of the target game, thereby avoiding the display delay caused by network congestion and the like, and thereby giving the game user the experience of playing the game locally.

[0023] S202: Obtain a control operation for the target game, and draw an operation animation corresponding to the control operation on a user interface based on the control operation.

[0024] In one embodiment, the terminal device may be a personal computer, and the target game running on the personal computer is a client terminal game. Specifically, it is considered that the operating platform of the target game is different based on the different operating systems of the personal computer. Here, the operating system of the personal computer includes a PC (operating system based on Microsoft) platform, or the operating system of the personal computer may be a MAC (different from the operating system of the PC platform) platform, that is, the client terminal game running on the personal computer may be run on the PC platform or on the MAC platform. As can be further understood, when the target game is a client terminal game running on a personal computer, a game user can control the target game by an operation cursor. Here, the operation cursor is a mapping of an external input device of a personal computer in a user interface of the personal computer, and the game user can realize the control of the operation cursor in the user interface of the personal computer by controlling the external input device. That is, when the target game is a client terminal game running on a personal computer, the terminal device obtaining a control operation for the target game means obtaining a control operation for an external input device connected to the terminal device by the game user. The control operation may be, for example, a movement operation of an operation cursor input by the external input device, and a selection operation performed on a game screen using the operation cursor, and the external input device may be a game pad or a mouse, etc.

[0025] In another embodiment, the terminal device may be a mobile terminal, and it can be understood that the target game running on the mobile terminal is a mobile phone game. Because the terminal screen of the mobile terminal is a touch-controlled screen, the game user can input data into the terminal device without an external input device based on the touch-controlled screen, and control the operation of the game. Therefore, when the target game is a mobile phone game running on a mobile terminal, the game user can realize the control of the target game based on the touch control on the terminal screen, that is, when the target game is a mobile phone game running on a mobile terminal, the control operation of the target game acquired by the terminal device is the touch control operation performed by the game user, and the touch control operation may be, for example, a selection operation or a slide operation performed by the game user on the terminal screen.

[0026] In order to improve the smoothness of the control of the target game by the game user, the terminal device, after acquiring the control operation for the target game, draws the operation animation locally on the terminal device. At the same time, the terminal device can request the cloud server for response data indicated by the control operation. Specifically, when the control operation for the target game acquired by the terminal device is a moving operation for the operation cursor, as can be understood, the operation animation drawn by the terminal device on the user interface is the moving trajectory of the moving operation, or when the control operation for the target game acquired by the terminal device is a selection operation performed by employing the operation cursor, or a selection operation performed based on touch control on the terminal screen, the operation animation of the control operation drawn by the terminal device on the user interface is an operation animation related to the selection operation. For example, when a certain game setting component is selected, the animation of the selected game setting component, or a click animation generated when clicking on a blank position of the game, etc. In one embodiment, the terminal device can leave the operation animation of the acquired control operation for the target game locally on the terminal device and draw it, and then overlay and display the drawn operation animation on the game screen, that is, proceed to execute S203. Based on the terminal device retaining the drawing of the operation video locally, the smoothness of the execution of operation control for the target game can be increased, and the game user's experience of controlling the cloud game can be improved.

[0027] S203: Overlay the operation animation on the game screen, and display the game screen on which the operation animation is overlaid in the user interface.

[0028] In one embodiment, in the process of the terminal device running the target game, an interface displaying the operation animation of the target game floats on the user interface displaying the game screen of the target game. That is, the cursor interface of the terminal device used to display the operation animation is an upper interface in the display direction of the user interface displaying the game screen, as shown in FIG. 3. As can be seen, the terminal device locally leaves and draws the operation animation of the control operation for the target game, that is, draws the operation animation of the control operation in the cursor interface. Meanwhile, the game screen related to the target game displayed in the user interface is still rendered and displayed based on the requested game resources by requesting game resources from the cloud server, so that the cloud server only transmits the response data (i.e., game resources) requested by the control operation to the terminal device. When the delay of the communication link between the terminal device and the cloud server is relatively low, it can achieve the operation experience of the game user performing the cloud game operation locally, and furthermore, by leaving and drawing the operation animation locally, it is possible to avoid the problem of delaying the display of the operation animation due to the frame rate and network delay, and improve the real-time display of the operation animation, thereby improving the smoothness of the operation by the game user.

[0029] In the embodiment of the present application, the terminal device can request game data of the target game from the target container of the cloud server during the operation of the target game, and render the game screen of the target game on the user interface based on the game data. Furthermore, the terminal device can obtain a control operation for the target game, and based on the obtained control operation, draw an operation animation corresponding to the control operation on the user interface, and overlay and display the operation animation on the game screen. Since the terminal device locally retains and executes the drawing of the operation animation of the control operation, the terminal device can improve the smoothness of drawing the operation animation based on the control operation of the game user, thereby achieving a game experience in which the game user performs game operations locally on the terminal device, and improving the satisfaction of the user.

[0030] Refer to Figure 4, which is a schematic flowchart of a screen display method provided in an embodiment of the present application. As shown in Figure 4, the method may include S401 to S405.

[0031] S401: In the operation process of a target game, a game screen of the target game is rendered in a user interface according to game data distributed from a target container, and the target game is a cloud game running in the target container.

[0032] After obtaining game data of the target game from the target container, the terminal device can render a game screen in a user interface based on the game data. After rendering the game screen of the target game in the user interface, the terminal device can further determine a control method for the target game. Here, when the target game is a client terminal game running on a personal computer, the control method for the target game is a first control method of controlling the target game by adopting an operation cursor, or when the target game is a mobile phone game running on a mobile terminal, the control method for the target game is a second control method of controlling the target game by touch control.

[0033] In one embodiment, when determining a control method for a target game, the terminal device may first obtain a screen type of the terminal device used to display a user interface. Here, if the screen type is a touch-controlled screen type, the terminal device determines that the control method for the target game is a second control method of control by touch control, while if the screen type is not a touch-controlled screen type, the terminal device determines that the control method for the target game is a first control method of controlling the target game by adopting an operation cursor. Here, when the terminal device determines that the control method for the target game is the first control method, the terminal device can render an operation cursor of the target game on the user interface based on game data distributed from the target container. Here, when the terminal device renders the operation cursor of the target game on the user interface, the terminal device can first obtain a system cursor displayed on the user interface, where the system cursor is displayed on a cursor interface (i.e., an interface one layer above in the display direction of the user interface) when game data is not obtained from the target container. Furthermore, the terminal device can obtain an icon to be rendered by analyzing the obtained game data after obtaining the distributed game data from the target container. The icon is used to mark the operation cursor of the target game, and the terminal device can hide the system cursor and render the icon of the operation cursor in the cursor interface.

[0034] In one embodiment, when the terminal device adopts the first control manner to control the target game, as shown in FIG. 5a, before the terminal device obtains game data from the target container, an interface schematic diagram displaying a system cursor on a user interface may be, for example, the schematic diagram marked with 501 in FIG. 5a. Here, the system cursor displayed in the interface may be, for example, the cursor marked with 50 in FIG. 5a, while the game screen rendered by the terminal device based on the game data after the terminal device obtains game data from the target container may be that shown in the interface marked with 502 in FIG. 5a. After the terminal device obtains the game data, an icon of the operation cursor of the target game may be obtained based on the analysis of the game data, and after the terminal device displays the game screen, the operation cursor of the target game may be rendered and displayed. Here, the shape of the operation cursor of the target game displayed in the terminal device may be the same as the system cursor, or the operation cursor of the target game displayed in the terminal device may be different from that of the system cursor, and in one embodiment, the operation cursor different from the system cursor displayed in the terminal device may be shown as the cursor marked with 51 in FIG. 5a. In one embodiment, when the terminal device displays the operation cursor of the target game, it can replace the originally displayed system cursor. In a specific implementation, the terminal device may cancel the display of the original system cursor and then display the operation cursor at the display position of the original system cursor, or the terminal device may cancel the displayed original system cursor and then display the operation cursor of the target game at any random location.

[0035] After displaying the game screen of the target game, the terminal device can render an operation animation of the acquired control operation for the target game on the user interface, that is, proceed to execute S402.

[0036] S402: Obtain a control operation for the target game, and draw an operation animation corresponding to the control operation on a user interface based on the control operation.

[0037] In one embodiment, when the target game is a client terminal game running on a personal computer, an operation cursor of the target game is displayed on a user interface, and the control operation for the target game includes a moving operation for the operation cursor. As can be further understood, when the terminal device draws an operation animation corresponding to the control operation on the user interface (i.e., in the cursor interface, the cursor interface is an interface one layer above in the display direction of the user interface) based on the control operation, the terminal device can first obtain an initial display position of the operation cursor on the cursor interface when the operation cursor is moved. Furthermore, the terminal device can obtain position change information of the operation cursor on the cursor interface based on the moving operation for the operation cursor, and can thereby draw a movement trajectory corresponding to the movement operation on the cursor interface based on the initial display position and the position change information. Here, the schematic diagram of the terminal device drawing the movement trajectory of the operation cursor may be the schematic diagram shown in FIG. 5b. Furthermore, the control operation for the target game acquired by the terminal device may include a touch control operation on a user interface by a game user, in which the terminal device, when drawing an operation animation corresponding to the control operation on the user interface based on the control operation, can first acquire an operation gesture when performing a touch control operation on the user interface, and then acquire an associated operation animation of the operation gesture, and further, the terminal device can draw an associated operation animation related to the operation gesture on the user interface, where the operation gesture is, for example, a scaling gesture, and the associated operation animation executed by the terminal device based on the operation gesture is a scaling animation for a game screen.

[0038] In one embodiment, the control operation acquired by the terminal device includes a selection operation to be performed, where the selection operation may be performed by employing an operation cursor, or the selection operation may be performed based on a touch control on a user interface. When the control operation acquired by the terminal device is a selection operation, when drawing an operation animation corresponding to the control operation on the user interface based on the control operation, the terminal device can first determine an action position of the selection operation on the user interface, and then determine a mapping position of the action position corresponding to the game screen, and further, the terminal device can obtain a trigger animation associated with the mapping position, and draw the trigger animation at the action position of the selection operation on the user interface. In a specific implementation, when the terminal device obtains the trigger animation associated with the mapping position, the terminal device can first determine whether a game setting component of the target game is displayed at the mapping position, and a rendering code of the trigger animation of each game setting component of the target game is stored in the local memory. Here, if a game setting component is displayed at the mapping position, the rendering code of the trigger animation associated with the game setting component is obtained from the local memory, and the animation indicated by the rendering code is the trigger animation associated with the mapping position. In one embodiment, the game setting components include a game end component, a game start component, or an operation setting component.

[0039] In another embodiment, when the terminal device determines that the game setting component is not displayed at the mapping position of the action position of the selection operation corresponding to the game screen, the terminal device can obtain a preset rendering rule, so that the animation indicated by the preset rendering rule is the trigger animation associated with the mapping position. That is, when the terminal device determines that the action position of the selection operation is a blank position that does not display a game component, the terminal device can display the trigger animation indicated by the preset rendering rule after the game user performs the selection operation, and the trigger animation indicated by the terminal device according to the preset rendering rule may be, for example, the animation displayed in the interface marked with 503 in Fig. 5c.

[0040] S403: Send a data acquisition request to the target container, where the data acquisition request is used to request to acquire response data corresponding to the control operation.

[0041] S404: The distributed response data is obtained from the target container, and the game screen displayed in the user interface is updated according to the instructions in the response data.

[0042] S405: The operation animation is overlaid on the game screen, and the game screen on which the operation animation is overlaid is displayed in the user interface.

[0043] Here, S403 and S404 are optional steps. In S403 to S405, after the terminal device acquires the control operation for the target game, it determines response data corresponding to the control operation, and then transmits a data acquisition request for the response data to the target container, so that after acquiring the response data from the target container, it can update the game screen displayed in the user interface according to the instruction of the response data. Furthermore, after determining an operation animation of the control operation for the target game, the terminal device can overlay and display the operation animation on the game screen. As can be seen, the operation animation of the control operation of the target game is left and drawn locally on the terminal device, and only the response data of the game is requested from the target container, thereby ensuring smoothness in the cloud game operation process of the game user. In a specific implementation form, when the target game is a client terminal game running on a personal computer, the game screen displayed on the terminal device is a game screen of any frame of the game. When the game screen displayed on the terminal device includes a character image of a game character corresponding to the game user, and the control operation for the target game acquired by the terminal device is an operation of selecting any blank position on the current game screen, the terminal device controls the game character corresponding to the game user to move based on the control operation performed by the game user. That is, after acquiring the control operation, the terminal device locally draws an operation animation (for example, it may be an operation animation marked with 503 in FIG. 5c) corresponding to the control operation, and then overlays and displays the operation animation on the current game screen. At the same time, the terminal device must also send a response data acquisition request to the target container, thereby acquiring game data for moving the game character, and rendering the game screen based on the game data, so that the game screen with the game character moved can be displayed on the current user interface.

[0044] In one embodiment, when the terminal device is a personal computer and the game user controls the target game by the operation cursor, the schematic diagram of the process of the terminal device running the target game may be as shown in Fig. 5d. Meanwhile, the flow of steps performed by the cloud server may be as shown in Fig. 5e. Specifically, the terminal device runs the target game, and the interaction process between the terminal device and the cloud server may include the following steps:

[0045] 1. A game user launches a target game in a cloud game client terminal of a terminal device. Here, a communication connection (or network connection) is established between the cloud game client terminal of the terminal device and a cloud server, and when the game user requests the launch of a target game, the terminal device can transmit a game identity (ID) identifier of the target game to be launched to the cloud server. After receiving the ID identifier of the target game to be launched transmitted from the terminal device, the cloud server can launch the target game based on the ID identifier. In one embodiment, when the cloud server launches the target game in the terminal device, it can transmit game data of the target game to the terminal device, and after the terminal device acquires the game data, it can render a game screen based on the game data. Thus, the launch of the target game is realized, and after the terminal device launches the target game, it can acquire the state of the operation cursor, and when it is determined that the operation cursor needs to be drawn, it can acquire an icon corresponding to the operation cursor from the acquired game data, and can render and display the operation cursor based on the game data.

[0046] Here, the cloud server can determine whether it is necessary to render the operation cursor on the user interface by monitoring the state of the operation cursor. Here, the cloud server can determine that it is not necessary to render the operation cursor on the user interface when the terminal device is a touch-control screen type screen, or the cloud server may not render the operation cursor on the user interface when monitoring that the terminal device is displaying a special cloud game screen. Meanwhile, the cloud server determines that it is necessary to render the operation cursor on the user interface when the terminal device is a non-touch control type screen. In one embodiment, when the cloud server determines that it is necessary to render the operation cursor on the user interface, the cloud server can include the operation cursor icon and the rendering code in the game data when distributing the game data to the terminal device and distribute them to the terminal device all at once. Thus, the terminal device renders the operation cursor on the user interface based on the rendering code. Meanwhile, when the server determines that it is not necessary to render the operation cursor on the user interface, the cloud server may not distribute the operation cursor icon and the corresponding rendering code to the terminal device when transmitting the game data to the terminal device.

[0047] 2. When the game data acquired by the terminal device from the cloud server includes an icon of an operation cursor and a corresponding rendering code, the terminal device can render and display the operation cursor on the user interface. Here, when the terminal device renders and displays the operation cursor of the game data, it can replace the original system icon displayed on the user interface of the terminal device. Here, the shape of the operation cursor displayed on the user interface can be the same icon shape as the system icon, or can be a cursor shape different from the system icon shape, and the icon shape of the operation cursor is not limited in the embodiments of the present application.

[0048] 3. After displaying the operation cursor of the target game, the terminal device can locally draw an operation animation of the control operation performed based on the operation cursor, and transmit operation data of the control operation performed based on the operation cursor to the cloud server, thereby obtaining response data corresponding to the operation data from the cloud server, and the terminal device can update the game screen displayed in the user interface based on the response data obtained from the cloud server.

[0049] 4. After the terminal device requests the cloud server to run the target game, the cloud server continuously transmits game data of the target game to the terminal device, thereby realizing continuous updates to the game screen in the terminal device. According to the control operation performed by the game user on the user interface, the terminal device can render an operation animation of the control operation on the user interface, and overlay the operation animation on the game screen displayed on the user interface, thereby achieving the operation experience of the game user playing a local game on the terminal device.

[0050] In the embodiment of the present application, the terminal device can render a game screen of the target game on the user interface based on the game data distributed from the target container in the process of operating the target game. Thereby, by further acquiring a control operation for the target game, the terminal device can draw an operation animation corresponding to the control operation on the user interface. At the same time, after acquiring the control operation for the target game, the terminal device can determine response data corresponding to the control operation, send a data acquisition request for the response data to the target container, and after acquiring the response data from the target container, can continuously update the game screen displayed on the user interface based on the response data. The terminal device locally leaves and draws the operation animation of the control operation, and at the same time, overlays the operation animation on the game screen obtained by rendering the game data requested by the cloud server, thereby reducing the data processing load of the cloud server, improving the data processing efficiency of the cloud server, and improving the smoothness of the display of the game screen when the terminal device operates the target game.

[0051] Based on the description of the above embodiment of the screen display method, the embodiment of the present application further proposes a screen display device, which may be a computer program (including program code) running on the above terminal device. The screen display device can be used to execute the screen display method described in Figure 2 and Figure 4. As shown in Figure 6, the screen display device includes a rendering unit 601, an acquisition unit 602, a drawing unit 603, an overlay unit 604 and a display unit 605.

[0052] The rendering unit 601 is used for rendering a game screen of the target game in a user interface according to game data distributed from the target container during the operation process of the target game, and the target game is a cloud game running in the target container.

[0053] The acquisition unit 602 is used for acquiring the control operation for the target game.

[0054] The drawing unit 603 is used for drawing an operation animation corresponding to the control operation on the user interface according to the control operation.

[0055] The overlay unit 604 is used to overlay the operation video on the game screen.

[0056] The display unit 605 is used for displaying a game screen on which the operation animation is overlaid on the user interface.

[0057] In one embodiment, the user interface displays an operation cursor of the target game, and the cursor interface displaying the operation cursor is an upper interface in the display direction of the user interface, and the control operation includes a moving operation on the operation cursor, and the drawing unit 603 specifically: acquiring an initial display position of the operation cursor in the cursor interface when moving the operation cursor; acquiring position change information of the operation cursor in the cursor interface based on a moving operation of the operation cursor; A movement trajectory corresponding to the movement operation is drawn on the cursor interface based on the initial display position and the position change information.

[0058] In one embodiment, the control operation includes a touch control operation on the user interface, and the drawing unit 603 specifically includes: Acquire an operation gesture when performing the touch control operation on the user interface, and acquire an operation video related to the operation gesture; and drawing the related operation animation on the user interface.

[0059] In one embodiment, the control operation includes a selection operation to be performed, the selection operation being performed based on an operation cursor or based on a touch control on the user interface, and the drawing unit 603 specifically comprises: determining an action position of the selection operation in the user interface, and determining a mapping position of the action position corresponding to the game screen; and obtaining a trigger animation associated with the mapping location; and rendering the trigger animation at the action location in the user interface.

[0060] In one embodiment, the rendering unit 603 specifically includes: determining whether a game setting component of the target game is displayed at the mapping location, and a rendering code of a trigger animation of each game setting component of the target game is stored in a local memory; if the game setting component is displayed at the mapping position, obtaining a rendering code of a trigger video associated with the game setting component from the local memory, and setting the video indicated by the rendering code as the trigger video associated with the mapping position; If the game setting component is not displayed at the mapping position, a pre-defined rendering rule is obtained, and the animation indicated by the pre-defined rendering rule is used as the trigger animation associated with the mapping position.

[0061] In one embodiment, the apparatus further includes a determining unit 606 .

[0062] the determining unit 606 is used for determining a control manner for the target game, the control manner including a first control manner for controlling the target game by using an operation cursor, or a second control manner for controlling the target game by touch control through the user interface; The rendering unit 601 is further used for rendering an operation cursor of the target game on the user interface based on game data distributed from the target container if it determines that the control method for the target game is the first control method.

[0063] In one embodiment, the determining unit 606 specifically: obtaining a screen type of a terminal device used to display the user interface; If the screen type is a touch-controlled screen type, determining that a control manner for the target game is a second control manner; If the screen type is not a touch-controlled screen type, then determining that the control manner for the target game is a first control manner is used.

[0064] In one embodiment, the interface for displaying the operation cursor is a cursor interface of the user interface, and the rendering unit 601 specifically includes: obtaining a system cursor displayed in the cursor interface, the system cursor being displayed in the cursor interface when no game data is being obtained from the target container; and Obtaining an icon to be rendered from the game data distributed by the target container through analysis, the icon being used to mark an operation cursor of the target game; and hiding the system cursor and rendering an icon of the manipulation cursor in a cursor interface of the user interface.

[0065] In one embodiment, the device further includes an update unit 607 .

[0066] The determining unit 606 is further used for sending a data acquisition request to the target container, where the data acquisition request is used for requesting to acquire response data corresponding to the control operation.

[0067] The update unit 607 is used for obtaining the distributed response data from the target container, and updating the game screen displayed on the user interface according to the instruction of the response data.

[0068] In the embodiment of the present application, in the operation process of the target game, the rendering unit 601 can request game data of the target game from the target container of the cloud server, and can render the game screen of the target game on the user interface according to the game data. Furthermore, the acquisition unit 602 can acquire the control operation for the target game, so that the drawing unit 603 can draw the operation animation corresponding to the control operation on the user interface according to the acquired control operation. The display unit 605 can overlay and display the operation animation on the game screen, and the drawing of the operation animation of the control operation is left and executed locally, so that the smoothness of drawing the operation animation of the control operation of the game user can be improved, thereby achieving the game experience of the game user performing the game operation locally, and improving the satisfaction of the user.

[0069] Referring to Figure 7, a schematic block diagram of the structure of a terminal device provided in an embodiment of the present application. The terminal device in this embodiment shown in Figure 7 may include one or more processors 701, one or more input devices 702, one or more output devices 703, and a memory 704. The above processor 701, the input device 702, the output device 703 and the memory 704 are connected by a bus 705. The memory 704 is used for storing a computer program, the computer program includes program instructions, and the processor 701 is used for executing the program instructions stored in the memory 704.

[0070] The memory 704 may include volatile memory, such as random-access memory (RAM), the memory 704 may also include non-volatile memory, such as flash memory, a solid-state drive (SSD), etc., or the memory 704 may further include a combination of the above types of memory.

[0071] The processor 701 may be a central processing unit (CPU). The processor 701 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), etc. The PLD may be a field-programmable gate array (FPGA), a generic array logic (GAL), etc. The processor 701 may be a combination of the above structures.

[0072] In an embodiment of the present application, the memory 704 is used to store a computer program, the computer program includes program instructions, and the processor 701 is used to execute the program instructions stored in the memory 704, and to implement the corresponding method steps in Figures 2 and 4 above.

[0073] In one embodiment, the processor 701 calls the program instructions to: In the operation process of the target game, a game screen of the target game is rendered in a user interface based on game data distributed from the target container, the target game being a cloud game running in the target container; obtaining a control operation for the target game, and drawing an operation animation corresponding to the control operation on the user interface based on the control operation; overlaying the operation animation on the game screen, and displaying the game screen on which the operation animation is overlaid in the user interface.

[0074] An embodiment of the present application provides a computer program product or a computer program, the computer program product or the computer program includes computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the above embodiment of the method shown in FIG. 2 or FIG. 4. Here, the above computer-readable storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0075] In addition, the embodiments of the present application further provide a storage medium, the storage medium being used to store a computer program, and the computer program being used to execute the method provided in the above embodiments.

[0076] An embodiment of the present application further provides a computer program product including instructions, which when run on a computer, cause the computer to perform the methods provided in the above embodiments.

[0077] The above disclosure is merely some of the embodiments of the present application, and of course, they cannot limit the scope of the present application. Those skilled in the art can understand and realize all or part of the above embodiment flow, and equivalent replacements made based on the claims of the present application still belong to the scope covered by the invention. [Explanation of symbols]

[0078] 10 Terminal Equipment 11 Cloud Server 601 Rendering Units 602 Acquired Units 603 drawing units 604 Overlay Unit 605 Display Unit 606 Decision Unit 607 Update Unit 701 Processor 702 Input Device 703 Output Device 704 Memory 705 Bus

Claims

1. A screen display method executed by a terminal device, the method comprising: In the operation process of a target game, a game screen of the target game is rendered in a user interface based on game data distributed from a target container, and the target game is a cloud game running in the target container; acquiring a control operation for the target game, the control operation being an operation for an operation cursor on the user interface or a touch control operation for the user interface; locally drawing an operation animation corresponding to the control operation on the user interface based on the control operation; overlaying the operation video on the game screen and displaying the game screen on which the operation video is overlaid in the user interface; sending a data acquisition request to the target container, the data acquisition request being used to request response data corresponding to the control operation; A screen display method including:

2. an operation cursor of the target game is displayed on the user interface, a cursor interface displaying the operation cursor is an upper interface in a display direction of the user interface, and the control operation is a movement operation on the operation cursor; the step of acquiring a control operation for the target game and rendering an operation animation corresponding to the control operation on the user interface based on the control operation, acquiring an initial display position of the operation cursor in the cursor interface when the operation cursor is moved; acquiring position change information of the operation cursor in the cursor interface based on a movement operation of the operation cursor; The method according to claim 1 , further comprising: drawing a movement trajectory corresponding to the movement operation on the cursor interface based on the initial display position and the position change information.

3. the control operation is a touch control operation on the user interface; the step of acquiring a control operation for the target game and rendering an operation animation corresponding to the control operation on the user interface based on the control operation, acquiring an operation gesture when performing the touch control operation on the user interface, and acquiring an operation video related to the operation gesture; and rendering the associated operation animation on the user interface.

4. the control operation includes a selection operation to be performed, the selection operation being performed based on an operation cursor or based on a touch control on the user interface; the step of acquiring a control operation for the target game and rendering an operation animation corresponding to the control operation on the user interface based on the control operation, determining an action position in the user interface of the selection operation, and determining a mapping position of the action position corresponding to the game screen; 2. The method of claim 1, further comprising obtaining a trigger animation associated with the mapping location and rendering the trigger animation at the action location in the user interface.

5. said step of obtaining a trigger animation associated with said mapping location and rendering said trigger animation at said action location in said user interface further comprising: determining whether a game setting component of the target game is displayed at the mapping location, wherein a rendering code of a trigger animation of each game setting component of the target game is stored in a local memory; if the game setting component is displayed at the mapping position, obtaining a rendering code of a trigger video associated with the game setting component from the local memory, and setting the video indicated by the rendering code as the trigger video associated with the mapping position; 5. The method of claim 4, further comprising: if the game setting component is not displayed at the mapping location, obtaining a preset rendering rule, and setting an animation indicated by the preset rendering rule as a trigger animation associated with the mapping location.

6. The method comprises: determining a control method for the target game, the control method including a first control method for controlling the target game by adopting an operation cursor, or a second control method for controlling the target game by touch control through the user interface; The method of claim 1 , further comprising: if determining that the control method for the target game is the first control method, rendering a control cursor for the target game on the user interface based on game data distributed from the target container.

7. The step of determining a control strategy for the target game includes: obtaining a screen type of a terminal device used to display the user interface; if the screen type is a touch-controlled screen type, determining that a control manner for the target game is the second control manner; and if the screen type is not a touch-control screen type, determining that a control manner for the target game is the first control manner.

8. a cursor interface displaying the operation cursor is an interface on a higher level in the display direction of the user interface; If it is determined that the control method for the target game is the first control method, the step of rendering an operation cursor of the target game on the user interface based on game data distributed from the target container includes: obtaining a system cursor displayed in the cursor interface, the system cursor being displayed in the cursor interface when no game data is being obtained from the target container; and obtaining an icon to be rendered from the game data distributed by the target container through analysis, the icon being used to mark an operation cursor of the target game; hiding the system cursor and rendering an icon of the manipulation cursor in the cursor interface.

9. After the step of transmitting the data acquisition request, the method further comprises: The method of claim 1 , further comprising the steps of: acquiring the distributed response data from the target container; and updating the game screen displayed in the user interface in accordance with instructions from the response data.

10. A screen display device, A rendering unit is used for rendering a game screen of the target game in a user interface according to game data distributed from a target container during an operation process of the target game, the target game being a cloud game running in the target container; an acquisition unit used for acquiring a control operation for the target game, the control operation being an operation for an operation cursor on the user interface or a touch control operation for the user interface; a drawing unit, which is used for locally drawing an operation animation corresponding to the control operation on the user interface according to the control operation; an overlay unit used for overlaying the operation video on the game screen; a display unit for displaying a game screen on which the operation video is overlaid in the user interface; a unit for sending a data acquisition request to the target container, the data acquisition request being used for requesting response data corresponding to the control operation; A screen display device including:

11. A terminal device comprising a processor, an input device, an output device and a memory, the processor, the input device, the output device and the memory being connected to each other, the memory being used to store a computer program, the computer program including program instructions, the processor being configured to call the program instructions and to be used to execute the method according to any one of claims 1 to 9.

12. A computer program causing a computer to carry out the method according to any one of claims 1 to 9.

Images