Cloud game data transmission method, device, system and electronic device
By comparing the game screen serial numbers between the client and the server, determining the network transmission status and adjusting the output frame rate, the problem of delay and lag in cloud games is solved and the user experience is improved.
Patent Information
- Application Number
- CN202010627243.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-01
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2040-07-01
AI Technical Summary
The delay and lag problems caused by unstable network conditions in cloud games affect users' gaming experience.
By receiving the comparison between the game screen serial number returned by the client and the game screen serial number generated by the server, the network transmission status is determined, and the output frame rate of the game screen is adjusted in real time according to the status to adapt to network conditions and ensure that the game screen is in Generate and transmit at appropriate frame rates.
It effectively improves the delay status of cloud games, improves users' gaming experience, and reduces the impact of unstable network conditions on game delays.
Smart Images

Figure CN113965779B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of Internet technology. Specifically, the present disclosure relates to a method, device, system and electronic device for transmitting cloud game data, and also to a computer-readable storage medium. Background Art
[0002] With the continuous development of computer technology, cloud gaming based on cloud computing has also become popular. In cloud gaming applications, all games are run on cloud servers, which compress and package the audio and video images rendered by the games and transmit them to the user's client (for example, a mobile phone, tablet computer or personal computer, etc.), where the client decodes and displays the audio and video images.
[0003] Based on the working characteristics of the above-mentioned cloud games, when users operate the game, the client first sends the operation information to the cloud server, and the cloud server then performs corresponding game control and game screen rendering in the game software based on the operation information, and then transmits the game screen to the client, which can easily lead to control delays. When the network condition is unstable, the data transmission delay between the client and the server is more serious, and even the game screen may freeze, affecting the user's gaming experience. Summary of the invention
[0004] The invention information section is provided to introduce the concepts in a brief form, which will be described in detail in the detailed implementation section below. The invention information section is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to be used to limit the scope of the technical solution claimed for protection.
[0005] In a first aspect, an embodiment of the present disclosure provides a method for transmitting cloud game data, the method comprising:
[0006] Receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client;
[0007] Obtain a second serial number, and determine the network transmission status according to the second serial number and the first serial number; wherein the second serial number is the serial number corresponding to the second game screen being generated;
[0008] The output frame rate of the second game screen is adjusted according to the network transmission status, and the second game screen is sent to the client according to the output frame rate.
[0009] In a second aspect, an embodiment of the present disclosure provides a method for transmitting cloud game data, including:
[0010] The client receives a first game screen sent by the server, wherein the first game screen carries a first serial number;
[0011] The client plays the first game screen and obtains a first serial number corresponding to the first game screen while the first game screen is being played, returns the first serial number to the server so that the server obtains a second serial number corresponding to the second game screen being generated, determines the network transmission status according to the second serial number and the first serial number, adjusts the output frame rate of the second game screen according to the network transmission status, and sends the second game screen to the client according to the output frame rate.
[0012] In a third aspect, an embodiment of the present disclosure provides a cloud gaming data transmission device, the device comprising:
[0013] A serial number receiving module, used to receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client;
[0014] A transmission status determination module, used to obtain a second serial number, and determine the network transmission status according to the second serial number and the first serial number; wherein the second serial number is a serial number corresponding to the second game screen being generated;
[0015] The frame rate adjustment module is used to adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0016] In a fourth aspect, an embodiment of the present disclosure provides a cloud gaming data transmission device, including:
[0017] A picture receiving module, used for receiving a first game picture sent by a server, wherein the first game picture carries a first serial number;
[0018] A serial number return module is used to play the first game screen and return the first serial number corresponding to the first game screen to the server when the first game screen is played, so that the server can obtain the second serial number corresponding to the second game screen being generated, determine the network transmission status according to the second serial number and the first serial number, adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0019] In a fifth aspect, an embodiment of the present disclosure provides a cloud game data transmission system, including: a client and a server, the client and the server are communicatively connected via a network;
[0020] The client is used to receive a first game screen sent by the server, wherein the first game screen carries a first serial number;
[0021] The client is further used to play the first game screen and return the first serial number corresponding to the first game screen to the server when the first game screen is played;
[0022] The server is used to obtain a second serial number corresponding to a second game screen being generated, determine a network transmission status according to the second serial number and the first serial number, adjust an output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0023] In a sixth aspect, an embodiment of the present disclosure provides an electronic device, the electronic device comprising:
[0024] one or more processors;
[0025] Memory;
[0026] One or more applications, wherein one or more applications are stored in a memory and configured to be executed by one or more processors, and one or more programs are configured to: execute the cloud gaming data transmission method disclosed above.
[0027] In a seventh aspect, an embodiment of the present disclosure provides a computer-readable medium on which a computer program is stored, and the computer-readable medium is characterized in that when the program is executed by a processor, the method for transmitting cloud game data described above in the present disclosure is implemented.
[0028] The beneficial effects of the technical solution provided by the present disclosure are:
[0029] The cloud gaming data transmission method, device, system, electronic device and computer-readable medium provided in the above-mentioned embodiments determine the network transmission status by comparing the first serial number corresponding to the first game screen being played by the client and the second serial number corresponding to the second game screen being generated and played by the server, and adaptively and dynamically adjust the output frame rate of the second game screen in real time according to the network transmission status to ensure that the second game screen is generated at a speed corresponding to the appropriate output frame rate and sent to the client at the output frame rate, thereby improving the delay of the cloud game and improving the user's gaming experience.
[0030] Additional aspects and advantages of the present disclosure will be given in part in the following description, which will become obvious from the following description, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.
[0032] Figure 1 It is a schematic diagram of the system framework of the cloud gaming system;
[0033] Figure 2 is a schematic diagram of the structure of a cloud gaming data transmission system provided by an embodiment;
[0034] Figure 3 is a flow chart of a method for transmitting cloud gaming data provided by an embodiment;
[0035] Figure 4 This is a schematic diagram of a picture transmission process of cloud game data provided by an embodiment;
[0036] Figure 5 is another flow chart of a method for transmitting cloud gaming data provided by an embodiment;
[0037] Figure 6 is a schematic diagram of the structure of a cloud gaming data transmission device provided by an embodiment;
[0038] Figure 7 is another structural schematic diagram of a cloud gaming data transmission device provided by an embodiment;
[0039] Figure 8 A schematic diagram of the structure of an electronic device for cloud gaming data transmission provided by one embodiment. DETAILED DESCRIPTION
[0040] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0041] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.
[0042] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.
[0043] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish between devices, modules or units, and are not used to limit these devices, modules or units to be different devices, modules or units, nor are they used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0044] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0045] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0046] The cloud gaming data transmission method, device, system, electronic device and computer-readable medium provided in the present invention are intended to solve the above technical problems in the prior art.
[0047] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.
[0048] Cloud gaming, also known as game on demand, is an online gaming technology based on cloud computing technology. Cloud gaming technology enables client devices with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud gaming scenario, the game is not run on the client used by the user to play the game, but on the cloud server, which renders the game scene into an audio and video stream and transmits it to the client through the network audio and video stream. The client does not need to have powerful graphics computing and data processing capabilities, but only needs to have basic streaming media playback capabilities and the ability to obtain user input commands and send them to the cloud server.
[0049] In order to better illustrate the technical solution of the present disclosure, the following shows an application environment to which the cloud game data transmission method of the present solution can be applied. Figure 1 As shown, Figure 11 is a schematic diagram of the system framework of a cloud gaming system, which includes a client 101 and a server 102, and the client 101 and the server 102 establish a communication connection through a network. The workflow of the cloud gaming operation system can be: the user inputs a control operation in the client 101, the client 101 generates an operation instruction according to the control operation input by the user and sends the operation instruction to the server 102, the server 102 parses the received operation instruction, and obtains the game data corresponding to the operation instruction. Further, the server 102 renders the screen according to the game data, generates the corresponding video stream data, and encodes the video stream data and transmits it to the client 101 via the network, the client 101 decodes the received video stream data, obtains the game screen, and displays it on the display interface of the client 101.
[0050] In one embodiment, the client 101 may be a client such as a smart phone, a tablet computer, an e-reader, a desktop computer or a laptop computer, etc., and is not limited thereto. The client 101 is installed with an application program related to cloud gaming, and the server 102 is a background server for providing background services to the client device, which may be implemented by an independent server or a server cluster consisting of multiple servers.
[0051] As can be seen from the above, the current cloud game operation is mainly undertaken by the server to run the game, and the client only needs to obtain the game-related video stream data sent by the server and display the game screen corresponding to the received video stream. Therefore, the game screen sent by the cloud server to the client may be affected by the network environment of the cloud game system and cause delays. When the network bandwidth is large or the network speed is fast, the game screen transmission rate between the server and the client is fast, and the user game is very smooth; when the network bandwidth is small or the network speed is slow, the game screen transmission rate between the server and the client is slow, causing the client to receive the game screen with delay, which in turn causes the game to freeze and not be smooth.
[0052] Based on this, the embodiments of the present disclosure provide a cloud gaming data transmission solution to achieve real-time dynamic adjustment of the output frame rate of the game screen sent to the client according to the network transmission status, so as to solve the problems of cloud gaming network delay and lag.
[0053] The present disclosure provides a cloud gaming data transmission system. Figure 2 As shown, Figure 2 2 is a schematic diagram of a cloud gaming data transmission system according to an embodiment of the present invention, wherein the cloud gaming data transmission system includes a client 201 and a server 202. The client 201 and the server 202 are connected in communication via a network.
[0054] In one embodiment, the client 201 may be a client such as a smart phone, a tablet computer, an e-reader, a desktop computer or a laptop computer, etc., and is not limited thereto. The client 201 is installed with an application program related to cloud gaming, and the server 202 is a background server for providing background services for the client device, which may be implemented by an independent server or a server cluster consisting of multiple servers.
[0055] The client 201 is used to receive a first game screen sent by the server, wherein the first game screen carries a first serial number;
[0056] The client 201 is further used to play the first game screen, and return the first serial number corresponding to the first game screen to the server 202 when the first game screen is played;
[0057] The server 202 is also used to receive the first serial number returned from the client 201, and obtain the second serial number corresponding to the second game screen being generated; determine the network transmission status according to the second serial number and the first serial number, and adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client 201 according to the output frame rate.
[0058] It should be noted that, in order to facilitate distinction and understanding, the game screen being played by the client is defined as the first game screen, and the game screen being generated by the server is defined as the second game screen.
[0059] In the disclosed embodiment, cloud gaming operations are performed through a client. When a user triggers a response game operation through an interactive operation such as clicking or sliding, the client records the interactive operation input by the user and uploads the operation instruction corresponding to the interactive operation to the cloud gaming server. The server generates a corresponding game screen based on the operation instruction.
[0060] The server generates a frame of game screen and adds a corresponding serial number to the game screen. During the operation of the cloud game, each frame of the game screen corresponds to a unique serial number to facilitate identification of different game screens. In this embodiment, the serial number is a character with a sequential relationship, such as an increasing or decreasing numerical symbol, and the numerical symbol can be a binary, octal or hexadecimal numerical symbol, etc.
[0061] Optionally, in one embodiment, the server adds periodic serial numbers to the generated game screens, and each serial number increases or decreases in each cycle. For example, the serial number value is 0 to 255, and the serial number is added to the game screen starting from 0. When the added serial number is 255, the serial number added to the next frame of the game screen is 0 and starts again. At this time, the number of serial numbers should be greater than the number of game screens generated in the time period between the server sending a certain game screen and receiving the client returning the message of receiving the game screen.
[0062] Optionally, in another embodiment, the server adds an increasing or decreasing serial number to the generated game screen within a preset time interval. For example, with 1 minute as the preset time interval, an increasing or decreasing serial number is added to the game screen generated within each minute, such as the serial number value added to the first frame of the game screen within the first minute is 1, the serial number value added to the second frame of the game screen is 2, and so on. When the second minute starts, the serial number value added to the first frame of the game screen within the second minute is 1, the serial number value added to the second frame of the game screen is 2, and so on.
[0063] Based on the description of the embodiments of the above-mentioned cloud game data transmission system, the cloud game data transmission method of the present disclosure will be described in detail in combination with the following embodiments.
[0064] Figure 3 is a flowchart of a method for transmitting cloud game data provided by an embodiment, and the method for transmitting cloud game data can be executed in Figure 1 In the cloud gaming system shown, it can be executed by a server.
[0065] See also Figure 3 , the cloud game data transmission method may include the following steps:
[0066] S110. Receive a first sequence number returned from the client.
[0067] Among them, the first serial number is the serial number corresponding to the first game screen being played by the client.
[0068] During the operation of the cloud game, the server continuously sends the game screen to the client. The client receives the game screen for real-time dynamic refresh. In this embodiment, the game screen sent by the server to the client carries a serial number. When the client receives the game screen, it decodes the game screen and identifies the serial number corresponding to the game screen. It then returns the serial number to the server and plays the frame of the game screen. For ease of understanding and distinction, the game screen being played by the client is the first game screen, and its corresponding serial number is the first serial number.
[0069] S120: Obtain a second sequence number, and determine a network transmission status according to the second sequence number and the first sequence number.
[0070] In the disclosed embodiment, the server generates a game screen. To facilitate distinction and understanding, the game screen being generated by the server is referred to as the second game screen, and the second serial number is the serial number corresponding to the game screen being generated.
[0071] The server adds a serial number to each frame of the game screen generated to distinguish each frame of the game screen. The generation order or generation time of the frame of the game screen is determined according to the serial number. For example, if the serial number of the game screen identified by the client is 99, it can be said that the game screen is the 99th frame of the game screen generated by the server.
[0072] In this embodiment, the sequence number is added to the game screen in the order in which the game screen is generated. Optionally, the sequence number is added to the generated game screen in the ascending sequence of the sequence number, that is, the sequence number corresponding to the game screen first sent to the client is smaller than the sequence number of the game screen sent to the client later. Optionally, in one embodiment, the sequence number can also be added to the generated game screen in the descending sequence of the sequence number, that is, the sequence number corresponding to the game screen first sent to the client is larger than the sequence number of the game screen sent to the client later.
[0073] The server can determine the game screen being played by the client based on the first serial number (for the sake of distinction, the game screen being played by the client is defined as the first game screen), and can determine the game screen being generated based on the second serial number (for the sake of distinction, the game screen being generated by the server is defined as the second game screen). Since the first serial number and the second serial number have a sequential relationship, the greater the difference between the second serial number and the first serial number, the worse the network transmission status.
[0074] In one embodiment, the network transmission status can be determined by comparing the difference between the values of the first serial number and the second serial number. A large difference between the two values indicates that the network transmission rate is slow and more game screens are blocked in the network channel. Optionally, the values of the first serial number and the second serial number can be represented by ASCII codes. For example, according to the values of the second serial number and the first serial number, it can be known how many frames of intermediate game screens are between the second game screen and the first game screen, and these intermediate game screens are all in the "network transmission" state, that is, these intermediate game screens have been output from the server but have not been received by the client.
[0075] In another embodiment, the network transmission status can also be determined by comparing the difference between the time carried by the first serial number and the second serial number. For example, when the client recognizes the first serial number of the first game screen being played, the playing time is recorded, and the first serial number carrying the playing time is returned to the server. The server obtains the generation time corresponding to the generated second game screen, and determines the network transmission status based on the time difference between the two. If the time difference between the two is large, it means that the network transmission rate is slow.
[0076] S130. Adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0077] Normally, the server sends the game screen to the client at a stable output frame rate, so that the server's output frame rate is the same or similar to the display frame rate of the game screen received by the client, thereby making the cloud game run smoothly.
[0078] In this embodiment, when it is detected that the network transmission state is unstable, such as the network transmission rate is slow, the output frame rate of the server generating the second game screen is reduced to avoid too many third game screens being blocked in the network transmission process; when the network transmission efficiency is improved, the output frame rate of the server generating the second game screen is increased so that the generated second game screen can be transmitted to the client faster.
[0079] The cloud game data transmission method provided in this embodiment is executed on the server. The server determines the network transmission status by comparing the first serial number corresponding to the first game screen being played and returned from the client with the second serial number corresponding to the second game screen being generated by the server. The output frame rate of the second game screen is adaptively and dynamically adjusted in real time according to the network transmission status to ensure that the second game screen is generated at a suitable output frame rate and sent to the client, thereby improving the delay of the cloud game and improving the user's gaming experience.
[0080] In one embodiment of the present disclosure, after the server adds the serial number to the game screen, it does not cache it, but encodes it in real time and sends it to the client. In addition, in another embodiment, after the client receives the game screen, it decodes it in real time and does not cache it, but directly plays it in real time.
[0081] Compared with the related art, the server generates the game screen and caches it first, encodes multiple frames of the game screen into a data packet and sends it to the client, the client receives the data packet and stores it in the buffer, decodes it to obtain multiple frames of the game screen, and then obtains the game screen from the buffer for playback. This transmission method increases the delay time of the cloud game. In the technical solution of this embodiment, the server generates the game screen and encodes it in real time and packages it to the client, which decodes it in real time after receiving it for playback. There is no need for the server and client caching process, which shortens the delay time.
[0082] It should be noted that the present embodiment can dynamically adjust the output frame rate of the second game screen generated by the server in real time according to the network transmission status, and transmit the generated second game screen to the client in real time, so that the client can decode and play the game screen in real time, which can reduce the impact of unstable network conditions on cloud game delays. Under this premise, since the generation rate and output frame rate of the second game screen can be adjusted in real time with the network status, even the real-time encoding and sending of the second game screen and the real-time decoding and playback of the first game screen are not likely to cause cloud game lag problems.
[0083] In order to make the present technical solution clearer and easier to understand, the specific implementation process and method in the present technical solution are described in detail below.
[0084] In one embodiment, determining the network transmission status according to the second sequence number and the first sequence number in step S120 may include the following steps:
[0085] S1201. Calculate the difference between the second serial number and the first serial number, and determine the number of frames of the third game screen being transmitted over the network based on the difference.
[0086] In this embodiment, the first serial number and the second serial number are characters with a sequential relationship, such as increasing or decreasing numerical symbols. The difference between the second serial number and the first serial number is calculated. For example, if the serial number is a numerical value that increases by "1", the numerical value corresponding to the second serial number is 60, and the numerical value corresponding to the first serial number is 56, the difference between the second serial number and the first serial number is calculated to be 4, and the number of frames of the third game screen being transmitted over the network is determined to be 3 frames, that is, the game screens corresponding to the serial numbers 57, 58 and 59 respectively.
[0087] S1202: Compare the frame number of the third game screen being transmitted over the network with a preset threshold, and determine the network transmission status according to the comparison result.
[0088] Under normal circumstances, the number of frames of the third game screen being transmitted over the network is within a stable numerical range, and the stable numerical range is adapted to the network bandwidth. In this embodiment, the preset threshold can be set by the actual network bandwidth. If the number of frames of the third game screen being transmitted over the network is within the preset threshold range, it means that the network transmission state is stable. If the number of frames of the third game screen being transmitted over the network is outside the preset threshold range, the output frame rate of the second game screen of the server needs to be adjusted to adapt to the network transmission state.
[0089] Figure 4 is a schematic diagram of a picture transmission process of cloud game data provided by an embodiment, such as Figure 4 As shown, in the process of cloud game data transmission, the second game screen 201 being generated by the server, the third game screen 202 being transmitted over the network, and the first game screen 203 being played on the client are involved. The server 102 generates the second game screen 201, and adds a serial number 103 to the second game screen 201, such as adding a number "1" to the second game screen 201, and transmits the second game screen 201 with the added serial number "1" to the client 101 through the network for playback. The server 102 continuously generates the second game screen 201 and sends the second game screen 201 to the network for transmission, and the third game screen 202 being transmitted over the network is transmitted to the client 101, and the client 101 continuously receives the third game screen 202 from the network and plays the received first game screen 203.
[0090] In this example, increasing numeric characters are added to the game screen in the order of generation. It should be noted that Figure 4 The serial numbers "1" to "5" are only used for illustration. In actual applications, the serial numbers may be characters presented in other forms.
[0091] Optionally, in one embodiment, if the frame number of the third game screen being transmitted over the network is greater than a first preset threshold, it is determined that the network transmission state is in a first network transmission state; if the frame number of the third game screen being transmitted over the network is less than a second preset threshold, it is determined that the network transmission state is in a second network transmission state.
[0092] In this embodiment, if the frame number of the third game screen being transmitted over the network is greater than the first preset threshold, it means that more third game screens are being transmitted over the network. At this time, the network transmission state is determined to be the first network transmission state. In the first network transmission state, the network transmission rate is slow, resulting in transmission congestion.
[0093] If the frame rate of the third game screen being transmitted over the network is less than the second preset threshold, it means that fewer third game screens are being transmitted over the network. At this time, the network transmission state is determined to be the second network transmission state. In the second network transmission state, the output frame rate of the second game screen generated by the server is slow, which is lower than the network transmission rate, resulting in a waste of network transmission resources.
[0094] If the frame rate of the third game screen being transmitted over the network is within the first preset threshold and the second preset threshold, the network transmission state is determined to be the third network transmission state. In the third network transmission state, the server maintains the standard output frame rate of the second game screen and stably sends the second game screen to the client.
[0095] In one embodiment, the standard output frame rate at which the server outputs the second game screen depends on the network bandwidth. In the disclosed embodiment, the network bandwidth is obtained, and the standard output frame rate of the game screen corresponding to the network bandwidth is queried.
[0096] At the beginning of the game, the network bandwidth of the user is detected, and the standard output frame rate of the second game screen is set according to the network bandwidth. In this embodiment, the generation rate of the second game screen is equal to the output frame rate of the second game screen. When the output frame rate of the second game screen changes, the generation rate of the second game screen generated by the server also changes accordingly.
[0097] Optionally, a mapping relationship between the transmission bandwidth and the standard output frame rate is preconfigured and saved in a preset directory, which may be a designated database or memory. For example, if the transmission bandwidth is 1Mbpa, the standard output frame rate mapped thereto is 5 frames / second; if the transmission bandwidth is 10Mbpa, the standard output frame rate mapped thereto is 20 frames / second; if the transmission bandwidth is 100Mbpa, the standard output frame rate mapped thereto is 50 frames / second, etc.
[0098] Furthermore, based on the mapping relationship between the transmission bandwidth and the standard output frame rate, the standard output frame rate of the game screen corresponding to the transmission bandwidth is determined.
[0099] For example, if the transmission bandwidth is detected to be 10Mbps, through the mapping relationship between the transmission bandwidth and the standard output frame rate, it can be queried that the standard output frame rate corresponding to the transmission bandwidth of 10Mbps is 20 frames per second. At the beginning of the cloud game, the server generates the game screen at the standard output frame rate and sends it to the client.
[0100] In one embodiment, step S130 adjusts the output frame rate of the game screen according to the network transmission status, which may include the following steps:
[0101] S1301. When it is determined that the network transmission state is in the first network transmission state, the output frame rate of the second game screen is reduced based on the standard output frame rate.
[0102] In the first network transmission state, the network transmission rate is slow, resulting in transmission congestion. At this time, the output frame rate of the game screen is reduced on the basis of the standard output frame rate to avoid the incompatibility between the output frame rate of the game screen of the server and the network transmission rate, resulting in more serious congestion. For example, the standard output frame rate is 50 frames / second, and the output frame rate of the game screen is reduced to 48 frames / second. Further, in one embodiment, the output frame rate is gradually reduced on the basis of the output frame rate with a preset number of frames. For example, when the output frame rate is gradually reduced by 2 frames / second, the standard output frame rate is 50 frames / second. Since it is detected that it is in the first network transmission state, the output frame rate of the game screen is reduced to 48 frames / second. If the game screen is output at an output frame rate of 48 frames / second, and the determined network transmission state is in the first network transmission state, that is, the number of frames of the game screen being transmitted on the network is still greater than the first preset threshold, the output frame rate of the game screen is further reduced to 46 frames / second, and so on, until the number of frames of the game screen being transmitted on the network is within the preset threshold range.
[0103] S1302: When it is determined that the network transmission state is in the second network transmission state, the output frame rate of the second game screen is increased based on the standard output frame rate.
[0104] In the second network transmission state, the output frame rate of the server generating the game screen is slow, which is lower than the network transmission rate, resulting in a waste of network transmission resources. At this time, the output frame rate of the game screen is increased on the basis of the standard output frame rate to make full use of the network bandwidth resources. For example, the standard output frame rate is 50 frames / second, and the output frame rate of the height game screen is 52 frames / second. Further, in one embodiment, the output frame rate is gradually increased on the basis of the output frame rate with a preset number of frames. For example, when the output frame rate is gradually increased at 2 frames / second, the standard output frame rate is 50 frames / second. Since it is detected that it is in the second network transmission state, the output frame rate of the game screen is increased to 52 frames / second. If the game screen is output at an output frame rate of 52 frames / second, the determined network transmission state is still in the second network transmission state, that is, the number of frames of the game screen being transmitted on the network is still less than the second preset threshold, then the output frame rate of the game screen is continued to be increased to 52 frames / second, and so on, until the number of frames of the game screen being transmitted on the network is within the preset threshold range.
[0105] S1303: When it is determined that the network transmission state is in the third network transmission state, maintain the standard output frame rate.
[0106] If the frame rate of the game screen being transmitted over the network is between the first preset threshold and the second preset threshold, the network transmission state is determined to be the third network transmission state. In the third network transmission state, the server maintains a standard output frame rate as the output frame rate of the second game screen, and stably sends the second game screen to the client.
[0107] Figure 5 is another flow chart of a method for transmitting cloud game data provided by an embodiment, and the method for transmitting cloud game data can be executed in Figure 1 In the cloud gaming system shown, it can be executed by the client.
[0108] See also Figure 5 , the cloud game data transmission method may include the following steps:
[0109] S310: The client receives a first game screen sent by the server, wherein the first game screen carries a first serial number.
[0110] S320. The client plays the first game screen and returns the first serial number corresponding to the first game screen to the server while the first game screen is being played, so that the server obtains the second serial number corresponding to the second game screen being generated, determines the network transmission status according to the second serial number and the first serial number, adjusts the output frame rate of the second game screen according to the network transmission status, and sends the second game screen to the client according to the output frame rate.
[0111] During the operation of the cloud game, the server continuously sends the game screen to the client. The client receives the game screen for real-time dynamic refresh. In this embodiment, the game screen sent by the server to the client carries a serial number. When the client receives the game screen, it decodes the game screen and identifies the serial number corresponding to the game screen. It then returns the serial number to the server and plays the frame of the game screen.
[0112] To facilitate understanding and distinction, the game screen being played by the client is the first game screen, and its corresponding serial number is the first serial number. The game screen being generated by the server is the second game screen, and the second serial number is the serial number corresponding to the game screen being generated.
[0113] In one embodiment, the network transmission status is determined according to the first serial number and the second serial number, and the network transmission status can be determined by comparing the difference between the values of the first serial number and the second serial number. A large difference between the two values indicates that the network transmission rate is slow and more game screens are blocked in the network channel. When it is detected that the network transmission status is unstable, such as the network transmission rate is slow, the output frame rate of the second game screen generated by the server is reduced to avoid too many third game screens being blocked in the network transmission process; if the network transmission efficiency is improved, the output frame rate of the second game screen generated by the server is increased so that the generated second game screen can be transmitted to the client faster.
[0114] The cloud game data transmission method provided in this embodiment is executed on the client, and the first game screen sent by the server is received by the client, and the first serial number corresponding to the first game screen being played is returned to the server, so that the server can determine the network transmission status according to the second serial number corresponding to the second game screen being generated and the first serial number, and adaptively and dynamically adjust the output frame rate of the second game screen in real time according to the network transmission status to ensure that the second game screen is generated at a suitable output frame rate and sent to the client, thereby improving the delay of the cloud game and improving the user's gaming experience.
[0115] In one embodiment of the present disclosure, the client plays the first game screen, including:
[0116] When the previous frame of the first game screen is played, if the first game screen has been sent to the client, the client immediately plays the first game screen;
[0117] When the previous frame of the game screen of the first game screen is played, if the first game screen has not been sent to the client, the client will immediately play the first game screen when the first game screen is sent to the client.
[0118] The technical solution provided in this embodiment ensures that the frame rate of the game screen played by the client matches the network transmission rate, so that the client can decode and play the received game screen in real time, and the client does not need to cache the game screen sent by the server.
[0119] Compared with the related art, the server generates the game screen and caches it first, encodes multiple frames of the game screen into a data packet and sends it to the client, the client receives the data packet and stores it in the buffer, decodes it to obtain multiple frames of the game screen, and then obtains the game screen from the buffer for playback. This transmission method increases the delay time of the cloud game. In the technical solution of this embodiment, the server generates the game screen and encodes it in real time and packages it to the client, which decodes it in real time after receiving it for playback. There is no need for the server and client caching process, which shortens the delay time.
[0120] It should be noted that the present embodiment can dynamically adjust the output frame rate of the second game screen generated by the server in real time according to the network transmission status, and transmit the generated second game screen to the client in real time, so that the client can decode and play the game screen in real time, which can reduce the impact of unstable network conditions on cloud game delays. Under this premise, since the generation rate and output frame rate of the second game screen can be adjusted in real time with the network status, even the real-time encoding and sending of the second game screen and the real-time decoding and playback of the first game screen are not likely to cause cloud game lag problems.
[0121] The following is a detailed description of the relevant embodiments of the cloud gaming data transmission device.
[0122] Figure 6 is a schematic diagram of the structure of a transmission device for cloud gaming data provided by an embodiment, such as Figure 6 As shown, the cloud gaming data transmission device 100 may include: a serial number receiving module 110 , a transmission status determination module 120 and a frame rate adjustment module 130 .
[0123] The serial number receiving module 110 is used to receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to the first game screen being played by the client;
[0124] The transmission status determination module 120 is used to obtain a second serial number and determine the network transmission status according to the second serial number and the first serial number; wherein the second serial number is a serial number corresponding to the second game screen being generated;
[0125] The frame rate adjustment module 130 is used to adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0126] The cloud game data transmission device provided in this embodiment determines the network transmission status by comparing the first serial number corresponding to the first game screen being played and returned from the client with the second serial number corresponding to the second game screen being generated by the server, and adaptively and dynamically adjusts the output frame rate of the second game screen in real time according to the network transmission status to ensure that the second game screen is generated at a suitable output frame rate and sent to the client, thereby improving the delay of the cloud game and improving the user's gaming experience.
[0127] In one embodiment, the transmission status determination module 120 includes: a frame number determination unit and a status determination unit;
[0128] The frame number determination unit is used to calculate the difference between the second serial number and the first serial number, and determine the frame number of the third game screen being transmitted over the network based on the difference;
[0129] The state determination unit is used to compare the frame number of the third game screen being transmitted over the network with a preset threshold value, and determine the network transmission state according to the comparison result.
[0130] In one embodiment, the state determination unit is used to determine that the network transmission state is in the first network transmission state if the frame number of the third game screen being transmitted over the network is greater than the first preset threshold; determine that the network transmission state is in the second network transmission state if the frame number of the third game screen being transmitted over the network is less than the second preset threshold; and determine that the network transmission state is in the third network transmission state if the frame number of the third game screen being transmitted over the network is within the first preset threshold and the second preset threshold.
[0131] In one embodiment, the frame rate adjustment module 130 is used to determine that when the network transmission state is in the first network transmission state, the output frame rate of the game screen is reduced based on the standard output frame rate of the second game screen; when the network transmission state is in the second network transmission state, the output frame rate of the game screen is increased based on the standard output frame rate; when the network transmission state is in the third network transmission state, the standard output frame rate is maintained as the output frame rate of the second game screen; wherein the standard output frame rate is determined based on the transmission bandwidth of the second game screen.
[0132] In one embodiment, the cloud game data transmission device 100 further includes: a pre-configuration module and a frame rate query module;
[0133] A pre-configuration module, used to pre-configure a mapping relationship between a transmission bandwidth and a standard output frame rate of a second game screen;
[0134] The frame rate query module is used to determine the standard output frame rate of the second game screen corresponding to the transmission bandwidth based on the mapping relationship.
[0135] Figure 7 is another structural schematic diagram of a cloud game data transmission device provided by an embodiment, the cloud game data transmission device is executed on a client, and the cloud game data transmission device 300 includes: a picture receiving module 310 and a serial number returning module 320;
[0136] The screen receiving module 310 is used to receive the first game screen sent by the server, wherein the first game screen carries a first serial number;
[0137] The serial number return module 320 is used to play the first game screen and return the first serial number corresponding to the first game screen to the server when the first game screen is played, so that the server can obtain the second serial number corresponding to the second game screen being generated, determine the network transmission status according to the second serial number and the first serial number, adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0138] In one embodiment, the serial number return module 320 includes a playback unit, which is used to immediately play the first game screen on the client side when the previous frame of the first game screen is played, if the first game screen has been sent to the client side;
[0139] When the previous frame of the game screen of the first game screen is played, if the first game screen has not been sent to the client, the client will immediately play the first game screen when the first game screen is sent to the client.
[0140] The cloud gaming data transmission device provided above can be used to execute the cloud gaming data transmission method provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0141] Reference below Figure 8 , Figure 8 FIG. 1 is a schematic diagram of a structure of an electronic device for cloud game data transmission provided by an embodiment, which shows an electronic device 700 (eg, Figure 1 The electronic device in the disclosed embodiment may include a background server that provides background services for the client device, which may be implemented by an independent server or a server cluster composed of multiple servers. Figure 8 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.
[0142] The electronic device includes: a memory and a processor, wherein the processor here may be referred to as a processing device 701 hereinafter, and the memory may include at least one of a read-only memory (ROM) 702, a random access memory (RAM) 703, and a storage device 708 hereinafter, as specifically shown below:
[0143] like Figure 8As shown, the electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.
[0144] Typically, the following devices may be connected to the I / O interface 705: an input device 706 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 708 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 700 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.
[0145] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 709, or installed from a storage device 708, or installed from a ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
[0146] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0147] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0148] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
[0149] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:
[0150] Receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client;
[0151] Obtain a second serial number, and determine the network transmission status according to the second serial number and the first serial number; wherein the second serial number is the serial number corresponding to the second game screen being generated;
[0152] The output frame rate of the second game screen is adjusted according to the network transmission status, and the second game screen is sent to the client according to the output frame rate.
[0153] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
[0154] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0155] The modules or units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The name of a module or unit does not limit the unit itself in some cases. For example, a receiving module may also be described as a "module for receiving a first serial number".
[0156] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0157] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the above information. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above information.
[0158] According to one or more embodiments of the present disclosure, the present disclosure provides a method for transmitting cloud game data, including:
[0159] Receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client;
[0160] Obtain a second serial number, and determine the network transmission status according to the second serial number and the first serial number; wherein the second serial number is the serial number corresponding to the second game screen being generated;
[0161] The output frame rate of the second game screen is adjusted according to the network transmission status, and the second game screen is sent to the client according to the output frame rate.
[0162] In a possible implementation, the step of determining the network transmission state according to the second sequence number and the first sequence number includes:
[0163] Calculate the difference between the second serial number and the first serial number, and determine the frame number of the third game screen being transmitted over the network based on the difference;
[0164] The frame number of the third game screen being transmitted over the network is compared with a preset threshold, and the network transmission status is determined according to the comparison result.
[0165] In a possible implementation, the step of comparing the number of frames of the third game screen being transmitted over the network with a preset threshold and determining the network transmission state according to the comparison result includes:
[0166] If the frame number of the third game screen being transmitted over the network is greater than the first preset threshold, determining that the network transmission state is in the first network transmission state;
[0167] If the frame rate of the third game screen being transmitted over the network is less than the second preset threshold, determining that the network transmission state is in the second network transmission state;
[0168] If the frame number of the third game screen being transmitted over the network is within the first preset threshold and the second preset threshold, it is determined that the network transmission state is in the third network transmission state.
[0169] In a possible implementation, the step of adjusting the output frame rate of the game screen according to the network transmission status includes:
[0170] When it is determined that the network transmission state is in the first network transmission state, the output frame rate of the second game screen is reduced based on the standard output frame rate of the second game screen;
[0171] When it is determined that the network transmission state is in the second network transmission state, increasing the output frame rate of the second game screen based on the standard output frame rate;
[0172] When determining that the network transmission state is in the third network transmission state, maintaining the standard output frame rate as the output frame rate of the second game screen;
[0173] Among them, the standard output frame rate is determined according to the transmission bandwidth of the second game screen.
[0174] In a possible implementation, before the step of adjusting the output frame rate of the second game screen according to the network transmission status, the step further includes:
[0175] Pre-configure the mapping relationship between the transmission bandwidth and the standard output frame rate of the second game screen;
[0176] The standard output frame rate of the second game screen corresponding to the transmission bandwidth is determined based on the mapping relationship.
[0177] According to one or more embodiments of the present disclosure, the present disclosure provides a method for transmitting cloud game data, including:
[0178] The client receives a first game screen sent by the server, wherein the first game screen carries a first serial number;
[0179] The client plays the first game screen and returns the first serial number corresponding to the first game screen to the server when the first game screen is played, so that the server obtains the second serial number corresponding to the second game screen being generated, determines the network transmission status according to the second serial number and the first serial number, adjusts the output frame rate of the second game screen according to the network transmission status, and sends the second game screen to the client according to the output frame rate.
[0180] In a possible implementation, the client plays the first game screen, including:
[0181] When the previous frame of the first game screen is played, if the first game screen has been sent to the client, the client immediately plays the first game screen;
[0182] When the previous frame of the game screen of the first game screen is played, if the first game screen has not been sent to the client, the client will immediately play the first game screen when the first game screen is sent to the client.
[0183] According to one or more embodiments of the present disclosure, the present disclosure provides a cloud gaming data transmission device, including:
[0184] A serial number receiving module, used to receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client;
[0185] A transmission status determination module, used to obtain a second serial number, and determine the network transmission status according to the second serial number and the first serial number; wherein the second serial number is a serial number corresponding to the second game screen being generated;
[0186] The frame rate adjustment module is used to adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0187] In a possible implementation, the transmission status determination module includes: a frame number determination unit and a status determination unit;
[0188] The frame number determination unit is used to calculate the difference between the second serial number and the first serial number, and determine the frame number of the third game screen being transmitted over the network based on the difference;
[0189] The state determination unit is used to compare the frame number of the third game screen being transmitted over the network with a preset threshold value, and determine the network transmission state according to the comparison result.
[0190] In one possible implementation, the status determination unit is used to determine that the network transmission status is in the first network transmission status if the frame number of the third game screen being transmitted over the network is greater than a first preset threshold; determine that the network transmission status is in the second network transmission status if the frame number of the third game screen being transmitted over the network is less than a second preset threshold; and determine that the network transmission status is in the third network transmission status if the frame number of the third game screen being transmitted over the network is within the first preset threshold and the second preset threshold.
[0191] In one possible implementation, the adjustment module is used to determine that when the network transmission state is in a first network transmission state, the output frame rate of the game screen is reduced based on the standard output frame rate; when the network transmission state is in a second network transmission state, the output frame rate of the game screen is increased based on the standard output frame rate; when the network transmission state is in a third network transmission state, the standard output frame rate is maintained.
[0192] In a possible implementation, the cloud game data transmission device further includes: a pre-configuration module, configured to pre-configure a mapping relationship between a transmission bandwidth and a standard output frame rate of the second game screen;
[0193] The frame rate query module is used to determine the standard output frame rate of the second game screen corresponding to the transmission bandwidth based on the mapping relationship.
[0194] According to one or more embodiments of the present disclosure, the present disclosure provides a cloud gaming data transmission device, including:
[0195] A picture receiving module, used for receiving a first game picture sent by a server, wherein the first game picture carries a first serial number;
[0196] A serial number return module is used to play the first game screen and return the first serial number corresponding to the first game screen to the server when the first game screen is played, so that the server can obtain the second serial number corresponding to the second game screen being generated, determine the network transmission status according to the second serial number and the first serial number, adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0197] According to one or more embodiments of the present disclosure, the present disclosure provides a cloud game data transmission system, including: a client and a server, the client and the server are communicatively connected via a network;
[0198] The client is used to receive a first game screen sent by the server, wherein the first game screen carries a first serial number;
[0199] The client is further used to play the first game screen and return the first serial number corresponding to the first game screen to the server when the first game screen is played;
[0200] The server is used to obtain a second serial number corresponding to a second game screen being generated, determine a network transmission status according to the second serial number and the first serial number, adjust an output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
[0201] According to one or more embodiments of the present disclosure, the present disclosure provides an electronic device, comprising:
[0202] one or more processors;
[0203] Memory;
[0204] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute the method for transmitting the cloud gaming data.
[0205] According to one or more embodiments of the present disclosure, the present disclosure provides a computer-readable medium having a computer program stored thereon, which implements the cloud game data transmission method when executed by a processor.
[0206] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.
[0207] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.
[0208] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.
Claims
1. A method for transmitting cloud game data, It is characterized in that The following steps are involved: Receive a first serial number returned from the client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client, and the client decodes and plays the first game screen in real time after receiving it; Obtaining a second serial number, and determining a network transmission state according to a difference between the second serial number and the first serial number; wherein the second serial number is a serial number corresponding to a second game screen being generated, and after adding the second serial number to the second game screen, encoding the second game screen in real time and sending it to the client; The output frame rate of the second game screen is adjusted according to the network transmission status, and the second game screen is sent to the client according to the output frame rate so as to play the second game screen in real time on the client.
2. The method for transmitting cloud game data according to claim 1, It is characterized in that The step of determining the network transmission status according to the second sequence number and the first sequence number comprises: Calculating a difference between the second serial number and the first serial number, and determining the frame number of the third game screen being transmitted over the network based on the difference; The frame number of the third game screen being transmitted over the network is compared with a preset threshold, and the network transmission status is determined according to the comparison result.
3. The method for transmitting cloud gaming data according to claim 2, It is characterized in that The step of comparing the frame number of the third game screen being transmitted over the network with a preset threshold and determining the network transmission status according to the comparison result comprises: If the frame number of the third game screen being transmitted over the network is greater than a first preset threshold, determining that the network transmission state is in the first network transmission state; If the frame number of the third game screen being transmitted over the network is less than the second preset threshold, determining that the network transmission state is in the second network transmission state; If the frame number of the third game screen being transmitted over the network is within the first preset threshold and the second preset threshold, it is determined that the network transmission state is in the third network transmission state.
4. The method for transmitting cloud game data according to claim 3, It is characterized in that The step of adjusting the output frame rate of the second game screen according to the network transmission status comprises: When it is determined that the network transmission state is in the first network transmission state, reducing the output frame rate of the second game screen based on the standard output frame rate of the second game screen; When it is determined that the network transmission state is in the second network transmission state, increasing the output frame rate of the second game screen based on the standard output frame rate; When determining that the network transmission state is in the third network transmission state, maintaining the standard output frame rate as the output frame rate of the second game screen; The standard output frame rate is determined according to the transmission bandwidth of the second game screen.
5. The method for transmitting cloud game data according to claim 4, It is characterized in that Before the step of adjusting the output frame rate of the second game screen according to the network transmission status, the method further includes: Pre-configure the mapping relationship between the transmission bandwidth and the standard output frame rate of the second game screen; The standard output frame rate of the second game screen corresponding to the transmission bandwidth is determined based on the mapping relationship.
6. A method for transmitting cloud game data, It is characterized in that include: The client receives a first game screen sent by the server, wherein the first game screen carries a first serial number; The client decodes and plays the first game screen in real time, and returns a first serial number corresponding to the first game screen to the server while the first game screen is being played, so that the server obtains a second serial number corresponding to a second game screen being generated, determines a network transmission status according to a difference in values between the second serial number and the first serial number, adjusts an output frame rate of the second game screen according to the network transmission status, and encodes and sends the second game screen to the client in real time at the output frame rate so as to play the second game screen in real time on the client.
7. The method for transmitting cloud game data according to claim 6, It is characterized in that The client plays the first game screen, including: When the previous frame of the first game screen is played, if the first game screen has been sent to the client, the client immediately plays the first game screen; When the previous frame of the first game screen is played, if the first game screen has not been sent to the client, when the first game screen is sent to the client, the client immediately plays the first game screen.
8. A cloud gaming data transmission device, It is characterized in that include: A serial number receiving module, used to receive a first serial number returned from a client; wherein the first serial number is a serial number corresponding to a first game screen being played by the client, and the client decodes and plays the first game screen in real time after receiving it; a transmission status determination module, configured to obtain a second serial number, and determine a network transmission status according to a difference between the second serial number and the first serial number; wherein the second serial number is a serial number corresponding to a second game screen being generated, and after adding the second serial number to the second game screen, the second game screen is encoded in real time and sent to the client; A frame rate adjustment module is used to adjust the output frame rate of the second game screen according to the network transmission status, and send the second game screen to the client according to the output frame rate.
9. A cloud gaming data transmission device, It is characterized in that include: A picture receiving module, used for receiving a first game picture sent by a server, wherein the first game picture carries a first serial number; A serial number return module is used to decode and play the first game screen in real time, and return the first serial number corresponding to the first game screen to the server when the first game screen is played, so that the server can obtain the second serial number corresponding to the second game screen being generated, determine the network transmission status according to the difference between the second serial number and the first serial number, adjust the output frame rate of the second game screen according to the network transmission status, and encode and send the second game screen to the cloud game data transmission device in real time according to the output frame rate so as to play the second game screen in real time on the cloud game data transmission device.
10. A cloud gaming data transmission system, It is characterized in that include: A client and a server, wherein the client and the server are communicatively connected via a network; The client is used to receive a first game screen sent by the server, wherein the first game screen carries a first serial number; The client is further configured to decode and play the first game screen in real time, and return a first serial number corresponding to the first game screen to the server when the first game screen is played; The server is used to obtain a second serial number corresponding to a second game screen being generated, determine a network transmission status according to a difference between the second serial number and the first serial number, adjust an output frame rate of the second game screen according to the network transmission status, and encode and send the second game screen to the client in real time at the output frame rate so as to play the second game screen in real time on the client.
11. An electronic device, It is characterized in that It includes: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to: execute the cloud gaming data transmission method according to any one of claims 1-7.
12. A computer readable medium having a computer program stored thereon, It is characterized in that When the program is executed by a processor, the cloud gaming data transmission method described in any one of claims 1 to 7 is implemented.
