Method and device for preventing cloud game from being stuck, equipment and medium

Abstract

The invention provides a method, device and equipment for preventing cloud game jamming and a medium, and relates to the technical field of cloud computing, in particular to the cloud game and cloud mobile phone technology. According to the specific implementation scheme, a remote control sub-process is created, and the remote control sub-process is used for being connected with a remote control service of the cloud server; the desktop data of the cloud server is obtained from the remote control service through the remote control sub-process, and the remote control sub-process is further used for abandoning the desktop data. According to the method and the device, the problem of jamming caused by cloud game on-hook can be solved with lower cost.

Description

Technical Field

[0001] The present disclosure relates to the field of cloud computing technology, in particular to cloud gaming and cloud mobile phone technology, and specifically to a method, device, equipment and medium for preventing cloud gaming from freezing. Background Art

[0002] Cloud gaming is a gaming method based on cloud computing. In the cloud gaming mode, all games are run on the server side, and the rendered game screens are compressed and transmitted to the client side through the network. The client side device does not need any high-end processors and graphics cards, only basic video decompression capabilities are required to play the games running on the server side.

[0003] However, when the game is idle on the user side, the server side will lock the screen or wait for a certain period of time, resulting in frame drops and causing the game to lag. Summary of the invention

[0004] The present disclosure provides a method, apparatus, device and medium for preventing cloud gaming from freezing.

[0005] According to one aspect of the present disclosure, a method for preventing cloud game lag is provided, which is applied to a cloud server on which a cloud game is run, and the method includes:

[0006] Creating a remote control subprocess, wherein the remote control subprocess is used to connect to the remote control service of the cloud server;

[0007] The desktop data of the cloud server is obtained from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

[0008] According to another aspect of the present disclosure, there is provided a device for preventing a cloud game from freezing, which is configured on a cloud server on which a cloud game is run, and the device comprises:

[0009] A creation module, used to create a remote control subprocess, wherein the remote control subprocess is used to connect to the remote control service of the cloud server;

[0010] The acquisition module is used to acquire the desktop data of the cloud server from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

[0011] According to another aspect of the present disclosure, there is provided an electronic device, comprising:

[0012] at least one processor; and

[0013] a memory communicatively connected to the at least one processor; wherein,

[0014] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for preventing cloud game lag as described in any embodiment of the present disclosure.

[0015] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable a computer to execute the method for preventing cloud game lag as described in any embodiment of the present disclosure.

[0016] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the method for preventing cloud game lag according to any embodiment of the present disclosure.

[0017] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0019] Figure 1 is a schematic diagram of a method for preventing cloud gaming from freezing according to an embodiment of the present disclosure;

[0020] Figure 2 is a schematic diagram of another method for preventing cloud gaming from freezing according to an embodiment of the present disclosure;

[0021] Figure 3 is a schematic diagram of a device for preventing cloud gaming from freezing according to an embodiment of the present disclosure;

[0022] Figure 4 It is a block diagram of an electronic device used to implement the method of preventing cloud game lag in the embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0024] Figure 1This is a schematic diagram of a method for preventing cloud gaming from freezing according to an embodiment of the present disclosure. This embodiment can be applied to preventing cloud gaming from freezing after a user has left the cloud gaming system idle. It relates to the field of cloud computing technology, and in particular to cloud gaming and cloud mobile phone technology. The method can be performed by a device for preventing cloud gaming from freezing, which is implemented in software and / or hardware, and is preferably configured in an electronic device, such as a cloud server. Figure 1 As shown, the method specifically includes the following:

[0025] S101: Create a remote control subprocess, where the remote control subprocess is used to connect to a remote control service of a cloud server.

[0026] S102: Obtain desktop data of the cloud server from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

[0027] The cloud server runs cloud games, and the client can obtain cloud game data through the cloud server's streaming service. The client device only needs to have basic video decompression capabilities to play the cloud games running on the cloud server. At the same time, the hardware requirements for the client device's processor and graphics card are not high. Moreover, the operating system of the cloud server and the client can be the same or different. In the cloud game idle scenario, the cloud server will lock the screen or wait for a certain period of time, and the frame rate will drop, which will cause the cloud game to freeze and affect the user experience.

[0028] To solve this technical problem, in the disclosed embodiment, the cloud server creates a remote control subprocess, which is used to connect to the remote control service of the cloud server. The remote control service is, for example, a service provided by the cloud server that can be used to remotely control the desktop of the cloud server. Then, the cloud server obtains the desktop data of the cloud server from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

[0029] That is to say, after the remote control subprocess is connected to the remote control service of the cloud server, the remote control service will send the current desktop data of the cloud server to the remote control subprocess, but the remote control subprocess will not render or process the desktop data, but will directly discard it. The purpose of this is to connect the remote control service of the cloud server through the created remote control subprocess, keep the cloud server system screen refreshed based on the remote control service, and more accurately activate the cloud server desktop, thereby avoiding the cloud server screen lock or standby, avoiding frame drops, and thus preventing cloud games from freezing.

[0030] It should be noted that the existing technology usually adopts the method of plugging a screen into the cloud server and then regularly clicking the cloud server desktop displayed on the screen to keep the desktop always activated. However, this method not only increases hardware and labor costs, but also the triggering time of the regular click action is difficult to grasp, resulting in unsatisfactory results.

[0031] In contrast, the technical solution of the disclosed embodiment can remotely control the cloud server through the remote control service provided by the cloud server. After the remote control subprocess is created, it is connected to the remote control service through the remote control subprocess, which is equivalent to the cloud server desktop being always in an activated state. Then, the remote control subprocess only needs to not process the desktop data sent by the remote control service, and no additional decoding and rendering resources are required. In this way, the cloud server desktop can be activated more accurately, and the cloud game freeze problem caused by cloud game hanging up can be solved at a lower cost, and at the same time, it will not consume too many system resources.

[0032] In one embodiment, creating a remote control sub-process includes: creating a remote control sub-process through a streaming service running on a cloud server, wherein the streaming service is used to push game screen data of the cloud game to a user end.

[0033] The streaming service is a service provided by the cloud server itself. When the user plays a cloud game, it connects to the streaming service of the cloud server and obtains the game screen data of the cloud game pushed by the streaming service. The streaming service runs as a process in the cloud server. A remote control subprocess is created through the streaming service, and the streaming service serves as the main process of the remote control subprocess. Then, the streaming service can also obtain and monitor the running status of the remote control subprocess to ensure the normal operation of the remote control subprocess. Using the existing streaming service of the cloud server as the main process to create a remote control subprocess can achieve the purpose of further saving system resources. By monitoring the running status of the remote control subprocess, the smooth implementation of the present disclosure can be further ensured.

[0034] In one embodiment, the remote control subprocess is also used to establish a long connection with the remote control service, and periodically detect the connection status of the long connection by means of heartbeat detection. That is, the connection mode between the remote control subprocess and the remote control service of the cloud server is a long connection. In addition, in order to avoid the disconnection of the long connection, which causes the cloud game to freeze again, the remote control subprocess can also periodically detect the connection status of the long connection by means of heartbeat detection.

[0035] It should be noted that after the user terminal connects to the cloud server remote control service, the obtained desktop data is usually rendered and displayed, but this will consume unnecessary decoding and rendering resources. Therefore, in the disclosed embodiment, the desktop data of the cloud server is read on the loopback network card of the cloud server through the remote control subprocess, and then the desktop data is discarded. Among them, the desktop data of the cloud server is sent to the loopback network card by the remote control service. The loopback network card is not connected to an external device, so that the desktop data can be directly discarded without processing, thereby avoiding wasting unnecessary resources and achieving the purpose of solving the problem of cloud game hang-up and jamming at a lower cost.

[0036] Figure 2 It is a schematic diagram of another method for preventing cloud games from freezing according to an embodiment of the present disclosure. This embodiment is further optimized on the basis of the above embodiment. In this embodiment, the cloud server is a MAC cloud server, and the user end can be a device with an operating system other than the MAC system, such as a Windows system device or an Android system device. The cloud desktop is an APP developed for the MAC operating system and runs on the MAC server. The user end can connect to the MAC cloud server through the corresponding client and trigger the game icon you want to play on the cloud desktop. The cloud desktop APP will communicate with the streaming service of the MAC cloud server, and send the process ID of the cloud game triggered by the user to the streaming service. The streaming service determines the corresponding window based on the process ID, and takes a screenshot to obtain the cloud game data under the window, and then sends it to the user end. In this way, users can play cloud games running on the MAC cloud server on the user end.

[0037] In addition, the streaming service will also create a remote control subprocess, which uses the VNC (Virtual Network Console) underlying protocol RFB provided by the MAC cloud server to communicate with the VNC service, and creates a long connection locally to the VNC service of the MAC to avoid occupying the network card bandwidth. Then, the desktop data sent by the VNC service is read on the network card looped back inside the MAC cloud server (not shown in the figure), and the desktop data is discarded, that is, no processing is performed on the desktop data. At the same time, the remote control subprocess also intermittently detects the connection status of the long connection through heartbeat detection to ensure the stability of the connection and avoid cloud games from freezing again due to disconnection.

[0038] The technical solution of the disclosed embodiment utilizes the VNC service provided by MAC itself to perform remote desktop control on the MAC cloud. After the remote control subprocess is created, it is connected to the VNC service through the remote control subprocess, which is equivalent to the MAC cloud server being always in an activated state. It only needs to not process the desktop data sent by the VNC service to achieve more accurate activation of the MAC server desktop, thereby solving the lag problem after the cloud game is idle at a lower cost and without consuming too many system resources.

[0039] Figure 3 This is a schematic diagram of a device for preventing cloud game lag according to an embodiment of the present disclosure. This embodiment can be applied to the situation where a cloud game is lag-free after a user hangs up the cloud game. In the field of cloud computing technology, it particularly relates to cloud games and cloud phone technology. The device can implement the method for preventing cloud game lag-free described in any embodiment of the present disclosure. Figure 3 As shown, the device 300 is configured on a cloud server, and a cloud game is run on the cloud server. The device 300 specifically includes:

[0040] A creation module 310, used to create a remote control subprocess, wherein the remote control subprocess is used to connect to the remote control service of the cloud server;

[0041] The acquisition module 320 is used to acquire the desktop data of the cloud server from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

[0042] Optionally, the creation module 310 is specifically used for:

[0043] The remote control sub-process is created by a streaming service running on the cloud server, wherein the streaming service is used to push the game screen data of the cloud game to the user end.

[0044] Optionally, the device further comprises:

[0045] The monitoring module is used to obtain and monitor the running status of the remote control subprocess through the streaming service.

[0046] Optionally, the remote control subprocess is further used to establish a persistent connection with the remote control service, and to periodically detect the connection status of the persistent connection by means of heartbeat detection.

[0047] Optionally, the acquisition module 320 is specifically used for:

[0048] The desktop data of the cloud server is read on the loopback network card of the cloud server through the remote control subprocess, wherein the desktop data of the cloud server is sent to the loopback network card by the remote control service.

[0049] Optionally, the cloud game is in an idle state.

[0050] The above-mentioned product can execute the method provided by any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0051] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0052] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0053] Figure 4 A schematic block diagram of an example electronic device 400 that can be used to implement an embodiment of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0054] like Figure 4 As shown, the device 400 includes a computing unit 401, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 402 or a computer program loaded from a storage unit 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the device 400 can also be stored. The computing unit 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0055] A number of components in the device 400 are connected to the I / O interface 405, including: an input unit 406, such as a keyboard, a mouse, etc.; an output unit 407, such as various types of displays, speakers, etc.; a storage unit 408, such as a disk, an optical disk, etc.; and a communication unit 409, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 409 allows the device 400 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0056] The computing unit 401 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 401 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 401 performs the various methods and processes described above, such as a method for preventing cloud game jams. For example, in some embodiments, the method for preventing cloud game jams may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 408. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 400 via ROM 402 and / or communication unit 409. When the computer program is loaded into RAM 403 and executed by the computing unit 401, one or more steps of the method for preventing cloud game jams described above may be performed. Alternatively, in other embodiments, the computing unit 401 may be configured to perform a method for preventing cloud game jams in any other appropriate manner (e.g., by means of firmware).

[0057] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0058] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0059] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0060] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0061] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0062] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services. The server may also be a server of a distributed system, or a server combined with a blockchain.

[0063] Artificial intelligence is a discipline that studies how to use computers to simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.). It includes both hardware-level and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, machine learning / deep learning technology, big data processing technology, knowledge graph technology, and other major directions.

[0064] Cloud computing refers to a technology system that uses network access to elastically scalable shared physical or virtual resource pools. Resources can include servers, operating systems, networks, software, applications, and storage devices, and can be deployed and managed on demand and in a self-service manner. Cloud computing technology can provide efficient and powerful data processing capabilities for technical applications such as artificial intelligence and blockchain, as well as model training.

[0065] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions provided by this disclosure can be achieved, and this document does not limit this.

[0066] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A method for preventing cloud games from freezing, applied to a cloud server on which a cloud game is run, the method comprising: Creating a remote control subprocess, wherein the remote control subprocess is used to connect to the remote control service of the cloud server; The desktop data of the cloud server is obtained from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

2. The method according to claim 1, wherein: The step of creating a remote control subprocess includes: The remote control sub-process is created by a streaming service running on the cloud server, wherein the streaming service is used to push the game screen data of the cloud game to the user end.

3. The method according to claim 2, further comprising: The running status of the remote control subprocess is obtained and monitored through the streaming service.

4. The method according to claim 1, wherein: The remote control subprocess is also used to establish a persistent connection with the remote control service, and to periodically detect the connection status of the persistent connection by means of a heartbeat detection method.

5. The method according to claim 1, wherein: The obtaining desktop data of the cloud server from the remote control service through the remote control subprocess includes: The desktop data of the cloud server is read on the loopback network card of the cloud server through the remote control subprocess, wherein the desktop data of the cloud server is sent to the loopback network card by the remote control service.

6. The method according to claim 1, wherein: The cloud game is in an idle state.

7. A device for preventing cloud games from freezing, configured on a cloud server, on which a cloud game is run, the device comprising: A creation module, used to create a remote control subprocess, wherein the remote control subprocess is used to connect to the remote control service of the cloud server; The acquisition module is used to acquire the desktop data of the cloud server from the remote control service through the remote control subprocess, wherein the remote control subprocess is also used to discard the desktop data.

8. The device according to claim 7, wherein: The creation module is specifically used for: The remote control sub-process is created by a streaming service running on the cloud server, wherein the streaming service is used to push the game screen data of the cloud game to the user end.

9. The apparatus according to claim 8, further comprising: The monitoring module is used to obtain and monitor the running status of the remote control subprocess through the streaming service.

10. The device according to claim 7, wherein: The remote control subprocess is also used to establish a persistent connection with the remote control service, and to periodically detect the connection status of the persistent connection by means of a heartbeat detection method.

11. The device according to claim 7, wherein: The acquisition module is specifically used for: The desktop data of the cloud server is read on the loopback network card of the cloud server through the remote control subprocess, wherein the desktop data of the cloud server is sent to the loopback network card by the remote control service.

12. The device according to claim 7, wherein: The cloud game is in an idle state.

13. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method for preventing cloud game lag as described in any one of claims 1-6.

14. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause a computer to execute a method for preventing cloud gaming lag according to any one of claims 1-6.

15. A computer program product, comprising a computer program, which, when executed by a processor, implements the method for preventing cloud game lag according to any one of claims 1-6.

Images