Method and device for solving picture tearing in cloud game scenario based on adaptive synchronization technology

Abstract

The application provides a solution and device for tearing of a cloud game scene picture based on adaptive synchronization technology. The solution comprises: establishing a virtual display and adding a compatible layer of a preset authentication technology to the driving of the virtual display; when cloud gaming is performed, a graphics card of a cloud host transmits a rendered picture to the virtual display, and simultaneously dynamically adjusts a refresh rate of the virtual display through a protocol of the preset authentication technology; a cloud game coding program receives original video data and frame rate information of the virtual display, encodes a video according to the frame rate information at a dynamic frame rate VFR, and sends the encoded video stream to a client; a graphics card of the client and a physical display open a function of the preset authentication technology, decode the video after receiving the video stream, and directly output the decoded video to the display. The disclosure can achieve better elimination of picture tearing by using the virtual display technology to compatibly implement the G-Sync / FreeSync adaptive synchronization technology with better effects.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of cloud gaming and audio and video technology, and in particular to a solution and device for solving cloud gaming scene picture tearing based on adaptive synchronization technology. BACKGROUND

[0002] In today's digital wave, cloud computing has become a cornerstone in the IT industry. Cloud gaming, as a new highlight in this field, is changing the game experience by shifting the game rendering task from the player's personal device to a centralized rendering server. However, current high-frame-rate cloud gaming faces a difficult problem, which is cloud gaming picture tearing. Game picture tearing has been a thorny problem since the birth of games. In traditional local games, this problem occurs because of the asynchronization between the refresh rate of the display and the frame rate of the GPU generating images. If the display is refreshing a new image while the GPU is generating the next frame, the two parts of the display will obtain different frames, causing picture tearing.

[0003] To solve this problem, the common method is to enable vertical synchronization (V-Sync) technology, which synchronizes the display's static refresh rate by reducing the GPU output frame rate, thereby reducing or eliminating tearing. However, vertical synchronization causes input delay and significantly reduces the frame rate when the GPU output frame rate is lower than the display's static refresh rate (vertical synchronization limits the GPU frame rate to half of the display frame rate when the GPU frame rate does not reach the display frame rate), affecting game performance. Therefore, in some cases, players may turn off vertical synchronization to ensure game performance.

[0004] In response to the shortcomings of vertical synchronization, GPU companies Nvidia and AMD have introduced G-Sync and FreeSync technology, which dynamically adjusts the display's refresh frequency to synchronize the GPU frame rate. This technology can effectively solve the picture tearing problem while ensuring game smoothness and low latency when the GPU frame rate is between the lower limit frame rate (G-SYNC supports ultra-low lower limit 4-10hz, G-Sync Compatible (compatible version of G-Sync) and FreeSync mostly 42HZ) and the highest refresh rate of the display, but this technology requires display compatibility.

[0005] Vertical synchronization and G-Sync, FreeSync and other technologies are all to solve the problem of local game picture tearing. Cloud game is generally divided into the following steps: cloud video card output picture -> picture collection and encoding -> network transmission -> client receiving and decoding -> output to local display. Currently, cloud game mainly uses WGC / DXGI technology and video card trickster to realize picture collection (cannot be compatible with G-Sync and FreeSync), so the general anti-tearing solution of cloud game is still to use vertical synchronization technology in [cloud video card output picture -> picture collection and encoding] and [client receiving and decoding -> output to local display] stages. The better G-Sync / FreeSync technology can only be used in the client decoding stage.

[0006] In summary, the current mainstream anti-picture tearing method has the following problems:

[0007] 1) Using vertical synchronization technology to eliminate picture tearing in the traditional cloud game scene will cause the problem of delay rising and game performance decline;

[0008] 2) G-Sync and FreeSync technology can solve the problem of delay rising and game performance decline caused by vertical synchronization to a certain extent, but it can only be used in the cloud game [local receiving and decoding -> output to local display] link by default, and cannot solve the picture tearing problem in the WGC / DXGI collection stage. SUMMARY

[0009] The present application shows a solution method and device for cloud game scene picture tearing based on adaptive synchronization technology.

[0010] In a first aspect, the present application shows a solution method for cloud game scene picture tearing based on adaptive synchronization technology, which comprises:

[0011] Establish a virtual display, and add a compatible layer of a preset authentication technology to the driver of the virtual display;

[0012] When cloud gaming, the cloud host's video card transmits the rendered picture to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, encodes the video according to the frame rate information with a dynamic frame rate VFR, and sends the encoded video stream to the client;

[0013] The client video card and the physical display open the function of the preset authentication technology, and after receiving the video stream, the video is decoded and output to the display.

[0014] In an exemplary embodiment of the present disclosure, the method further comprises:

[0015] The preset authentication technology at least includes NVIDIA tested and authenticated G-Sync compatible and AMD tested and authenticated FreeSync.

[0016] In an exemplary embodiment of the present disclosure, the method further comprises:

[0017] The virtual display is used to directly receive the picture output by the graphics card and transfer it to the encoding module.

[0018] In an exemplary embodiment of the present disclosure, the method further comprises:

[0019] The cloud host mounts the virtual display, and the cloud graphics card driver opens the G-Sync compatible or FreeSync function.

[0020] In an exemplary embodiment of the present disclosure, the method further comprises:

[0021] The original video data and frame rate information of the virtual display received by the cloud game encoding program are provided by the G-Sync compatible or FreeSync protocol.

[0022] In an exemplary embodiment of the present disclosure, the method further comprises:

[0023] The frame rate lower than the lower limit value of the G-Sync compatible or FreeSync technology is repeatedly sampled to make it effective on the client side G-Sync compatible or FreeSync during encoding.

[0024] In a second aspect, the present application shows a device for solving the tearing of the cloud game scene picture based on the adaptive synchronization technology, the device comprises:

[0025] A virtual display establishing module is configured to establish a virtual display, and add a compatible layer of a preset authentication technology to the driver of the virtual display;

[0026] A dynamic frame rate encoding module is configured to, when cloud gaming, transmit the rendered picture to the virtual display by the cloud host graphics card, dynamically adjust the refresh rate of the virtual display through the protocol of the preset authentication technology, receive the original video data and frame rate information of the virtual display by the cloud game encoding program, encode the video according to the frame rate information with a dynamic frame rate VFR, and send the encoded video stream to the client;

[0027] The video decoding and playing module is configured to enable a preset authentication technology for a client graphics card and a physical display, decode the video after receiving the video stream, and output the decoded video to the display directly.

[0028] In a third aspect, the present application shows an electronic device, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the method of any one of the above aspects.

[0029] In a fourth aspect, the present application shows a non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of an electronic device, the electronic device can execute the method of any one of the above aspects.

[0030] In a fifth aspect, the present application shows a computer program product, when the instructions in the computer program product are executed by the processor of an electronic device, the electronic device can execute the method of any one of the above aspects.

[0031] The method of the technical solution provided by the present application comprises: establishing a virtual display, and adding a compatible layer of a preset authentication technology to the driving of the virtual display; when cloud gaming is performed, a graphics card of a cloud host transmits a rendered picture to the virtual display, and simultaneously dynamically adjusts a refresh rate of the virtual display through a protocol of the preset authentication technology; a cloud gaming encoding program receives original video data and frame rate information of the virtual display, encodes the video according to the frame rate information at a dynamic frame rate VFR, and sends the encoded video stream to a client; a client graphics card and a physical display enable a function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video to a display directly. The present disclosure can realize better elimination of picture tearing effect through the virtual display technology and the better G-Sync / FreeSync adaptive synchronization technology. BRIEF DESCRIPTION OF DRAWINGS

[0032] Figure 1 is a step flow chart of a solution method for picture tearing in a cloud gaming scene based on adaptive synchronization technology according to the present application.

[0033] Figure 2 is a schematic diagram of a conventional cloud gaming picture tearing elimination method (only vertical synchronization) according to the present application.

[0034] Figure 3 is a schematic diagram of a picture tearing elimination method (three video stream synchronization frame rates) of a solution method for picture tearing in a cloud gaming scene based on adaptive synchronization technology according to the present application.

[0035] Figure 4Is a flowchart of a solution method for tearing of a cloud game scene picture based on adaptive synchronization technology according to the present application.

[0036] Figure 5 Is a structural block diagram of a solution device for tearing of a cloud game scene picture based on adaptive synchronization technology according to the present application.

[0037] Figure 6 Is a block diagram of an electronic device according to the present application.

[0038] Figure 7 Is a block diagram of a computer readable storage medium according to the present application. DETAILED DESCRIPTION

[0039] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of protection of the present application.

[0040] The solution method for tearing of a cloud game scene picture based on adaptive synchronization technology of the present disclosure comprises:

[0041] Step S110, a virtual display is established, and a compatible layer of a preset authentication technology is added to the driver of the virtual display;

[0042] Step S120, when cloud gaming is performed, a graphics card of a cloud host transmits a rendered picture to the virtual display, and simultaneously adjusts a refresh rate of the virtual display dynamically through a protocol of the preset authentication technology, a cloud game encoding program receives original video data and frame rate information of the virtual display, the encoding program encodes a video according to the frame rate information with a dynamic frame rate VFR, and sends the encoded video stream to a client;

[0043] Step S130, a client graphics card and a physical display open a function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display.

[0044] The method of the technical scheme provided in the application comprises: establishing a virtual display, and adding a compatible layer of a preset authentication technology in the driver of the virtual display; when cloud gaming is performed, a graphics card of a cloud host transmits a rendered picture to the virtual display, and simultaneously dynamically adjusts a refresh rate of the virtual display through a protocol of the preset authentication technology, a cloud gaming coding program receives original video data and frame rate information of the virtual display, the coding program performs video coding in a dynamic frame rate VFR according to the frame rate information, and sends the coded video stream to a client; a graphics card of the client and a physical display open a function of the preset authentication technology, and after receiving the video stream, the video is decoded, and the decoded video is directly output to the display. The disclosure can realize better elimination of picture tearing effect through the virtual display technology and the G-Sync / FreeSync adaptive synchronization technology with better compatibility.

[0045] Embodiment one:

[0046] G-Sync / FreeSync technology: is a display refresh rate adaptive synchronization technology developed by Nvidia / AMD, G-Sync Compatible is a compatible version of G-Sync, and the principle is the same and the effect is similar

[0047] Game picture tearing (Screen tearing): is a kind of image display problem that may occur in electronic games. It usually occurs in the case of fast moving scenes or asynchronous frame rate. This problem will cause the mismatch between two adjacent frames on the screen, so that the image seems to be "torn" into two parts, the upper half and the lower half are not completely synchronized

[0048] DXGI (Directx Graphics Infrastructure) / WGC (Window Graphics Capturer) technology: two implementation schemes that can be used for cloud game picture acquisition

[0049] Referring to Figure 1 , a step flowchart of a method for solving picture tearing in a cloud game scene based on adaptive synchronization technology is shown, which can be applied to an electronic device, wherein the method can specifically comprise the following steps:

[0050] In step S110, a virtual display can be established, and a compatible layer of a preset authentication technology can be added in the driver of the virtual display.

[0051] In the embodiment of the present example, the method further comprises:

[0052] The preset authentication technology includes but is not limited to NVIDIA tested and certified G-Sync compatible, AMD tested and certified FreeSync.

[0053] In step S120, when cloud gaming, the cloud host's graphics card transmits the rendered picture to the virtual display, and simultaneously dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, encodes the video according to the frame rate information at a dynamic frame rate VFR, and sends the encoded video stream to the client.

[0054] In an embodiment of the present example, the method further comprises:

[0055] The virtual display is used to directly receive the picture output by the graphics card and transmit it to the encoding module.

[0056] In an embodiment of the present example, the method further comprises:

[0057] The cloud host mounts the virtual display, and enables the G-Sync compatible or FreeSync function of the cloud graphics card driver.

[0058] In an embodiment of the present example, the method further comprises:

[0059] The original video data and frame rate information of the virtual display received by the cloud game encoding program are provided by the G-Sync compatible or FreeSync protocol.

[0060] In step S130, the client's graphics card and the physical display can enable the function of the preset authentication technology, and after receiving the video stream, the video is decoded and the decoded video is directly output to the display.

[0061] In an embodiment of the present example, the method further comprises:

[0062] When encoding, the frame rate lower than the lower limit value of the G-Sync compatible or FreeSync technology needs to be repeatedly sampled to make it effective on the client side G-Sync compatible or FreeSync.

[0063] In an embodiment of the present example, compared with the vertical synchronization technology used in the traditional cloud game solution, the method can realize better elimination of picture tearing effect through the virtual display technology compatible with the better G-Sync / FreeSync adaptive synchronization technology.

[0064] Compared with the vertical synchronization technology used in the traditional cloud game solution, the present method does not cause the problem of rising input delay.

[0065] Compared with the vertical synchronization technology adopted by the traditional cloud game solution, the method does not cause the problem of game performance decline.

[0066] Embodiment two:

[0067] In the embodiment of the present example, the purpose of the present disclosure is to find a solution to the tearing of the cloud game scene picture based on adaptive synchronization technology, as shown in Figure 2 The three video streams (video stream output by the graphics card, encoded video stream, and decoded video stream) are simultaneously synchronized in frame rate for cloud game [cloud end graphics card output picture -> collect picture and encode] and [local receive and decode -> output to local display], and the picture tearing is eliminated.

[0068] In the embodiment of the present example, as shown in Figure 3 The solution to the tearing of the cloud game scene picture based on adaptive synchronization technology proposed by the present application is to synchronize the frame rate of the three video streams through the frame rate synchronization technology, the virtual display technology, and the existing G-Sync and Free-Sync adaptive synchronization technology to eliminate the problem of cloud game picture tearing.

[0069] As shown in Figure 4 The specific steps include:

[0070] 1) Develop a virtual display (vMonitor), and the driver of the virtual display adds a G-Sync compatible and FreeSync compatible layer. The cloud host mounts the virtual display, and the cloud end graphics card driver opens the G-Sync compatible or FreeSync function. The virtual display functions to replace the original DXGI or WGC technology for picture collection, and directly receives the picture output by the graphics card and transfers it to the encoding module.

[0071] 2) When cloud gaming, the cloud host's graphics card transmits the rendered picture to the virtual display, and simultaneously adjusts the refresh rate of the virtual display through the G-Sync / FreeSync protocol. The cloud game encoding program receives the original video data and frame rate information (provided by the G-Sync / FreeSync protocol) of the virtual display, encodes the video according to the frame rate information with a dynamic frame rate (VFR), and repeats the sampling of the frame rate (generally lower than 42FPS) below the lower limit value of the G-Sync / FreeSync technology to make it effective on the client side. Finally, the encoded video stream is sent to the client.

[0072] The client graphics card and the physical display also enable the G-Sync / FreeSync function, and after receiving the video stream, the video is decoded, and the decoded video is directly output to the display.

[0073] Embodiment three:

[0074] In the embodiment of the present example, since the prior art anti-tearing method has the following problems respectively: the use of vertical synchronization technology in the traditional cloud game scene will cause the problem of increased delay and decreased game performance; the G-Sync and FreeSync technologies can solve the problem of increased delay and decreased game performance caused by vertical synchronization to a certain extent, but by default, they can only be used in the cloud game [locally received and decoded -> output to the local display] link, and cannot solve the problem of tearing in the WGC / DXGI capture stage.

[0075] In the embodiment of the present example, it is assumed that the cloud game preset FPS is 144, the cloud end mounts a virtual display and synchronizes with the graphics card through G-Sync / FreeSync, when the graphics card outputs a picture at 100 FPS, the graphics card will dynamically adjust the frame rate of the virtual display to 100 FPS for synchronization reception, if the traditional cloud game solution, the graphics card outputs 100 FPS frame rate to the preset 144 FPS graphics card deceiver, and then the WGC / DXGI capture will cause tearing.

[0076] In the embodiment of the present example, when the 100 FPS video stream is transmitted to the capture and encoding module, the graphics card is called for dynamic frame rate encoding, and since it is dynamic frame rate encoding, tearing will not occur when the frame rate changes.

[0077] In the embodiment of the present example, the 100 FPS picture is transmitted to the client, the client calls the graphics card for decoding, and the output picture is also synchronized with the local display for G-Sync / FreeSync synchronization to adjust the display to 100 FPS to eliminate tearing.

[0078] In the embodiment of the present example, the present disclosure realizes frame rate synchronization in the capture stage to eliminate tearing by means of a virtual display built-in G-Sync / FreeSync compatible layer, and does not use WGC, DXGI technology, but directly outputs the video stream to the encoding module for encoding.

[0079] It should be noted that for the method embodiments, in order to simply describe, they are all described as a series of action combinations, but those skilled in the art should know that the present application is not limited to the action order described, because according to the present application, certain steps can be performed in other order or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification are all optional embodiments, and the actions involved are not necessarily required by the present application.

[0080] Referring to Figure 5 , a structure block diagram of a device for solving the picture tearing of a cloud game scene based on an adaptive synchronization technology is shown, the device comprises a virtual display establishing module 210, a dynamic frame rate encoding module 220, and a video decoding and playing module 230, wherein:

[0081] The virtual display establishing module 210 is configured to establish a virtual display and add a compatible layer of a preset authentication technology to the driving of the virtual display.

[0082] The dynamic frame rate encoding module 220 is configured to, when cloud gaming, transmit a rendered picture by a graphics card of a cloud host to the virtual display, dynamically adjust a refresh rate of the virtual display through a protocol of the preset authentication technology, receive original video data and frame rate information of the virtual display by a cloud game encoding program, encode a video according to the frame rate information with a dynamic frame rate VFR, and send the encoded video stream to a client.

[0083] The video decoding and playing module 230 is configured to, when a graphics card of the client and a physical display open a function of the preset authentication technology, decode a video after receiving the video stream, and directly output the decoded video to the display.

[0084] For the device embodiment, it is basically similar to the method embodiment, so the description is relatively simple, and the related parts refer to the part of the method embodiment.

[0085] Optionally, the embodiment of the application further provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program is executed by the processor to implement each process of the method embodiment and achieve the same technical effect, and details are not repeated here.

[0086] The embodiment of the application further provides a computer readable storage medium, and the computer readable storage medium stores a computer program, wherein the computer program is executed by a processor to implement each process of the method embodiment and achieve the same technical effect, and details are not repeated here. The computer readable storage medium includes a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0087] Figure 6is a block diagram of an electronic device 800 shown in the present application. For example, the electronic device 800 can be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0088] Referring to Figure 6 The electronic device 800 can include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0089] The processing component 802 usually controls overall operations of the electronic device 800, such as operations associated with displaying, making phone calls, data communications, camera operations, and recording operations. The processing component 802 can include one or more processors 820 to execute instructions to complete all or part of steps of the above methods. In addition, the processing component 802 can include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0090] The memory 804 is configured to store various types of data to support operations of the electronic device 800. Examples of these data include instructions for any application or method operating on the electronic device 800, contact data, phonebook data, messages, images, videos, and the like. The memory 804 can be implemented by any type of volatile or non-volatile storage devices or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0091] The power supply component 806 provides power for the various components of the electronic device 800. The power supply component 806 can include a power supply management system, one or more power supplies, and other components associated with generating, managing and distributing power for the electronic device 800.

[0092] The multimedia component 808 includes a screen to provide an output interface between the electronic device 800 and a user. In some embodiments, the screen can include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense a touch, a slide, and a gesture on the touch panel. The touch sensor can not only sense a boundary of a touching or a sliding action, but also detect duration and pressure related to the touching or sliding action. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. The front camera and / or the rear camera can receive external multimedia data when the electronic device 800 is in an operating mode, such as a shooting mode or a video mode. Each of the front and rear camera can be a fixed optical lens system or have a focal length and optical zooming capability.

[0093] The audio component 810 is configured to output and / or input an audio signal. For example, the audio component 810 includes a microphone (MIC) to receive an external audio signal when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker to output an audio signal.

[0094] The I / O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which can be a keypad, a click wheel, buttons, and the like. The buttons can include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0095] The sensor component 814 includes one or more sensors to provide various state assessments for the electronic device 800. For example, the sensor component 814 can detect an open / closed state of the device 800, relative positioning of components, such as a display and a keypad of the electronic device 800, a change in position of the electronic device 800 or a component of the electronic device 800, presence or absence of user contact with the electronic device 800, a direction or acceleration / deceleration of the electronic device 800, and a change in temperature of the electronic device 800. The sensor component 814 can include a proximity sensor to detect presence of an object in proximity to the electronic device 800 without any physical contact. The sensor component 814 can also include a light sensor, such as a CMOS or CCD image sensor, to use in an imaging application. In some embodiments, the sensor component 814 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0096] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, a cellular network (e.g., 2G, 3G, 4G or 5G), or a combination thereof. In an example embodiment, the communication component 816 receives broadcast signals or broadcast operation information from an external broadcast management system via a broadcast channel. In an example embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) techniques, infrared data association (IrDA) techniques, ultra-wideband (UWB) techniques, Bluetooth (BT) techniques and other techniques.

[0097] In an example embodiment, the electronic device 800 can be implemented with one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic elements, for performing the above-described methods.

[0098] In an example embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, is also provided, which can be executed by the processor 820 of the electronic device 800 to complete the above-described methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage device, etc.

[0099] Figure 7 is a block diagram of a computer-readable storage medium 1900 shown in the present application. For example, the computer-readable storage medium 1900 can be provided as a server.

[0100] Referring to Figure 7 The computer-readable storage medium 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932, for storing instructions executable by the processing component 1922, such as an application program. The application program stored in the memory 1932 can include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute the instructions to perform the above-described methods.

[0101] The computer-readable storage medium 1900 can also include a power supply component 1926 configured to perform power management for the computer-readable storage medium 1900, a wired or wireless network interface 1950 configured to connect the computer-readable storage medium 1900 to a network, and an input / output (I / O) interface 1958. The computer-readable storage medium 1900 can operate based on an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or the like.

[0102] It should be noted that, in the present document, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can also include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element preceded by "comprises... a" does not, without more constraints, foreclose the existence of additional identical elements in the process, method, article, or apparatus that comprises the element.

[0103] Those skilled in the art can clearly understand from the above description of the embodiments that the above-mentioned embodiment methods can be realized by means of software and necessary general hardware platforms, of course, they can also be realized by hardware, but in many cases the former is a better embodiment. Based on such understanding, the technical solutions of the present application can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, or optical disc) and includes a plurality of instructions for causing a terminal (which can be a mobile phone, computer, server, air conditioner, or network device) to execute the methods described in the various embodiments of the present application.

[0104] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-described specific embodiments, which are merely illustrative rather than limiting, and those of ordinary skill in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope of protection of the claims.

[0105] Those skilled in the art can clearly understand the unit and algorithm steps of each example described in combination with the embodiments disclosed in the present application can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software manner depends on the specific application and design constraints of the technical solution. The skilled person can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0106] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0107] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0108] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the present embodiment.

[0109] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit.

[0110] If the functions are implemented in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a ROM, a RAM, a magnetic disk or an optical disk, etc.

[0111] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology, characterized in that, The method includes: A virtual display is created, and a compatibility layer with a preset authentication technology is added to the driver of the virtual display; When playing cloud games, the graphics card of the cloud host transmits the rendered image to the virtual display. At the same time, the refresh rate of the virtual display is dynamically adjusted through the protocol of the preset authentication technology. The cloud game encoding program receives the raw video data and frame rate information of the virtual display. The encoding program encodes the video at a dynamic frame rate (VFR) according to the frame rate information and sends the encoded video stream to the client. The client's graphics card and physical display enable the preset authentication technology. After receiving the video stream, the video is decoded and the decoded video is directly output to the display. The preset certification technologies include at least NVIDIA-tested and certified G-Sync compatible and AMD-tested and certified FreeSync; The raw video data and frame rate information of the virtual display received by the cloud gaming encoding program are provided by the G-Sync compatible or FreeSync protocol.

2. The method as described in claim 1, characterized in that, The method further includes: The virtual display is used to directly receive the image output by the graphics card and transfer it to the encoding module.

3. The method as described in claim 1, characterized in that, The method further includes: The cloud host mounts the virtual display and enables G-Sync compatible or FreeSync functionality in the cloud graphics card driver.

4. The method as described in claim 1, characterized in that, The method further includes: During encoding, frame rates below the lower limit of G-Sync compatible or FreeSync technology are resampled to enable G-Sync compatible or FreeSync on the client side.

5. A device for solving screen tearing in cloud gaming scenes based on adaptive synchronization technology, characterized in that, The device includes: A virtual display creation module is used to create a virtual display and add a compatibility layer of preset authentication technology to the driver of the virtual display; The dynamic frame rate encoding module is used when cloud gaming is performed. The graphics card of the cloud host transmits the rendered screen to the virtual display. At the same time, it dynamically adjusts the refresh rate of the virtual display through a protocol with preset authentication technology. The cloud gaming encoding program receives the raw video data and frame rate information of the virtual display. The encoding program encodes the video at the dynamic frame rate (VFR) according to the frame rate information and sends the encoded video stream to the client. The video decoding and playback module is used to enable the preset authentication technology for the client's graphics card and physical display. After receiving the video stream, it decodes the video and outputs the decoded video directly to the display. The preset certification technologies include at least NVIDIA-tested and certified G-Sync compatible and AMD-tested and certified FreeSync; The raw video data and frame rate information of the virtual display received by the cloud gaming encoding program are provided by the G-Sync compatible or FreeSync protocol.

6. An electronic device, characterized in that, include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the method as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1 to 4.

Images