Method and device for solving cloud game scene picture tearing based on adaptive synchronization technology

Abstract

The invention provides a cloud game scene picture tearing solution method and device based on an adaptive synchronization technology. The method comprises the following steps: establishing a virtual display, and adding a compatible layer of a preset authentication technology into a driver of the virtual display; when a cloud game is carried out, a graphics card of the cloud host transmits a rendered picture to the virtual display, meanwhile, the refresh rate of the virtual display is dynamically adjusted through a protocol of a preset authentication technology, and a cloud game coding program receives original video data and frame rate information of the virtual display; the coding program carries out video coding at a dynamic frame rate VFR according to the frame rate information, and sends a coded video stream to the client; and starting a function of a preset authentication technology by the client display card and the entity display, decoding the video after receiving the video stream, and directly outputting the decoded video to the display. Through the virtual display technology, the method can be compatible with the G-Sync / FreeSync adaptive synchronization technology with a better effect, and achieves a better effect of eliminating picture tearing.

Description

Technical Field

[0001] The present application relates to the field of cloud gaming and audio and video technology, and in particular to a solution and device for image tearing in cloud gaming scenes based on adaptive synchronization technology. Background Art

[0002] In today's digital wave, cloud computing has become the mainstay of the IT industry. As a new highlight in this field, cloud gaming is beginning to change the gaming experience by transferring the task of game rendering from players' personal devices to centralized rendering servers. However, cloud games with high frame rates are currently facing a problem, that is, cloud game screen tearing. Game screen tearing has been a thorny problem since the birth of games. In traditional local games, this problem occurs because of the lack of synchronization between the refresh rate of the monitor and the frame rate at which the graphics card (GPU) generates images. If the monitor is refreshing a new image and the GPU is generating the next frame, the upper and lower parts of the monitor will obtain images of different frames, resulting in screen tearing.

[0003] To solve this problem, a common method is to enable vertical synchronization (V-Sync) technology, which reduces or eliminates tearing by reducing the graphics card output frame rate to synchronize the static refresh rate of the monitor. However, vertical synchronization will cause input delay, and when the graphics card output frame rate is lower than the static refresh rate of the monitor, the frame rate will drop significantly (when the graphics card frame rate cannot reach the monitor frame rate, vertical synchronization will limit the graphics card frame rate to half of the monitor frame rate), affecting game performance. Therefore, in some cases, players may turn off vertical synchronization to ensure game performance.

[0004] In response to the shortcomings of vertical synchronization, graphics card companies NVIDIA and AMD have respectively launched G-Sync and FreeSync technologies, which synchronize the graphics card frame rate by dynamically adjusting the refresh rate of the monitor. This technology can effectively solve the problem of screen tearing while ensuring game smoothness and low latency when the graphics card frame rate is between the lower limit frame rate (G-SYNC supports an ultra-low limit of 4-10hz, G-Sync Compatible (compatible version of G-Sync) and FreeSync are mostly 42HZ) and the maximum refresh rate of the monitor. However, this technology requires monitor compatibility.

[0005] Vertical synchronization and technologies such as G-Sync and FreeSync are all designed to solve the problem of screen tearing in local games. Cloud gaming is generally divided into the following steps: cloud graphics card outputs the screen -> captures the screen and encodes it -> transmits it over the network -> receives and decodes it on the client -> outputs it to the local display. Currently, cloud gaming mainly uses WGC / DXGI technology and graphics card spoofers to achieve screen capture (not compatible with G-Sync and FreeSync), so the common anti-tearing solution for cloud gaming is to use vertical synchronization technology in the [cloud graphics card outputs the screen -> captures the screen and encodes it] and [client receives and decodes -> outputs it to the local display] stages. The better performing G-Sync / FreeSync technology can only be used in the client decoding stage.

[0006] In summary, the current mainstream methods for preventing screen tearing have the following problems:

[0007] 1) Traditional cloud gaming scenarios use vertical synchronization technology to eliminate screen tearing, which can lead to increased latency and reduced game performance;

[0008] 2) G-Sync and FreeSync technologies can solve the problems of increased latency and decreased gaming performance caused by vertical synchronization to a certain extent, but by default they can only be used in the cloud gaming [local reception and decoding -> output to the local display] phase, and cannot solve the screen tearing problem in the WGC / DXGI acquisition phase. Summary of the invention

[0009] The present application shows a solution and device for solving screen tearing in cloud gaming scenes based on adaptive synchronization technology.

[0010] In the first aspect, the present application shows a solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology, the method comprising:

[0011] Establishing a virtual display, and adding a compatibility layer of a preset authentication technology to a driver of the virtual display;

[0012] When playing cloud games, the graphics card of the cloud host transmits the rendered images to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program encodes the video at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client;

[0013] The client graphics card and the physical display enable the function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display.

[0014] In an exemplary embodiment of the present disclosure, the method further includes:

[0015] The preset certification technologies include at least G-Sync compatible tested and certified by NVIDIA and FreeSync tested and certified by AMD.

[0016] In an exemplary embodiment of the present disclosure, the method further includes:

[0017] The virtual display is used to directly receive the picture output by the graphics card and transfer it to the encoding module.

[0018] In an exemplary embodiment of the present disclosure, the method further includes:

[0019] The virtual display can implement graphics-based DXGI or G-Sync compatible or FreeSync technology, and can eliminate screen tearing in the acquisition stage when receiving the output image of the graphics card.

[0020] In an exemplary embodiment of the present disclosure, the method further includes:

[0021] The cloud host mounts the virtual display and enables the G-Sync compatible or FreeSync function in the cloud graphics card driver.

[0022] In an exemplary embodiment of the present disclosure, the method further includes:

[0023] The original video data and frame rate information of the virtual display received by the cloud gaming encoding program are provided by the G-Synccompatible or FreeSync protocol.

[0024] In an exemplary embodiment of the present disclosure, the method further includes:

[0025] When encoding, frame rates below the lower limit of G-Sync compatible or FreeSync technology are oversampled to make them effective on the client side.

[0026] In the second aspect, the present application shows a device for solving screen tearing in cloud game scenes based on adaptive synchronization technology, the device comprising:

[0027] A virtual display creation module, used to create a virtual display and add a compatibility layer of a preset authentication technology to the driver of the virtual display;

[0028] Dynamic frame rate encoding module, used for cloud gaming, the graphics card of the cloud host transmits the rendered image to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program encodes the video at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client;

[0029] The video decoding and playback module is used to enable the preset authentication technology function of the client graphics card and the physical display. After receiving the video stream, the video is decoded and the decoded video is directly output to the display.

[0030] In a third aspect, the present application shows an electronic device, which includes: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the method described in any of the above aspects.

[0031] In a fourth aspect, the present application illustrates a non-temporary computer-readable storage medium, which, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute a method as described in any of the above aspects.

[0032] In a fifth aspect, the present application illustrates a computer program product. When instructions in the computer program product are executed by a processor of an electronic device, the electronic device is enabled to execute the method described in any of the above aspects.

[0033] The method of the technical solution provided by the present application includes: establishing a virtual display, and adding a compatibility layer of a preset authentication technology to the driver of the virtual display; when playing a cloud game, the graphics card of the cloud host transmits the rendered image to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology, and the cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program performs video encoding at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client; the client graphics card and the physical display enable the function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display. The present disclosure can achieve a better elimination of screen tearing effect through the virtual display technology that is compatible with the better G-Sync / FreeSync adaptive synchronization technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 This is a flowchart of the steps of a solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology in this application.

[0035] Figure 2 This is a schematic diagram of the traditional cloud gaming method for eliminating screen tearing (vertical synchronization only) of the present application.

[0036] Figure 3 This is a schematic diagram of a solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology in the present application, which is a method for eliminating screen tearing (synchronous frame rates of three video streams).

[0037] Figure 4 This is a flow logic diagram of a solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology in this application.

[0038] Figure 5 This is a structural block diagram of a device for solving screen tearing in cloud gaming scenes based on adaptive synchronization technology in the present application.

[0039] Figure 6 It is a block diagram of an electronic device of the present application.

[0040] Figure 7 It is a block diagram of a computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0041] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0042] The solution to the screen tearing of cloud game scenes based on the adaptive synchronization technology disclosed in the present invention includes:

[0043] Step S110, establishing a virtual display, and adding a compatibility layer of a preset authentication technology to the driver of the virtual display;

[0044] Step S120: When playing a cloud game, the graphics card of the cloud host transmits the rendered image to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program performs video encoding at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client;

[0045] Step S130, the client graphics card and the physical display enable the function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display.

[0046] The method of the technical solution provided by the present application includes: establishing a virtual display, and adding a compatibility layer of a preset authentication technology to the driver of the virtual display; when playing a cloud game, the graphics card of the cloud host transmits the rendered image to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology, and the cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program performs video encoding at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client; the client graphics card and the physical display enable the function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display. The present disclosure can achieve a better elimination of screen tearing effect through the virtual display technology that is compatible with the better G-Sync / FreeSync adaptive synchronization technology.

[0047] Embodiment 1:

[0048] G-Sync / FreeSync technology: It is a display refresh rate adaptive synchronization technology developed by Nvidia / AMD. G-Sync Compatible is a compatible version of G-Sync, with the same principle and similar effect.

[0049] Screen tearing: It is an image display problem that may occur in video games. It usually occurs in fast-moving scenes or when the frame rate is not synchronized. This problem causes a mismatch between two adjacent frames on the screen, making the image seem to be "torn" into two parts, with the upper and lower halves not completely synchronized.

[0050] DXGI (Directx Graphics Infrastructure) / WGC (Window Graphics Capturer) technology: two implementation solutions for cloud gaming screen capture

[0051] Reference Figure 1 , shows a flowchart of a solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology of the present application, the method can be applied to electronic devices, wherein the method can specifically include the following steps:

[0052] In step S110 , a virtual display may be established, and a compatibility layer of a preset authentication technology may be added to a driver of the virtual display.

[0053] In the embodiment of this example, the method further includes:

[0054] The preset certification technologies include but are not limited to G-Sync compatible tested and certified by NVIDIA and FreeSync tested and certified by AMD.

[0055] In step S120, when cloud gaming is ready, the graphics card of the cloud host transmits the rendered image to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud gaming encoding program receives the original video data and frame rate information of the virtual display, and the encoding program performs video encoding at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client.

[0056] In the embodiment of this example, the method further includes:

[0057] The virtual display is used to directly receive the picture output by the graphics card and transfer it to the encoding module.

[0058] In the embodiment of this example, the method further includes:

[0059] The virtual display can implement G-Sync compatible or FreeSync technology that cannot be achieved by the graphics base DXGI or the graphics capture WGC, and can eliminate the screen tearing in the acquisition stage when receiving the output image of the graphics card.

[0060] In the embodiment of this example, the method further includes:

[0061] The cloud host mounts the virtual display and enables the G-Sync compatible or FreeSync function in the cloud graphics card driver.

[0062] In the embodiment of this example, the method further includes:

[0063] The original video data and frame rate information of the virtual display received by the cloud gaming encoding program are provided by the G-Synccompatible or FreeSync protocol.

[0064] In step S130, the client graphics card and the physical display can enable the function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display.

[0065] In the embodiment of this example, the method further includes:

[0066] When encoding, frame rates below the lower limit of G-Sync compatible or FreeSync technology need to be repeatedly sampled to make G-Sync compatible or FreeSync effective on the client side.

[0067] In the embodiment of this example, compared with the vertical synchronization technology used in the traditional cloud gaming solution, this method can achieve a better effect of eliminating screen tearing by using the virtual display technology that is compatible with the better G-Sync / FreeSync adaptive synchronization technology;

[0068] Compared with the vertical synchronization technology used in traditional cloud gaming solutions, this method does not cause the problem of increased input delay;

[0069] Compared with the vertical synchronization technology used in traditional cloud gaming solutions, this method will not cause the problem of reduced game performance.

[0070] Embodiment 2:

[0071] In the embodiment of this example, the purpose of this disclosure is to find a solution to the tearing of cloud game scenes based on adaptive synchronization technology, such as Figure 2 As shown, for cloud gaming [cloud graphics card output screen -> capture screen and encode] and [local reception and decoding -> output to local display], three video streams (graphics card output video stream, encoded video stream, decoded video stream) are synchronized in frame rate at the same time to eliminate screen tearing.

[0072] In this exemplary embodiment, if Figure 3 As shown, the solution to the screen tearing in cloud gaming scenes based on adaptive synchronization technology proposed in the present invention is to achieve frame rate synchronization of three video streams through frame rate synchronization technology, virtual display technology, combined with existing G-Sync and Free-Sync adaptive synchronization technologies to eliminate the problem of screen tearing in cloud gaming.

[0073] like Figure 4 As shown, the specific steps include:

[0074] 1) Develop a virtual monitor (vMonitor), whose driver adds G-Sync compatible and FreeSync compatible layers. The cloud host mounts the virtual monitor and turns on the G-Sync compatible or FreeSync function in the cloud graphics card driver. The role of the virtual monitor is to replace the DXGI or WGC technology originally used for image acquisition, directly receive the image output by the graphics card and transfer it to the encoding module. The virtual monitor can implement G-Sync compatible or FreeSync technology that DXGI or WGC cannot achieve, and can eliminate image tearing during the acquisition stage when receiving the image output by the graphics card.

[0075] 2) When playing cloud games, the graphics card of the cloud host transmits the rendered images to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the G-Sync / FreeSync protocol. The cloud game encoding program receives the original video data and frame rate information of the virtual display (provided by the G-Sync / FreeSync protocol). The encoding program encodes the video at a dynamic frame rate (VFR) according to the frame rate information. When encoding, it is necessary to repeatedly sample the frame rate below the lower limit of the G-Sync / FreeSync technology (generally below 42FPS) to make it effective on the client side. Finally, the encoded video stream is sent to the client.

[0076] The client graphics card and physical display also have the G-Sync / FreeSync function turned on. After receiving the video stream, the video is decoded and the decoded video is directly output to the display.

[0077] Embodiment three:

[0078] In the embodiments of this example, the methods for preventing screen tearing in the prior art have the following problems: the traditional cloud gaming scene uses vertical synchronization technology to eliminate screen tearing, which will cause increased latency and reduced gaming performance; G-Sync and FreeSync technologies can solve the problems of increased latency and reduced gaming performance caused by vertical synchronization to a certain extent, but by default they can only be used in the cloud gaming [local reception and decoding -> output to the local display] link, and cannot solve the screen tearing problem in the WGC / DXGI acquisition stage.

[0079] In the embodiment of this example, it is assumed that the preset FPS of the cloud game is 144, and the virtual display is mounted on the cloud and synchronized with the graphics card for G-Sync / FreeSync. When the graphics card outputs the picture at 100FPS, the graphics card will dynamically adjust the virtual display frame rate to 100FPS to synchronize the reception. If it is a traditional cloud game solution, the graphics card outputs 100FPS frame rate to the preset 144FPS graphics card spoofer, and then after WGC / DXGI acquisition, screen tearing will occur.

[0080] In the embodiment of this example, when the 100FPS video stream is transmitted to the acquisition and encoding module, the graphics card is called to perform dynamic frame rate encoding. Since it is dynamic frame rate encoding, screen tearing will not occur when the frame rate changes.

[0081] In the embodiment of this example, a 100FPS picture is transmitted to the client, and the client calls the graphics card for decoding. When outputting the picture, it also synchronizes G-Sync / FreeSync with the local display to adjust the display to 100FPS to eliminate screen tearing.

[0082] In the embodiment of this example, the present disclosure uses a built-in G-Sync / FreeSync compatible layer in a virtual display to achieve frame rate synchronization in the acquisition phase to eliminate screen tearing, and does not use WGC and DXGI technology, but directly outputs the video stream through the virtual display to the encoding module for encoding.

[0083] It should be noted that, for the method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all optional embodiments, and the actions involved are not necessarily required by the present application.

[0084] Reference Figure 5 , shows a structural block diagram of a device for solving screen tearing in cloud game scenes based on adaptive synchronization technology of the present application, the device includes a virtual display establishment module 210, a dynamic frame rate encoding module 220, and a video decoding and playback module 230, wherein:

[0085] A virtual display creation module 210, used to create a virtual display and add a compatibility layer of a preset authentication technology to the driver of the virtual display;

[0086] The dynamic frame rate encoding module 220 is used for transmitting the rendered image to the virtual display by the graphics card of the cloud host during the cloud game, and dynamically adjusting the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program performs video encoding at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client;

[0087] The video decoding and playing module 230 is used for the client graphics card and the physical display to enable the preset authentication technology function, decodes the video after receiving the video stream, and directly outputs the decoded video to the display.

[0088] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0089] Optionally, an embodiment of the present application further provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the various processes of the above-mentioned method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0090] The embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, each process of the above method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0091] Figure 6 800 is a block diagram of an electronic device 800 shown in the present application. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0092] Reference Figure 6 , the electronic device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0093] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0094] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, images, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0095] The power supply component 806 provides power to the various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 800.

[0096] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0097] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0098] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0099] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0100] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast operation information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0101] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0102] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0103] Figure 719 is a block diagram of a computer-readable storage medium 1900 shown in the present application. For example, the computer-readable storage medium 1900 may be provided as a server.

[0104] Reference Figure 7 , the computer-readable storage medium 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions, such as an application, that can be executed by the processing component 1922. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0105] The computer readable storage medium 1900 may also include a power supply component 1926 configured to perform power management of the computer readable storage medium 1900, a wired or wireless network interface 1950 configured to connect the computer readable storage medium 1900 to a network, and an input / output (I / O) interface 1958. The computer readable storage medium 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

[0106] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0107] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0108] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

[0109] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in the present application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0110] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0111] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0112] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0113] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0114] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard drives, ROM, RAM, magnetic disks, or optical disks.

[0115] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A solution to screen tearing in cloud gaming scenes based on adaptive synchronization technology, characterized in that: The method comprises: Establishing a virtual display, and adding a compatibility layer of a preset authentication technology to a driver of the virtual display; When playing cloud games, the graphics card of the cloud host transmits the rendered images to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program encodes the video at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client; The client graphics card and the physical display enable the function of the preset authentication technology, decode the video after receiving the video stream, and output the decoded video directly to the display.

2. The method according to claim 1, characterized in that The method further comprises: The preset certification technologies include at least G-Sync compatible tested and certified by NVIDIA and FreeSync tested and certified by AMD.

3. The method according to claim 2, characterized in that The method further comprises: The virtual display is used to directly receive the picture output by the graphics card and transfer it to the encoding module.

4. The method according to claim 3, characterized in that The method further comprises: The virtual display can implement graphics-based DXGI or G-Sync compatible or FreeSync technology, and can eliminate screen tearing in the acquisition stage when receiving the output image of the graphics card.

5. The method according to claim 1, characterized in that The method further comprises: The cloud host mounts the virtual display and enables the G-Sync compatible or FreeSync function in the cloud graphics card driver.

6. The method according to claim 1, characterized in that The method further comprises: The original video data and frame rate information of the virtual display received by the cloud gaming encoding program are provided by the G-Synccompatible or FreeSync protocol.

7. The method according to claim 1, characterized in that The method further comprises: When encoding, frame rates below the lower limit of G-Sync compatible or FreeSync technology are oversampled to make them effective on the client side.

8. A device for solving screen tearing in cloud gaming scenes based on adaptive synchronization technology, characterized in that: The device comprises: A virtual display creation module, used to create a virtual display and add a compatibility layer of a preset authentication technology to the driver of the virtual display; Dynamic frame rate encoding module, used for cloud gaming, the graphics card of the cloud host transmits the rendered image to the virtual display, and dynamically adjusts the refresh rate of the virtual display through the protocol of the preset authentication technology. The cloud game encoding program receives the original video data and frame rate information of the virtual display, and the encoding program encodes the video at a dynamic frame rate VFR according to the frame rate information, and sends the encoded video stream to the client; The video decoding and playback module is used to enable the preset authentication technology function of the client graphics card and the physical display. After receiving the video stream, the video is decoded and the decoded video is directly output to the display.

9. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program implements the method according to any one of claims 1 to 7 when executed by the processor.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images