A live multi-opening method and system based on a remote GPU desktop

Abstract

The application discloses a live broadcast multi-opening method and system based on a remote GPU desktop, relates to the network live broadcast technical field, and solves the technical problem that multiple anchors are difficult to use the same IP to perform live broadcast, which influences live broadcast flexibility and live broadcast effect. The method comprises the following steps: creating multiple users with administrator permissions; starting a freeRDP client to simultaneously log in multiple users; acquiring the type of a Windows system supporting coding and decoding; adding a Windows system supporting coding and decoding field in a game service manager, setting coding and decoding configuration information by using an audio and video streaming tool, and creating a game audio and video streamer; copying the compiled game audio and video streamer, and setting different IP addresses for each user; starting game streaming in each freeRDP window to perform game live broadcast. The application realizes live broadcast multi-opening by remotely logging in through the freeRDP client, and realizing that multiple anchors have different proxy IP addresses through the audio and video configuration tool, the game service manager and the audio and video streaming tool.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of network live broadcast, and in particular to a live broadcast multi-opening method and system based on a remote GPU (Graphics Processing Unit) desktop. BACKGROUND

[0002] At present, network live broadcast based on GPU (Graphics Processing Unit) desktop technology to provide multimedia services to users in real time is becoming more and more popular. With the development of artificial intelligence technology, digital person live broadcast is also increasingly common. Digital person live broadcast is a new mode of live broadcast using AI technology driven virtual image, that is, using artificial intelligence, computer graphics, speech synthesis and other technologies to build virtual digital person image and make it perform live broadcast activities. These digital person images not only have high simulation appearance, can have similar facial features, hairstyle and clothing to real people, but also can simulate rich expressions, natural movements and fluent language expression, interact with the audience in the live broadcast scene, and be used to replace real anchors for live broadcast.

[0003] However, in order to prevent network congestion caused by a large number of digital person live broadcasts, which affects the live broadcast effect of the live broadcast platform, the number of IPs that each anchor can access is limited. If multiple anchors use the same IP due to work site, live broadcast operation and other reasons, the platform will usually permanently or temporarily ban the accounts of these anchors, thereby affecting the live broadcast application, and there is an urgent need for a live broadcast multi-opening (i.e., simultaneously running multiple live broadcast rooms on one device, suitable for multi-platform synchronous live broadcast or multi-account operation on the same platform) solution.

[0004] In the process of implementing the present application, the inventors have found that there are at least the following problems in the prior art:

[0005] In the existing live broadcast platform, multiple anchors cannot use the same IP for live broadcast, which affects the flexibility and effect of live broadcast. SUMMARY

[0006] The present application aims to provide a live broadcast multi-opening method and system based on a remote GPU desktop to solve the technical problem that in the prior art, multiple anchors cannot use the same IP for live broadcast, which affects the flexibility and effect of live broadcast. The preferred technical solutions in the many technical solutions provided by the present application can produce many technical effects, which are described in detail below.

[0007] To achieve the above-mentioned purpose, the present application provides the following technical solutions:

[0008] The application provides a live multi-opening method based on a remote GPU desktop, wherein the remote GPU desktop serves as a computing power core and provides cloud computing services, and the method comprises the following steps: S100: creating a plurality of users with administrator permissions based on a Windows system of a host computer, and each user has remote access permission; S200: starting a freeRDP client on the Windows system through remote control, and performing multi-user simultaneous login and setting corresponding login passwords; S300: obtaining the types of encoding and decoding supported by the Windows system through an audio and video configuration tool; S400: adding a Windows system supported encoding and decoding field in a game service manager, setting encoding and decoding configuration information based on the Windows system supported encoding and decoding field by an audio and video streaming tool, and creating a game audio and video streamer through the encoding and decoding configuration information; S500: copying the compiled game audio and video streamer into a plurality of copies consistent with the number of users, naming each copy, and setting different IP addresses for each user; S600: starting a chain server, a game management assistant server, the game audio and video streamer and the game service manager in each freeRDP window in turn using administrator permissions, and independently running a game on the desktop of each freeRDP window to start game streaming and perform multi-user game live broadcast based on a live broadcast platform.

[0009] Preferably, in the S200 step, if the Windows system of the host computer is a Windows server system, the multi-user simultaneous login freeRDP client is directly performed; if the Windows system of the host computer is a Windows 10 system, the multi-user simultaneous login freeRDP client is performed through an RDPWrap tool.

[0010] Preferably, in the S200 step, a username, a destination host IP address, a window width and a window height are further set; the destination host IP address is set as 127.0.0.1; the window width and the window height are respectively set as 3840 and 2160, 2560 and 1440, 1920 and 1080 or 1280 and 720.

[0011] Preferably, in the S300 step, the audio and video configuration tool is used for encoding and decoding information configuration of game audio and video, and the encoding and decoding types supported by the Windows system are collected into a JSON array.

[0012] Preferably, in the S400 step, the encoding and decoding types supported by the Windows system are added in the game service manager through a start interface, and the encoding and decoding types supported by the Windows system are forwarded to the audio and video streaming tool based on a start streaming interface.

[0013] Preferably, in the S400 step, the audio and video streaming tool selects an AVC format, an HEVC format or an AV1 format as the video coding configuration information.

[0014] Preferably, in the S500 step, different IP addresses are set for each user in the compiled game audio and video streamer through a stream_ipv4_address field and a mgr_ipv4_address field.

[0015] Preferably, in the S600 step, the number of frames of the game stream is set to 60 frames by modifying the attribute value of DWMFRAMEINTERVAL to 15.

[0016] Preferably, in the S600 step, the chain server is configured to configure a linker, the game management assistant server is configured to assist network connection, the game audio and video streamer is configured to encapsulate a compiled game audio and video streamer, and the game service manager is configured to start or terminate a game and monitor and manage a game stream.

[0017] A live multi-opening system based on a remote desktop, configured to implement the live multi-opening method based on a remote GPU desktop according to any one of the above embodiments, and including a thin terminal, a live platform, a plurality of RDP multi-opening instances and a plurality of audio and video acquisition devices; the thin terminal is a host computer configured to simultaneously run a plurality of freeRDP clients; the live platform is configured to transmit live game content to viewers; the RDP multi-opening instances are configured to enable a plurality of users to log in to the plurality of freeRDP clients with different IP addresses and to set configuration information of a game stream; and the audio and video acquisition devices are configured to acquire audio signals and video signals in a plurality of live games.

[0018] Implementing one of the above technical solutions of the present application has the following advantages or beneficial effects:

[0019] In the present embodiment, a freeRDP client of a Windows system is used to log in to a remote GPU desktop, and an audio and video configuration tool, a game service manager and an audio and video streaming tool are used to enable a plurality of anchors to have different proxy IP addresses, so that the same IP address can be used for live streaming, the live multi-opening function is realized, the live streaming site of the anchors can be more flexibly arranged, and more flexible live streaming operation can be performed, thereby improving the flexibility and effect of live streaming. BRIEF DESCRIPTION OF DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments description. Obviously, the drawings in the following description only constitute some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative effort, and the drawings are as follows:

[0021] Figure 1 is a flow chart of a live multi-opening method based on a remote GPU desktop according to an embodiment of the present application;

[0022] Figure 2 is a working process schematic diagram of a live multi-opening method based on a remote GPU desktop according to an embodiment of the present application;

[0023] Figure 3 is a schematic diagram of a live multi-opening system based on a remote desktop according to an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solutions and advantages of the present application more clear, the various exemplary embodiments to be described in the following will refer to the corresponding drawings, which constitute a part of the exemplary embodiments, and the various exemplary embodiments possibly adopted to realize the present application are described. Unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation described in the following exemplary embodiments does not represent all the implementations consistent with the present disclosure. It should be understood that they are only examples of processes, methods and devices, etc. consistent with some aspects of the present disclosure as detailed in the appended claims, and other embodiments can also be used, or modifications can be made to the embodiments listed herein in structure and function, without departing from the scope and essence of the present application.

[0025] In the description of the present application, it should be understood that the terms "center", "longitudinal", "transverse" and the like indicate the orientation or positional relationship based on the drawings shown, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the elements referred to must have a specific orientation, structure and operation. The terms "first", "second" and the like are only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. The term "a plurality of" means two or more. The terms "connected", "connected" should be understood broadly, for example, it can be fixed connection, detachable connection, integral connection, mechanical connection, electrical connection, communication connection, direct connection, indirect connection through intermediate medium, internal communication of two elements or interaction relationship between two elements. The term "and / or" includes any and all combinations of one or more related listed items. For those skilled in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0026] In order to illustrate the technical solutions of the present application, the following will be described by specific examples, only showing the parts related to the embodiments of the present application.

[0027] Example one:

[0028] As Figure 1 , Figure 2As shown, the present application provides a live multi-opening method based on a remote GPU desktop. The remote GPU desktop serves as the computing power core and provides cloud computing services. Specifically, the remote GPU desktop provides a virtual desktop environment equipped with GPUs. These GPUs are usually high-performance and suitable for processing graphics-intensive tasks such as 3D rendering, video editing, game development and operation, scientific computing, and other applications requiring fast graphics processing. The method includes the following steps. S100: Create multiple users with administrator privileges based on the host's Windows system. The administrator privileges facilitate various operations, and each user has remote access privileges, allowing remote desktop access through the user's login. S200: Start the freeRDP client on the Windows system remotely (in this embodiment, the freeRDP client is started through the wfreerdp.exe program, which is the Windows executable file of the FreeRDP project. It is an open-source remote connection tool based on the Microsoft Remote Desktop Protocol (RDP). The wfreerdp window does not affect streaming even when minimized). Perform multi-user simultaneous login and set the corresponding login password (set the username through the parameter U in the wfreerdp.exe program, corresponding to the multiple users in step S100. When multiple users are used, log in by entering multiple different usernames, and set the login password through the parameter P). S300: Obtain the type of encoding and decoding supported by the Windows system through an audio and video configuration tool. The encoding and decoding type information supported by the system can be obtained using existing technology, making it easy to select the type for game streaming as needed. S400: Add a Windows system-supported encoding field to the game service manager. The audio and video streaming tool sets the encoding and decoding configuration information based on the Windows system-supported encoding field and creates a game audio and video streamer through the encoding and decoding configuration information. S500: Copy the compiled game audio and video streamer multiple times corresponding to the number of users and name them separately. That is, each user establishes an independent file directory to save the compiled game audio and video streamer, so that each compiled game audio and video streamer runs independently, allowing different IP addresses to be set for each user. The address is the proxy IP address of the host.S600: using administrator permission in each freeRDP window, starting chain server, game management assistant server, game audio and video streamer, game service manager in turn, in each user's file directory, separately establishing the file of chain server, game management assistant server, game audio and video streamer, game service manager, so that each user's live broadcast process is independent of each other, avoiding mutual interference, running games on the desktop of each freeRDP window, the specific games run can be the same or different, starting game streaming, and performing multi-user game live broadcast based on a live broadcast platform. In the embodiment, remote GPU desktop login is performed through the freeRDP client of the Windows system, and multiple anchors have different proxy IP addresses through the audio and video configuration tool, game service manager, and audio and video streaming tool, so that the same IP address can be used for live broadcast, the live broadcast multi-opening function is realized, the live broadcast site of the anchor is arranged more flexibly, the live broadcast operation is more flexible, and therefore the flexibility and live broadcast effect of the live broadcast are improved.

[0029] As an optional implementation, in the step S200, if the Windows system of the host computer is a Windows server system, multiple users can simultaneously log in to the freeRDP client. The Windows server system supports multiple users to simultaneously log in to the freeRDP client and does not need to be additionally set. If the Windows system of the host computer is a Windows 10 system, multiple users can simultaneously log in to the freeRDP client through the RDPWrap tool. The RDPWrap is a remote desktop enhancement tool of the Windows system, which can allow multiple users to simultaneously remotely log in to the same Windows computer without interfering with each other. The specific configuration method can be performed by using the prior art.

[0030] As an optional implementation, in the step S200, the IP address of the destination host, the width of the window, and the height of the window (the IP address of the destination host is set by the parameter V in the wfreerdp.exe program, and the width of the window and the height of the window are set by the parameter SIZE) are also set. The IP address of the destination host is set to 127.0.0.1, which is a local loopback address mainly used for local network testing and inter-process communication, that is, a data packet sent to 127.0.0.1 is immediately returned by the operating system network protocol stack without passing through the physical network card or external network, thereby facilitating the simultaneous login of multiple users through cooperation with other programs. The width of the window and the height of the window are set to 3840 and 2160, 2560 and 1440, 1920 and 1080, or 1280 and 720, respectively. The width of the window and the height of the window together form the resolution of the freeRDP window. The resolutions corresponding to the above sizes are 3840*2160, 2560*1440, 1920*1080, or 1280*720, respectively. The above sizes correspond to common resolutions of monitors. Users can comprehensively select according to factors such as network bandwidth and the need for the degree of detail of game pictures, thereby improving the adaptability of live streaming of remote desktops.

[0031] As an optional implementation, in the step S300, the audio and video configuration tool is used to configure the game audio and video codec information, and the codec types supported by the Windows system are also collected into a JSON array. The JSON array is a data structure in the JSON (JavaScript Object Notation) data format, which is used to store an ordered value set. There are many codec types supported by the Windows system, and the JSON array is used to store them in order to facilitate the setting of codec configuration information by the audio and video streaming tool.

[0032] As an optional implementation, in the step S400, as shown in Figure 2 , the codec types supported by the Windows system are added in the game service manager through the start interface, and the codec types supported by the Windows system are forwarded to the audio and video streaming tool based on the start streaming interface.

[0033] As an optional implementation, in the step S400, the audio and video streaming tool selects the AVC format, the HEVC format, or the AV1 format as the video codec configuration information. The AVC format, the HEVC format, or the AV1 format is the current mainstream video compression format, and is widely supported by hardware. The audio and video streaming tool can select according to the user's use scenario and the mainstream hardware configuration, thereby improving the applicability of streaming.

[0034] As an optional implementation, in the step S500, different IP addresses are set for each user in the compiled game audio and video streamer through the stream_ipv4_address field and the mgr_ipv4_address field, the stream_ipv4_address field and the mgr_ipv4_address field of each user are set with the same IP address, and different users are set with different IP addresses, so that multiple IP addresses are bound to the host computer, so that the differentiation of each user on the IP address and the port can be realized, and then the live multi-opening can be realized.

[0035] As an optional implementation, in the step S600, the frame number of the game stream is set to 60 frames by modifying the attribute value of DWMFRAMEINTERVAL to 15. DWMFRAMEINTERVAL is a registry key value in the Windows system for controlling the frame rate of the remote desktop protocol, and by modifying its value, the default 30FPS limit can be broken, and the smoothness of the remote session can be improved. By modifying the attribute value of DWMFRAMEINTERVAL to 15, the frame number of the game stream is set to 60 frames, the smoothness of the game stream is improved, and the user experience is improved.

[0036] As an optional implementation, in the step S600, the chain server is used to configure the linker (such as starting the protocol link and the like), the game management assistant server is used to assist the network connection (the parameters monitored by the network connection assistance include: network overhead caused by network communication, such as jitter caused by network fluctuation, temporary unavailability; resource occupation caused by network communication, such as TIME_WAIT occupation; and network card overhead), the game audio and video streamer is an encapsulated and compiled game audio and video streamer, and the game service manager is used to start or terminate the game and monitor and manage the game stream.

[0037] The embodiment is only a specific example, and does not mean that the present application is in this way.

[0038] Embodiment two:

[0039] A live multi-opening system based on a remote desktop, used to run a live multi-opening method based on a remote GPU desktop in the embodiment one, such as Figure 3 As shown in the figure, the system includes a thin terminal, a live platform, a plurality of RDP multi-opening instances, and a plurality of audio and video acquisition devices, Figure 3The embodiment is used for live multi-opening of two users. The thin terminal is a host computer, and is used for simultaneously running multiple freeRDP clients. Preferably, the thin terminal is a core display host, which is convenient for picture display and reducing device power consumption. Preferably, the CPU is an Intel JASPER LAKE series processor, which can support AVC format, HEVC format encoding and decoding, AV1 format and VP9 format decoding, and the minimum power consumption can be controlled within 10W. The 2.5G network card, 5G SIM card, USB interface and audio interface are supported. The 2.5G network card and 5G SIM card can realize the effect of high-speed data transmission, so as to achieve the effects of fast decoding, high speed, low power consumption and easy adaptation. The live platform is used for transmitting game live content to the audience. The RDP multi-opening instance is configured by an audio and video configuration tool, a game service manager and an audio and video streaming tool, so that multiple users log in to multiple freeRDP clients with different IP addresses, and is used for setting configuration information of game streaming. The multiple freeRDP clients can be logged in by corresponding usernames and login passwords, so as to realize live multi-opening of the remote desktop. The audio and video acquisition setting is used for acquiring audio signals and video signals in multiple game live broadcasts, such as a camera and a microphone. In the embodiment, the freeRDP client of the thin terminal Windows system is used for remote login, and the RDP multi-opening instance is used for realizing that multiple anchors have different proxy IP addresses, so that the same IP address can be used for live broadcast, the live multi-opening function is realized, the live broadcast site of the anchor is arranged more flexibly, the live broadcast operation is more flexible, and the flexibility and live broadcast effect of the live broadcast are improved.

[0040] In the live broadcast technology based on the GPU desktop, the thin terminal does not actually load a physical GPU module as hardware, but remotely accesses remote GPU computing resources through cloud technology. The remote GPU instance is usually a cloud computing resource shared by multiple thin terminal clients, which reduces the investment cost and simplifies the hardware investment of the thin terminal.

[0041] The above only describes the preferred embodiments of the present application, and those skilled in the art know that various changes or equivalent replacements can be made to the features and embodiments without departing from the spirit and scope of the present application. In addition, the features and embodiments can be modified to adapt to specific conditions and materials under the guidance of the present application without departing from the spirit and scope of the present application. Therefore, the present application is not limited to the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of the present application are within the protection scope of the present application.

Claims

1. A live multi-opening method based on a remote GPU desktop, characterized in that, The remote GPU desktop as a computing power core provides cloud computing services, including the following steps: S100: based on the Windows system of the host, create multiple users with administrator permissions, each user has remote access permission; S200: start the freeRDP client on the Windows system through remote, and perform multi-user simultaneous login and set the corresponding login password; S300: obtain the type of encoding and decoding supported by the Windows system through the audio and video configuration tool; S400: add the Windows system supported encoding and decoding field in the game service manager, and the audio and video streaming tool sets the encoding and decoding configuration information based on the Windows system supported encoding and decoding field, and creates a game audio and video streamer through the encoding and decoding configuration information; S500: copy the compiled game audio and video streamer multiple times consistent with the number of users and name them respectively, and set different IP addresses for each user; S600: in each freeRDP window, use administrator permission to start chain server, game management assistant server, game audio and video streamer, game service manager in turn, run game on the desktop of each freeRDP window independently, start game streaming, and perform multi-user game live broadcast based on the live broadcast platform.

2. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the S200 step, if the Windows system of the host is a Windows server system, directly perform multi-user simultaneous login to the freeRDP client; if the Windows system of the host is a Windows 10 system, perform multi-user simultaneous login to the freeRDP client through the RDPWrap tool.

3. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the S200 step, the username, destination host IP address, window width, and window height are also set; the destination host IP address is set to 127.0.0.1; the window width and window height are set to 3840 and 2160, 2560 and 1440, 1920 and 1080, or 1280 and 720, respectively.

4. The live multi-opening method based on a remote GPU desktop according to claim 1, wherein, In the S300 step, the audio and video configuration tool is used for game audio and video encoding and decoding information configuration, and the encoding and decoding types supported by the Windows system are also collected into a JSON array.

5. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the S400 step, the encoding and decoding types supported by the Windows system are added in the game service manager through the start interface, and the encoding and decoding types supported by the Windows system are forwarded to the audio and video streaming tool based on the start streaming interface.

6. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the S400 step, the audio and video streaming tool selects AVC format, HEVC format or AV1 format as the video encoding and decoding configuration information.

7. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the S500 step, different IP addresses are set for each user in the compiled game audio and video streamer through the stream_ipv4_address field and the mgr_ipv4_address field.

8. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the S600 step, the frame number of the game streaming is set to 60 frames by modifying the attribute value of DWMFRAMEINTERVAL to 15.

9. The live multi-opening method based on a remote GPU desktop according to claim 1, characterized in that, In the step S600, the chain server is configured to configure a linker, the game management assistant server is configured to assist network connection, the game audio and video streamer is configured to encapsulate a compiled game audio and video streamer, and the game service manager is configured to start or terminate a game and monitor and manage game streaming.

10. A live multi-opening system based on a remote desktop, characterized in that, A live multi-opening method based on a remote GPU desktop for running the method according to any one of claims 1-9, comprising a thin terminal, a live broadcast platform, a plurality of RDP multi-opening instances and a plurality of audio and video acquisition devices; the thin terminal is a host computer, configured to simultaneously run a plurality of freeRDP clients; the live broadcast platform is configured to transmit game live broadcast content to viewers; the RDP multi-opening instance is configured to enable a plurality of users to log in to the plurality of freeRDP clients with different IP addresses and set configuration information of game streaming; and the audio and video acquisition device is configured to acquire audio signals and video signals in a plurality of game live broadcasts.

Images