Live broadcast multi-opening method and system based on remote GPU desktop

Abstract

The invention discloses a live broadcast multi-opening method and system based on a remote GPU desktop, relates to the technical field of network live broadcast, and solves the technical problems that multiple anchors are difficult to use the same IP for live broadcast, and the live broadcast flexibility and the live broadcast effect are influenced. The method comprises the following steps: creating a plurality of users with administrator authority; starting a freeRDP client, and carrying out the simultaneous login of a plurality of users; the type of coding and decoding supported by the Windows system is obtained; a Windows system is added in a game service manager to support coding and decoding fields, an audio and video streaming tool sets coding and decoding configuration information, and a game audio and video streaming device is created; copying the compiled game audio and video streamer, and setting different IP addresses for each user; and starting a game stream in each freeRDP window, and carrying out game live broadcast. According to the invention, remote login is carried out through the freeRDP client, a plurality of anchors have different proxy IP addresses through the audio and video configuration tool, the game service manager and the audio and video streaming tool, and multi-open live broadcast is realized.

Description

Technical Field

[0001] The present invention relates to the field of network live broadcast technology, and in particular to a multi-opening live broadcast method and system based on a remote GPU desktop. Background Art

[0002] Currently, live streaming, which uses GPU (Graphics Processing Unit) desktop technology to provide users with instant multimedia services, is becoming increasingly popular. With the development of artificial intelligence (AI), digital human live streaming is also becoming increasingly common. Digital human live streaming is an emerging model for live streaming using AI-powered virtual avatars. This approach leverages AI, computer graphics, and speech synthesis to create virtual human avatars and enable them to conduct live broadcasts. These avatars not only possess highly realistic appearances, with facial features, hairstyles, and clothing similar to those of real people, but also simulate rich expressions, natural movements, and fluent speech, allowing them to interact with viewers during live broadcasts, replacing real-life hosts.

[0003] However, to prevent network congestion caused by a large number of digital human broadcasts, which could impact the platform's live streaming performance, live streaming platforms limit the number of IP addresses that can be connected to each streamer. If multiple streamers use the same IP address for reasons such as work location or live streaming operations, the platform will often ban their accounts for a short or long period, further impacting live streaming applications. A solution for multi-streaming (running multiple live streaming rooms simultaneously on a single device, suitable for simultaneous live streaming on multiple platforms or operating multiple accounts on the same platform) is urgently needed.

[0004] In the process of implementing the present invention, the inventors discovered that the prior art has at least the following problems: On existing live streaming platforms, it is difficult for multiple anchors to use the same IP for live streaming, which affects the flexibility and effect of live streaming. Summary of the Invention

[0005] The purpose of the present invention is to provide a multi-opening live broadcast method and system based on a remote GPU desktop to solve the technical problem that existing live broadcast platforms in the prior art have difficulty in using the same IP address for multiple hosts to broadcast live, which affects the flexibility and quality of live broadcasts. The various technical effects that can be produced by the preferred technical solutions among the many technical solutions provided by the present invention are detailed below.

[0006] To achieve the above objectives, the present invention provides the following technical solutions: The present invention provides a multi-opening live broadcast method based on a remote GPU desktop. The remote GPU desktop serves as a computing power core and provides cloud computing services. The method includes the following steps: S100: creating multiple users with administrator privileges based on the Windows system of a host machine, each user having remote access privileges; S200: remotely opening a freeRDP client in the Windows system, logging in multiple users simultaneously, and setting corresponding login passwords; S300: obtaining the types of codecs supported by the Windows system through an audio and video configuration tool; S400: adding a Windows system supported codec field to a game service manager, an audio and video streaming tool setting codec configuration information based on the Windows system supported codec field, and creating a game audio and video streamer based on the codec configuration information; S500: copying the compiled game audio and video streamer into multiple copies that match the number of users and naming them respectively, and setting a different IP address for each user; S600: using administrator privileges in each freeRDP window to sequentially start a chain server, a game management assistant server, a game audio and video streamer, and a game service manager, independently running a game on the desktop of each freeRDP window, starting game streaming, and performing multi-user game live broadcast based on a live broadcast platform.

[0007] Preferably, in step S200, if the Windows system of the host machine is a Windows server system, multiple users are directly logged into the freeRDP client at the same time; if the Windows system of the host machine is a Windows 10 system, multiple users are logged into the freeRDP client at the same time through the RDPWrap tool.

[0008] Preferably, in step S200, the user name, destination host IP address, window width, and window height are also set; the destination host IP address is set to 127.0.0.1; the window width and window height are set to 3840 and 2160, 2560 and 1440, 1920 and 1080, or 1280 and 720, respectively.

[0009] Preferably, in step S300, the audio and video configuration tool is used to configure the game audio and video codec information, and also aggregates the codec types supported by the Windows system into a JSON array.

[0010] Preferably, in step S400, the codec type supported by the Windows system is added to the game service manager through the startup interface, and the codec type supported by the Windows system is forwarded to the audio and video streaming tool based on the start streaming interface.

[0011] Preferably, in step S400, the audio and video streaming tool selects AVC format, HEVC format or AV1 format as the video codec configuration information.

[0012] Preferably, in step S500, a different IP address is set for each user in the compiled game audio and video streamer through the stream_ipv4_address field and the mgr_ipv4_address field.

[0013] Preferably, in step S600, the frame rate of the game streaming is set to 60 frames by modifying the attribute value of DWMFRAMEINTERVAL to 15.

[0014] Preferably, in step S600, the chain server is used to configure the linker, the game management assistant server is used to assist in network connection, the game audio and video streamer is a packaged and compiled game audio and video streamer, and the game service manager is used to start or terminate the game and monitor and manage the game streaming.

[0015] A live broadcast multi-opening system based on remote desktop is used to run any of the above-mentioned live broadcast multi-opening methods based on remote GPU desktop, including a thin terminal, a live broadcast platform, multiple RDP multi-opening instances and multiple audio and video acquisition devices; the thin terminal is a host machine, used to run multiple freeRDP clients at the same time; the live broadcast platform is used to transmit game live broadcast content to the audience; the RDP multi-opening instance enables multiple users to log in to multiple freeRDP clients with different IP addresses, and is used to set the configuration information of the game stream; the audio and video acquisition device is used to collect audio signals and video signals in multiple game live broadcasts.

[0016] Implementing one of the above technical solutions of the present invention has the following advantages or beneficial effects: In this embodiment, remote GPU desktop login is performed through the freeRDP client of the Windows system, and multiple anchors are given different proxy IP addresses through the audio and video configuration tool, the game service manager, and the audio and video streaming tool, so that the same IP address can be used for live broadcast, realizing the multi-opening function of live broadcast, facilitating more flexible arrangement of the anchor's live broadcast venue, and conducting more flexible live broadcast operations, thereby improving the flexibility and effect of live broadcast. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. Those skilled in the art can also derive other drawings based on these drawings without inventive work. In the drawings: Figure 1 This is a flowchart of a live broadcast multi-opening method based on a remote GPU desktop according to an embodiment of the present invention; Figure 2 This is a schematic diagram of the working process of a multi-opening live broadcast method based on a remote GPU desktop according to an embodiment of the present invention; Figure 3 This is a schematic diagram of a live broadcast multi-opening system based on remote desktop according to embodiment 2 of the present invention. DETAILED DESCRIPTION

[0018] In order to make the objects, technical solutions and advantages of the present invention clearer, the various exemplary embodiments to be described below will refer to the corresponding drawings, which constitute a part of the exemplary embodiments, in which various exemplary embodiments that may be used to implement the present invention are described. Unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation methods described in the following exemplary embodiments do not represent all implementation methods consistent with the present disclosure. It should be understood that they are only examples of processes, methods and devices that are consistent with some aspects of the present disclosure as detailed in the appended claims, and other embodiments may also be used, or structural and functional modifications may be made to the embodiments listed herein without departing from the scope and essence of the present invention.

[0019] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "transverse" and the like indicate the orientation or positional relationship based on the figures, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the elements referred to must have a specific orientation, be constructed and operated in a specific orientation. The terms "first", "second" and the like are only used for descriptive purposes and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. The term "multiple" means two or more. The terms "connected" and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, an integral connection, a mechanical connection, an electrical connection, a communication connection, a direct connection, an indirect connection through an intermediate medium, and can be the internal connection of two elements or the interaction relationship between two elements. The term "and / or" includes any and all combinations of one or more related listed items. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to the specific circumstances.

[0020] In order to illustrate the technical solution of the present invention, a specific embodiment is provided below, in which only the parts related to the embodiment of the present invention are shown.

[0021] Example 1: like Figure 1 、 Figure 2As shown, the present invention provides a live broadcast multi-opening method based on remote GPU desktop. The remote GPU desktop serves as the computing power core and provides cloud computing services. Specifically, the remote GPU desktop provides a virtual desktop environment equipped with GPUs. These GPUs are usually high-performance and suitable for processing graphics-intensive tasks such as 3D rendering, video editing, game development and operation, scientific computing and other applications that require fast graphics processing. The following steps are included. S100: Create multiple users with administrator privileges based on the Windows system of the host machine. The administrator privileges facilitate various operations. Each user has remote access rights, so that the remote desktop can be implemented through the login of the user. S200: Remotely launch the freeRDP client on the Windows system (in this embodiment, the freeRDP client is launched using the wfreerdp.exe program. wfreerdp.exe is the Windows executable file for the FreeRDP project, an open-source remote connection tool based on the Microsoft Remote Desktop Protocol (RDP). Even minimizing the wfreerdp window does not affect streaming). Multiple users are logged in simultaneously and their corresponding login passwords are set (the wfreerdp.exe program uses the U parameter to set the user name, corresponding to the multiple users in step S100. Multiple users log in by entering multiple different user names and setting login passwords using the P parameter). S300: Obtain the codec types supported by the Windows system through the audio and video configuration tool. Obtaining the supported codec type information can be accomplished using existing techniques, thereby facilitating the selection of the required codec type for game streaming. S400: Add a Windows system supported codec field to the game service manager. The audio and video streaming tool sets codec configuration information based on the Windows system supported codec field and creates a game audio and video streamer using the codec configuration information. S500: Copy the compiled game audio and video streamer into multiple copies that match the number of users and name them separately. That is, each user creates an independent file directory to save the compiled game audio and video streamer, so that each compiled game audio and video streamer runs independently, so that a different IP address can be set, and a different IP address is set for each user. This address is the proxy IP address of the anchor.S600: In each freeRDP window, administrator privileges are used to sequentially start the chain server, game management assistant server, game audio and video streamer, and game service manager. Files for the chain server, game management assistant server, game audio and video streamer, and game service manager are separately created in each user's file directory. This allows each user's live broadcast process to be independent of each other, avoiding mutual interference. Games can be run independently on the desktop of each freeRDP window. The specific games being run can be the same or different. Game streaming is enabled, and multi-user game live broadcasts are performed based on the live broadcast platform. In this embodiment, remote GPU desktop login is performed through the Windows system's freeRDP client. The audio and video configuration tool, game service manager, and audio and video streaming tool are used to enable multiple hosts to have different proxy IP addresses. This allows for live broadcasts using the same IP address, realizing a multi-opening live broadcast function. This facilitates more flexible arrangements for the host's live broadcast venues and allows for more flexible live broadcast operations, thereby improving the flexibility and effectiveness of live broadcasts.

[0022] As an optional implementation, in step S200, if the host machine's Windows system is Windows Server, multiple users can log in to the freeRDP client simultaneously. Windows Server systems support multiple users logging in to the freeRDP client simultaneously, and no additional configuration is required. If the host machine's Windows system is Windows 10, multiple users can log in to the freeRDP client simultaneously using the RDPWrap tool. RDPWrap is a Windows remote desktop enhancement tool that allows multiple users to remotely log in to the same Windows computer simultaneously without interfering with each other. The specific configuration method can be implemented using existing technologies, such as https: / / woshub.com / how-to-allow-multiple-rdp-sessions-in-windows-10 / #google_vignette.

[0023] As an optional implementation, in step S200, the destination host IP address, window width, and window height are also set (the destination host IP address is set through parameter V in the wfreerdp.exe program, and the window width * window height is set through parameter SIZE); the destination host IP address is set to 127.0.0.1, and 127.0.0.1 is the local loopback address (LoopbackAddress), which is mainly used for local network testing and inter-process communication, that is, data packets sent to 127.0.0.1 are immediately returned by the operating system network protocol stack without passing through the physical network card or the external network, thereby facilitating simultaneous login of multiple users through cooperation with other programs. The window width and window height are set to 3840 and 2160, 2560 and 1440, 1920 and 1080, or 1280 and 720 respectively. The window width and window height together form the resolution of the freeRDP window. The corresponding resolutions of the above sizes are: 3840*2160, 2560*1440, 1920*1080, or 1280*720. The above sizes correspond to common monitor resolutions. Users can make comprehensive selections based on factors such as network bandwidth and the required level of game screen detail, thereby improving the adaptability of remote desktop live streaming.

[0024] As an optional implementation, in step S300, the audio and video configuration tool is used to configure the audio and video codec information of the game, and also collects the codec types supported by the Windows system into a JSON array. The JSON array is a data structure in the JSON (JavaScript Object Notation) data format, which is used to store an ordered set of values. There are many codec types supported by the Windows system. Storing them in order through the JSON array makes it easier for the audio and video streaming tool to set the codec configuration information.

[0025] As an optional implementation, in step S400, if Figure 2 As shown, the codec types supported by the Windows system are added to the game service manager through the startup interface, and the codec types supported by the Windows system are forwarded to the audio and video streaming tool based on the start streaming interface.

[0026] As an optional implementation, in step S400, the audio and video streaming tool selects AVC, HEVC, or AV1 as the video codec configuration information. AVC, HEVC, or AV1 are currently mainstream video compression formats with widespread hardware support. The audio and video streaming tool can select the format based on the user's usage scenario and mainstream hardware configuration, thereby improving streaming applicability.

[0027] As an optional implementation, in step S500, a different IP address is set for each user in the compiled game audio and video streamer through the stream_ipv4_address field and the mgr_ipv4_address field. The stream_ipv4_address field and the mgr_ipv4_address field of each user are set with the same IP address, and different users are set with different IP addresses, thereby binding multiple IP addresses to the host machine, so that each user can be distinguished in terms of IP address and port, and multiple live broadcasts can be realized.

[0028] As an optional implementation, in step S600, the frame rate of the game stream is set to 60 frames by modifying the DWMFRAMEINTERVAL property value to 15. DWMFRAMEINTERVAL is a registry key used to control the frame rate of the Remote Desktop Protocol in Windows. By modifying its value, the default 30FPS limit can be exceeded, improving the smoothness of the remote session. Modifying the DWMFRAMEINTERVAL property value to 15 sets the frame rate of the game stream to 60 frames, improving the smoothness of the game stream and enhancing the user experience.

[0029] As an optional implementation, in step S600, the chain server is used to configure the linker (such as the configuration of the startup protocol link, etc.), the game management assistant server is used to assist in network connection (the parameters for assisting in network connection monitoring include: network overhead caused by network communication, such as jitter caused by network fluctuations, temporary disconnection; resource usage caused by network communication, such as TIME_WAIT usage; and network card overhead), the game audio and video streamer is a packaged and compiled game audio and video streamer, and the game service manager is used to start or terminate the game, and monitor and manage the game streaming.

[0030] The embodiment is only a special example and does not represent only one way of implementing the present invention.

[0031] Example 2: A live broadcast multi-opening system based on remote desktop, used to run a live broadcast multi-opening method based on remote GPU desktop in embodiment 1, such as Figure 3 As shown, it includes thin terminals, live broadcast platforms, multiple RDP instances and multiple audio and video acquisition devices. Figure 3The embodiment of two users performing multiple live broadcasts is shown in the figure. The thin terminal is a host machine used to run multiple freeRDP clients simultaneously. The thin terminal is preferably a core graphics host, which facilitates screen display and reduces device power consumption. The CPU is preferably Intel's JASPER LAKE series processor, which can support AVC format, HEVC format encoding and decoding, AV1 format, VP9 format decoding, and the minimum power consumption can be controlled within 10W; and supports 2.5G network card, 5G SIM card, USB interface, audio interface. 2.5G network card and 5G SIM card can achieve high-speed data transmission, thereby achieving fast decoding, high speed, low power consumption, and easy adaptability. The live broadcast platform is used to transmit live game content to the audience. The RDP multi-opening instance uses audio and video configuration tools, game service manager, and audio and video streaming tools to enable multiple users to log in to multiple freeRDP clients with different IP addresses, and is used to set the configuration information of game streaming. By logging in to multiple freeRDP clients with corresponding usernames and login passwords, multiple remote desktop live broadcasts can be achieved. The audio and video acquisition setting is used to collect audio and video signals from multiple game live broadcasts, such as cameras and microphones. In this embodiment, remote login is performed through the freeRDP client of the thin terminal Windows system, and multiple RDP instances are opened to enable multiple anchors to have different proxy IP addresses. This allows the same IP address to be used for live broadcasts, realizing the multi-opening function of live broadcasts, facilitating more flexible arrangement of anchors' live broadcast venues, and conducting more flexible live broadcast operations, thereby improving the flexibility and effect of live broadcasts.

[0032] In GPU desktop-based live streaming technology, thin clients, as hardware, do not actually host physical GPU modules. Instead, they remotely access remote GPU computing resources through cloud technology. Typically, remote GPU instances are cloud computing resources shared by multiple thin client clients, reducing both investment costs and streamlining thin client hardware investment. "Instance" is a term representing one or more physical GPU devices installed in a computer room. These GPU devices utilize modules based on publicly available technologies.

[0033] The foregoing is merely a preferred embodiment of the present invention. Those skilled in the art will appreciate that various changes or equivalent substitutions may be made to these features and embodiments without departing from the spirit and scope of the present invention. Furthermore, under the guidance of the present invention, these features and embodiments may be modified to suit specific circumstances and materials without departing from the spirit and scope of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed herein, and all embodiments falling within the scope of the claims of this application are intended to be within the scope of the present invention.

Claims

1. A live broadcast multi-opening method based on remote GPU desktop, characterized in that: The remote GPU desktop serves as the computing core and provides cloud computing services, including the following steps: S100: Create multiple users with administrator privileges based on the host's Windows system. Each user has remote access permissions. S200: Remotely open the freeRDP client on the Windows system, log in multiple users at the same time and set the corresponding login passwords; S300: Obtain the codec types supported by the Windows system through the audio and video configuration tool; S400: Add a Windows system supported codec field in the game service manager. The audio and video streaming tool sets the codec configuration information based on the Windows system supported codec field and creates a game audio and video streamer based on the codec configuration information. S500: Copy the compiled game audio and video streamer into multiple copies that match the number of users and name them respectively, and set a different IP address for each user; S600: Use administrator privileges to start the chain server, game management assistant server, game audio and video streamer, and game service manager in each freeRDP window in sequence, run the game independently on the desktop of each freeRDP window, start game streaming, and conduct multi-user game live broadcasts based on the live broadcast platform.

2. A live broadcast multi-opening method based on remote GPU desktop according to claim 1, characterized in that: In the step S200, if the Windows system of the host machine is a Windows server system, multiple users are directly logged into the freeRDP client at the same time; if the Windows system of the host machine is a Windows 10 system, multiple users are logged into the freeRDP client at the same time through the RDPWrap tool.

3. A live broadcast multi-opening method based on remote GPU desktop according to claim 1, characterized in that: In step S200, the user name, destination host IP address, window width, and window height are also set; the destination host IP address is set to 127.0.0.1; the window width and window height are set to 3840 and 2160, 2560 and 1440, 1920 and 1080, or 1280 and 720, respectively.

4. A live broadcast multi-opening method based on remote GPU desktop according to claim 1, characterized in that: In the step S300, the audio and video configuration tool is used to configure the game audio and video codec information, and also aggregates the codec types supported by the Windows system into a JSON array.

5. The method for multi-opening live broadcast based on remote GPU desktop according to claim 1, characterized in that: In step S400, the codec types supported by the Windows system are added to the game service manager through the startup interface, and the codec types supported by the Windows system are forwarded to the audio and video streaming tool based on the start streaming interface.

6. A live broadcast multi-opening method based on remote GPU desktop according to claim 1, characterized in that: In step S400 , the audio and video streaming tool selects AVC format, HEVC format, or AV1 format as video codec configuration information.

7. A live broadcast multi-opening method based on remote GPU desktop according to claim 1, characterized in that: In step S500, a different IP address is set for each user in the compiled game audio and video streamer through the stream_ipv4_address field and the mgr_ipv4_address field.

8. The method for multi-opening live broadcast based on remote GPU desktop according to claim 1, characterized in that: In step S600 , the frame rate of the game streaming is set to 60 frames by modifying the attribute value of DWMFRAMEINTERVAL to 15.

9. The method for multi-opening live broadcast based on remote GPU desktop according to claim 1, characterized in that: In step S600, the chain server is used to configure the linker, the game management assistant server is used to assist in network connection, the game audio and video streamer is a packaged and compiled game audio and video streamer, and the game service manager is used to start or terminate the game and monitor and manage the game streaming.

10. A live broadcast multi-opening system based on remote desktop, characterized in that: A live broadcast multi-opening method based on a remote GPU desktop for running any one of claims 1-9, comprising a thin terminal, a live broadcast platform, multiple RDP multi-opening instances and multiple audio and video acquisition devices; the thin terminal is a host machine, used to run multiple freeRDP clients at the same time; the live broadcast platform is used to transmit game live broadcast content to the audience; the RDP multi-opening instance enables multiple users to log in to multiple freeRDP clients with different IP addresses, and is used to set the configuration information of the game stream; the audio and video acquisition device is used to collect audio signals and video signals in multiple game live broadcasts.

Images